Comments (6)
Agreed! In particular, what we should be looking for here is for the s3_client
crate to set a default user-agent for all its requests, and also allow the constructor of an S3Client
to prepend whatever they want. Then the file connector can just set that config.
from mountpoint-s3.
We should also add versioning to that header.
from mountpoint-s3.
I think we should explicitly call this out as "S3 File Connector" (or whichever name we come up with). Of course, we can allow it to be prefixed too - but let's keep the name of the connector in there by default.
So default:
S3FileConnector/1.0 aws-s3-crt-rust/2.0 Linux/5.x
And with configurable prefix:
whateveriwant S3FileConnector/1.0 aws-s3-crt-rust/2.0 Linux/5.x
from mountpoint-s3.
Agreed! In particular, what we should be looking for here is for the
s3_client
crate to set a default user-agent for all its requests, and also allow the constructor of anS3Client
to prepend whatever they want. Then the file connector can just set that config.
Re-reading this, this sounds exactly right.
Wasn't clicking the first time I read this thread when I responded earlier.
We don't need to provide a configurable user agent prefix for the file connector at this time - only in the S3 Client crate which we will use within the connector.
from mountpoint-s3.
We already do this: https://github.com/awslabs/s3-file-connector/blob/b671df4a0d8552804b45aca1af37eda7df44e024/s3-client/src/s3_client.rs#L137
But we should make it extensible so we can distinguish the connector from anyone else who ends up using this Rust S3 client.
from mountpoint-s3.
I think this would be a good first issue for @sauraank or myself to pickup.
from mountpoint-s3.
Related Issues (20)
- Mountpoint operations hang indefinitely HOT 12
- Installation fails in Sagemaker Classic kernel console HOT 4
- Implement statfs operation to report basic stats HOT 3
- CRT error 2054 (AWS_ERROR_HTTP_INVALID_PATH) when mounting S3 Express bucket HOT 4
- Listing all files under specific prefix is very slow HOT 1
- Disable TLS / certificate verification HOT 3
- Caching performance should be better HOT 4
- Improvements to error reporting (RFC)
- Add the expected behaviours of Mountpoint in the troubleshooting page that customers face
- Duplication of file and directory of same name in S3 Express Zone One bucket using Mountpoint
- Build is not reproducible HOT 1
- Double `touch` errors HOT 2
- Include creation of files for benchmarking Mountpoint in benchmarking script HOT 1
- token is not refreshed when running in k8s pod connected to serviceaccount HOT 8
- Unable to Write HOT 4
- Files unexpectedly released leading to `Bad file descriptor` HOT 5
- Disabling data cache isn't mentioned in the documentation HOT 2
- Unable to mount non-aws storage due to "Host name was invalid for dns resolution" HOT 2
- Clarify the expected behavior of the `--metadata-ttl` option set to zero HOT 2
- Separate part sizes for GET and PUT
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mountpoint-s3.