sstoiana / s3funnel Goto Github PK

Hi,
I have an account with an other S3 provider, where can I change the endpoint ?
thanks.

I am using funnel in instance bootstrap script, and this(topic) really annoys me. Any workarounds?

So it says: "Unix-friendly input and output. Pipe things in, out, and all around." which I took to mean I could do something like

tar -czv big-directory | s3funnel bucket PUT big-directory.tgz

seemingly not though. Is this possible via some combination of args? might be nice to document it if so...

Could I make a feature request?

Would it be possible for the script to return a non-zero exit code when a function fails.

Eg: if uploading of a file to the bucket fails for whatever reason, the program would return an exit code of 1 instead of 0.

Would be a bit nicer when scripting using this util.

I am one of the maintainers of Boto. A few weeks ago we began to merge backward-compatible Python 3.3 and 3.4 support into our develop branch. Most modules now support Python 3 with passing unit and integration tests, and I am hoping to do a release soon. I am reaching out to you to ask if you would test our develop branch with S3Funnel.

Testing against Python 2.x will help to ensure that we don't accidentally break third party modules like S3Funnel. If you would like, you may also try out the Python 3 support and let us know any feedback. More information about the Python 3 support can be found in this boto-users post:

https://groups.google.com/forum/#!topic/boto-users/vcvoy8zrfP8

I appreciate any time that you can put into helping the Boto project with this.

This request is part of boto/boto#2437

Is multi-part supported, and if so, does it also works with multi-thread ?

Thank you,
Roye

Is it possible to run multiple copies of s3funnel at the same time?

Love the tool!

I'd like to use this to clear out an S3 bucket on which I've enabled versioning. Would you be open to a PR that lets one list/delete object versions?

jobs.py
data = read(READ_CHUNK)
should be
data = fp.read(READ_CHUNK)

d06c956

With commands like
s3funnel my-bucket PUT * --add-prefix=folder/ --threads=10 --put-full-path --verbose
it would be better if it can automatically put files in subfolders creating a directory structure.