s3 put failing with 400 with >5GB file about aws HOT 5 OPEN

One additional piece of information. By using higher compression, I was able to get my file down to 4.4GB and do a successful put. The put took a little over a minute. As I mentioned the put with the 5GB file fails after about 2 minutes (not exactly 2, a little over last time I checked the timing). Maybe that is a clue.

from aws.

Eric,

Thanks for the feedback. It's been 6 years since I made any substantive changes to "aws" and 3 years since the ticket before yours. I'm thrilled and surprised that there is still interest in this project. (I do still use it myself.)

To address your report, I confirmed there is a failure with multi-part upload, which is a feature needed to upload files bigger than 5GB. Unfortunately, the problem has to do with Amazon changing their API yet again, involving how authorization credentials are provided. I suppose it's reasonable for API changes over a long period of time. Unfortunately, Amazon was never willing to help me support this project, even back in the beginning, when it was the only command-line tool available, and the top-rated community contributed project. The new feature velocity of AWS, their API changes, and their unwillingness to support this effort makes it difficult for me to keep it working.

I am willing to continue to support the project if it doesn't require substantial code changes, but I'm afraid fixing this one is to involved.

...Tim

from aws.

Hi Tim,
Well that's understandable. Thanks for the candid reply, some projects seem to just stop responding when they hit that phase. I suppose long term I should start looking for a replacement but for now I'll just do something to break my data into smaller files and probably use this until amazon breaks it more seriously. Any opinions on what's a good replacement cli tool?

from aws.

from aws.

Wow that sucks you were getting charged like that, and that they tried to claim they couldn't change it...talk about good deeds not going unpunished! I feel like Amazon obfuscates their services to make it hard to figure out what anything is going to cost you. We've switched to Digital Ocean for most of our servers, but we haven't found a good inexpensive equivalent of S3 (though we haven't looked very recently).

No software is forever. You should feel proud that you've made something that served so many people so well for many years.

from aws.