Comments (3)
klaaslanghout
commented on July 29, 2024
1
I'll try tonight. I'm slowly moving all my photos up to archive blobs and still have quite a few years to do :) FWIW the error rate with CONCURRENCY set was much lower (out of 5k files, I have ~5 errors so far). I'll send an update after I retest without AZCOPY_CONCURRENCY_VALUE set.
from azure-storage-azcopy.
zezha-msft
commented on July 29, 2024
Hi @klaaslanghout, thanks for reporting this issue! We really appreciate your feedbacks.
Could you reliably reproduce this problem? In other words, if you remove the environment variable AZCOPY_CONCURRENCY_VALUE and run the same command on your home network, do you see the same errors? I'm asking this because home networks tend to be less reliable, so I just wanted to make sure that this is a consistent behavior.
We are still working on refining the pacing behavior, AZCOPY_CONCURRENCY_VALUE is for internal testing only, so for the moment we do not plan on documenting it.
from azure-storage-azcopy.
zezha-msft
commented on July 29, 2024
Hi @klaaslanghout, any update?
from azure-storage-azcopy.
Related Issues (20)
- Does azcopy work like replication? HOT 2
- azcopy copy memory error on 10.23.0 MacOS via brew using SAS HOT 3
- sync --preserve-symlinks/--follow-symlinks
- azcopy on file share to file share copy does not support managed identity HOT 13
- `--include-after` Does Not Appear to Work As Expected HOT 31
- Download specific version of AZCopy - or at least the most recent release (redux) HOT 4
- Slash '/' at the end necessary when syncing directories? HOT 2
- Failed to perform Auto-login: PSContextCredentialInvalid output while retrving token. HOT 8
- azcopy and socks5 proxy
- Filtering attributes/tags/access tier when transfering blobs between storage accounts HOT 9
- 401 Server failed to authenticate the request Using azcopy login HOT 3
- azcopy stuck at 0% pageblob >127Gig HOT 2
- azcopy login --identity failed with ManagedIdentityCredential on 10.24.0 HOT 3
- Azcopy fails to connect dfs endpoint.
- `panic: cannot allocate memory` on job with many files. HOT 6
- azcopy storage account to storage account/$root not supported HOT 2
- ContentMD5 missing on System.Private.CoreLib.dll being uploaded via azcopy sync HOT 4
- Invalid json output from jobs list --output-type json argument when newer version available HOT 4
- Monotonic memory growth bug in `azcopy jobs show <jobID>` for large job, significantly worse with `--with-status` flag HOT 1
- WSL support for azcopy HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from azure-storage-azcopy.