Comments (2)
Yaroslav Halchenko wrote:
@joeyh - what would be your thoughts on how to wrap it up? tags?
Yes, you can already do this with tags.
git annex metadata -t precious foo/ bar/
git annex copy --to externaldrive --metadata tag=precious .
It might be better though, to configure precious data to have a high
numcopies value. This would prevent git-annex dropping a precious file
unless it can verify enough other copies of it exist.
Doing it this way, you'd write a .gitattributes files that matches the
precious files and sets their number of copies to some reasonably high
value. (Depending on how low a chance you want to have of losing the
data, vs the expense to keep additional copies of it.)
*.raw annex.numcopies=5
And then you coud ask git-annex to copy files to external drives until
the files' various numcopies values were satisfied, by using the --auto
parameter.
git annex copy --to externaldrive --auto .
This also has the benefit that you could have, say, 10 drives, and
git-annex will copy each precious file to only 5 of them, and then stop
making more copies. So as you add drives and files over time, you don't
need to worry about manually telling git-annex what files to put where.
With external drives and a high numcopies setting, it can be annoying to
need to plug in lots of drives just so git-annex drop can verify that the
required number of copies have been made. So you might decide to mark
some/all of the external drives as trusted.
see shy jo
from datalad.
I think it is largely superseded by #925 which suggests to provide convenient user interface to define common schemas for siblings
from datalad.
Related Issues (20)
- push to remote, until a specific commit HOT 9
- `datalad download-url` fails if server sends `content-encoding: gzip` header HOT 7
- foreach-dataset (in eval mode) rejects method HOT 3
- replace uses of pkg_resources HOT 1
- create a "gitignore" procedure HOT 1
- No annex uuid after "git annex initremote" HOT 1
- Issue with symlinked top level repository directory HOT 6
- test_unannex_etc fails on windows HOT 7
- datalad install <url> without "-s" taught me wrong HOT 5
- Migrate to use --json interfaces of git-annex where possible
- Datalad asks for login keyring forever HOT 10
- FOI: sphinx_rtd_theme need an upgrade if sphinx gets to 7.0.0
- How to datalad update and merge new branch created in remote? HOT 2
- I think 'annex sync' might have "lost" my commit HOT 2
- Split a dataset without touching hosted data HOT 8
- After unlock, saving again will not change the data to symlink HOT 1
- we do not crash informatively while running outdated git
- Moving files between subdatasets? HOT 2
- datalad.api.copy_file is quite slow? HOT 4
- `datalad save` on the data with different owner gets "permission denied" HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datalad.