Comments (3)
Thanks for the report!
DVC CLI does not do any monorepo slicing at the moment -- that is limited to Studio. The reason you only saw 2 experiments in dvc exp list
is because you did not include -A
for that command. All dvc exp
commands will look at the entire repo.
from dvc.
I'm not sure we are actually pushing two copies of the experiment, I'm guessing that there are actually two separate experiments with the same name being generated.
git refs (and exps) apply to the entire repository. If we actually need to separate exps by subrepo, then we need to extend the exp ref namespace to differentiate them in the dvc init --subdir
case
so the exp refs would go somewhere like
refs/exps/<git-sha>/subrepo/path/to/subdir/exp-name
from dvc.
Looks like #10244 (comment) is related.
I didn't notice at first that these are entirely different dvc projects with project_a/.dvc
and project_b/.dvc
. @pmrowla Thoughts on how dvc exp
commands should handle this scenario? See the link above, where it looks like we end up pushing two copies of each experiment from each project.
from dvc.
Related Issues (20)
- dvc fetch: hangs forever on "Fetching" HOT 5
- exp run: pygit2 in script does not find active branch and last commit HOT 2
- `dvc repro --pull`: invalidates cache HOT 8
- Dataset delete when using 'dvc add' due to low memory on pc HOT 2
- import: hangs when pulling many files from GCS remote and one fails HOT 2
- Stages with conditional dependency HOT 4
- bug: running exp with `--queue` always take workspace version for python deps HOT 4
- Feature proposal: `dvc artifacts get --show-url` HOT 1
- dvc.scm.CloneError: SCM error HOT 1
- Config setting studio.url is not respected
- pull: breaks if imported dir ends with "/" HOT 1
- dvc queue status doesn't report active workers HOT 6
- dvc exp run --run-all: One or two experiments are executed, than it hangs (JSONDecodeError) (similar to #10398)
- dvc metrics diff --all: on same branch is empty HOT 2
- json output is not valid, due to colorized ANSI escape codes HOT 1
- dvc repro: pygit2 update breaking changes HOT 3
- dvc exp apply - fails HOT 3
- plots: Multiple fields result in invalid dvc.yaml HOT 2
- Git credentials does not work on a dvc pull for an imported dvc-git repository HOT 1
- Latest release of DVC breaks object versioned configs HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dvc.