Comments (3)
@JenniferHem Have you tried keeping them all "horizontally" in one line? How related is each experiment? How would you like to be grouping each "run" that combines the endpoints if you were to have a line per endpoint?
from dvclive.
@dberenbaum thanks for the answer. We work in the bio field so the endpoints really are considering similar biology. Actually while experimenting a bit I realized, that with the setup I explained using dvclive I do get the horizontal tracking as you mentioned, I just had a displaying issue which did not show me the full horizontal table. Considering that actually all endpoints are trained in the same run it makes sense to save it like this.
One thing I am wondering about, which might be me not fully grasping the capacity is if there would be a way to track the same metrics files etc as I do above, keeping them horizontally but without needing to spread the metrics.json files manually via dvclive as an additional factor. Does that make sense?
from dvclive.
It makes sense. You should be able to use Live(resume=True)
to keep appending to the same dvclive folder for each model run. There was a bug that was fixed in #740 that was preventing dvclive from preserving metrics when resuming, so it will not work as expected until the next release unless you use the upstream branch (pip install git+https://github.com/iterative/dvclive.git
).
from dvclive.
Related Issues (20)
- lightning: args passed to dvclive are outdated
- integrations: hf accelerate HOT 4
- Log metrics/models etc... to studio directly with Live or DVCLiveCallbacks in training script HOT 9
- integrations: lightning fabric
- `log_image` fails to save an image if the path was provided, but the `name` does not have an extension HOT 1
- 4.0 Checklist HOT 1
- Add user friendly warning/error messages and helpers for log_plot() HOT 3
- DVCLive throws a weird warning when origin is not defined HOT 6
- Add docstrings HOT 2
- Invalid path causes `TypeError` due to shadowed builtin `type` HOT 2
- `Live.log_artifact` raises `ValueError` by logging to closed `stderr` when Tensorflow is imported first HOT 6
- `log_image`: log bounding boxes HOT 5
- Test falling for Huggingface
- Path not supported for some path arguments HOT 2
- Error RuntimeError: SQLite version is too old, please upgrade to >= (3, 8, 3) HOT 7
- Provide examples or quick code snippets in the public methods
- System metrics should be plotted with `timestamp` rather than `step`
- log_sklearn_plot: exception when plot params are passed. HOT 3
- DVC Live hangs when pushing to remote HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dvclive.