Comments (1)
1.when i run the train scripts :
python3 scripts/train.py
+experiment=cvt_nuscenes_vehicle
data.dataset_dir=/media/datasets/nuscenes
data.labels_dir=/media/datasets/cvt_labels_nuscenes,
Error occurs:
[RuntimeError: Expected to have finished reduction in the prior iteration before starting a new one. This error indicates that your module has parameters that were not used in producing loss. You can enable unused parameter detection by passing the keyword argument
find_unused_parameters=True
totorch.nn.parallel.DistributedDataParallel
, and by
making sure allforward
function outputs participate in calculating loss. ]
- Then, i try to change
find_unused_parameters=True
in scripts/train.py. But, the second error occurs:
[RuntimeError: Expected to mark a variable ready only once. This error is caused by one of the following reasons: 1) Use of a module parameter outside the
forward
function. Please make sure model parameters are not shared across multiple concurrent forward-backward passes. or try to use _set_static_graph() as a workaround if this module graph does not change during training loop.2) Reused parameters in multiple reentrant backward passes. For example, if you use multiplecheckpoint
functions to wrap the same part of your model, it would result in the same set of parameters been used by different reentrant backward passes multiple times, and hence marking a variable ready multiple times. DDP does not support such use cases in default. You can try to use _set_static_graph() as a workaround if your module graph does not change over iterations.]
This seriously bothers me, do you have any advice?
from cross_view_transformers.
Related Issues (20)
- How to segmentate road_segment and dynamic objects together ? HOT 1
- How long does it take to train the model?
- Geometric reasoning in cross-view attention
- How to train this for segmenting more than 2 classes? HOT 1
- Question about camera extrinsics
- Question about the implementation of 'camera-aware positional encoding' part
- The labels of dataset Argoverse.
- loss function mutation when training
- When run [train.py] RuntimeError: unmatched '}' in format string HOT 2
- Discrepancy in the validation IOU values for Driveable Area segmentation HOT 14
- About setting1 HOT 1
- The label link is broken
- generating labels error : [OSError]: [Error 24] Too many open files HOT 1
- train error : urllib.error.URLError : <urlopen error Error instantiating 'cross_view_transformer.model.backbones.efficientnet.EfficientNetExtractor' : <urlopen error [Errno 111] Connection refused> ]
- Error executing job with overrides HOT 1
- no test.py
- about the model test
- Error running training (LR Scheduler) HOT 1
- 运行时出现以下错误
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cross_view_transformers.