All losses become NaN after about 1 epoch of training about fiery HOT 6 CLOSED

Hey!

Interesting. Do you run into the same issue if you first load the weights of the encoder (from FIERY Static, the single-timeframe bird's-eye view model).

To do so, add the following lines in baseline.yml

PRETRAINED:
   LOAD_WEIGHTS: True
   PATH: './static_lift_splat_setting.ckpt'

from fiery.

I loaded the weights first following your suggestion, and the training works now (without NaN)! Thanks a lot!!

from fiery.

Can I ask one more question? :-) How can I train the FIERY Static weights from scratch?

from fiery.

Of course. To train the FIERY Static from scratch, point the training script to the following config: https://github.com/wayveai/fiery/blob/master/fiery/configs/literature/static_lss_setting.yml

from fiery.

I see. Thanks a lot!

from fiery.

You're welcome!

from fiery.