Pre-train Action recognition videoMAE model on UCF101 about videomaev2 HOT 12 CLOSED

Start training. You can see the doc of pre-train or follow the instructions in VideoMAE, we use the similar architecture with VideoMAE.

from videomaev2.

-1 means that the file on the video_path is a video. 0 is the start_idx, it's meaningless when the file is video, just a placeholder.
you just need to modify the video_path to the path of UCF101 videos.

You mean we don't need any labels for pretrain the model?

Sure. MAE is a self-supervised method

from videomaev2.

-1 means that the file on the video_path is a video. 0 is the start_idx, it's meaningless when the file is video, just a placeholder.

you just need to modify the video_path to the path of UCF101 videos.

from videomaev2.

-1 means that the file on the video_path is a video. 0 represents the label, but labels are useless in pre-train, so we just place 0 on the position as the placeholder.

you just need to modify the video_path to the path of UCF101 videos.

Thanks for the quick response!! I really appreciate that. I have some more questions about to pretrain the model. What are the next steps after organizing the paths into the CSV??

from videomaev2.

-1 means that the file on the video_path is a video. 0 is the start_idx, it's meaningless when the file is video, just a placeholder.

you just need to modify the video_path to the path of UCF101 videos.

You mean we don't need any labels for pretrain the model?

from videomaev2.

I have a machine with the following specifications

and have RTX 3060. Is the system capable of pretraining on UCF101?

from videomaev2.

I think not. You may need at least 8 GPUs

from videomaev2.

Can I finetune it on the UCF101 with the system specs??

from videomaev2.

you can try it using the distilled vit-small model.

from videomaev2.

Could you please suggest to me which scripts from Finetunescripts I should follow to finetune it?

from videomaev2.

Read the finetune doc and write a new one.

from videomaev2.

What does mean by slurm train and Dist train?

from videomaev2.