r-cui / viga Goto Github PK

Thank you very much for your inspiring work, but I don't know why I can't reproduce the scores in the paper

could you provite TACoS h5df to npy transform file?

Hi, thanks for your wonderful work , however, I have met the following error when I run the Charades-STA dataset (everything goes well when I run the other two datasets, tacos and activity net). Would you mind helping figure it out? Thanks.

errors log

Training epoch 1 with lr 0.0001: 0%| | 0/24 [00:00<?, ?it/s]
Training epoch 1 with lr 0.0001: 0%| | 0/24 [00:01<?, ?it/s]
Traceback (most recent call last):
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/data1/chentongbao/VCMR/ViGA/src/experiment/train.py", line 90, in
train(config)
File "/data1/chentongbao/VCMR/ViGA/src/experiment/train.py", line 56, in train
desc="Training epoch {} with lr {}".format(epoch, model.optimizer.param_groups[0]["lr"])
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/tqdm/std.py", line 1195, in iter
for obj in iterable:
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 521, in next
data = self._next_data()
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1203, in _next_data
return self._process_data(data)
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1229, in _process_data
data.reraise()
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/torch/_utils.py", line 434, in reraise
raise exception
RuntimeError: Caught RuntimeError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/torch/utils/data/_utils/worker.py", line 287, in _worker_loop
data = fetcher.fetch(index)
File "/data1/zhekun/anaconda3/envs/viga/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 52, in fetch
return self.collate_fn(data)
File "/data1/chentongbao/VCMR/ViGA/src/dataset/dataset.py", line 116, in collate_fn
batch[k] = torch.stack(batch[k], dim=0)
RuntimeError: stack expects each tensor to be equal size, but got [87, 1, 42, 1024] at entry 0 and [72, 1, 57, 1024] at entry 1

could you please the c3d features of charades?

1. Can you provide the predict.py file for extracting the c3d features of the Charades-STA dataset in the c3d warehouse you gave?
2. In addition, please tell ViGA how to change the read-in feature dimension to (T, 1024) when ViGA is trained based on Charadest-STA?

Many thanks!