tsp-prl's Introduction

Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Video (AAAI2020)

This repository contains the pytorch codes and trained models described in the paper "Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Video" By Jie Wu, Guanbin Li, Si Liu, Liang Lin. Paper

Motivation

Framework

Requirements

Python 2.7
Pytorch 0.4.1
matplotlib
The code is for Charades-STA dataset.

Visual Features

Please download the features in Features1, and put it in the "Dataset/Charades" folder.

Training and Testing Data

Please download the TrainingData in TrainingData, and put it in the "Dataset/Charades/ref_info" folder. Please download the TestingData in TestingData, and put it in the "Dataset/Charades/ref_info" folder.

Pre-trained models

We provide the pre-trained model for Charades-STA dataset, which can get 24.73 on R@1, IoU0.7 and 45.30 on R@1, IoU0.5: Models

Train

python train.py

Validate

python val.py

Test from Pre-trained Model

python test.py

tsp-prl's People

Contributors

Stargazers

Watchers

tsp-prl's Issues

谢谢你的分享，很有意思的工作！请问能不能分享一下特征提取的方法，以方便从头开始训练。

many files were missed

Hi. i've implement your code but 'charades_movie_length_info.txt' and 'charades_sta_test_swin_props_num_36364.txt' were missed. Could you provide these missing files please?

test.py wont run

python2.7 test.py 
1334 test videos are readed
Traceback (most recent call last):
  File "test.py", line 34, in <module>
    test_dataset = Charades_Test_dataset()
  File "/media/test/ssd_ntfs/video_analytics_projects/TSP-PRL/dataloader_charades.py", line 215, in __init__
    with open(self.test_swin_txt_path) as f:
IOError: [Errno 2] No such file or directory: './Dataset/Charades/ref_info/charades_sta_test_swin_props_num_36364.txt'

Recommend Projects

wujie1010 / tsp-prl Goto Github PK