wujie1010 / temporally-language-grounding Goto Github PK
View Code? Open in Web Editor NEWA Pytorch implemention for some state-of-the-art models for" Temporally Language Grounding in Untrimmed Videos"
A Pytorch implemention for some state-of-the-art models for" Temporally Language Grounding in Untrimmed Videos"
hi WuJie,Sorry to bother you. I was reading your code to reproduce the A2C model and I was wondering how you dealt with the dataset. How to get ref_info folder and charades_rl_train_feature.pkl. Maybe my knowledge level is not enough, I hope to get your advice, thank you very much!
Can you release the code about preprocessing the visual / sentence feature?
I want to know about how you get the visual feature (ResNet or others?) and what is the exact meaning of the sentence feature files.
I try to run your code, but I failed because of the pickle.load.
self.clip_sentence_pairs_iou_all = pickle.load(open("./Dataset/Charades/ref_info/charades_rl_train_feature.pkl"))
the the error is
TypeError: a bytes-like object is required, not 'str'
then I try
pickle.load(open("./Dataset/Charades/ref_info/charades_rl_train_feature.pkl",'rb'))
but the error is
UnicodeDecodeError: 'ascii' codec can't decode byte 0x81 in position 0: ordinal not in range(128)
I also tried several methods, but none of them working. Such as add encoding/decoding, import sys ...... I also try to use python2.7 load the data, but I get the same errors.
thanks for your sharing!
I run your code and get the results,but the performance is much worse than yours.
I have no idea about this,could you give me some advice?
The code contains a line where the directory for training softmax files is set as 'D:/pythonpro/Dataset/Charades/train_softmax/', but the file does not exist.
In the code, you didn't add Location/IoU loss, what you do is just create the variables without assigning any value. Actually, if I try to revise the loss function into correct code. I find the performance will decrease largely.
The policy loss function is always negative and what we want to do is minimum this loss rather than make it always increase. I was wondering the reason is reward value is always lower than state value(According to the A2C formula) or this is the bug of the code.
@WuJie1010 Thanks for the nice sharing!
Could you please tell me where is the data under the directory train_softmax_dir?
Thanks for your sharing!
I encountered a problem when training MAC: Dataloader is extremely slow to load data even if I increase the num_work value. In the case of num_work equal to 16, a batch of data takes about 8 minutes to load. So I want to ask if you have this problem or if there is something wrong with my settings.
I noticed that the number of uncompressed visual feature and visual activity concepts tar files is huge (the former is about 940,000 and the latter is about 640,000).
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.