tfzhou / matnet Goto Github PK

Dear author:
I have used your provided code to train the model to study UVOS. Slightly different from yours, my running deploys a more advanced optical net named RAFT to generate flow graphs. However, my Jaccard is 0.762, much lower than your 0.8-odd. Other than RAFT, my running configration is totally cosistent with your published. Could you please tell me what is wrong with my settings? Your reply is desired.

sorry， I can not find run_davis.py and run_youtube.py two files or projects in your repo. Are you sure you've uploaded it？I have open the '/3rdparty', but I got nothing， I can not click these folders...

Thank you for your code. Do you have any python code to replace run_youtube.m?

Hi I was training the code and I bumped upon this issue which I wasn't sure why it was happening?

In davis2017_youtubevos_ehem.py line 74 it sets the foreground to 255, but then the random augmentations in custome_transforms.py line 47 is if ((tmp == 0) | (tmp == 1)): It will use Nearest Interpolation. Should this be 255 instead of 1?

Cause when I debugged the loader it seems the output for the groundtruth mask is not 0/255 only.

Thanks for your help in advance

Hi, in your paper, you said you use DAVIS16 with 4K frames and YoutubeVOS with 12K frames. However, I found in DAVIS16 training set, 30 videos only with 2K frames. DAVIS17 training set has about 4K frames. So may I confirm whether you used DAVIS16 or DAVIS17 for traing? And for YoutubeVOS, even sampled every 10 frames, it still has 50K frames. May I know which videos you selected from YoutubeVOS for training, please? Or could you share you training list files to me? Thanks very much.

Hi， would you provide your FBMS dataset? because it contains multi-object, so I want to know what operations you use in FBMS or do some others process. It would be nice to provide the test data that you are using. THX!!!

I have tried, but failed. I do not know where the problem is.

你好，我想请问一下，准备数据环节，准备的光流图是直接用pytorch-pwc在其他光流数据集上训练得到的权重预测生成的吗，您有在DAVIS数据集上训练吗，如果有，可不可以提供一下预训练模型呢？

你好，我看您最近更新了在davis17上的结果。 请问，您能公开下关于多目标训练和测试的code吗？ 十分感谢

Hi, I appreciate for you to share this great repository.

However, I got "No module named run" error when I tried to execute python run_davis.py in MATNet/3rdparty directory.
I cannot find any module or libraries related to "run" module.
Any help would be appreciated.
Thanks

Jiseong Heo

Thank you for your great work!
Can I train with my own dataset? If I have video data where no targets appear at the beginning and targets appear in the middle frames, can the model accurately identify when targets start to appear? Or will the model identify the foreground from just the beginning of the video (even if it's not the target I'm expecting)?

您好,我下载了您提供的Youtube-object链接下的map.其给人直观的视觉是肉眼可见的差,并且测了score与您论文中的结果也不符.请问您是不是放错map了? 希望您能检查一下. 谢谢...

TianFei 您好，请问MATNet网络可是从一个视频中获得多个运动目标的分割吗？谢谢。

您好，对于Youtube-object，您使用的光流是基于高分辨的检测数据集的image计算的吗，因为您给出的Result的分辨率是与检测数据集分辨率对应的。（与使用Youtube-Object Mask的数据集中低分辨率的image是否有差异，我产生的光流基本上都是噪声）另外您的光流计算是基于检测数据集（00001-00002）计算光流还是Mask数据集（00001-00011）计算光流？
我用基于Davis的test代码测试Davis 16结果与论文吻合（忽略第一帧和最后一帧），但是在测试Youtube-object数据集上存在极大的差异，您是否方便公开一下测试代码？（比如car0001的真值中有00201，但是因为00201没有光流，所以您给出的结果没有第201帧的结果）
另外，还有一些私人问题给您发了邮件，期待着您的回复。

@tfzhou Thank you for sharing your excellent work, I was wondering how to test the FBMS dataset, since images and ground truth are not one-to-one correspondence

First frame doesn't have optical flow picture, how to deal with this?

您好，真值的边界不应该也属于难例中的一部分吗？并且网络应该更加注重这部分的学习，赋予更高的权重。为什么在做边界的难例挖掘时，要扣除这部分？

Hello thanks for your code

When I try to train MATNet after performing all the steps for dataset preparation. I still find the code is looking for these two json files can you please share them?
"train-train-meta.json"
"train-val-meta.json"

Thanks

After I run the command:

git clone --recursive https://github.com/tfzhou/MATNet.git

in the folder pytorch-pwc and pytorch-hed in the folder 3rdparty, there is nothing.

How can I get these code, especially the file run_davis2017.py?

Thanks!