Depth Maps for OULU-NPU about cdcn HOT 15 CLOSED

bbox is extracted with MTCNN; depth map is via PRNet

from cdcn.

Can you please tell me about the map_dir,
Then, also about the train_iamges directory

I have the oulu-npu dataset

It will be a great help to my research work

Thanks in advance

from cdcn.

from cdcn.

@ZitongYu
@CuauLuzbel
@punitha-valli

Can you please tell me about the map_dir,
Then, also about the train_iamges directory

I have the oulu-npu dataset

It will be a great help to my research work

Thanks in advance

from cdcn.

from cdcn.

@punitha-valli @ZitongYu Can you share me how to arrange training data folder?

from cdcn.

from cdcn.

@punitha-valli I dont know what is 6_3_20_5_121_scene.dat and info_list file ?
Can you help me clarify it?

from cdcn.

from cdcn.

I have used OULU dataset to train the model. When I run train_CDCN.py I get the error
"FileNotFoundError: [Errno 2] No such file or directory: '/home/busrasirin/KYC/TRAIN/data/train_map/6_2_19_2'".

I think this train method requires map_dir files. I don't have map images. How can I access map_images
or generate these images? I have also added the error trace

/home/busrasirin/KYC/TRAIN/cdcn-env/lib/python3.8/site-packages/torch/optim/lr_scheduler.py:129: UserWarning: Detected call of lr_scheduler.step() before optimizer.step(). In PyTorch 1.1.0 and later, you should call them in the opposite order: optimizer.step() before lr_scheduler.step(). Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
warnings.warn("Detected call of lr_scheduler.step() before optimizer.step(). "
Traceback (most recent call last):
File "train_CDCN.py", line 461, in
train_test()
File "train_CDCN.py", line 302, in train_test
for i, sample_batched in enumerate(dataloader_train):
File "/home/busrasirin/KYC/TRAIN/cdcn-env/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 521, in next
data = self._next_data()
File "/home/busrasirin/KYC/TRAIN/cdcn-env/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 561, in _next_data
data = self._dataset_fetcher.fetch(index) # may raise StopIteration
File "/home/busrasirin/KYC/TRAIN/cdcn-env/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 49, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/home/busrasirin/KYC/TRAIN/cdcn-env/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 49, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/home/busrasirin/KYC/TRAIN/CDCN/CVPR2020_paper_codes/Load_OULUNPU_train.py", line 231, in getitem
image_x, map_x = self.get_single_image_x(image_path, map_path, videoname)
File "/home/busrasirin/KYC/TRAIN/CDCN/CVPR2020_paper_codes/Load_OULUNPU_train.py", line 249, in get_single_image_x
frames_total = len([name for name in os.listdir(map_path) if os.path.isfile(os.path.join(map_path, name))])
FileNotFoundError: [Errno 2] No such file or directory: '/home/busrasirin/KYC/TRAIN/data/train_map/6_2_19_2'

By the way, I made some changes in train_CDCN.py file. These changes are

• modifications to allow CPU to be used as opposed to GPU
• data folder setup modifications
• setted dataloader num_workers=0

Your feedback would be very much appreciated.

from cdcn.

According to https://github.com/timesler/facenet-pytorch/blob/master/models/mtcnn.py, the MTCNN network required threshold values for face detection.

What threshold values did you choose for the network and whether it was adapted or fixed ?

Also, with your thresholds, did you encounter empty or wrong face detections and how did you deal with those images ?

from cdcn.

People, who have tried extracting depth maps using PRNet, which github repository did you find to be most reliable and useful ?

from cdcn.

@ZitongYu @CuauLuzbel @punitha-valli

Can you please tell me about the map_dir, Then, also about the train_iamges directory

I have the oulu-npu dataset

It will be a great help to my research work

Thanks in advance

Hi! Have you solved this problem?What should I put into map_dir?Thank you a lot!!

from cdcn.

Can you share more about how to extract more from videos to images?

from cdcn.

from cdcn.