Hello @sparisi ,

I am currently working on replicating results from your paper with the intention to extend the work.
I used the 'main' branch and downloaded the pretrained models provided using the github link. I was able to replicate the ground truth results for the Habitat dataset but having little trouble replicating results for - resnet50 models pretrained on ImageNet for embedding name - resnet50_l3 and resnet50_l4. I am running following commands:

Generated Optimal trajectories for 5 scenes

python behavioral_cloning/save_opt_trajectories.py --env=HabitatImageNav-apartment_0
python behavioral_cloning/save_opt_trajectories.py --env=HabitatImageNav-frl_apartment_0
python behavioral_cloning/save_opt_trajectories.py --env=HabitatImageNav-room_0
python behavioral_cloning/save_opt_trajectories.py --env=HabitatImageNav-hotel_0
python behavioral_cloning/save_opt_trajectories.py --env=HabitatImageNav-office_0

generated desired embeddings

python behavioral_cloning/save_embedded_obs.py --env=HabitatImageNav-apartment_0 --embedding_name=resnet50_l3 --source=pickle
python behavioral_cloning/save_embedded_obs.py --env=HabitatImageNav-frl_apartment_0 --embedding_name=resnet50_l3 --source=pickle
python behavioral_cloning/save_embedded_obs.py --env=HabitatImageNav-room_0 --embedding_name=resnet50_l3 --source=pickle
python behavioral_cloning/save_embedded_obs.py --env=HabitatImageNav-hotel_0 --embedding_name=resnet50_l3 --source=pickle
python behavioral_cloning/save_embedded_obs.py --env=HabitatImageNav-office_0 --embedding_name=resnet50_l3 --source=pickle

running bc files - to train the policy network for 5 seeds

python main_bc_2.py --env=HabitatImageNav-apartment_0,HabitatImageNav-frl_apartment_0,HabitatImageNav-room_0,HabitatImageNav-hotel_0,HabitatImageNav-office_0 --embedding_name=resnet50_l3 --run_id=1

python main_bc_2.py --env=HabitatImageNav-apartment_0,HabitatImageNav-frl_apartment_0,HabitatImageNav-room_0,HabitatImageNav-hotel_0,HabitatImageNav-office_0 --embedding_name=resnet50_l3 --run_id=2

python main_bc_2.py --env=HabitatImageNav-apartment_0,HabitatImageNav-frl_apartment_0,HabitatImageNav-room_0,HabitatImageNav-hotel_0,HabitatImageNav-office_0 --embedding_name=resnet50_l3 --run_id=3

python main_bc_2.py --env=HabitatImageNav-apartment_0,HabitatImageNav-frl_apartment_0,HabitatImageNav-room_0,HabitatImageNav-hotel_0,HabitatImageNav-office_0 --embedding_name=resnet50_l3 --run_id=4

python main_bc_2.py --env=HabitatImageNav-apartment_0,HabitatImageNav-frl_apartment_0,HabitatImageNav-room_0,HabitatImageNav-hotel_0,HabitatImageNav-office_0 --embedding_name=resnet50_l3 --run_id=5

computed the mean across five seeds for the last 6 policy updates as described in the paper - i am not able to get the same value as mentioned. Can you please let me know what I am doing wrong?

###I also tried testing the models by running following command again - model_test.py file

python main_test.py --from_env=HabitatImageNav-apartment_0,HabitatImageNav-frl_apartment_0,HabitatImageNav-room_0,HabitatImageNav-hotel_0,HabitatImageNav-office_0 --embedding_name=resnet50_l3 --to_env=HabitatImageNav-apartment_0

Thank you for the help!

Hello @sparisi,

Can you please let me know your timeline for uploading data generation code for HMS dataset? I would like to repeat your experiments for HMS dataset as well was wondering about your timeline to upload the code based on your comment below on the README.

Hand Manipulation Suite: coming soon.
More data will be added in the future.

Thank you,
Manju

Running command git clone --filter=blob:none --quiet https://github.com/facebookresearch/detectron2.git /tmp/pip-req-build-gyjrz5o0
Resolved https://github.com/facebookresearch/detectron2.git to commit 864913f0e57e87a75c8cc0c7d79ecbd774fc669b
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Preparing metadata (setup.py) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.