davidfernandezchaves / detectron2_ros Goto Github PK

I am not sure why it keeps giving this error message. I did run catkin_make and I am able to run it and view the segmentation results in Rviz with visualizations. But I can't get the segmentation information out for some reason. Am I supposed to be changing something else in the CMakes/package.xml?

Hi @DavidFernandezChaves,
Thank you for this great work, While installation i have not face with any problem untill compile. In chapter 4 I kind of confused. I attached 2 image in one of them I was trying to catkin_make inside the workspace in another one outside of workspace. But they both cannot source to ROS. Btw before starting the installation I already sourced to ROS with this "source /opt/ros/melodic/setup.bash" .

I will be happy if you could help me with this one.
Thanks,

Currently when the repo is cloned detectron2_ros in src does not have the .py extension. Since I was planning on adding one more .py file I decided to rename detectron2_ros to detectron2_ros.py and edit the launch file to reflect that. It started giving can't find detectron2_ros.msg does not exist. Am I missing some other step?

Thank you very much for your open source. I want to use the panoramic segmentation model, but I don't know whether I can switch to MSG. Does the MSG of this project support this idea?

It is unable to find the "model_final_f10217.pkl" file

process[detectron2_ros-1]: started with pid [14640]
[WARN] [1632167722.433477]: Initializing
[INFO] [1632167722.442250]: [Detectron2] ~config: /home/vikas/detectron_ros/src/detectron2_ros/detectron2/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x.yaml
[INFO] [1632167722.470800]: [Detectron2] ~detection_threshold: 0.5
[INFO] [1632167722.473040]: [Detectron2] ~model: detectron2://COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x/137849600/model_final_f10217.pkl
Traceback (most recent call last):
  File "/home/vikas/detectron_ros/src/detectron2_ros/src/detectron2_ros", line 158, in <module>
    main(sys.argv)
  File "/home/vikas/detectron_ros/src/detectron2_ros/src/detectron2_ros", line 154, in main
    node = Detectron2node()
  File "/home/vikas/detectron_ros/src/detectron2_ros/src/detectron2_ros", line 34, in __init__
    self.predictor = DefaultPredictor(self.cfg)
  File "/home/vikas/.virtualenvs/detectron2_ros/lib/python3.8/site-packages/detectron2/engine/defaults.py", line 188, in __init__
    checkpointer.load(cfg.MODEL.WEIGHTS)
  File "/home/vikas/.virtualenvs/detectron2_ros/lib/python3.8/site-packages/fvcore/common/checkpoint.py", line 141, in load
    assert os.path.isfile(path), "Checkpoint {} not found!".format(path)
AssertionError: Checkpoint detectron2://COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x/137849600/model_final_f10217.pkl not found!
[detectron2_ros-1] process has died [pid 14640, exit code 1, cmd /home/vikas/detectron_ros/src/detectron2_ros/src/detectron2_ros __name:=detectron2_ros __log:=/home/vikas/.ros/log/a2aa41ea-1a4c-11ec-8c3f-2d667ddb57ab/detectron2_ros-1.log].
log file: /home/vikas/.ros/log/a2aa41ea-1a4c-11ec-8c3f-2d667ddb57ab/detectron2_ros-1*.log
all processes on machine have died, roslaunch will exit
shutting down processing monitor...
... shutting down processing monitor complete
done

facebookresearch/detectron2#1360

Hi,@DavidFernandezChaves
Thank you for your great work! I had tried to compile and run your project in a virtual environment created by conda, and the compile process had successuly, however i don't know whether it will work or not by doing like this previously! Now when i run with the command line "roslaunch detectron2_ros detectron2_ros.launch", the output as bellows:
''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''
[WARN] [1616158634.220835]: Initializing
[INFO] [1616158634.227763]: [Detectron2] ~model: /home/robot_nb/catkin_mask/src/detectron2_ros/detectron2/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x.yaml
shutdown request: [/detectron2_ros] Reason: new node registered with same name
WARNING [03/19 20:57:14 d2.config.compat]: Config '/home/robot_nb/catkin_mask/src/detectron2_ros/detectron2/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x.yaml' has no VERSION. Assuming it to be compatible with latest v2.
[INFO] [1616158634.311513]: [Detectron2] ~detection_threshold: 0.5
[INFO] [1616158651.696466]: [Detectron2] ~visualization: True
[INFO] [1616158651.738531]: [Detectron2] ~input: ViMantic/ToCNN
[WARN] [1616158651.744645]: Initialized
''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''
It seems that something is wrong, because i can't see the result!
I hope you can tell me whether i can compile and run this project in a virtual environment created by conda? if your answer is yes, then what should i do to acquire the output result and whether the dataset needed?

Best Regards.

Hello,

I believe I followed the instruction on README exactly but I am getting the following error messages. I double-checked that I didn't use the python virtual environment when doing catkin_make. As explained in the instruction, I ran two terminals: one for roscore and the other for running workon detectron2_ros and then roslaunch detectron2_ros detectron2_ros.launch. Could you please help me on this issue?

Traceback (most recent call last):
  File "~/detectron2_ros/src/detectron2_ros/src/detectron2_ros", line 5, in <module>
    import cv2 as cv
ImportError: /opt/ros/kinetic/lib/python2.7/dist-packages/cv2.so: undefined symbol: PyCObject_Type