- Ubuntu 16.04
- ROS kinetic
- Point Cloud Library
- Realsense ROS
- Gazebo 7.14
$ cd
$ git clone https://github.com/championway/gan_rv
$ cd ~/gan_rv/catkin_ws
$ source /opt/ros/kinetic/setup.bash
$ catkin_make
Note: Do the following everytime as you open new terminals
$ cd ~/gan_rv
$ source environment.sh
- SSD model: https://drive.google.com/open?id=1TIXA0t9OMXW6_ojoSd9jfSIlbSbagyWA
- GAN model: https://drive.google.com/open?id=1eCMgsKO7VXYg77_mAtGMSBT9Z4sod4b1
- FCN model: https://drive.google.com/open?id=1ywR8dR1OF0wuUQXoFBe2TV5GqFgEjdxc
- Rosbag file: https://drive.google.com/open?id=1onTrb6HU35V7RusSw_bV8Nzmt7PLiR99
RGB image --> mask
- SSD + GAN
$ rosrun classify gan_crop.py
- FCN
$ rosrun classify fcn_predict.py
(Please modify the SSD, GAN and FCN model path for your own computer)
RGB image + Depth image + Mask --> Point Cloud
$ roslaunch pcl_exercise mask_to_point.launch
Run rosbag recorded in tunnel(Real data)
$ rosbag play artifact_part.bag
$ jupyter-notebook gan_rv/catkin_ws/src/classify/src/predict_gan_ssd.ipynb
UNDO: IOU, fscore......