Relation-Shape Convolutional Neural Network for Point Cloud Analysis

This repository contains the author's implementation in Pytorch for the paper:

Relation-Shape Convolutional Neural Network for Point Cloud Analysis [arXiv] [CVF]
Yongcheng Liu, Bin Fan, Shiming Xiang and Chunhong Pan
CVPR 2019 Oral & Best paper finalist Project Page: https://yochengliu.github.io/Relation-Shape-CNN/

Citation

If our paper is helpful for your research, please consider citing:

        @inproceedings{liu2019rscnn,   
            author = {Yongcheng Liu and    
                            Bin Fan and    
                      Shiming Xiang and   
                           Chunhong Pan},   
            title = {Relation-Shape Convolutional Neural Network for Point Cloud Analysis},   
            booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},    
            pages = {8895--8904},  
            year = {2019}   
        }

Usage: Preparation

Requirement

Ubuntu 14.04
Python 3 (recommend Anaconda3)
Pytorch 0.3.*/0.4.*
CMake > 2.8
CUDA 8.0 + cuDNN 5.1

Building Kernel

git clone https://github.com/Yochengliu/Relation-Shape-CNN.git 
cd Relation-Shape-CNN

mkdir build && cd build
cmake .. && make

Dataset

Shape Classification

Download and unzip ModelNet40 (415M). Replace $data_root$ in cfgs/config_*_cls.yaml with the dataset parent path.

ShapeNet Part Segmentation

Download and unzip ShapeNet Part (674M). Replace $data_root$ in cfgs/config_*_partseg.yaml with the dataset path.

Usage: Training

Shape Classification

sh train_cls.sh

You can modify relation_prior in cfgs/config_*_cls.yaml. We have trained a Single-Scale-Neighborhood classification model in cls folder, whose accuracy is 92.38%.

Shape Part Segmentation

sh train_partseg.sh

We have trained a Multi-Scale-Neighborhood part segmentation model in seg folder, whose class mIoU and instance mIoU is 84.18% and 85.81% respectively.

Usage: Evaluation

Shape Classification

Voting script: voting_evaluate_cls.py

You can use our model cls/model_cls_ssn_iter_16218_acc_0.923825.pth as the checkpoint in config_ssn_cls.yaml, and after this voting you will get an accuracy of 92.71% if all things go right.

Shape Part Segmentation

Voting script: voting_evaluate_partseg.py

You can use our model seg/model_seg_msn_iter_57585_ins_0.858054_cls_0.841787.pth as the checkpoint in config_msn_partseg.yaml.

License

The code is released under MIT License (see LICENSE file for details).

Acknowledgement

The code is heavily borrowed from Pointnet2_PyTorch.

Contact

If you have some ideas or questions about our research to share with us, please contact yongcheng.liu@nlpr.ia.ac.cn