/3D-Object-Detection

Papers and code related to 3D object detection

Awesome-3D-Object-Detection

This is a collection of resources related with 3D-Object-Detection using point clouds.

Paper title, [code], [dataset], [3D or 2D combination]

Contents

2017

  1. Multi-View 3D Object Detection Network for Autonomous Driving [CVPR] [Tensorflow] [KITTI]
  2. Vote3Deep: Fast object detection in 3D point clouds using efficient convolutional neural networks [ICRA] [Code] [KITTI]
  3. Car detection for autonomous vehicle: LIDAR and vision fusion approach through deep learning framework [IROS] [KITTI]
  4. 3D fully convolutional network for vehicle detection in point cloud [IROS] [Tensorflow] [KITTI]

2018

  1. PIXOR: Real-time 3D Object Detection from Point Clouds [CVPR] [Pytorch] [KITTI]
  2. VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection [CVPR] [Tensorflow] [KITTI]
  3. A Minimalist Approach to Type-Agnostic Detection of Quadrics in Point Clouds [CVPR] [ITODD]
  4. CarFusion: Combining Point Tracking and Part Detection for Dynamic 3D Reconstruction of Vehicles [CVPR] [Code]
  5. Frustum PointNets for 3D Object Detection from RGB-D Data [CVPR] [Tensorflow] [KITTI] [2D->3D]
  6. Deep Continuous Fusion for Multi-Sensor 3D Object Detection [ECCV] [KITTI]
  7. YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud [ECCVW] [KITTI]
  8. Robust Real-Time 3D Person Detection for Indoor and Outdoor Applications [ICRA] [own dataset]
  9. A General Pipeline for 3D Detection of Vehicles [ICRA] [KITTI]
  10. Joint 3D Proposal Generation and Object Detection from View Aggregation [IROS] [KITTI]
  11. A 3D Convolutional Neural Network Towards Real-Time Amodal 3D Object Detection [IROS] [NYUv2 RGBD, SUN RGBD]
  12. SECOND: Sparsely Embedded Convolutional Detection [Sensors] [Pytorch] [KITTI]
  13. Complex-YOLO: Real-time 3D Object Detection on Point Clouds [arXiv] [Pytorch] [KITTI]
  14. RoarNet: A Robust 3D Object Detection based on RegiOn Approximation Refinement [arXiv] [Tensorflow] [KITTI] [2D->3D]

2019

  1. PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud. [CVPR] [Pytorch] [KITTI] [3D]
  2. Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving [CVPR] [Code] [KITTI] [2D->3D]
  3. PointPillars: Fast Encoders for Object Detection from Point Clouds [CVPR] [Pytorch] [KITTI] [3D]
  4. Attentional PointNet for 3D-Object Detection in Point Clouds [CVPRW] [Pytorch] [KITTI] [3D]
  5. Deep Hough Voting for 3D Object Detection in Point Clouds [ICCV] [Pytorch] [Tensorflow] [ScanNet, SUN RGB-D]
  6. Detection and Tracking of Small Objects in Sparse 3D Laser Range Data [ICRA] [InLiDa]
  7. Oriented Point Sampling for Plane Detection in Unorganized Point Clouds [ICRA] [SUN RGB-D]
  8. Focal Loss in 3D Object Detection [ICRA] [Code] [KITTI]
  9. SEG-VoxelNet for 3D Vehicle Detection from RGB and LiDAR Data [ICRA] [KITTI]
  10. MVX-Net: Multimodal VoxelNet for 3D Object Detection [ICRA] [KITTI]
  11. Fast 3D Line Segment Detection From Unorganized Point Cloud [arXiv] [Semantic3D, Shape Repertory]
  12. Monocular 3D Object Detection with Pseudo-LiDAR Point Cloud [arXiv] [KITTI] [2D->3D]
  13. FVNet: 3D Front-View Proposal Generation for Real-Time Object Detection from Point Clouds [[arXiv] (https://arxiv.org/pdf/1903.10750.pdf)] [Code] [KITTI] [3D]
  14. USIP: Unsupervised Stable Interest Point Detection from 3D Point Clouds [arXiv] [Code] [KITTI, Oxford, Redwood and ModelNet40]
  15. Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds [arXiv] [Pytorch] [KITTI] [2D->3D]
  16. 3D Backbone Network for 3D Object Detection [arXiv] [Code] [KITTI] [3D]
  17. StarNet: Targeted Computation for Object Detection in Point Clouds [arXiv] [Tensorflow] [KITTI] [3D]
  18. STD: Sparse-to-Dense 3D Object Detector for Point Cloud [ICCV] [KITTI] [3D]
  19. Multi-Task Multi-Sensor Fusion for 3D Object Detection [CVPR] [KITTI]
  20. Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds [NIPS] [ScanNet]
  21. KPConv: Flexible and Deformable Convolution for Point Clouds [ICCV] [Tensorflow] [S3DIS, Scannet]
  22. Fast Point R-CNN [ICCV] [KITTI]
  23. Pseudo-LiDAR From Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving [CVPR] [KITTI]
  24. Frustum ConvNet: Sliding Frustums to Aggregate Local Point-Wise Features for Amodal 3D Object Detection [IROS] [Pytorch] [KITTI] [2D->3D]

2020

  1. ImVoteNet: Boosting 3D Object Detection in Point Clouds with Image Votes [CVPR] [SUN RGB-D]
  2. MLCVNet: Multi-Level Context VoteNet for 3D Object Detection [CVPR] [ScanNet]
  3. PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection [CVPR] [KITTI] [3D]
  4. Structure Aware Single-stage 3D Object Detection from Point Cloud [CVPR] [KITTI] [3D]
  5. 3DSSD: Point-based 3D Single Stage Object Detector. [CVPR] [KITTI] [3D]
  6. Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud. [CVPR] [KITTI] [3D]
  7. Associate-3Ddet: Perceptual-to-Conceptual Association for 3D Point Cloud Object Detection [[CVPR]] [KITTI] [3D]
  8. From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Network. [TPAMI] [KITTI] [3D]
  9. Patch Refinement: Localized 3D Object Detection [NeurIPSW] [KITTI] [3D]
  10. 3D IoU-Net: IoU Guided 3D Object Detector for Point Clouds [arXiv] [KITTI] [3D]
  11. 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation [arXiv] [ScanNet] [S3DIS]

--Datasets

Outdoor (Point Cloud data)

  1. KITTI 3D Object Detection Evaluation 2017
  2. KITTI Bird's Eye View Evaluation 2017
  3. nuScenes
  4. Waymo
  5. Lyft
  6. apolloscape

Indoor (RGB-D data)

  1. The Stanford Large-Scale 3D Indoor Spaces Dataset (S3DIS)
  2. Richly-annotated 3D Reconstructions of Indoor Scenes (ScanNet)
  3. SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite
  4. NYU Depth Dataset V2