/3D-Data-Essentials

3D DATA PROCESSING AND MODELING ESSENTIALS: A curated collection of tools, literature, courses, and datasets for mastering 3D point cloud technology.

Alt text for the image

Table of Contents

  1. Introduction 🎉
  2. Tools and Software 🛠️
  3. Courses and Tutorials 📚
  4. Learning RoadMap 🚀
  5. Lectures and Seminars 🎤
  6. Project Examples and Case Studies 💼
  7. Community and Networking 🌐
  8. Books and Literature 📖
  9. Datasets
  10. 3D tech startup 🚀
  11. Contributing 👐

Introduction

Welcome to "3D Point Cloud Essentials"! I've developed this repository as a comprehensive hub for anyone delving into the world of 3D point cloud technology. Whether you're a student, researcher, or industry professional, this repository aims to be your go-to resource. It encompasses a wide array of materials, including essential tools, foundational books, groundbreaking research papers, practical datasets, informative courses, and insightful lectures. The goal is to facilitate learning, research, and development in the dynamic field of 3D point clouds, providing resources that cater to various levels of expertise and interest.

Tools and Software

This section provides a comprehensive list of tools and software for 3D point cloud processing, covering a range of functionalities from acquisition and processing to analysis and visualization. Both open-source and commercial options are included to cater to diverse needs and preferences.

Open-Source Tools

Tool Description Links
PCL (Point Cloud Library) A comprehensive library for 2D/3D image and point cloud processing. GitHub | Website
CloudCompare Specializes in 3D point cloud and mesh comparison and processing. GitHub | Website
Open3D A toolkit for processing, visualizing, and analyzing 3D data. GitHub | Website
PDAL (Point Data Abstraction Library) A C++ library for processing point cloud data. GitHub | Website
laspy A Python library for reading, modifying, and writing LAS files. GitHub
plyfile A Python library for reading and writing PLY files. GitHub
MeshLab An open-source system for processing and editing 3D triangular meshes. GitHub | Website
LidarView which is an open source application derived from ParaView and adding tools for live sensor connection / replay and point cloud specific algorithms ( including wrapping of PCL fonctionalities as filters, SLAM, Deep Learning... ) GitLab | Website
Telesculptor which is an open source photogrammetry software, specialized in creating 3D point cloud and meshes in aerial imagery Github |Website

ML/DL

Tool Description Links
RandLA-Net Efficient Semantic Segmentation of Large-Scale Point Clouds. Tensorflow
KPConv Flexible and Deformable Convolution for Point Clouds. Tensorflow | PyTorch
Superpoint Transformer Efficient 3D Semantic Segmentation with Superpoint Transformer. PyTorch
SemanticML A package for semantic segmentation of 3D unorganized point clouds using ML techniques. GitHub

3D Modelling

Tool Description Links
3dfier The open-source tool for creating 3D models. GitHub
City3D Large-scale LoD2 Building Reconstruction from Airborne LiDAR Point Clouds. GitHub
val3dity Validation of 3D primitives according to the international standard ISO19107. GitHub
AdTree Accurate, detailed, and automatic modeling of laser-scanned trees. GitHub
Geoflow3D Geoflow plugin for building LoD2 reconstruction from a point cloud. GitHub
PolyFit Polygonal Building Surface Reconstruction from Point Clouds. GitHub

Visualization and Analysis

Tool Description Links
ParaView A multi-platform tool for data analysis and visualization. Website
Blender A free and open-source 3D creation suite for modeling, animation, and rendering. Website
COLMAP Structure-from-Motion (SfM) and Multi-View Stereo (MVS) for scene reconstruction from images. Website

Commercial Software

Tool Description Links
Leica Cyclone Comprehensive software for point cloud processing in various industries. Website
Autodesk Recap For 3D scanning and photogrammetry, creating 3D models from photographs and laser scans. Website
Faro Scene Processes and manages scanned data, mainly from FARO scanners. Website
Agisoft Metashape Photogrammetric processing of digital images and 3D spatial data generation. Website
Pix4Dmapper Professional photogrammetry software for drone mapping. Website

Courses and Tutorials

A compilation of courses, tutorials, and lectures offering structured learning paths for all levels in 3D point cloud technology.

Course Title Link
3D Point Cloud In Cloudcompare 3D Point Cloud In Cloudcompare
3D Point Cloud In QGIS 3D Point Cloud In QGIS
3D Modelling of the Built Environment 3D Modelling of the Built Environment
Photogrammetry I & II (2021, Uni Bonn, Cyrill Stachniss) Photogrammetry I & II
3D Point Cloud and Machine Learning 3D Point Cloud and Machine Learning
Potree 3D Potree 3D
The Early Days of 3D Laser Scanning The Early Days of 3D Laser Scanning
Point Cloud Processing with Open3D Point Cloud Processing with Open3D
Photogrammetric Computer Vision Photogrammetric Computer Vision
3D Point Cloud Data Processing for SLAM 3D Point Cloud Data Processing
Open3D 3D Point Cloud Data Processing

Learning Roadmap

Here's a roadmap for learning and mastering 3D point cloud processing:

Foundational Knowledge

  • Mathematics: Strong background in linear algebra, calculus, and statistics.
  • Programming: Familiarity with languages like Python, C++, or MATLAB.
  • Data Structures: Understanding of point clouds, voxel grids, and octrees.

Point Cloud Acquisition and Preprocessing

  • LiDAR Data Acquisition: Learn about LiDAR sensors, data acquisition techniques, and data formats.
  • Point Cloud Preprocessing: Techniques for noise removal, filtering, registration, and segmentation.
  • 3D Visualization: Mastering tools like Open3D, Meshlab, or CloudCompare.

Feature Extraction and Descriptors

  • Feature Extraction: Techniques for extracting features such as shape, texture, and contextual features.
  • Descriptors: Understanding different types of descriptors like normals, curvatures, and signatures.
  • Feature Matching: Algorithms for matching features between point clouds (e.g., ICP, FLANN).

Applications and Visualization

  • 3D Reconstruction: Techniques for reconstructing 3D shapes from point clouds.
  • Segmentation and Classification: Algorithms for segmenting point clouds into meaningful regions.
  • Surface Representation: Techniques for representing and simplifying point cloud data.

Advanced Topics

  • Deep Learning for Point Clouds: Application of deep learning techniques in point cloud analysis.
  • Semantic Segmentation and Object Detection: Techniques for semantic segmentation and object detection in point clouds.
  • Point Cloud Fusion and Multi-Sensor Data Integration: Fusing point clouds from multiple sensors and integrating multi-modal data.
  • Point Cloud Compression and Data Reduction: Techniques for compressing and reducing the size of point cloud data.
  • Interactive Visualization and Exploration: Tools and techniques for interactive visualization of large-scale point cloud data.

Continuous Learning and Collaboration

  • Stay Updated: Keep up with the latest advancements through research papers and online resources.
  • Contribute to Open-Source Projects: Participate in open-source projects to gain hands-on experience.
  • Network and Collaborate: Connect with experts and researchers in the field.
  • Explore New Applications: Apply knowledge to solve real-world problems and develop innovative applications.

Lectures and Seminars

Recorded lectures and seminars from field experts, providing insights into both industry trends and academic advancements.

Project Examples and Case Studies

Showcases of practical applications and projects that utilize 3D point cloud technology, offering real-world examples and case studies.

Community and Networking

The field of 3D point cloud technology is enriched by a vibrant community of professionals, enthusiasts, and researchers. Engaging with these communities can be invaluable for learning, collaboration, and staying abreast of the latest developments. Here are some key forums and platforms for networking and discussion:

Specific Forums

  • CloudCompare Forum

    • A dedicated forum for users of CloudCompare, where you can discuss issues, share tips, and get help from fellow users.
    • CloudCompare Forum
  • Laser Scanning Forum

    • A hub for professionals, enthusiasts, and newcomers to discuss everything related to laser scanning, including 3D point cloud processing.
    • Laser Scanning Forum

Broader Online Communities

  • LinkedIn Groups
    • LinkedIn hosts various groups focused on 3D scanning, LiDAR, and point cloud technologies, providing a platform for professional networking and knowledge sharing.
    • Search for groups related to "3D Scanning", "LiDAR", and "Point Cloud Technology" on LinkedIn.

Books and Literature

The field of 3D point cloud technology is vast and intricate, requiring a solid understanding of various concepts and practices. This section lists books and literature that provide valuable insights and knowledge, beneficial for beginners and experts alike.

Foundational Texts

  • "Computer Vision: Algorithms and Applications" by Richard Szeliski
    • A comprehensive introduction to computer vision, including 3D point cloud data.
    • Link to Book

Advanced Topics

  • "3D Deep Learning with Python" by Packt Publishing

    • A hands-on guide to 3D deep learning, exploring PyTorch3D for processing 3D mesh and point cloud data.
    • Link to Book
  • "3D Point Cloud Analysis: Traditional, Deep Learning, and Explainable Machine Learning Methods" by Shan Liu, Min Zhang, Pranav Kadam, C.-C. Jay Kuo

    • Comprehensive investigation of point cloud processing including traditional, deep learning, and explainable ML methods.
    • Link to Book
  • "Reconstruction and Analysis of 3D Scenes: From Irregularly Distributed 3D Points to Object Classes" by Martin Weinmann

    • Latest research on 3D point cloud generation, feature extraction, registration, and scene analysis.
    • Link to Book

Practical Guides

  • "3D Recording, Documentation and Management of Cultural Heritage" edited by Efstratios Stylianidis and Fabio Remondino
    • Methods and technologies in 3D recording for managing and preserving cultural heritage.
    • Link to Book

Journals and Periodicals

  • ISPRS Journal of Photogrammetry and Remote Sensing

    • A leading journal covering topics including point cloud processing.
    • Journal Link
  • Photogrammetric Engineering & Remote Sensing (PE&RS)

    • Articles and research on photogrammetry, remote sensing, and spatial information sciences.
    • Journal Link

This list is a starting point and is not exhaustive. Suggestions and contributions to this section are welcome.

Datasets

Annotated Point Cloud Datasets

Dataset Description Links
Paris-Lille 3D The Paris-Lille-3D is a Dataset and a Benchmark on Point Cloud Classification. The data has been produced by a Mobile Laser System (MLS) in two different cities in France (Paris and Lille). Website
Toronto3D A large-scale point cloud dataset of Toronto, Canada, covering approximately 1 km of road and consists of about 78.3 million points.. Website
Semantic3D A point cloud dataset of 10 different urban environments, including parks, streets, and buildings. Website
Wuhan Railway 3D A point cloud dataset of the railway network in Wuhan, China. Website
Saint Petersburg A point cloud dataset of Saint Petersburg, Russia. Website

LiDAR Data Programs

This table provides an overview of various LiDAR data programs available in open access, highlighting their applications and the countries they cover. Each entry includes a direct link to access the data or learn more about the program.

Dataset Description Country Links
LiDAR HD - France High-definition LiDAR data. France Website
AHN - Actueel Hoogtebestand Nederland A detailed elevation dataset of the Netherlands, derived from LiDAR scans. Widely used for water management, urban planning, and environmental monitoring. Netherlands Website
OpenTopography Provides access to high-resolution, Earth science-oriented, topography data, and tools, including LiDAR. USA Website
Lidar Data - Geoscience Australia LiDAR data collection covering various regions of Australia, supporting environmental research and management. Australia Website
UK Environment Agency LiDAR High-quality LiDAR data covering England, used for flood risk management and environmental assessment. United Kingdom Website
Canadian Digital Elevation Model (CDEM) Derived from LiDAR and other sources, this dataset provides elevation data across Canada. Canada Website
New Zealand LiDAR High-resolution topographic data collected via LiDAR, covering significant parts of New Zealand. New Zealand Website

3D Tech Startups

This section lists various startups in the 3D technology space, each offering unique solutions ranging from mapping systems to cloud-based platforms for 3D data processing and digital twin creation.

Startup Description Website
NavVis Mobile 3D mapping system/processing solutions for indoor and outdoor spaces. NavVis
Matterport Hardware and cloud-based platform for creating/sharing 3D models of buildings and interior spaces. Matterport
Flai Software/Processing and Model as a service, known for FlaiNet for automatic 3D point cloud classification. Flai
POINTLY Cloud-based B2B software for automatic 3D point cloud classification and vectorization. POINTLY
ATIS.cloud Cloud-based platform for visualizing, analyzing, and sharing 3D point cloud data. ATIS.cloud
Vercator Cloud-based platform for processing 3D point cloud data (Registration, Classification, format conversion). Vercator
The Cross Product (TCP) Automated software for classification, vectorization, inspection, inventory, and measurements in 3D point clouds. The Cross Product
NUBIGON Inc. Point cloud visualization and animation software for the reality capture industry. NUBIGON Inc.
Prevu3D Digital Twin Solution Software for Business, 3D point cloud processing platform for industrial applications. Prevu3D
Pointerra Cloud-based platform for creating/managing digital twins of buildings and infrastructure. Pointerra
Cintoo Cloud-based platform for managing and processing 3D point cloud, BIM, and digital twin. Cintoo
Outsight 3D lidar sensors/software solutions for robotics, transportation, monitoring, and logistics. Outsight
Jakarto Specialized in 3D mapping offering digital twin and automated asset inventory creation. Jakarto
Point Cloud Technology GmbH Universal platform for big data analytics on 3D point clouds based on machine learning. Point Cloud Technology GmbH
Nira.app Collaborative platform for rendering massive 3D assets in real-time for web-based inspection and review. Nira.app
Flyability Visual inspections in confined spaces using advanced technology. Flyability

This table provides an overview of various startups in the 3D tech space, highlighting their core offerings and linking to their respective websites for more information.

Contributing

Your contributions are what make "3D Point Cloud Essentials" a dynamic and valuable resource. Whether it's suggesting new resources, updating existing ones, or providing feedback, I welcome your input. Let's collaborate to keep this repository a rich, accurate, and up-to-date resource for everyone in the 3D point cloud community.

Thank you for visiting and contributing to 3D Point Cloud Essentials!