/AccuNeRF

Primary LanguageJupyter Notebook

mit

AccuNeRF

ACCURATE 3D ACCIDENT RECONSTRUCTION USING NEURAL RADIANCE FIELDS

ADONAI VERA ยท PROF. DR. ARMIN GRASNICK

Accurate damage documentation post-automobile accidents are a significant challenge in the insurance industry. Traditional methods often fall short of precision and detail, leading to discrepancies in damage reports. In the United States alone, there are approximately 6 million car accidents yearly, resulting in over $160 billion in economic losses, including medical expenses and property damage (Administration, The National Highway Traffic Safety, 2023). In this context, our study introduces AccuNeRF, an innovative application of Neural Radiance Fields (NeRF), developed to construct digital twins of damaged vehicles using conventional smartphone video capture. Our research delves into the effectiveness and constraints of NeRF for precise 3D reconstruction of damaged vehicles, accounting for video quality and environmental factors. Additionally, we establish a comprehensive pipeline, guiding the transformation from input images to user-friendly digital twin interfaces, streamlining accident analysis. Notably, we introduce an innovative post-processing step utilizing a Denoising Autoencoder with Spatial Attention architecture (Point-DAE) to enhance point cloud quality, contributing to the overall robustness of our approach. These advancements serve as critical components of our research, advancing the field of digital vehicle reconstruction. Our findings could bridge the gap between current damage reporting limitations and the promise of cutting-edge machine learning tools, setting the stage for more accurate, swift, and detailed assessments in the insurance domain.

Paper | Video |

Table of Contents
  1. Install
  2. Download Datasets
  3. Implementation
  4. Run
  5. Results
  6. Citation
  7. License
  8. Acknowledgments
  9. Contact

Install

Clone repo with submodules:

git clone https://github.com/AdonaiVera/AccuNeRF.git --recurse-submodules
git submodule update --init --recursive

Create a virtualenv

conda env create --file environment.yml
conda activate accunerf

Download Sample Data

pending

Implementation

In the implementation phase, we bring our research to fruition, transforming the proposed methodology into a functional software application known as AccuNeRF. This section will delve into the various components of the AccuNeRF pipeline, illustrating how each stage contributes to the precise 3D reconstruction of accident scenes. The pipeline outlined below represents an intricate system engineered to transform single-camera imagery into a vividly detailed three-dimensional space. It is a composite framework that amalgamates the 3D surface reconstruction prowess of Nerfacto. From the initial phase of image capture to the final rendering, the pipeline employs a series of interconnected modules, each specialized for a critical aspect of the scene creation process. The intricacies of these modules and their interplay are visually depicted in the subsequent diagram, providing a clear depiction of the pipeline's methodology and its holistic approach to 3D scene construction and enhancement (see Image below).

Run

pending

Results

Citation ๐Ÿ“ฆ

pending

License ๐Ÿ“Œ

Pending to ADD

Acknowledgments ๐Ÿค“

Based on NeRF++ codebase and inherits the same training data preprocessing and format.

Build with ๐Ÿ› ๏ธ

Mention the tools you used to create your project

Pending to add

Contact ๐ŸŽ

If you are interested in building on top of this, feel free to reach out :)

  • Adonai Vera - AI developer Geta Club - AdonaiVera