TripoSR

This is the official codebase for TripoSR, a state-of-the-art open-source model for fast feedforward 3D reconstruction from a single image, collaboratively developed by Tripo AI and Stability AI.

Leveraging the principles of the Large Reconstruction Model (LRM), TripoSR brings to the table key advancements that significantly boost both the speed and quality of 3D reconstruction. Our model is distinguished by its ability to rapidly process inputs, generating high-quality 3D models in less than 0.5 seconds on an NVIDIA A100 GPU. TripoSR has exhibited superior performance in both qualitative and quantitative evaluations, outperforming other open-source alternatives across multiple public datasets. The figures below illustrate visual comparisons and metrics showcasing TripoSR's performance relative to other leading models. Details about the model architecture, training process, and comparisons can be found in this technical report.

The model is released under the MIT license, which includes the source code, pretrained models, and an interactive online demo. Our goal is to empower researchers, developers, and creatives to push the boundaries of what's possible in 3D generative AI and 3D content creation.

Getting Started

Installation

Python >= 3.8
If you want to set up a virual environment, please make sure to use virtualenv instead of venv.
Install PyTorch according to your platform: https://pytorch.org/get-started/locally/
Install other dependencies by pip install -r requirements.txt

Manual Inference

python run.py examples/chair.png --output-dir output/

This will save the reconstructed 3D model to output/. You can also specify more than one image path separated by spaces. The default options takes about 6GB VRAM for a single image input.

For defailed usage of this script, use python run.py --help.

Local Gradio App

Install Gradio:

pip install gradio

Start the Gradio App:

python gradio_app.py

Troubleshooting

AttributeError: module 'torchmcubes_module' has no attribute 'mcubes_cuda'

This may be caused by using venv for the Python virtual environment. Please try to build the environment with virtualenv instead, or use the Dockerfile provided here.

Also related to different local and PyTorch CUDA versions, see this issue.

Update 2024.03.06: Will automatically fallback to CPU marching cubes when the error occurs.

Citation

@article{TripoSR2024,
  title={TripoSR: Fast 3D Object Reconstruction from a Single Image},
  author={Tochilkin, Dmitry and Pankratz, David and Liu, Zexiang and Huang, Zixuan and and Letts, Adam and Li, Yangguang and Liang, Ding and Laforte, Christian and Jampani, Varun and Cao, Yan-Pei},
  journal={arXiv preprint arXiv:2403.02151},
  year={2024}
}