/3dlfm

Official codebase for 3D-LFM paper. Accepted at CVPR, 2024.

Primary LanguageJupyter NotebookBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause

3D Lifting Foundation Model (3D-LFM) 🌐

PWC PWC PWC

arXiv Paper

Hits

Welcome to the official repository for the 3D Lifting Foundation Model (3D-LFM), a model designed to take 2D landmarks and generate high-fidelity 3D poses across diverse object categories. 🚀

3D Pose for anything!

Current Status: This repository currently supports demo visualization of the model's performance. The comprehensive codebase, which includes actual training and evaluation functionalities, is planned for release as soon as the licensing information becomes available. COMING SOON! STAY TUNED!!

Features 🌟

  • Versatile 3D Reconstruction: Capable of lifting single-view 2D landmarks into 3D structures for a wide range of objects.
  • OOD Handling: State-of-the-art performance on object-specific as well as object-agnostic Out-of-Distribution (OOD) validation data.
  • Interactive Visualization: Explore and visualize 3D predictions against ground truth data interactively.

Getting Started 🚀

Prerequisites

  • Make sure you have Python installed on your system. You can download it from here.

Installation

  1. Clone the Repository:

    git clone https://github.com/mosamdabhi/3dlfm.git
cd 3dlfm

  2. Set up a Virtual Environment (Optional but recommended):

    python -m venv venv
source venv/bin/activate  # On Windows use `venv\Scripts\activate`

Running the Demo

Launch the demo_vis.ipynb notebook using Jupyter:

    jupyter notebook demo_vis.ipynb

Follow the instructions in the notebook for an interactive experience.

Usage 📘

After launching the notebook:

  • Choose a Category: Select from predefined categories for visualization (option to choose between standard validation and OOD validation).
  • Visualize Results: View the 3D reconstructed models and compare them with ground truth data (including actual RGB images).
  • Explore Different Objects: Experiment with various object categories, both standard and OOD.

Contributing 🤝

Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

License 📜

Distributed under the BSD-3-Clause license. See LICENSE for more information.

Contact 📫