/GaussianEditor

Primary LanguageC++MIT LicenseMIT

GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting

Yiwen Chen*1,2, Zilong Chen*3, Chi Zhang2, Feng Wang3, Xiaofeng Yang2,
Yikai Wang3, Zhongang Cai4 Lei Yang4 Huaping Liu3 Guosheng Lin**1,2
*Equal contribution. **Corresponding author.
1S-Lab, Nanyang Technological University,
2School of Computer Science and Engineering, Nanyang Technological University,
3Department of Computer Science and Technology, Tsinghua University, 4SenseTime Research,

                       

Note: This repo is still under construction. We aim to build this repo as a swift, controllable, and interactive 3D editing tool. We welcome any collaboration. If you're interested in connecting or partnering with us, please don't hesitate to reach out via email (YIWEN002@e.ntu.edu.sg).

Demo Videos

Swift and controllable 3D editing with only 2-7 minutes.
Add.a.teddy.bear.on.bench.mp4
Turn.him.into.a.clown.mp4
Delete.mp4

Release

  • [11/27] 🔥 We released GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting and beta version of GaussianEditing WebUI.

Contents

Install

Our environment has been tested on Ubuntu 22, CUDA 11.8 with 3090 and A6000. Please follow Installation.

WebUI Guide

Please be aware that our WebUI is currently in a beta version. Powered by Viser, you can use our WebUI even if you are limited to remote server. For details, please follow WebUI Guide.

Command Line

We also provide a command line version of GaussianEditor. Like WebUI, you need to specify your path to the pretrained Gaussians and COLMAP outputs as mentioned in here. Please check scripts in sciprt folder. Simply change data.source to your COLMAP output directory and system.gs_source to your pretrained Gaussians and run our demo scripts.

TODO

The repo is still being under construction, thanks for your patience.

  • Step-by-step tutorial for WebUI .
  • Tutorial for hyperparameter tuning.
  • Colab.
  • Windows support.
  • Docker support.
  • Realised WebUI beta version and GaussianEditor.

FAQ