TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition

Yongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang, Kui Jia

NeurIPS 2022 Spotlight

Paper | Project Page

News

🏆 [Nov 11th 2022] TANGO was selected in NeurIPS spotlight papers.

Installation

Note: You can directly pull the image we uploaded to AliCloud

docker pull registry.cn-shenzhen.aliyuncs.com/baopin/t2m:1.7

System Requirements

Python >=3.7 and <=3.9
CUDA 11
Nvidia GPU with 12 GB ram at least
Open3d >=0.14.1
the package of clip (https://github.com/openai/CLIP)

Train

Call the below shell scripts to generate example styles.

# shoe made of gold
./demo/run_shoe_gold.sh
# vase made of wicker 
./demo/run_vase_wicker.sh
# car made of wood
./demo/run_car_wood_origin.sh
# ...

The outputs will be saved to results/demo

Validate

Call the below shell scripts to generate gif.

# shoe made of gold
./demo/test_shoe_gold.sh
# vase made of wicker 
./demo/test_vase_wicker.sh
# car made of wood
./demo/test_car_wood_origin.sh
# ...

Citation

@inproceedings{ChenChenNeurIPS22,
  title={TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition},
  author={Yongwei Chen and Rui Chen and Jiabao Lei and Yabin Zhang and Kui Jia},
  booktitle={Proceedings of the Neural Information Processing Systems (NeurIPS)},
  year={2022}
}

Exception1984/tango