/SPACE

This repository contains the source codes for the paper: "SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments" published at ICCV 2021, 1st SEAI Workshop.

Primary LanguagePython

SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments

newsetup (1)

Paper

[ArXiv]

SPACE Simulator

Run the Blender Code for each of the physical interactions tasks from the BlenderGeneration file using the Blender Python API. Please ensure that the object files is in the same file directory as the .blend file.

SPACE Dataset

Download the respective dataset along with the annotation from here:

[Contact]

[Containment]

[Stability]

You may download down and put it into your own drive,then you can gdown <Drive Url to upload to server>

Dataset Statistics

Dataset statistics are obtained from running python ./util/get_stats.py.

System Requirements

  • Blender 2.83 with eevee engine
  • Python 3.6
  • External Python libraries in PhyDNet_Add_On/requirement.txt

Creating Images from Data

Run ./util/Convert_Video_to_Frames.py file using frames from ./Datasets/containment/video and save it to ./Datasets/containment/contactframes.

For evaluation results via PhyDNet, please view the PhyDNet_Add_On for instruction

If you use SPACE, please cite the our paper:

@inproceedings{duan2021space,
  title={SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments},
  author={Duan, Jiafei and Yu, Samson and Tan, Cheston},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={2058--2063},
  year={2021}
}