/vibrotactile-autoencoder

Primary LanguageJupyter Notebook

Tactile Texture Exploration and Synthesis System Using Generative Adversarial Network

This repository contains the code for the paper: TEXasGAN: Tactile Texture Exploration and Synthesis System Using Generative Adversarial Network

System structure Network model

The opendataset used this paper: LMT Haptic Texture Database (108 surface materials, SoundScans, Movement)

To obtain the preprocessed dataset, run the notebook preprocess.ipynb. In this study, we selected 14 classes to build a training dataset.

Run the TactileCAAE/train.py to train the model. The dictionary of the trained model parameters are saved in TactileCAAE. After loading the trained parameters, the model can be used directly for the user optimization.

Run the DSS_Experiment_UserInitialization.py to start the optimization with the user initialization. Run the DSS_Experiment.py to start the optimization directly.

Citation

If you find this repo is helpful, please cite:

@article{zhang2024texasgan,
  title={TEXasGAN: Tactile Texture Exploration and Synthesis System Using Generative Adversarial Network},
  author={Zhang, Mingxin and Terui, Shun and Makino, Yasutoshi and Shinoda, Hiroyuki},
  journal={arXiv preprint arXiv:2407.11467},
  year={2024}
}

Acknowledgments

This code is based on the implementations of Difference-Subspace-Search.