/paper_interspeech23

Data and code for "Synthesis after a couple PINTs: Investigating the role of pause-internal phonetic particles in speech synthesis and perception" at Interspeech 2023, Dublin, Aug 20-24.

Primary LanguageRMIT LicenseMIT

orcid

Synthesis after a couple PINTs

This repository contains the data and code for "Synthesis after a couple PINTs: Investigating the role of pause-internal phonetic particles in speech synthesis and perception" by Mikey Elmers, Johannah O'Mahony, and Éva Székely for the 24th INTERSPEECH Conference (Interspeech '23), Dublin, August 20-24. This project developed TTS systems that included pause-internal phonetic particles and evaluated speaker certainty.

A demo of the text-to-speech stimuli can be found here.

The following PINTs are investigated:

  • silence (sil)
  • inhalation noise (in)
  • exhalation noise (ex)
  • filler particles (uh/um)
  • tongue click (cl)

Table Of Contents

Instructions

  1. Clone repository. 
    git clone https://github.com/MikeyElmers/paper_interspeech23.git
cd paper_interspeech23/
  2. Rmarkdown documents and the sessionInfo are located in output/.

Directory Information

data

  • Raw data
  • Final data

docs

  • elmers_interspeech23_paper.pdf: Interspeech '23 paper submission
  • elmers_interspeech23_poster.pdf: Interspeech '23 poster submission

output

  • 02_analysis.html: Output of analysis.Rmd file
  • sessionInfo.txt: R session info
  • plot_heatmag.png: Heatmap for certainty score and condition

scripts

  • 00_renvRestore.R: Restores project dependencies
  • 01_clean.R: Cleans and exports final data
  • 02_eda.Rmd: Descriptive and inferential data analysis

Citation

If you use this data or code for you work, please cite as:

@inproceedings{elmers23interspeech,
  author={Mikey Elmers and Johannah O'Mahony and \'{E}va Sz\'{e}kely},
  title={{Synthesis after a couple PINTs: Investigating the Role of Pause-Internal Phonetic Particles in Speech Synthesis and Perception}},
  year=2023,
  booktitle={Proc. INTERSPEECH 2023},
  pages={4843--4847},
  doi={10.21437/Interspeech.2023-2178}
}

Issues/Comments/Suggestions

Please use the issue tracker.

License

This code is licensed under the terms of the MIT license. See LICENSE.md

References

Langdon Hammer, Modern Poetry (Yale University: Open Yale Couses), http://oyc.yale.edu (Accessed June 27, 2022). License: Creative Commons BY-NC-SA