/DataAugmentation-SED_WaveGAN-CRNN

基于WaveGAN+CRNN的音频数据增强与声学事件检测(SED), Python实现, 科研项目, 2020夏

Primary LanguageJupyter Notebook

AcousticsDataAugmentation_WaveGAN-CRNN

基于WaveGAN+CRNN的音频数据增强与声音事件检测(SED), Python实现, 科研项目, 2020夏

成果发表 - Achievements

专利 - Patents

一种基于对抗神经网络的枪声数据增广与检测方法，招梓枫，李煊鹏*，林涵

研讨会短论文 - Symposium Short Paper

Rare Data Augmentation for Audio Event Detection based on Generative Adversarial Network, Zhao Zifeng, Lin Han, Xuanpeng Li*

使用

音频数据增强 - Audio Data

声音事件检测 - Sound Event Detection

参考文献 - Reference

音频数据增强 - Audio Data Augmentation

  • Donahue C , Mcauley J , Puckette M . Adversarial Audio Synthesis[J]. 2018.
  • R. Yamamoto, E. Song and J. Kim, "Parallel Wavegan: A Fast Waveform Generation Model Based on Generative Adversarial Networks with Multi-Resolution Spectrogram," ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 2020, pp. 6199-6203
  • Salamon J , Bello J P . Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification[J]. IEEE Signal Processing Letters, 2017, PP(3):1-1.
  • McFee, B., Humphrey, E.J., and Bello, J.P. “A software framework for Musical Data Augmentation.” 16th International Society for Music Information Retrival conference (ISMIR). 2015.

声音事件检测 - Sound Event Detection

  • Lim H , Park J , Lee K , et al. RARE SOUND EVENT DETECTION USING 1D CONVOLUTIONAL RECURRENT NEURAL NETWORKS[C]// Detection and Classification of Acoustic Scenes and Events (DCASE) 2017. 2018.
  • Mesaros A , Diment A , Elizalde B , et al. Sound Event Detection in the DCASE 2017 Challenge[J]. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019, 27(6):992-1006.
  • Stowell D , Giannoulis D , Benetos E , et al. Detection and Classification of Acoustic Scenes and Events[J]. IEEE Transactions on Multimedia, 2015, 17(10):1733-1746.

数据集 - Datasets

  • Fonseca E , Pons J , Favory X , et al. Freesound Datasets: A Platform for the Creation of Open Audio Datasets[C]// International Society for Music Information Retrieval Conference. 2017.
  • Salamon J , Jacoby C , Bello J P . A Dataset and Taxonomy for Urban Sound Research[C]// acm International Conference on Multimedia. ACM, 2014.
  • Annamaria Mesaros, Toni Heittola, Aleksandr Diment, Benjamin Elizalde, Ankit Shah, et al.. DCASE 2017 Challenge setup: Tasks, datasets and baseline system. DCASE 2017 - Workshop on Detection and Classification of Acoustic Scenes and Events, Nov 2017, Munich, Germany.
  • J. F. Gemmeke et al., "Audio Set: An ontology and human-labeled dataset for audio events," 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, 2017, pp. 776-780, doi: 10.1109/ICASSP.2017.7952261.
  • Piczak K J . ESC: Dataset for Environmental Sound Classification[C]// Acm International Conference on Multimedia. ACM, 2015.
  • Beck S D , Nakasone H , Marr K W . Variations in recorded acoustic gunshot waveforms generated by small firearms[J]. Journal of the Acoustical Society of America, 2011, 129(4):1748-1759.

文件组织

/PaperReading：参考文献
/GunshotResearch：枪声音频信号相关数据和研究(数据源自 Gunshot Audio Recordings)，文件夹内.mat文件为干扰极小的纯净枪声信号，文件夹内.m文件为信号波形分析的MATLAB程序
/GunshotData：使用到的枪声音频数据