Research Tutorial Of Software Engineering For Intelligent Systems

Survey

Machine Learning Testing: Survey, Landscapes and Horizons. [pdf]
- Seokhyun Lee, Sooyoung Cha, Dain Lee, Hakjoo Oh. ISSTA, 2020.

Fuzz Testing Based Data Augmentation to Improve Robustness of Deep Neural Networks. [pdf] [code]
- Gao, Xiang and Saha, Ripon K. and Prasad, Mukul R. and Roychoudhury, Abhik. ICSE, 2020.
DLFuzz: Differential Fuzzing Testing of Deep Learning Systems. [pdf] [code]
- Guo, Jianmin and Jiang, Yu and Zhao, Yue and Chen, Quan and Sun, Jiaguang. FSE, 2018.
DeepMutation: Mutation Testing of Deep Learning Systems. [pdf]
- Lei Ma, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Felix Juefei-Xu, Chao Xie, Li Li, Yang Liu, Jianjun Zhao, and Yadong Wang. ISSRE, 2018.
DeepHunter: a coverage-guided fuzz testing framework for deep neural networks. [pdf] [code]
- Xiaofei Xie, Lei Ma, Felix Juefei-Xu, Minhui Xue, Hongxu Chen, Yang Liu, Jianjun Zhao, Bo Li, Jianxiong Yin, Simon See. ISSTA, 2019.

DeepXplore: Automated Whitebox Testing of Deep Learning Systems. [pdf] [code]
- Kexin Pei, Yinzhi Cao, Junfeng Yang, Suman Jana. Association for Computing Machinery, 2019.
Guiding Deep Learning System Testing Using Surprise Adequacy. [pdf] [code]
- Kim, Jinhan and Feldt, Robert and Yoo, Shin. ICSE, 2019.
DeepGauge: multi-granularity testing criteria for deep learning systems. [pdf] [code]
- Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, Jianjun Zhao, Yadong Wang. ASE, 2018.
Effective white-box testing of deep neural networks with adaptive neuron-selection strategy. [pdf] [code]
- Seokhyun Lee, Sooyoung Cha, Dain Lee, Hakjoo Oh. ISSTA, 2020.

DeepStellar: model-based quantitative analysis of stateful deep learning systems. [pdf] [code]
- Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu, Jianjun Zhao. FSE, 2019.

Is Neuron Coverage a Meaningful Measure for Testing Deep Neural Networks?. [pdf] [code]
- Harel-Canada, Fabrice and Wang, Lingxiao and Gulzar, Muhammad Ali and Gu, Quanquan and Kim, Miryung. FSE, 2020.
DeepGini: prioritizing massive tests to enhance the robustness of deep neural networks. [pdf] [code]
- Yang Feng, Qingkai Shi, Xinyu Gao, Jun Wan, Chunrong Fang, Zhenyu Chen. ISSTA, 2020.
Prioritizing Test Inputs for Deep Neural Networks via Mutation Analysis. [pdf] [code]
- Zan Wang, Hanmo You, Junjie Chen, Yingyi Zhang, Xuyuan Dong, and Wenbin Zhang. ICSE, 2021.

DeepXplore: Automated Whitebox Testing of Deep Learning Systems. [pdf] [code]
- Kexin Pei, Yinzhi Cao, Junfeng Yang, Suman Jana. Association for Computing Machinery, 2019.
DeepRoad: GAN-based metamorphic testing and input validation framework for autonomous driving systems. [pdf]
- Mengshi Zhang, Yuqun Zhang, Lingming Zhang, Cong Liu, Sarfraz Khurshid. ASE, 2018.
DeepTest: Automated Testing of Deep-Neural-Network-Driven Autonomous Cars. [pdf] [code]
- Tian, Yuchi and Pei, Kexin and Jana, Suman and Ray, Baishakhi. ICSE, 2018.

Testing DNN Image Classifiers for Confusion & Bias Errors. [pdf]
- Tian, Yuchi and Zhong, Ziyuan and Ordonez, Vicente and Kaiser, Gail and Ray, Baishakhi. ICSE, 2020.