💥 We have recently added a multithreading feature to generate tests more quickly!
You can configure the plugin with the following parameters to your pom.xml
file:
<plugin>
<groupId>io.github.ZJU-ACES-ISE</groupId>
<artifactId>chatunitest-maven-plugin</artifactId>
<version>1.0.0</version>
<configuration>
<!-- Required: You must specify your OpenAI API keys. -->
<apiKeys></apiKeys>
<model>gpt-3.5-turbo</model>
<testNumber>5</testNumber>
<maxRounds>5</maxRounds>
<minErrorTokens>500</minErrorTokens>
<temperature>0.5</temperature>
<topP>1</topP>
<frequencyPenalty>0</frequencyPenalty>
<presencePenalty>0</presencePenalty>
<proxy>${proxy}</proxy>
</configuration>
</plugin>
Here's a detailed explanation of each configuration option:
apiKeys
: (Required) Your OpenAI API keys. Example:Key1, Key2, ...
.model
: (Optional) The OpenAI model. Default:gpt-3.5-turbo
.testNumber
: (Optional) The number of tests for each method. Default:5
.maxRounds
: (Optional) The maximum rounds of the repair process. Default:5
.minErrorTokens
: (Optional) The minimum tokens of error message in the repair process. Default:500
.temperature
: (Optional) The OpenAI API parameters. Default:0.5
.topP
: (Optional) The OpenAI API parameters. Default:1
.frequencyPenalty
: (Optional) The OpenAI API parameters. Default:0
.presencePenalty
: (Optional) The OpenAI API parameters. Default:0
.proxy
: (Optional) Your host name and port number if you need. Example:127.0.0.1:7078
.
Essentially, the only thing you need to provide are your API keys.
<dependencies>
<dependency>
<groupId>org.junit.jupiter</groupId>
<artifactId>junit-jupiter-api</artifactId>
<version>5.8.2</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-core</artifactId>
<version>3.12.4</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-junit-jupiter</artifactId>
<version>3.12.4</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-inline</artifactId>
<version>3.12.4</version>
<scope>test</scope>
</dependency>
</dependencies>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-surefire-plugin</artifactId>
<version>3.1.0</version>
</plugin>
First, you need to download all necessary dependencies, which can be done by running mvn compile
or mvn install
command.
You can run the plugin with the following command:
Generate unit tests for the target method:
mvn chatunitest:method -DselectMethod=className#methodName
Generate unit tests for the target class:
mvn chatunitest:class -DselectClass=className
You must specify selectMethod
and selectClass
when executing mvn chatunitest:method
or mvn chatunitest:class
.
This is done using the -D option.
There are all parameters you can specify with the -D
option:
selectClass
: (Optional) Class under test. If the project contains the same class name in different packages, the className should be specified as the fully qualified name.selectMethod
: (Optional) Method under test.tmpOutput
: (Optional) The output path for parsed information. Default:/tmp/chatunitest-info
.testOutput
: (Optional) The output path for tests generated bychatunitest
. Default:{basedir}/chatunitest
.project
: (Optional) The target project path. Default:{basedir}
.thread
: (Optional) Enable multi-threaded execution. Default:true
.maxThread
: (Optional) The maximum number of threads. Default:CPU cores * 10
.stopWhenSuccess
: (Optional) Stop the repair process when the test passes. Default:true
.
You can also set the plugin configuration in pom.xml instead of using -D
option like: <maxThreads>30</maxThreads>
Example:
public class Example {
public void method1(Type1 p1, ...) {...}
public void method2() {...}
...
}
To test the class Example
and all methods in it:
mvn chatunitest:class -DselectClass=Example
To test the method method1
in the class Example
(Now ChatUnitest will generate tests for all methods named method1
in the class)
mvn chatunitest:method -DselectMethod=Example#method1
Generate unit tests for the whole project:
mvn chatunitest:project
Clean the generated tests:
mvn chatunitest:clean
Running this command will delete all generated tests and restore your test folder.
Note: When executing the generated tests, ChatUnitest will first create a backup of your test folder in the src/back/
directory. It will then copy the generated tests into the src/test/java/
directory for execution and for your
convenience when you want to run the tests manually. To restore the test folder, you should use the following Maven
command: mvn chatunitest:restore
.
This Maven plugin can be executed in various operating systems with different Java Development Kits (JDK) and Maven versions. The following environments have been tested and proven to work:
- Environment 1: Windows 11 / Oracle JDK 11 / Maven 3.9
- Environment 2: Windows 10 / Oracle JDK 11 / Maven 3.6
- Environment 3: Ubuntu 22.04 / OpenJDK 11 / Maven 3.6
- Environment 4: Darwin Kernel 22.1.0 / Oracle JDK 11 / Maven 3.8
Please note that these environments are tested and known to work. You can also try running the plugin in similar environments. If you encounter any issues in other environments, please refer to the documentation or seek appropriate support.
- Add code obfuscation to avoid sending the original code to ChatGPT.
- Add expense estimation and quota.
- Optimize the structure of generated test cases.
Our work has been submitted to arXiv. Check it out here: ChatUniTest.
@misc{xie2023chatunitest,
title={ChatUniTest: a ChatGPT-based automated unit test generation tool},
author={Zhuokui Xie and Yinghao Chen and Chen Zhi and Shuiguang Deng and Jianwei Yin},
year={2023},
eprint={2305.04764},
archivePrefix={arXiv},
primaryClass={cs.SE}
}
If you have any questions or would like to inquire about our experimental results, please feel free to contact us via email. The email addresses of the authors are as follows:
- Corresponding author:
zjuzhichen AT zju.edu.cn
- Author:
yh_ch AT zju.edu.cn
,xiezhuokui AT zju.edu.cn