/ChatGPT-Detection-PR-HPPT

Codes and dataset for the paper: Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Text

Primary LanguagePython

ChatGPT-Detection-PR-HPPT

This our dataset and code for the paper: Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Text The overall design of our method.

Guideline

The detector is a Roberta for classification model with labels (0: human, 1:ChatGPT-involved).

If you want to train it, follow these steps:

  1. install the environment
pip install -r requirements.txt
  1. train a detector
cd Detector
python train.py

It is also all right for you to change some setting in the code.

  1. get the detector

The best_model.pt is the trained detector.

You can test the custom sample in text_test.txt (only three examples in it):

python inference.py

If you do not want to train the model, we provide our trained detector on HPPT: Trained Detector on Google driver and Trained Detector on Huggingface.

  1. train a model to get polish ratio
cd ../PR_reg
python train.py

We also provide the trained PR model: Trained PR model

Citation

You are welcome to use our dataset and models. For citation following BibTex entry:

@article{yang2023chatgpt,
  title={Is chatgpt involved in texts? measure the polish ratio to detect chatgpt-generated text},
  author={Yang, Lingyi and Jiang, Feng and Li, Haizhou},
  journal={APSIPA Transactions on Signal and Information Processing},
  volume={13},
  number={2},
  publisher={Now Publishers, Inc.}
}