Skip to content

COLING'24 Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack

License

Notifications You must be signed in to change notification settings

zhouying20/HMGC

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Humanizing Machine-Generated Content

This repository contains resources of our paper:


How to reporduce our result

  1. Download and unzip dataset from Google Drive

  2. Run

python evaluation/eval_accuracy.py \
    --detector hc3 \
    --tests ./output/hc3/**/*.jsonl \
    --output_file /tmp/hc3_evaluation.csv

Do attacks on your own data

  1. Distill sample labels from your target victim detector, train a surrogate model with train_detector.py

  2. Follow attack.multi_flint_attack to start multi-process attacking

Citation

If you find our paper/resources useful, please cite:

@inproceedings{Zhou2024_COLING,
 author = {Ying Zhou and
           Ben He and
           Le Sun},
 title = {Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack},
 booktitle = {Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation.},
 year = {2024},
}

About

COLING'24 Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages