Skip to content

Automated quality assessment of training examples with LLMs.

License

Notifications You must be signed in to change notification settings

cg123/promptrate

Repository files navigation

Script for using large language models to assign quality ratings to training examples in bulk.

Has two backends, vLLM and exllama. Outputs ratings to a shelve file.

Currently pretty specifically tailored to my workflow. Feel free to reach out to me with any questions, suggestions, or feedback.

About

Automated quality assessment of training examples with LLMs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages