Skip to content

Fuses Language Model Adapters [LoRA, QLoRA, etc] to any chosen base model with three popups for model, peft, save location.

Notifications You must be signed in to change notification settings

Digitous/Easy-LLM-PEFT-GUI

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

EasyPEFTGUI

Want to fuse a that spicy roleplay LoRA to your favorite base language model?

Want it as easy as clicking a language model folder, a peft folder, a save directory and that LoRA or QLoRA is now fused to whatever base model?

This does that.

But How I Do The Thing?

You run the one script in this repo in a python instance.

Prerequisites

  • Python 3.6 or newer
  • transformers library
  • torch library
  • tkinter library

Usage

  1. Clone this repository:

  2. Navigate to the repository folder:

  3. Run the easypeftgui.py script:

  4. Follow the on-screen prompts to select the required directories.

Acknowledgements

This script is based on a command-line driven script TheBloke shared in this Hugging Face forum I don't know how TheBloke does it. I swear that guy is everywhere.

License

This project is licensed under nothing whatsoever. I don't get paid to do this. Tools this easy should have been released with the release of PEFT as a common sense onramp. I see problem I fix problem.

About

Fuses Language Model Adapters [LoRA, QLoRA, etc] to any chosen base model with three popups for model, peft, save location.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages