Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mobicham authored Oct 26, 2023
1 parent 5f27224 commit 2dc2918
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion code/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ First, install the dependencies:
pip install transformers[torch] datasets xformers accelerate evaluate trl
```

Then run the training script ```train_llama2_lowrank_lora.py``` with one of the datasets.
Then set your HuggingFace token ```hf_auth``` and run the training script ```train_llama2_lowrank_lora.py``` with one of the datasets.

If you want to use the model for ~25-30% faster prediction, you can merge the weights via the following command:
```Python
Expand Down

0 comments on commit 2dc2918

Please sign in to comment.