Skip to content

Commit

Permalink
Feature/llama factory llama2 pipeline (#95)
Browse files Browse the repository at this point in the history
* added llama-factory under llm_rl

* added sft training bash

* added datasets from llama-factory; will delete later

* finished llama-2-13b train and inference

* fixed minor errors

* changed config

* added deepspeed config

* added more training config to train bash

* adding fix for wandb tags and distributed ranks

* added fastchat data to replicate training for 2k

* tyring to replicate fastchat as close as possible

* before merging

* changed finetue scripts for better performance

* added new data

* example bash

* example bash for mistral
  • Loading branch information
Jasonqi146 authored Nov 12, 2023
1 parent 9b7f3ed commit 430ace6
Showing 0 changed files with 0 additions and 0 deletions.

0 comments on commit 430ace6

Please sign in to comment.