Skip to content

Commit

Permalink
Feature/move multiturn data (#85)
Browse files Browse the repository at this point in the history 
* support qlora mistral training

* added deep speed to requirements

* temporary save for switching disk region

* added shuffle and access token

* finished training pipeline; need to fix inference

* finished training pipeline; need to fix inference

* fixed inference pipeline

* commiting to test deepspeed

* added featurere to remove seq longer than 2048

* try to merge

* minor changes

* minor changes

* Move together data

* rename data process files and add together multiturn data preprocess

---------

Co-authored-by: lwaekfjlk <1125027232@qq.com>
Co-authored-by: Jasonqi146 <jasonqi146@gmail.com>
Co-authored-by: zqi2cmu <zqi2@andrew.cmu.edu>
Co-authored-by: Wonderplex <50866817+Jasonqi146@users.noreply.github.com>
(cherry picked from commit 1976990)
  • Loading branch information
@ruiyiw @lwaekfjlk
ruiyiw authored and lwaekfjlk committed Nov 6, 2023
1 parent 99b71d3 commit 667519d
Show file tree
Hide file tree
Showing 4 changed files with 0 additions and 556 deletions.
17 changes: 0 additions & 17 deletions together_ai_ft/together_completion_data/together_data_preprocess.py
View file

This file was deleted.

Loading

0 comments on commit 667519d

Please sign in to comment.