Code

Feature/move multiturn data#85

Code

Merged

ruiyiw merged 19 commits intomainsotopia-lab/sotopia-pi:mainfrom feature/move-multiturn-datasotopia-lab/sotopia-pi:feature/move-multiturn-dataCopy head branch name to clipboardNov 6, 2023

-556

Commits

Commits on Oct 11, 2023

• support qlora mistral training

  lwaekfjlk

  committed
  638064c

Commits on Oct 13, 2023

• added deep speed to requirements

  Jasonqi146

  committed
  dd939f3

• temporary save for switching disk region

  Jasonqi146

  committed
  8937459

• added shuffle and access token

  Jasonqi146

  committed
  a208d44

Commits on Oct 15, 2023

• finished training pipeline; need to fix inference

  Jasonqi146

  committed
  7938f13

• finished training pipeline; need to fix inference

  Jasonqi146

  committed
  2e41e86

• fixed inference pipeline

  Jasonqi146

  committed
  042ad7d

• commiting to test deepspeed

  Jasonqi146

  committed
  7f7481f

Commits on Oct 16, 2023

• added featurere to remove seq longer than 2048

  Jasonqi146

  committed
  cd5fdeb

Commits on Oct 17, 2023

• try to merge

  Jasonqi146

  committed
  4adcdf8

• added data preprocessing

  Jasonqi146

  committed
  daa6c59

Commits on Oct 24, 2023

• Merge branch 'main' into feature/llama2-13b-train

  lwaekfjlk

  authored
  1a07153

• minor changes

  zqi2cmu

  committed
  929e2ab

Commits on Oct 25, 2023

• minor changes

  zqi2cmu

  committed
  5db80be

• Merge pull request #64 from sotopia-lab/feature/llama2-13b-train

  Show description for 703ff73
  Jasonqi146

  authored
  703ff73

• Move together data

  ruiyiw

  committed
  5248438

Commits on Nov 6, 2023

• rename data process files and add together multiturn data preprocess

  ruiyiw

  committed
  5b5720c

• Merge branch 'main' of https://github.com/sotopia-lab/sotopia-llm-ft

  ruiyiw

  committed
  6ca3efa

• move redundant data preprocess files

  ruiyiw

  committed
  f7c3186