Skip to content

Commit

Permalink
support together ai ft (#4)
Browse files Browse the repository at this point in the history
  • Loading branch information
@lwaekfjlk @sharonwx54
lwaekfjlk authored and sharonwx54 committed Sep 27, 2023
1 parent 3d956ad commit ca1270e
Show file tree
Hide file tree
Showing 2 changed files with 122 additions and 0 deletions.
100 changes: 100 additions & 0 deletions together_ai_ft/together_ai_data.jsonl
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,100 @@
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
{"text":"<s>[INST] how old are you? [/INST] one yaer old. </s>"}
22 changes: 22 additions & 0 deletions together_ai_ft/together_ai_ft.py
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
import together
import os

resp = together.Files.upload(file="together_ai_data.jsonl")
file_id = resp["id"]
files_list = together.Files.list()


resp = together.Finetune.create(
training_file = files_list['data'][0]['id'],
model = 'togethercomputer/llama-2-7b-chat',
n_epochs = 3,
n_checkpoints = 1,
batch_size = 4,
learning_rate = 1e-5,
suffix = 'test-finetune',
wandb_api_key = '972035264241fb0f6cc3cab51a5d82f47ca713db',
)

fine_tune_id = resp['id']
print(resp)

0 comments on commit ca1270e

Please sign in to comment.