Skip to content

Actions: NousResearch/nanotron

Actions

Secret Leaks

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
9 workflow runs
9 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

add additional roles
Secret Leaks #9: Commit d8f8025 pushed by jquesnelle
September 6, 2024 13:35 16s ring_attention_with_chat_fa3
September 6, 2024 13:35 16s
use simpler rope and layernorm
Secret Leaks #8: Commit c0964e8 pushed by jquesnelle
August 17, 2024 01:46 21s ring_attention_with_chat
August 17, 2024 01:46 21s
pad to product of tp and sp group size
Secret Leaks #7: Commit 62f824b pushed by jquesnelle
August 14, 2024 19:12 20s ring_attention_with_chat
August 14, 2024 19:12 20s
non-packed sft w/ ring attention
Secret Leaks #6: Commit e34cabb pushed by jquesnelle
August 11, 2024 00:53 16s ring_attention_with_chat
August 11, 2024 00:53 16s
more chat
Secret Leaks #5: Commit e7600d0 pushed by jquesnelle
August 9, 2024 02:56 20s ring_attention_with_chat
August 9, 2024 02:56 20s
August 8, 2024 17:54 22s
add llama 3.1 rope to llama_sft
Secret Leaks #3: Commit 2420384 pushed by jquesnelle
August 8, 2024 16:27 17s sft
sft
August 8, 2024 16:27 17s
Update tools/preprocess_data.py
Secret Leaks #2: Commit 402d3ce pushed by jquesnelle
July 5, 2024 13:34 16s add-nanoset-parquet
July 5, 2024 13:34 16s
add parquet to data preprocessing
Secret Leaks #1: Commit aee410a pushed by jquesnelle
July 4, 2024 03:25 18s add-nanoset-parquet
July 4, 2024 03:25 18s