Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
williamFalcon authored Apr 6, 2024
1 parent dddb0e3 commit d78730a
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,11 @@

# ⚡ LitGPT

**Pretrain, finetune, deploy 20+ LLMs** with state-of-the-art techniques.
**Pretrain, finetune, deploy 20+ LLMs on your own data**

✅ fp16/fp32/fp8/fp4     ✅ LoRA, QLoRA, Adapter (v1, v2)     ✅ flash attention     ✅ FSDP     ✅ 1, 1000+ GPUs/TPUs
Uses the latest state-of-the-art techniques:

✅ fp4/8/16/32     ✅ LoRA, QLoRA, Adapter (v1, v2)     ✅ flash attention     ✅ FSDP     ✅ 1-1000+ GPUs/TPUs

---

Expand Down

0 comments on commit d78730a

Please sign in to comment.