Link to the paper: Collapse of Self-trained Langauge Models
pip install torch numpy transformers datasets tiktoken wandb tqdm
To run the code do:
python train.py config/finetune_collapse.py
-
Notifications
You must be signed in to change notification settings - Fork 0
"Collapse of Self-trained Language Models" codebase for ICLR 2024
License
DavidHerel/collapse-lm-iclr
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
"Collapse of Self-trained Language Models" codebase for ICLR 2024
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published