Skip to content

Issues: ReaLLMASIC/nanoGPT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

41 Open 10 Closed
41 Open 10 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Experiments: Rotary Position Embedding Swapping/Finetuning for HW Effiiciency
#228 opened Aug 14, 2024 by gkielian
4 tasks
Quest: Add Benchmarks and Pretokenized JSON for training epic Epic level contrib
#222 opened Aug 9, 2024 by gkielian
Exploration Augmentation: Add means to pause and resume search
#221 opened Aug 8, 2024 by gkielian
Exploration Augmentation: Run_experiments Best Results Log
#220 opened Aug 8, 2024 by gkielian
Exploration Automation: Obtain Dataset, Select Tokenization, and Cache results
#219 opened Aug 8, 2024 by gkielian
Sample.py: fix inference for p50k_base and cl100k_base bug Something isn't working
#213 opened Jul 31, 2024 by gkielian
Quest: Add compatibilty with a Simple-Wikipedia dataset
#207 opened Jul 30, 2024 by gkielian
Quest: Add SAM Preprocessing for Videos
#206 opened Jul 29, 2024 by gkielian
Add nan handling strategy for run_vizier.py
#193 opened Jun 24, 2024 by klei22
@gkielian @klei22
Quest: Add a Rough draft for Mixture of Experts enhancement New feature or request epic Epic level contrib good first issue Good for newcomers help wanted Extra attention is needed
#140 opened Apr 9, 2024 by gkielian
Quest: Create a training efficient version of windowed attention for experimenting with long contexts enhancement New feature or request epic Epic level contrib good first issue Good for newcomers
#139 opened Apr 9, 2024 by gkielian
Quest: Curriculum and Preprocessing for Translation Targets enhancement New feature or request epic Epic level contrib good first issue Good for newcomers help wanted Extra attention is needed
#129 opened Mar 18, 2024 by gkielian
4 tasks
Start Translation Training
Quest: Have run experiments print a number of combinations and optional printing of all options to file enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#126 opened Mar 17, 2024 by gkielian
Quest: Add Quantization Aware Training and Inference enhancement New feature or request epic Epic level contrib help wanted Extra attention is needed
#125 opened Mar 17, 2024 by gkielian Model Quantization
OpenFASoC PPA Analyzer
#122 opened Mar 14, 2024 by harshkhandeparkar
6 tasks
Quests: Add Weather Dataset
#121 opened Mar 14, 2024 by gkielian
Quest: Explore training stability of network with bf16 and fp16 enhancement New feature or request good first issue Good for newcomers
#118 opened Mar 9, 2024 by gkielian
Quest: Add support for loss masking
#117 opened Mar 9, 2024 by gkielian
Quests: Rotary Positional Embedding
#116 opened Mar 7, 2024 by gkielian
@gkielian
2
Quest: Add Quad2 and Relu2 Softmax Variations enhancement New feature or request good first issue Good for newcomers
#104 opened Feb 29, 2024 by gkielian
Add Learned Channel Embeddings enhancement New feature or request
#103 opened Feb 28, 2024 by gkielian
Add minbpe support for tokenization enhancement New feature or request
#102 opened Feb 28, 2024 by gkielian
Improve SentencePiece default settings
#101 opened Feb 28, 2024 by gkielian
Create special tokens for training conversations
#100 opened Feb 28, 2024 by gkielian
prepare.py script: add progress bar for tokenizers enhancement New feature or request good first issue Good for newcomers
#96 opened Feb 26, 2024 by gkielian
ProTip! Adding no:label will show everything without a label.