Add transformer example

parsiad · Aug 23, 2024 · 00e7cf1 · 00e7cf1
1 parent b1e398f
commit 00e7cf1
Show file tree

Hide file tree

Showing 2 changed files with 457 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -25,4 +25,5 @@ sys.path.insert(0, os.path.expanduser("~/micrograd-pp/python"))
 ## Examples
 
 * [Train a simple feedforward neural network on MNIST to classify handwritten digits](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/mnist.ipynb)
-* [Learn an n-gram model](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/n-gram.ipynb)
+* [Learn an n-gram model to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/n-gram.ipynb)
+* [Train a decoder-only transformer to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/transformer.ipynb)