From e490114a9265c6d5bdf75a4d3df3b3cb53b806a4 Mon Sep 17 00:00:00 2001
From: Parsiad Azimzadeh <parsiad.azimzadeh@gmail.com>
Date: Thu, 29 Aug 2024 19:43:16 -0400
Subject: [PATCH] Add features to README

---
 README.md | 18 ++++++++++++++++++
 1 file changed, 18 insertions(+)

diff --git a/README.md b/README.md
index bc54599..a65acc3 100644
--- a/README.md
+++ b/README.md
@@ -27,3 +27,21 @@ sys.path.insert(0, os.path.expanduser("~/micrograd-pp/python"))
 * [Train a simple feedforward neural network on MNIST to classify handwritten digits](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/mnist.ipynb)
 * [Learn an n-gram model to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/n-gram.ipynb)
 * [Train a decoder-only transformer to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/transformer.ipynb)
+
+## Features
+
+* Layers
+  * ☒ BatchNorm1d
+  * ☒ Dropout
+  * ☒ Embedding
+  * ☒ LayerNorm
+  * ☒ Linear
+  * ☒ MultiheadAttention
+  * ☒ ReLU
+  * ☒ Sequential
+* Optimizers
+  * ☐ Adam
+  * ☒ Stochastic Gradient Descent (SGD)
+* Misc.
+  * ☒ Reverse-mode automatic differentiation (`.backward`)
+  * ☒ GPU support