Skip to content

Commit

Permalink
wip
Browse files Browse the repository at this point in the history
  • Loading branch information
balancap committed Aug 15, 2024
1 parent 49090bc commit 56795c2
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion docs/JAX FP8 matmul tutorial.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,16 @@
"id": "f878aaba-ce22-42d3-89e3-ad7f22b6f75c",
"metadata": {},
"source": [
"## FP8 in machine learning quickstart\n",
"## Quickstart: FP8 in deep learning\n",
"\n",
"The latest generation of machine learning hardware (Nvidia H100, AMD MI300, Graphcore C600, ...) have integrated direct FP8 support in the hardware, improving energy efficiency and throughput.\n",
"\n",
"![image](img/fp-formats.webp)\n",
"\n",
"\n",
"\n",
"### References\n",
"\n",
"\n",
"* Two FP8 datatypes;\n",
"* Why?\n",
Expand Down
Binary file added docs/img/fp-formats.webp
Binary file not shown.

0 comments on commit 56795c2

Please sign in to comment.