Skip to content

Commit

Permalink
adds start of axolotl notebook
Browse files Browse the repository at this point in the history
  • Loading branch information
djliden committed Mar 26, 2024
1 parent 76d5f35 commit 5534873
Showing 1 changed file with 22 additions and 0 deletions.
22 changes: 22 additions & 0 deletions 5_gemma_2b_axolotl/gemma_2b_axolotl.ipynb
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Getting Started with Axolotl: Fine-Tuning Gemma 2B\n",
"\n",
"Axolotl is \"a tool designed to streamline the fine-tuning of various AI models.\" It is primarily for training Hugging Face models via full fine-tuning, lora, qlora, relora, gptq. Configurations are specified in yaml files. It supports a variety of different dataset formats. It supports additional libraries such as xformer and flash attention. It is compatible with FSDP and deepspeed for multi-gpu training. It supports logging to MLflow or WandB.\n",
"\n",
"# The recommended workflow is to pick a quickstart notebook from the [examples](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main/examples) directory and modify it as needed.\n"
]
}
],
"metadata": {
"language_info": {
"name": "python"
}
},
"nbformat": 4,
"nbformat_minor": 2
}

0 comments on commit 5534873

Please sign in to comment.