finetune adds infctx repo

RWKV · Sep 16, 2023 · b55dc30 · b55dc30
1 parent efee274
commit b55dc30
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/docs/advance/finetune.md b/docs/advance/finetune.md
@@ -29,6 +29,12 @@ Alternatively, you can use the official repo, to finetune the project without Lo
 
 - [https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v4neo](https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v4neo)
 
+Alternatively would be to do finetuning using the infctx trainer
+
+- [https://github.com/RWKV/RWKV-infctx-trainer/](https://github.com/RWKV/RWKV-infctx-trainer/)
+
+In general, use the BlinkDL trainer for better raw performance, and use infctx to trade in some speed for infctx size support.
+
 ## Training a model from scratch?
 
 Refer to the main project