Skip to content

Commit

Permalink
fix: update to remove CUDA limitation of HuggingFace/Canlde
Browse files Browse the repository at this point in the history
  • Loading branch information
danielclough committed Mar 12, 2024
1 parent f78edf2 commit b4a9fd7
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -78,5 +78,4 @@ export FIRESIDE_BACKEND_URL=192.168.1.6 && trunk serve

## Limitations

- Right now `Huggingface/Candle` does not allow for Quantized models to work with `CUDA`.
- I am not testing in Mac or Windows environments, so while everything may work fine I could use some help in order to ensure correctness on those systems.

0 comments on commit b4a9fd7

Please sign in to comment.