This is a simple Dockerized FastAPI application that returns a JSON response. It uses ollama to run llama3 model inside a docker container and serve the model as a FastAPI application.
The video tutorial is here: https://www.youtube.com/bitfumes
-
Notifications
You must be signed in to change notification settings - Fork 8
bitfumes/ollama-docker-fastapi
About
Run ollama llama3 model on docker with fastapi
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published