Docker image to serve a LLM on vLLM using Huggingface inference endpoints DockerHub image
Go to deploy a model on huggingface
Use the image under advanced settings:
docker.io/tsunkaraneni/vllm-openai-hf:latest
Optionally set any vLLm env variables
-
Notifications
You must be signed in to change notification settings - Fork 0
TSunny007/vllm-openai-hf
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Docker image to serve a LLM on vLLM using Huggingface inference endpoints
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published