Releases: lightonai/vllm
Releases · lightonai/vllm
v0.4-custom.1
- Falcon/Alfred LoRA support
- Read LoRAs params from env vars
- Add SageMaker support for LoRAs
- Add the
/loras
endpoint to add LoRAs while the server is running
v0.4-canary.3
- Read LoRAs params from env vars
v0.4-canary.2
- Add SageMaker support for LoRAs
- Add the
/loras
endpoint to add LoRAs while the server is running