lmdeploy

Here are 4 public repositories matching this topic...

shell-nlp / gpt_server

gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。

tts openai llama gpt infinity embedding text-moderation llm prompt-injection vllm fastchat function-calling rerank lmdeploy

Updated Jan 2, 2025
Python

In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or a dose of sharp retorts to let off steam, FunGPT has got you covered.

bot ai deploy emotion tts asr finetune llm boostbot banterbot internlm2 xtuner lmdeploy

Updated Dec 12, 2024
Python

wtlow003 / modal-llm-serving

Star

Examples of serving LLM on Modal.

modal openai model-serving openai-api llm vllm sglang lmdeploy

Updated Jun 13, 2024
Python

csg2008 / internlm2_lmdeploy_demo

Star

书生浦语 LMDeploy 部署实验

internlm2 lmdeploy

Updated Apr 25, 2024
Python

Improve this page

Add a description, image, and links to the lmdeploy topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the lmdeploy topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly