From 400df51d563e471af0adad2d2f4d0af317e5aeef Mon Sep 17 00:00:00 2001 From: akshay-anyscale <122416226+akshay-anyscale@users.noreply.github.com> Date: Tue, 28 May 2024 11:51:41 -0700 Subject: [PATCH] Update README.md for rayllm Signed-off-by: akshay-anyscale <122416226+akshay-anyscale@users.noreply.github.com> --- README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/README.md b/README.md index 9167ca1d..ac8bab19 100644 --- a/README.md +++ b/README.md @@ -1,3 +1,10 @@ +============================ +# Archiving Ray LLM + +We had started RayLLM to simplify setting up and deploying LLMs on top of Ray Serve. In the past few months, vLLM has made significant improvements in ease of use. We are archiving the RayLLM project and instead adding some examples to our Ray Serve docs for deploying LLMs with Ray Serve and vLLM. This will reduce another library for the community to learn about and greatly simplify the workflow to serve LLMs at scale. We also recently launched Hosted Anyscale where you can serve LLMs with Ray Serve with some more capabilities out of the box like multi-lora with serve multiplexing, JSON mode function calling and further performance enhancements. + + +============================ # RayLLM - LLMs on Ray The hosted Aviary Explorer is not available anymore.