Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1.1k 91

  2. rag-api-server rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 30 8

  3. workshops workshops Public

    8 1

  4. docs docs Public

    JavaScript 3 5

Repositories

Showing 10 of 18 repositories
  • LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/LlamaEdge’s past year of commit activity
    Rust 1,070 Apache-2.0 91 2 (1 issue needs help) 2 Updated Nov 2, 2024
  • rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    LlamaEdge/rag-api-server’s past year of commit activity
    Rust 30 Apache-2.0 8 9 2 Updated Nov 1, 2024
  • sd-proxy-server Public
    LlamaEdge/sd-proxy-server’s past year of commit activity
    Rust 1 0 0 0 Updated Oct 28, 2024
  • www Public

    Public website

    LlamaEdge/www’s past year of commit activity
    HTML 0 3 0 0 Updated Oct 27, 2024
  • sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/sd-api-server’s past year of commit activity
    Rust 13 2 3 0 Updated Oct 24, 2024
  • llama-proxy-server Public
    LlamaEdge/llama-proxy-server’s past year of commit activity
    Rust 0 0 0 0 Updated Oct 23, 2024
  • whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/whisper-api-server’s past year of commit activity
    Rust 10 3 0 0 Updated Oct 17, 2024
  • tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/tts-api-server’s past year of commit activity
    Rust 4 1 0 0 Updated Oct 12, 2024
  • docs Public
    LlamaEdge/docs’s past year of commit activity
    JavaScript 3 Apache-2.0 5 0 1 Updated Oct 7, 2024
  • search-api-server Public

    An extended version of the LlamaEdge API Server with web search. In development.

    LlamaEdge/search-api-server’s past year of commit activity
    Rust 3 0 4 0 Updated Sep 10, 2024
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…