SGLang is a fast serving framework for large language models and vision language models.

Convert pdf and image files into markdown

Benchmarking Agentic LLM and VLM Reasoning On Games

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

一个精选的 Gaussian Splatting 资源列表，受到 awesome-computer-vision 的启发。

This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"

A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ollama, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage neo4j KG, graphRAG / RAG / html 2 img

Fluid-Structure Interaction Analysis Using FEM and UVLM

Yet another set of LLM nodes for ComfyUI (for local/remote OpenAI-like APIs, multi-modal models supported)

Enhance and modify high-quality compositions using real-time rendering and generative AI output without affecting a hero product asset.

A hands-on repository dedicated to building mainstream deep learning models from scratch using PyTorch

Multi-modal Chatbot based on OpenAI

RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)