Structured Text Generation

BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promptfiddle.com playground

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

Experimental Code for StructuredRAG: Structured Outputs in Retrieval-Augmented Generation

Word alignment of multilingual sentences using structured generation

Query language for blending SQL logic and LLM reasoning across structured + unstructured data. [Findings of ACL 2024]

Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)

A gentle tutorial on structured generation using Anthropic and Pydantic

Structured Generation Evals

A fiction machine inspired by Borges

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

Mistral AI Fine-tuning Hackathon

Extract structured data from local or remote LLM models

A guide to structured generation using constrained decoding

Progressively extracts structured information from multi-turn user chats using pydantic schemas and LLMs

Examples of code that use Outlines to enable structured text generation for LLMs running on Modal