Skip to content
Outlines 〰️
ExllamaV2
Initializing search
outlines-dev/outlines
Home
Getting Started
Cookbook
Docs
API Reference
Community
Blog
Outlines 〰️
outlines-dev/outlines
Home
Getting Started
Getting Started
Welcome to Outlines
Installation
Quickstart
Licence
Cookbook
Cookbook
Classification
Named Entity Extraction
Generate synthetic data
Summarize a document
Playing chess
Perspective-taking prompting
Question-answering with citations
Knowledge Graph Extraction
Run on the cloud
Run on the cloud
BentoML
Cerebrium
Modal
Docs
Docs
Generation
Generation
Text
Samplers
Structured generation
Structured generation
Classification
Regex
Type constraints
JSON (function calling)
JSON mode
Grammar
Custom FSM operations
Utilities
Utilities
Serve with vLLM
Custom types
Prompt templating
Outlines functions
Models
Models
Open source
Open source
Transformers
Llama.cpp
vLLM
TGI
ExllamaV2
MLX
Mamba
API
API
OpenAI
API Reference
API Reference
Models
Prompts
Json schema
Guide
Parsing
Regex
Samplers
Community
Community
Feedback 🫶
Chat with us ☕
How to contribute 🏗️
Your projects 👏
Versioning Guide 📌
Blog
ExllamaV2
pip
install
exllamav2
transformers
torch
Coming soon