Text Generation Webui
Supports multiple local text generation backends, including llama.cpp, Transformers, ExLlamaV3, ExLlamaV2, and TensorRT-LLM (the latter via its own Dockerfile). Easy setup: Choose between portable builds (zero setup, just unzip and run) for GGUF models on Windows/Linux/macOS, or the one-click installer that creates a self-contained installerfiles directory. 100% offline and private, with zero telemetry, external resources, or remote update requests. File attachments: Upload text files, PDF documents, and.docx documents to talk about their contents. Vision (multimodal models): Attach images to messages for visual understanding (tutorial). Web search: Optionally search the internet with LLM-generated queries to add context to the conversation. Aesthetic UI with dark and light themes. Syntax highlighting for code blocks and LaTeX rendering for mathematical expressions. instruct mode for instruction-following (like ChatGPT), and chat-instruct/chat modes for talking to custom characters. Automatic prompt formatting using Jinja2 templates. You don't need to ever worry about prompt formats. Edit messages, navigate between message versions, and branch conversations at any point. Multiple sampling parameters and generation options for sophisticated text generation control. Switch between different models in the UI without restarting. Automatic GPU layers for GGUF models (on NVIDIA GPUs). Free-form text generation in the Notebook tab without being limited to chat turns. OpenAI-compatible API with Chat and Completions endpoints, including tool-calling support, see examples. Extension support, with numerous built-in and user-contributed extensions available. See the wiki and extensions directory for details. No installation needed, just download, unzip and run. All dependencies included. Compatible with GGUF (llama.cpp) models on Windows, Linux, and macOS.
View Text Generation Webui on GitHub
Supports multiple local text generation backends, including llama.cpp, Transformers, ExLlamaV3, ExLlamaV2, and TensorRT-LLM (the latter via its own Dockerfile). Easy setup: Choose between portable builds (zero setup, just unzip and run) for GGUF models on Windows/Linux/macOS, or the one-click installer that creates a self-contained installerfiles directory. 100% offline and private, with zero telemetry, external resources, or remote update requests. File attachments: Upload text files, PDF documents, and.docx documents to talk about their contents. Vision (multimodal models): Attach images to messages for visual understanding (tutorial). Web search: Optionally search the internet with LLM-generated queries to add context to the conversation. Aesthetic UI with dark and light themes. Syntax highlighting for code blocks and LaTeX rendering for mathematical expressions. instruct mode for instruction-following (like ChatGPT), and chat-instruct/chat modes for talking to custom characters. Automatic prompt formatting using Jinja2 templates. You don't need to ever worry about prompt formats. Edit messages, navigate between message versions, and branch conversations at any point. Multiple sampling parameters and generation options for sophisticated text generation control. Switch between different models in the UI without restarting. Automatic GPU layers for GGUF models (on NVIDIA GPUs). Free-form text generation in the Notebook tab without being limited to chat turns. OpenAI-compatible API with Chat and Completions endpoints, including tool-calling support, see examples. Extension support, with numerous built-in and user-contributed extensions available. See the wiki and extensions directory for details.
No installation needed, just download, unzip and run. All dependencies included.
Compatible with GGUF (llama.cpp) models on Windows, Linux, and macOS.
Text Generation Webui at a glance
| Language | Python |
|---|---|
| License | AGPL-3.0 |
| Last update | 2025-10-24 |
| Contributors | 375 |
How to install Text Generation Webui
bash git clone https://github.com/oobabooga/text-generation-webui
Navid Moazzez
AI business strategist & AI OS builder
Navid Moazzez helps creators and founders master AI and build their own AI Operating System (AI OS) to automate their business and life.
Navid.me is reader-supported. When you buy through links on this site, I may earn an affiliate commission. Learn more.
More repo topics
More free tools
X
Bluesky
LinkedIn
Threads
Mastodon
Instagram
TikTok
Pinterest
YouTube
Amazon KDP
Apple Books
Amazon
Substack
Spotify
Apple Podcasts
Related MCP servers & CLIs
Free AI newsletterThe most actionable AI newsletter for founders
Every week, get proven AI strategies, curated tools, and step-by-step systems to grow your audience, create better content, and build a profitable creator business.
No fluff, no filler, no BS. Just five minutes each week that might level up your online business and life.
P.S. Sign up now to get free access to my ultimate AI tools guide for creators.
