Navid MoazzezNavid Moazzez

Unsloth

Unsloth lets you run, train, and deploy AI models locally, with support for all types of models. Run and train LLMs, diffusion, embedding, audio models: Kimi K3, MiniMax-H3, Qwen3.8, Muse Glimmer, DeepSeek-V4, Gemma 4. Agents & Tools: Use local models with Claude Code, Codex, and MCP, including tool calling and code execution. Search & RAG: Use private and unlimited web search, deep research, and RAG. Image and video: Run and train image and video diffusion or multimodal models Audio: Use private and unlimited web search, deep research, and RAG. Hardware: Supports CPU, NVIDIA, AMD, Intel, macOS, and multi GPU setups. Remote Access: Access your local models remotely through secure Cloudflare HTTPS. Fine-tuning: Train LLMs, diffusion, TTS, and embedding models 2× faster with 70% less VRAM Complete support: Supports reinforcement learning, LoRA, QLoRA, full fine tuning, pretraining, RL, GRPO, DPO, and FP8. Export & Deploy: Export or Deploy models with including GGUF, NVFP4, FP8 and more formats. Datasets: Build datasets from PDFs, CSVs, DOCX files, and more with Data Recipes. OpenAI Compatible API: Serve models through an OpenAI compatible API and also connect to cloud providers Unsloth Start connects Claude Code, Codex and other agents to local models with one command. Unsloth can be used in three ways: Unsloth Desktop, the desktop app; Unsloth Studio, the web UI; or Unsloth Core, the code based version.

View Unsloth on GitHub
Navid Moazzezby Navid Moazzez·Updated Sept 30, 2026·2 min read
Unsloth

Unsloth lets you run, train, and deploy AI models locally, with support for all types of models. Run and train LLMs, diffusion, embedding, audio models: Kimi K3, MiniMax-H3, Qwen3.8, Muse Glimmer, DeepSeek-V4, Gemma 4. Agents & Tools: Use local models with Claude Code, Codex, and MCP, including tool calling and code execution. Search & RAG: Use private and unlimited web search, deep research, and RAG. Image and video: Run and train image and video diffusion or multimodal models Audio: Use private and unlimited web search, deep research, and RAG. Hardware: Supports CPU, NVIDIA, AMD, Intel, macOS, and multi GPU setups. Remote Access: Access your local models remotely through secure Cloudflare HTTPS. Fine-tuning: Train LLMs, diffusion, TTS, and embedding models 2× faster with 70% less VRAM Complete support: Supports reinforcement learning, LoRA, QLoRA, full fine tuning, pretraining, RL, GRPO, DPO, and FP8. Export & Deploy: Export or Deploy models with including GGUF, NVFP4, FP8 and more formats. Datasets: Build datasets from PDFs, CSVs, DOCX files, and more with Data Recipes. OpenAI Compatible API: Serve models through an OpenAI compatible API and also connect to cloud providers

Unsloth Start connects Claude Code, Codex and other agents to local models with one command.

Unsloth can be used in three ways: Unsloth Desktop, the desktop app; Unsloth Studio, the web UI; or Unsloth Core, the code based version.

Unsloth at a glance

Stars77k
Forks7.1k
LanguagePython
LicenseApache-2.0
Last update2026-09-27
Contributors349

How to install Unsloth

bash curl -fsSL https://unsloth.ai/install.sh | sh 

Where Unsloth is listed

Navid Moazzez

AI business strategist & AI OS builder

Navid Moazzez helps creators and founders master AI and build their own AI Operating System (AI OS) to automate their business and life.

Navid.me is reader-supported. When you buy through links on this site, I may earn an affiliate commission. Learn more.

More free tools

Related MCP servers & CLIs

Free AI newsletter

The most actionable AI newsletter for founders

Every week, get proven AI strategies, curated tools, and step-by-step systems to grow your audience, create better content, and build a profitable creator business.

No fluff, no filler, no BS. Just five minutes each week that might level up your online business and life.

P.S. Sign up now to get free access to my ultimate AI tools guide for creators.

Loved by 10,000+ readers