unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

⭐ 78,186 stars on GitHub · 🍴 7,224 forks · 📜 License: apache-2.0 · 💻 Language: Python

What is unsloth?

An open-source AI/LLM project — run models locally, no cloud data sharing, fully customizable to your needs.

The biggest strength is fully local AI inference — zero API cost, no data leak risk, low latency.

Best for AI devs, researchers, anyone building agents/chatbots without OpenAI dependency.

Topics: the project is tagged with popular topics:

• 🏷️ agent
• 🏷️ ai
• 🏷️ chatgpt
• 🏷️ deepseek
• 🏷️ fine-tuning
• 🏷️ gemma
• 🏷️ image-generation
• 🏷️ llama
• 🏷️ llm
• 🏷️ llms

📸 Screenshots

Quick install

See the README for detailed install instructions. Most projects support Docker — if the repo has a Dockerfile, use:

git clone https://github.com/unslothai/unsloth.git
cd unsloth
docker build -t unsloth .
docker run -d -p 8080:8080 unsloth

Minimum system requirements

⚡ Deploy fast on VSIS

Use the VSIS VPS Standard 4GB RAM / 2 vCPU / 50GB SSD (~150k/tháng) plan from VSIS.NET — high-speed VN-based VPS, 24/7 support, ideal for running unsloth smoothly.

🎯 Benefits:

• One-command docker compose up -d deploy in 2 minutes
• Dedicated IPv4, root access, unmetered domestic bandwidth
• Daily snapshot backup
• Free install assistance from the VSIS team

👉 See matching VPS plans at vsis.net

Resources

• 🔗 GitHub: unslothai/unsloth
• 🌐 Homepage: https://unsloth.ai/docs
• 📚 Official docs: see README in the repo
• 💬 Community: GitHub Issues + Discussions

Article compiled from GitHub data on 17/10/2026. Star/fork counts may have changed — see live numbers via the GitHub link.