anakin

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

⭐ 4,385 stars on GitHub · 🍴 181 forks · 📜 License: agpl-3.0 · 💻 Language: Go

What is anakin?

An open-source AI/LLM project — run models locally, no cloud data sharing, fully customizable to your needs.

Main components

• Handler chain with fallback — HTTP fetch → anti-detect browser → external API. Each handler tries in order; if one fails, the next picks up automatically. Most pages resolve on the free local HTTP ...
• Custom API handlers — plug in any third-party scraping service as a chain fallback. Only invoked when local handlers fail — saves 90%+ on API costs vs routing everything through a paid service. Bui...
• Domain configs — per-domain scraping strategies: choose which handlers to use, set timeouts, retries, custom headers, block domains, and validate content with pattern matching. Docs →
• Failure detection — define failure patterns and required patterns per domain. If the scraped content matches a failure pattern (e.g. CAPTCHA page) or misses a required pattern, the job auto-retries...
• Anti-detect browser — Camoufox (anti-detect Firefox) with realistic fingerprints, not headless Chrome. Docs →
• Proxy auto-select — Thompson Sampling picks the best proxy per domain, learning from success/failure in real time. Docs →
• Structured JSON extraction — use Gemini AI to extract structured data from any page (bring your own API key)
• Sync + async + batch API — POST /v1/scrape for instant results, /v1/url-scraper for async with polling, batch up to 10 URLs

The biggest strength is fully local AI inference — zero API cost, no data leak risk, low latency.

Best for AI devs, researchers, anyone building agents/chatbots without OpenAI dependency.

Topics: the project is tagged with popular topics:

• 🏷️ ai
• 🏷️ anti-detect
• 🏷️ golang
• 🏷️ markdown
• 🏷️ open-source
• 🏷️ playwright
• 🏷️ scraper
• 🏷️ self-hosted
• 🏷️ web-crawler
• 🏷️ web-scraping

Quick install

The project supports Docker Compose:

git clone https://github.com/Anakin-Inc/anakin.git
cd anakin
docker compose up -d

Check the README in the repo for required env variables.

Minimum system requirements

⚡ Deploy fast on VSIS

Use the VSIS VPS Standard 4GB RAM / 2 vCPU / 50GB SSD (~150k/tháng) plan from VSIS.NET — high-speed VN-based VPS, 24/7 support, ideal for running anakin smoothly.

🎯 Benefits:

• One-command docker compose up -d deploy in 2 minutes
• Dedicated IPv4, root access, unmetered domestic bandwidth
• Daily snapshot backup
• Free install assistance from the VSIS team

👉 See matching VPS plans at vsis.net

Resources

• 🔗 GitHub: Anakin-Inc/anakin
• 🌐 Homepage: https://anakin.io
• 📚 Official docs: see README in the repo
• 💬 Community: GitHub Issues + Discussions

Article compiled from GitHub data on 15/09/2026. Star/fork counts may have changed — see live numbers via the GitHub link.