AgentIndex icon
AgentIndex
ToolsCategoriesTrendingNewCompare
Submit Tool
Home/
Browser Automation/
anansi
anansi logo

anansi

Active·★ 89·Apache-2.0·Updated 2026-05-18
★ Trending★ Browser Automation★ API Integration

A self-healing web scraper built for hostile sites: selectors repair themselves, browser rendering kicks in when needed, and Chrome TLS fingerprinting evades bot detection. Ships with an MCP server so any LLM can drive a full crawl through conversation.

Anansi is a resilient web scraper that handles adversarial sites, survives redesigns, and improves over time. It features self-healing CSS selectors, automatic browser upgrade, TLS fingerprint mimicry, and adaptive rate limiting. It ships with an MCP server for LLM integration.

© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
QYSGitHubBuy me a coffee ☕

Browse by Category

Code AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.

#adaptive-scraping#ai-agent#anti-bot#crawler#data-extraction#llm-tools#mcp#mcp-server
$ Install
$ pip install "git+https://github.com/mdowis/anansi"
↗ Visit site★ GitHub
01

Features

01Self-healing parser with confidence-scored selectors and four healing strategies
02TLS/HTTP-2 fingerprint mimicry to bypass enterprise bot detection
03Automatic browser upgrade for JavaScript shells and Cloudflare challenges
04Incremental crawling with ETag, Last-Modified, and content hash comparison
05Structured data extraction from JSON-LD, Open Graph, and Microdata
02

Compatibility

Python
Python 3.8+
Verified via docs
03

Quick start

1
$ pip install "git+https://github.com/mdowis/anansi"
04

Use cases

↳Extract structured data from product pages with adaptive selectors
↳Concurrently crawl large websites with resilience and automatic recovery
↳Bypass anti-bot measures for authorized web scraping
05

Alternatives

CopilotKit logo
CopilotKit★ 31.8k
React UI + elegant infrastructure for AI Copilots, AI chatbots, and in-app AI agents. The Agentic Frontend.
vs →
mcp-chrome logo
mcp-chrome★ 11.8k
Chrome MCP Server is a Chrome extension-based Model Context Protocol (MCP) server that exposes your Chrome browser functionality to AI assistants like Claude, enabling complex browser automation, content analysis, and semantic search.
vs →
fastmcp logo
fastmcp★ 25.4k

Related searches

anansi AlternativesBest Browser Automation Tools 2026Open Source Browser Automationanansi Tutorialanansi Vs Competitorsadaptive-scrapingai-agentanti-bot

Comments

Log in to leave a comment
  • S
    Sage DavisMay 24, 2026

    Self-healing selectors that repair themselves on hostile sites is genuinely impressive

  • P
    Parker DavisMar 28, 2026

    Used this for competitive intelligence pipelines where target sites change frequently

  • A
    Alex RiveraMar 20, 2026

    The resilience engineering is thoughtful, handles JavaScript-heavy sites well

  • S
    Shawn AndersonMar 20, 2026

    Most scrapers break when sites update, Anansi adapts instead of failing

On this page
01Features02Compatibility03Quick start04Use cases05Alternatives
Stats
GitHub Stars★ 89
Last commit
🚀 The fast, Pythonic way to build MCP servers and clients.
vs →
FunASR logo
FunASR★ 16.6k
Industrial-grade speech recognition toolkit: 170x realtime, 50+ languages, speaker diarization, emotion detection, streaming, and OpenAI-compatible API.
vs →
nuclear logo
nuclear★ 17.7k
Streaming music player that finds free music for you
vs →
holaOS logo
holaOS★ 5.4k
The agent environment for long-horizon work, continuity, and self-evolution.
vs →
semble logo
semble★ 4.5k
Fast and Accurate Code Search for Agents
vs →
csharp-sdk logo
csharp-sdk★ 4.3k
The official C# SDK for Model Context Protocol servers and clients. Maintained in collaboration with Microsoft.
vs →
See all alternatives →
1w ago
StatusActive
LicenseApache-2.0
CategoryBrowser Automation
Trend (30d)
+3.5↑ 0.7%
Links
Documentation↗Discussion↗Issues↗Releases↗

Deploy on DigitalOcean — Get $200 Free Credit

Ad