Scrapling
Scrapling is an adaptive Python web scraping framework that scales from a single request to a full crawl. Its standout idea is adaptive parsing: elements you select can be saved and automatically relocated when a website's layout changes, so scrapers break less often. It combines fast HTTP fetching that can impersonate browser fingerprints, full browser automation for dynamic pages, and a Scrapy-like spider framework.
It suits developers and data teams collecting public web data, and AI builders who want agents to fetch and extract web content. The spider framework supports concurrency limits, per-domain throttling, automatic retry of blocked requests, pause and resume, streaming results and exports to JSON, CSV and XML, with optional robots.txt compliance. An MCP server lets AI assistants use Scrapling directly, and an interactive shell helps you develop selectors.
Getting started: requires Python 3.10+. Install with `pip install scrapling`; for browser-based fetchers install `scrapling[fetchers]` and run `scrapling install`, and for the MCP server install `scrapling[ai]`.
Features
Why choose it
Trade-offs
Maintenance check
- Last commit
- 2026-11-08
- Commits, last 90 days
- 100+
- Releases, last 90 days
- 4
- Latest release
- v0.5.1 (2026-11-04)
- Open issues
- 16
- Recent issues with at least one comment
- 6/9
Oldest week on the left; the latest four weeks are orange. Source: GitHub commit activity.
Status rule: archived on GitHub = Archived; last commit within 90 days = Active; 91 to 365 days = Slowing; older = Stale. All figures come from the GitHub API on the date shown.
Most discussed open issues
- #563 <base href> ignored when resolving relative URLs1 comments · 2026-11-05
- #558 Response.follow() inherits credentials when following links to a different origin0 comments · 2026-11-05
- #557 cannot access online sites like coupang.0 comments · 2026-11-04
Issue titles are quoted from GitHub. Open the link to check whether a problem still applies to the version you use.
Who it fits
- You need an ultra-fast, adaptive Python web scraping engine that handles modern anti-bot challenges (Cloudflare, fingerprinting) effortlessly.
- You want flexible fetchers ranging from lightweight HTTP to full headless browsers with intelligent element extraction.
- You need a full-blown mobile app automation framework; mobile-mcp covers iOS and Android devices.
- You need an enterprise distributed crawling queue with persistent database scheduling out of the box.
How it differs
Scrapling is a high-speed Python web scraping engine built for modern websites and anti-bot bypass. mobile-mcp controls mobile OS screens and mobile applications via MCP.
Compatibility
Quick start
Use cases
Alternatives
Featured in these lists
Comments
No comments yet. Be the first!