fitter
Active·★ 133·MIT·Updated 2026-08-29
Fitter is a declarative tool that transforms any website or API into structured JSON, eliminating the need for brittle scraping scripts. It's designed for AI agents, allowing Large Language Models to author, validate, and execute data extraction pipelines locally, on demand.
#Web Scraping#Data Extraction#AI Agents#Declarative Configuration#LLM Integration#Browser Automation#Structured Data#API Integration
01
Features
01Declarative & Auditable Configuration: AI agents produce readable, savable, and re-runnable configurations instead of throwaway code.
02Local-first Data Fetching: All data fetching occurs on the user's machine, eliminating reliance on third-party scraping APIs or per-request billing.
03Batteries Included: Provides a comprehensive set of tools including HTTP client, headless browser (Playwright/Chromium/Docker), various parsers (JSON, HTML, XML, XPath), pagination, caching, and rate-limiting.
04Multiple Usage Modes: Can be used as an MCP server for AI clients, an AI-powered CLI agent, a local CLI, an embeddable Go library, or a long-running service.
05LLM Integration via MCP: Exposes a Model Context Protocol (MCP) server, enabling Claude Code, Claude Desktop, and other MCP clients to author and run scraping pipelines.
02
Compatibility
Go
Runtime
Verified via docs
Docker
Containerization
Verified via docs
Headless Browser
Data Source
Verified via docs
Claude/MCP
AI Integration
Verified via docs
Linux
OS
Verified via docs
MacOS
OS
Verified via docs
03
Quick start
1
$ go build -o fitter_mcp ./cmd/mcp
2
$ claude mcp add fitter -s user -- "$(pwd)/fitter_mcp"
04
Use cases
↳Scrape data from websites without APIs and enrich it with data from external APIs (e.g., GitHub trending repos scraped from HTML, then enriched via GitHub REST API).
↳Extract structured information from dynamic web pages using headless browsers for JavaScript-rendered content.
↳Automate data collection for AI agents, allowing them to dynamically generate and execute data extraction configurations based on natural language requests.
↳Generate static data sequences or transform data fields based on calculated expressions.
↳Write extracted results to local files in various formats (e.g., CSV) for reporting or further processing.
05
Alternatives
PyScrappy★ 263
Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.
mcp-playwright★ 5.7k
Playwright Model Context Protocol Server - Tool to automate Browsers and APIs in Claude Desktop, Cline, Cursor IDE and More 🔌
invisible_playwright_mcp★ 876
Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use.
mcp-maigret★ 270
MCP server that lets AI agents run maigret, an OSINT tool that searches a username across thousands of sites
perplexity-webui-scraper★ 137
An advanced, high-performance Python client, MCP server, and REST API for reverse-engineering Perplexity AI's WebUI.
mcp-browser-use★ 62
FastAPI server implementing MCP protocol Browser automation via browser-use library.
Comments
Log in to leave a comment
No comments yet. Be the first!