AgentIndex icon
AgentIndex
ToolsCategoriesTrendingNewCompare
Submit Tool
Home/
Workflow Automation/
librecrawl-mcp
librecrawl-mcp logo

librecrawl-mcp

Active·★ 16·Updated 2026-05-28
★ Trending★ Hidden Gem

Self-hosted SEO crawler for Claude — Screaming Frog-level audits, unlimited pages, 1-click install. 19 MCP tools.

LibreCrawl MCP is a self-hosted SEO crawler that provides comprehensive website audits at no per-crawl cost, designed to integrate with any MCP-compatible AI agent. It offers a wide range of SEO checks, including broken links, Core Web Vitals, and GSC integration, delivering natural language audit reports.

#SEO#Web Crawling#AI Tools#Self-hosted#Website Audit#API Integration#Performance Monitoring#Data Analysis
$ Install
$ curl -fsSL https://raw.githubusercontent.com/adityaarsharma/librecrawl-mcp/main/install.sh | bash
↗ Visit site★ GitHub
01

Features

01Comprehensive SEO Audit Report Engine: Generates structured Markdown reports with 37 checks and 17 sections, surpassing Screaming Frog in scope.
02Crawl Large Sites Politely and in Chunks: Designed to handle sites of any size without overloading the target server, allowing crawls to be paused and resumed across multiple sessions.
03Integration with Google Search Console: Merges GSC indexing errors, top queries, and quick wins into audit reports for a complete picture.
04AI-native Audit Engine with 20 Specialized Tools: Empowers AI agents with a suite of SEO tools, allowing audits to be triggered and interpreted through natural language.
05Self-hosted with Zero Per-Crawl Cost: Runs locally on your machine or server, ensuring no cloud fees or data leaving your environment.
02

Compatibility

Python
Runtime
Verified via docs
Docker
Container
Verified via docs
Linux
OS
Verified via docs
MacOS
OS
Verified via docs
AI Agent (MCP)
Integration
Verified via docs
03

Quick start

1
$ curl -fsSL https://raw.githubusercontent.com/adityaarsharma/librecrawl-mcp/main/install.sh | bash
04

Use cases

↳Conducting comprehensive SEO audits for websites of any size, from small blogs to large enterprises.
↳Automating the detection and reporting of technical SEO issues such as broken links, orphan pages, canonical errors, and missing schema markup.
↳Integrating advanced SEO analysis directly into AI agent workflows for natural language interaction and automated fix plan generation.
↳Monitoring website performance metrics like Core Web Vitals and integrating Google Search Console data for indexing and query insights.
05

Alternatives

Gemini CLI logo
Gemini CLI★ 104.7k
An open-source AI agent that brings the power of Gemini directly into your terminal. Supports native MCP.
vs →
dagster logo
dagster★ 15.6k
An orchestration platform for the development, production, and observation of data assets.
vs →
OpenClaw logo
OpenClaw★ 375.5k
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
vs →
mindsdb logo
mindsdb★ 39.2k
Federated Query Engine for AI - The only MCP Server you'll ever need
vs →
Claude Flow logo
Claude Flow★ 56.4k
The leading agent orchestration platform for Claude. Deploy intelligent multi-agent swarms.
vs →
genai-toolbox logo
genai-toolbox★ 15.4k
MCP Toolbox for Databases is an open source MCP server for databases.
vs →
mcp-chrome logo
mcp-chrome★ 11.8k
Chrome MCP Server is a Chrome extension-based Model Context Protocol (MCP) server that exposes your Chrome browser functionality to AI assistants like Claude, enabling complex browser automation, content analysis, and semantic search.
vs →
TrendRadar logo
TrendRadar★ 58.6k
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅,支持关键词精准筛选。AI 翻译 + AI 分析简报直推手机,也支持接入 MCP 架构,赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。
vs →
See all alternatives →

Related searches

librecrawl-mcp AlternativesBest Workflow Automation Tools 2026Open Source Workflow Automationlibrecrawl-mcp Tutoriallibrecrawl-mcp Vs CompetitorsSEOWeb CrawlingAI Tools

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Compatibility03Quick start04Use cases05Alternatives
Stats
GitHub Stars★ 16
Last commit2d ago
StatusActive
License—
CategoryWorkflow Automation
Trend (30d)
+0.6↑ 1.5%
Links
Documentation↗Discussion↗Issues↗Releases↗

Deploy on DigitalOcean — Get $200 Free Credit

Ad
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
QYSGitHubBuy me a coffee ☕

Browse by Category

Code AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.