Tools Categories Trending New Compare Guides

Tools Categories Trending New Compare Guides

Browser Automation/

crw

crw

Active·★ 1.1k·AGPL-3.0·Updated 2026-10-06

★ Trending★ Essential

fastCRW is a high-performance engine designed to transform URLs into clean markdown or structured JSON. It provides a unified solution for web searching, scraping, mapping, crawling, and data extraction, available as a local Rust binary or a managed API.

#Web Scraping#Data Extraction#Content Transformation

© 2026 AgentIndex.app|Built by a 10-year iOS Developer.

About Contact Privacy Policy Terms of Use QYS GitHub Buy me a coffee ☕

Browse by Category

Code Assistant Workflow Automation RAG / Knowledge Base Multi-Agent Browser Automation LLM Infra Dev Tooling Observability

Not affiliated with Anthropic, OpenAI or Microsoft.

#Web Crawler

#API

#CLI

#AI Agent Tooling

#Rust

$ Install

$ curl -fsSL https://fastcrw.com/install | sh

↗ Visit site ★ GitHub

01

Features

01Scrape one URL to markdown, HTML, links, screenshots, or schema JSON

02Crawl a bounded site and collect its pages

03Map and discover URLs without scraping every page

04Search the web and optionally scrape selected results

05Extract structured fields from one or many URLs

02

Compatibility

Rust

Runtime

Verified via docs

MacOS

OS

Verified via docs

Linux

OS

Verified via docs

Python

SDK

Verified via docs

Node.js

SDK

Verified via docs

AI Agents (MCP)

Integration

Verified via docs

03

Quick start

1

$ curl -fsSL https://fastcrw.com/install | sh

04

Use cases

↳Converting web pages into structured data (markdown/JSON) for further processing or storage.

↳Building AI agents that require real-time and structured information from the web.

↳Collecting data for market research, competitive analysis, or content aggregation.

↳Monitoring website changes or tracking specific data points across multiple pages.

↳Integrating web data extraction capabilities into custom applications via SDKs or REST API.

05

Alternatives

mcp-chrome★ 12.5k

Chrome MCP Server is a Chrome extension-based Model Context Protocol (MCP) server that exposes your Chrome browser functionality to AI assistants like Claude, enabling complex browser automation, content analysis, and semantic search.

Scrapling★ 86.0k

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Gemini CLI★ 107.2k

An open-source AI agent that brings the power of Gemini directly into your terminal. Supports native MCP.

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page

01Features 02Compatibility 03Quick start 04Use cases 05Alternatives

Stats

GitHub Stars★ 1.1k

Last commit

GPT Researcher★ 29.9k

An autonomous agent that conducts deep research on any data using any LLM provider, producing detailed reports with citations from web and local sources.

Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

A CLI tool for building Go applications.

grafbase★ 1.2k

The Grafbase GraphQL Federation Gateway

See all alternatives →

1d ago

StatusActive

LicenseAGPL-3.0

CategoryBrowser Automation

Trend (30d)

+0k↑ 3.5%

Links

Documentation↗Discussion↗Issues↗Releases↗

Deploy on DigitalOcean — Get $200 Free Credit