AgentIndex icon
AgentIndex
chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
fitter logo
fitter
★ 133

chinese-llm-benchmark vs fitter

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; fitter: Fitter is a declarative tool that transforms any website or API into structured JSON, eliminating the need for brittle scraping scripts. It's designed for AI agents, allowing Large Language Models to author, validate, and execute data extraction pipelines locally, on demand.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

Read chinese-llm-benchmark full review →
fitter logo
fitterLLM Infra · ★ 133

Scrape data from websites without APIs and enrich it with data from external APIs (e.g., GitHub trending repos scraped from HTML, then enriched via GitHub REST API).

Read fitter full review →
02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
fitter logofitter
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 133
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
go build -o fitter_mcp ./cmd/mcp && claude mcp add fitter -s user -- "$(pwd)/fitter_mcp"
Updated
2d ago
1mo ago
Open Source
Yes
Yes
Website
↗ Visit
↗ Visit
GitHub
↗ GitHub
↗ GitHub
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
Web Scraping, Data Extraction, AI Agents
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
fitter logofitter
01Declarative & Auditable Configuration: AI agents produce readable, savable, and re-runnable configurations instead of throwaway code.
02Local-first Data Fetching: All data fetching occurs on the user's machine, eliminating reliance on third-party scraping APIs or per-request billing.
03Batteries Included: Provides a comprehensive set of tools including HTTP client, headless browser (Playwright/Chromium/Docker), various parsers (JSON, HTML, XML, XPath), pagination, caching, and rate-limiting.
04Multiple Usage Modes: Can be used as an MCP server for AI clients, an AI-powered CLI agent, a local CLI, an embeddable Go library, or a long-running service.
05LLM Integration via MCP: Exposes a Model Context Protocol (MCP) server, enabling Claude Code, Claude Desktop, and other MCP clients to author and run scraping pipelines.
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
fitter logofitter
↳Scrape data from websites without APIs and enrich it with data from external APIs (e.g., GitHub trending repos scraped from HTML, then enriched via GitHub REST API).
↳Extract structured information from dynamic web pages using headless browsers for JavaScript-rendered content.
↳Automate data collection for AI agents, allowing them to dynamically generate and execute data extraction configurations based on natural language requests.
↳Generate static data sequences or transform data fields based on calculated expressions.
↳Write extracted results to local files in various formats (e.g., CSV) for reporting or further processing.
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
fitter logofitter
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and fitter?
Both chinese-llm-benchmark and fitter are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while fitter has 133 stars.
Which is better, chinese-llm-benchmark or fitter?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and fitter if Scrape data from websites without APIs and enrich it with data from external APIs (e.g., GitHub trending repos scraped from HTML, then enriched via GitHub REST API)..
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is fitter free or open source?
Yes, fitter is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related

Alternatives to chinese-llm-benchmark →Alternatives to fitter →chinese-llm-benchmark details →fitter details →