chinese-llm-benchmark

★ 6.5k

llm-router

★ 119

chinese-llm-benchmark vs llm-router

Q: Which is better, chinese-llm-benchmark or llm-router?

By GitHub stars, chinese-llm-benchmark has more community adoption, but the best choice depends on your specific use case.

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; llm-router: LLM Router is an MCP server and hook set that intercepts prompts and routes them to the cheapest model that can handle the task, saving 60-80% on costs. It works with Claude Code, VS Code, Cursor, and many other AI coding tools, automatically offloading simple tasks to cheaper models while reserving premium models for complex work.

TL;DR

chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

Read chinese-llm-benchmark full review →

llm-routerLLM Infra · ★ 119

Automatically route simple queries to free/cheap models in AI coding assistants

Read llm-router full review →

Side-by-Side Comparison

Field

chinese-llm-benchmark

llm-router

Features

chinese-llm-benchmark

01Extensive coverage of 337+ commercial and open-source Chinese LLMs.

02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.

03Provides detailed ranking lists for various capabilities and specific domains.

04Offers a large defect library with over 2 million LLM flaws for research and improvement.

05Supports customized model selection and free evaluation services for private models.

llm-router

01Intelligent routing with task classification and cost optimization

0246 tools across 6 categories: smart routing, text, code, filesystem, media, and monitoring

03Support for 20+ providers including Ollama, Gemini, OpenAI, Anthropic, and more

04Budget control with per-provider caps, dashboards, and enforcement modes

05Seamless integration with multiple hosts via MCP and hooks

Use Cases

chinese-llm-benchmark

↳Comparing and selecting the best performing LLMs for specific applications.

↳Identifying weaknesses and improving the capabilities of large language models.

↳Benchmarking private or custom LLMs against public models for performance and cost optimization.

llm-router

↳Automatically route simple queries to free/cheap models in AI coding assistants

↳Reduce costs in Claude Code by offloading low-value prompts to cheaper models

↳Centralized budget management for teams using multiple LLM providers

Best For

chinese-llm-benchmark

EssentialTrending

llm-router

—

FAQ

What is the difference between chinese-llm-benchmark and llm-router?

Both chinese-llm-benchmark and llm-router are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while llm-router has 119 stars.

Which is better, chinese-llm-benchmark or llm-router?

The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and llm-router if Automatically route simple queries to free/cheap models in AI coding assistants.

Is chinese-llm-benchmark free or open source?

Yes, chinese-llm-benchmark is open source on GitHub.

Is llm-router free or open source?

Yes, llm-router is open source on GitHub (MIT).

Cloud Infrastructure

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit

→

Alternatives to chinese-llm-benchmark →Alternatives to llm-router →chinese-llm-benchmark details →llm-router details →

TL;DR

Side-by-Side Comparison

Features

Use Cases

Best For

FAQ

Deploy on DigitalOcean

Related