chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
houtini-lm logo
houtini-lm
★ 121

chinese-llm-benchmark vs houtini-lm

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; houtini-lm: Houtini LM connects Claude Code to a local LLM server or any OpenAI-compatible API, offloading bounded tasks to reduce token costs. It provides tools, performance tracking, and model routing for efficient delegation. Claude remains the orchestrator for complex reasoning, while cheap local models handle grunt work.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

houtini-lm logo
houtini-lmLLM Infra · ★ 121

Generate test stubs

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
houtini-lm logohoutini-lm
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 121
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
npx -y @houtini/lm
Updated
2d ago
1w ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
ai-agents, claude-mcp, code-generation
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
houtini-lm logohoutini-lm
01Offload bounded tasks to local or cloud LLMs
02Model discovery with HuggingFace metadata enrichment
03Real-time performance tracking (TTFT, tokens/s)
04Structured JSON output via grammar-based sampling
05Think-block stripping for models like GLM and Nemotron
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
houtini-lm logohoutini-lm
↳Generate test stubs
↳Code review and bug finding
↳Draft commit messages
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
houtini-lm logohoutini-lm
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and houtini-lm?
Both chinese-llm-benchmark and houtini-lm are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while houtini-lm has 121 stars.
Which is better, chinese-llm-benchmark or houtini-lm?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and houtini-lm if Generate test stubs.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is houtini-lm free or open source?
Yes, houtini-lm is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related