chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
LLMCompiler logo
LLMCompiler
★ 1.9k

chinese-llm-benchmark vs LLMCompiler

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; LLMCompiler: LLMCompiler is a framework that orchestrates efficient and effective parallel function calls for large language models, both open and closed source. It achieves this by automatically identifying parallelizable and interdependent tasks, leading to significant improvements in latency, cost, and accuracy compared to sequential methods.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

LLMCompiler logo
LLMCompilerLLM Infra · ★ 1.9k

Solving complex problems requiring multiple interdependent function calls

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
LLMCompiler logoLLMCompiler
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 1.9k
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
pip install -r requirements.txt
Updated
1d ago
2y ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
LLM Orchestration, Function Calling, Parallel Computing
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
LLMCompiler logoLLMCompiler
01Efficient and effective orchestration of parallel function calling
02Automatically identifies parallelizable and interdependent tasks
03Achieves significant latency speedup
04Provides cost savings in LLM operations
05Improves accuracy compared to sequential methods
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
LLMCompiler logoLLMCompiler
↳Solving complex problems requiring multiple interdependent function calls
↳Executing multi-hop information retrieval and question answering tasks
↳Developing efficient AI agents that leverage parallel tool use
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
LLMCompiler logoLLMCompiler
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and LLMCompiler?
Both chinese-llm-benchmark and LLMCompiler are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while LLMCompiler has 1.9k stars.
Which is better, chinese-llm-benchmark or LLMCompiler?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and LLMCompiler if Solving complex problems requiring multiple interdependent function calls.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is LLMCompiler free or open source?
Yes, LLMCompiler is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related