chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
chidori logo
chidori
★ 1.4k

chinese-llm-benchmark vs chidori

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; chidori: Chidori runs agents written as plain async TypeScript inside one Rust binary with an embedded pure-Rust JavaScript engine. Every LLM call, tool call and HTTP request goes through the runtime as a recorded host call, so a run can be checkpointed, replayed byte-identically with zero LLM calls, paused for human input for minutes or days, and resumed in a new process after a crash. TypeScript and Python SDKs talk to it over HTTP.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

chidori logo
chidoriLLM Infra · ★ 1.4k

Debugging non-deterministic agent bugs by replaying the exact run

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
chidori logochidori
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 1.4k
License
—
Apache-2.0
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
curl -fsSL https://raw.githubusercontent.com/ThousandBirdsInc/chidori/main/scripts/install.sh | sh
Updated
2d ago
6d ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
durable-execution, agent-framework, typescript
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
chidori logochidori
01Replay any recorded run byte-identically with zero LLM calls
02Checkpoints at every host safepoint, so a killed run resumes in a new process
03chidori.input() and named signals suspend a run to disk while waiting for humans
04Commit a recorded run as a zero-cost integration test
05One self-contained Rust binary: no Node, Deno or V8 required
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
chidori logochidori
↳Debugging non-deterministic agent bugs by replaying the exact run
↳Long-running agents with approval steps that may wait for days
↳Regression-testing agent behavior in CI without paying for tokens
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
chidori logochidori
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and chidori?
Both chinese-llm-benchmark and chidori are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while chidori has 1.4k stars.
Which is better, chinese-llm-benchmark or chidori?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and chidori if Debugging non-deterministic agent bugs by replaying the exact run.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is chidori free or open source?
Yes, chidori is open source on GitHub (Apache-2.0).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related