chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
ollaya logo
ollaya
★ 1.5k

chinese-llm-benchmark vs ollaya

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; ollaya: Ollaya pulls open decision models by name and serves them from a local daemon. A decision model reads a state such as a message, ticket or JSON plus typed questions (choice, score, yes/no) and returns calibrated probabilities in one forward pass without generating text. Its /v1/systemone, /v1/decisions and /v1/models endpoints match TypeSafe's Jev API, so existing Jev clients can switch to local open models.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

ollaya logo
ollayaLLM Infra · ★ 1.5k

Triaging support tickets by intent, urgency and churn risk locally

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
ollaya logoollaya
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 1.5k
License
—
Apache-2.0
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
curl -fsSL https://ollaya.dev/install.sh | sh
Updated
2d ago
1d ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
decision-models, self-hosted, onnx
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
ollaya logoollaya
01Ollama-style CLI: serve, run, pull, list, ps, show, rm, cp, stop and create
02Wire-compatible with TypeSafe's Jev API, so the official SDK works by changing the base URL
03Weights load from each author's Hugging Face repo, pinned to a commit and sha256-verified
04ollaya mcp serves the models to Claude Code, Cursor and other MCP clients
05Modelfiles bake a question set into a custom model
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
ollaya logoollaya
↳Triaging support tickets by intent, urgency and churn risk locally
↳Replacing a hosted Jev endpoint with self-hosted open models
↳Giving agents fast yes/no or multiple-choice judgments without text generation
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
ollaya logoollaya
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and ollaya?
Both chinese-llm-benchmark and ollaya are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while ollaya has 1.5k stars.
Which is better, chinese-llm-benchmark or ollaya?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and ollaya if Triaging support tickets by intent, urgency and churn risk locally.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is ollaya free or open source?
Yes, ollaya is open source on GitHub (Apache-2.0).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related