chinese-llm-benchmark
★ 6.5k
vs
osaurus
★ 8.1k
chinese-llm-benchmark vs osaurus
chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; osaurus: Osaurus is an AI edge runtime for macOS, designed to run local and cloud models and expose shared tools via its MCP server. It provides a native, always-on foundation for AI applications and workflows on Apple Silicon.
01
TL;DR
chinese-llm-benchmarkLLM Infra · ★ 6.5k
Comparing and selecting the best performing LLMs for specific applications.
osaurusLLM Infra · ★ 8.1k
When to choose:
- You use an Apple Silicon Mac and want local MLX models and cloud providers in one always-on app.
- You want OpenAI-, Anthropic- and Ollama-compatible endpoints so existing tools can use it unchanged.
- You want an MCP server, remote MCP aggregation, memory, skills and schedules in the same place.
When to skip:
- You are not on macOS 15.5 or later with Apple Silicon.
- You only want a simple local model server: its scope is much wider.
- You want a voice-first assistant: voice is not its focus.
02
Side-by-Side Comparison
Field
chinese-llm-benchmarkosaurusCategory
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 8.1k
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
brew install --cask osaurus
Updated
1d ago
1d ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
AI Edge Runtime, macOS Native, Local LLM Inference
03
Features
chinese-llm-benchmark01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
osaurus01Local LLM Inference with MLX Runtime for Apple Silicon
02Multi-API Compatibility (OpenAI, Anthropic, Ollama, etc.)
03MCP Server for AI Agent Tooling and Remote MCP Providers aggregation
04Advanced 4-layer persistent memory system with hybrid search
05Integrated on-device Voice Input and Transcription with VAD Mode
04
Use Cases
chinese-llm-benchmark↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
osaurus↳Automate complex multi-step tasks with AI agents using 'Work Mode' for code refactoring, debugging, or research.
↳Create personalized AI assistants with custom prompts, tools, and themes for various roles like Code Assistant or Creative Writer.
↳Automate recurring AI tasks and workflows such as daily journaling, weekly reports, or file organization via Watchers.
↳Integrate local and cloud Large Language Models for development and personal use via compatible API endpoints.
05
Best For
chinese-llm-benchmarkEssentialTrending
osaurus—
FAQ
FAQ
What is the difference between chinese-llm-benchmark and osaurus?
Both chinese-llm-benchmark and osaurus are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while osaurus has 8.1k stars.
Which is better, chinese-llm-benchmark or osaurus?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and osaurus if Automate complex multi-step tasks with AI agents using 'Work Mode' for code refactoring, debugging, or research..
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is osaurus free or open source?
Yes, osaurus is open source on GitHub (MIT).
Cloud Infrastructure
AdDeploy on DigitalOcean
Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.
→