chinese-llm-benchmark

★ 6.5k

codex-mcp-tool

★ 24

chinese-llm-benchmark vs codex-mcp-tool

Q: Which is better, chinese-llm-benchmark or codex-mcp-tool?

By GitHub stars, chinese-llm-benchmark has more community adoption, but the best choice depends on your specific use case.

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; codex-mcp-tool: This MCP server integrates Claude/Cursor with the Codex CLI, enhancing AI-powered code interactions. It enables advanced features like file analysis, multi-turn conversations, sandboxed code execution, and structured change management.

TL;DR

chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

Read chinese-llm-benchmark full review →

codex-mcp-toolLLM Infra · ★ 24

Code Understanding: Explain the architecture of project source code.

Read codex-mcp-tool full review →

Side-by-Side Comparison

Field

chinese-llm-benchmark

codex-mcp-tool

Features

chinese-llm-benchmark

01Extensive coverage of 337+ commercial and open-source Chinese LLMs.

02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.

03Provides detailed ranking lists for various capabilities and specific domains.

04Offers a large defect library with over 2 million LLM flaws for research and improvement.

05Supports customized model selection and free evaluation services for private models.

codex-mcp-tool

01File Analysis: Reference files with `@src/`, `@package.json` syntax

02Multi-Turn Sessions: Conversation continuity with workspace isolation

03Local OSS Models: Run with Ollama or LM Studio via `localProvider`

04Sandbox Mode: Safe code execution with `--full-auto`

05Change Mode: Structured OLD/NEW patch output for refactoring

Use Cases

chinese-llm-benchmark

↳Comparing and selecting the best performing LLMs for specific applications.

↳Identifying weaknesses and improving the capabilities of large language models.

↳Benchmarking private or custom LLMs against public models for performance and cost optimization.

codex-mcp-tool

↳Code Understanding: Explain the architecture of project source code.

↳Dependency Analysis: Analyze `package.json` to list and understand project dependencies.

↳Brainstorming & Idea Generation: Generate ideas for optimization using frameworks like SCAMPER.

↳Safe Code Execution: Create and run Python scripts securely in a sandbox environment.

↳Web-Enhanced Search: Query for the latest features of programming languages or frameworks with web search capabilities.

Best For

chinese-llm-benchmark

EssentialTrending

codex-mcp-tool

—

FAQ

What is the difference between chinese-llm-benchmark and codex-mcp-tool?

Both chinese-llm-benchmark and codex-mcp-tool are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while codex-mcp-tool has 24 stars.

Which is better, chinese-llm-benchmark or codex-mcp-tool?

The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and codex-mcp-tool if Code Understanding: Explain the architecture of project source code..

Is chinese-llm-benchmark free or open source?

Yes, chinese-llm-benchmark is open source on GitHub.

Is codex-mcp-tool free or open source?

Yes, codex-mcp-tool is open source on GitHub (MIT).

Cloud Infrastructure

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit

→

Alternatives to chinese-llm-benchmark →Alternatives to codex-mcp-tool →chinese-llm-benchmark details →codex-mcp-tool details →

TL;DR

Side-by-Side Comparison

Features

Use Cases

Best For

FAQ

Deploy on DigitalOcean

Related