chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
grok-mcp-server logo
grok-mcp-server
★ 25

chinese-llm-benchmark vs grok-mcp-server

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; grok-mcp-server: UniGrok serves as a local-first MCP gateway for xAI Grok, enabling multiple IDE agents to share a single Grok server instance on your machine. It centralizes xAI credentials, intelligently routes requests between metered developer APIs and SuperGrok CLI subscriptions, and provides a unified Streamable HTTP endpoint for seamless integration.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

grok-mcp-server logo
grok-mcp-serverLLM Infra · ★ 25

Centralize xAI Grok credential management for multiple IDEs

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
grok-mcp-server logogrok-mcp-server
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 25
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
git clone https://github.com/djtelicloud/grok-mcp-server.git && cd grok-mcp-server && uv run python main.py init && docker compose up --build -d
Updated
2d ago
3w ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
Grok, MCP Gateway, IDE Integration
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
grok-mcp-server logogrok-mcp-server
01Provides a shared Grok agent tool across all IDEs
02Centralizes server-side credentials (API key, CLI OAuth)
03Optional local UI for status monitoring
04Critiques implementation plans with Grok before user review
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
grok-mcp-server logogrok-mcp-server
↳Centralize xAI Grok credential management for multiple IDEs
↳Route Grok requests between xAI API and SuperGrok CLI subscription
↳Integrate Grok as a shared agent in MCP-capable IDEs
↳Obtain Grok's second opinion on implementation plans
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
grok-mcp-server logogrok-mcp-server
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and grok-mcp-server?
Both chinese-llm-benchmark and grok-mcp-server are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while grok-mcp-server has 25 stars.
Which is better, chinese-llm-benchmark or grok-mcp-server?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and grok-mcp-server if Centralize xAI Grok credential management for multiple IDEs.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is grok-mcp-server free or open source?
Yes, grok-mcp-server is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related