chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
MAgent logo
MAgent
★ 1.8k

chinese-llm-benchmark vs MAgent

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; MAgent: MAgent is a research platform designed for many-agent reinforcement learning, supporting scaling from hundreds to millions of agents. It provides a robust environment for exploring artificial collective intelligence, offering compatibility with Linux and OS X and various deep learning frameworks.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

MAgent logo
MAgentLLM Infra · ★ 1.8k

Many-agent reinforcement learning research

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
MAgent logoMAgent
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 1.8k
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
git clone [email protected]:geek-ai/MAgent.git && cd MAgent && sudo apt-get install cmake libboost-system-dev libjsoncpp-dev libwebsocketpp-dev && bash build.sh && export PYTHONPATH=$(pwd)/python:$PYTHONPATH
Updated
2d ago
4y ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
Multi-Agent Reinforcement Learning, Simulation Platform, Collective Intelligence
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
MAgent logoMAgent
01Scalable Many-Agent Support (hundreds to millions)
02Flexible Agent Development (rule-based or deep learning)
03Diverse Demo Scenarios (pursuit, gathering, battle)
04Interactive Battle Game Mode
05Integrated Baseline RL Algorithms (DQN, DRQN, A2C)
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
MAgent logoMAgent
↳Many-agent reinforcement learning research
↳Development of artificial collective intelligence
↳Benchmarking RL algorithms in large-scale environments
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
MAgent logoMAgent
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and MAgent?
Both chinese-llm-benchmark and MAgent are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while MAgent has 1.8k stars.
Which is better, chinese-llm-benchmark or MAgent?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and MAgent if Many-agent reinforcement learning research.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is MAgent free or open source?
Yes, MAgent is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related