chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
xLAM logo
xLAM
★ 641

chinese-llm-benchmark vs xLAM

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; xLAM: xLAM is a research repository for Large Action Models (LAMs), which aggregates and unifies agent trajectories from diverse environments into a consistent format. It streamlines the creation of a generic data loader optimized for agent training, enabling robust model development across various scenarios.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

xLAM logo
xLAMLLM Infra · ★ 641

Function calling in LLMs

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
xLAM logoxLAM
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 641
License
—
Apache-2.0
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
pip install -e .
Updated
1d ago
4mo ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
Large Action Models, Function Calling, Agent Training
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
xLAM logoxLAM
01Aggregates agent trajectories from distinct environments
02Standardizes and unifies trajectories into a consistent format
03Optimized generic data loader for agent training
04Maintains equilibrium across different data sources during training
05Supports efficient inference with Transformers and vLLM
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
xLAM logoxLAM
↳Function calling in LLMs
↳Training autonomous agents
↳Multi-turn conversation processing
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
xLAM logoxLAM
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and xLAM?
Both chinese-llm-benchmark and xLAM are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while xLAM has 641 stars.
Which is better, chinese-llm-benchmark or xLAM?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and xLAM if Function calling in LLMs.
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is xLAM free or open source?
Yes, xLAM is open source on GitHub (Apache-2.0).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related