chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k
vs
sema logo
sema
★ 54

chinese-llm-benchmark vs sema

chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; sema: Sema is a Lisp dialect that integrates LLM agents as core language primitives, providing a robust runtime that handles common agent scaffolding like retries, caching, and tool dispatch. It compiles to a fast bytecode VM, allowing LLM-powered scripts to be concise, shipped as single binaries, and easily understood by coding agents.

01

TL;DR

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

sema logo
semaLLM Infra · ★ 54

Building full coding agents with file editing, search, and shell tools.

02

Side-by-Side Comparison

Field
chinese-llm-benchmark logochinese-llm-benchmark
sema logosema
Category
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 54
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
curl -fsSL https://sema-lang.com/install.sh | sh
Updated
2d ago
1d ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
Lisp, LLM Agents, Bytecode VM
03

Features

chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
sema logosema
01LLMs as language primitives: Prompts, messages, conversations, tools, and agents are first-class data types.
02Multi-provider support: Seamlessly swap between various LLM providers like Anthropic, OpenAI, Gemini, and custom ones.
03Integrated agent runtime: Handles common scaffolding like retries, caching, rate limits, and tool dispatch automatically.
04Full developer toolchain: Includes a formatter, language server (LSP), debugger (DAP), and an MCP server.
05Standalone executables: Compile Sema programs into self-contained binaries with auto-traced imports.
04

Use Cases

chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
sema logosema
↳Building full coding agents with file editing, search, and shell tools.
↳AI-powered code review for git diffs and generating conventional commit messages.
↳Structured data extraction, classification, and multi-modal chat from text and images.
↳Implementing RAG (Retrieval-Augmented Generation) with in-memory vector stores and cross-encoder reranking.
↳Developing general-purpose applications with Lisp features, HTTP, JSON, and file I/O.
05

Best For

chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
sema logosema
—
FAQ

FAQ

What is the difference between chinese-llm-benchmark and sema?
Both chinese-llm-benchmark and sema are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while sema has 54 stars.
Which is better, chinese-llm-benchmark or sema?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and sema if Building full coding agents with file editing, search, and shell tools..
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is sema free or open source?
Yes, sema is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related