chinese-llm-benchmark
★ 6.5k
vs
deltallm
★ 20
chinese-llm-benchmark vs deltallm
chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; deltallm: DeltaLLM is a self-hosted AI gateway providing a single OpenAI-compatible API to over 100 LLM providers. It streamlines LLM integration with built-in enterprise features like routing, cost tracking, and security guardrails.
01
TL;DR
chinese-llm-benchmarkLLM Infra · ★ 6.5k
Comparing and selecting the best performing LLMs for specific applications.
deltallmLLM Infra · ★ 20
Centralized LLM Access Management: Simplify API key management and developer integration for multiple LLM providers.
02
Side-by-Side Comparison
Field
chinese-llm-benchmarkdeltallmCategory
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 20
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
MASTER_KEY=$(python3 -c 'import secrets; print("sk-" + secrets.token_hex(20) + "A1")') && SALT_KEY=$(python3 -c 'import secrets; print(secrets.token_hex(32))') && git clone https://github.com/deltawi/deltallm.git && cd deltallm && cp config.example.yaml config.yaml && echo "DELTALLM_MASTER_KEY=$MASTER_KEY" > .env && echo "DELTALLM_SALT_KEY=$SALT_KEY" >> .env && echo "OPENAI_API_KEY=sk-your-openai-key" >> .env && echo "[email protected]" >> .env && echo "PLATFORM_BOOTSTRAP_ADMIN_PASSWORD=ChangeMe123!" >> .env && docker compose --profile single up -d --build
Updated
2d ago
1d ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
AI Gateway, LLM Management, OpenAI API Proxy
03
Features
chinese-llm-benchmark01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
deltallm01Unified OpenAI-compatible API for 100+ LLM providers.
02Virtual API Keys with granular controls like budgets, rate limits, and model restrictions.
03Advanced routing and failover strategies with automatic retries.
04Built-in security guardrails including PII detection and prompt injection protection.
05Comprehensive spend tracking with cost attribution per key, team, and model.
04
Use Cases
chinese-llm-benchmark↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
deltallm↳Centralized LLM Access Management: Simplify API key management and developer integration for multiple LLM providers.
↳Cost Control and Optimization: Implement budgets and track spending to optimize LLM usage costs across teams and models.
↳Enhanced Security and Compliance: Apply guardrails for PII detection and prompt injection protection in LLM interactions.
↳Multi-vendor LLM Strategy: Route requests across various LLM providers based on performance, cost, or availability to avoid vendor lock-in.
05
Best For
chinese-llm-benchmarkEssentialTrending
deltallm—
FAQ
FAQ
What is the difference between chinese-llm-benchmark and deltallm?
Both chinese-llm-benchmark and deltallm are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while deltallm has 20 stars.
Which is better, chinese-llm-benchmark or deltallm?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and deltallm if Centralized LLM Access Management: Simplify API key management and developer integration for multiple LLM providers..
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is deltallm free or open source?
Yes, deltallm is open source on GitHub (MIT).
Cloud Infrastructure
AdDeploy on DigitalOcean
Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.
→