freellmpool logo
freellmpool
★ 129
vs
chinese-llm-benchmark logo
chinese-llm-benchmark
★ 6.5k

freellmpool vs chinese-llm-benchmark

freellmpool: freellmpool aggregates the free tiers of 19 LLM providers into a single OpenAI-compatible endpoint, enabling access to diverse models without API keys for some. It handles automatic failover between providers, tracks daily usage, and offers various interfaces including a CLI, Python library, and local proxy.; chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.

01

TL;DR

freellmpool logo
freellmpoolLLM Infra · ★ 129

Run coding agents (e.g., Claude Code, aider) against pooled free LLM models locally

chinese-llm-benchmark logo
chinese-llm-benchmarkLLM Infra · ★ 6.5k

Comparing and selecting the best performing LLMs for specific applications.

02

Side-by-Side Comparison

Field
freellmpool logofreellmpool
chinese-llm-benchmark logochinese-llm-benchmark
Category
LLM Infra
LLM Infra
Stars
★ 129
★ 6.5k
License
MIT
—
Install Command
pip install freellmpool
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
Updated
1w ago
2d ago
Open Source
Yes
Yes
Tags
LLM Proxy, Free Tier, OpenAI API
LLM Evaluation, Chinese LLMs, AI Benchmark
03

Features

freellmpool logofreellmpool
01OpenAI-compatible and experimental Anthropic-compatible API endpoint for LLMs and other services
02Automatic failover and load balancing across multiple free LLM providers on rate limits, timeouts, or errors
03Per-day usage tracking and intelligent quota management for free tiers to maximize availability
04Keyless operation for several providers, allowing immediate use without API key setup
05Intelligent routing based on prompt difficulty, latency, or usage (e.g., quality, fast, fair modes)
chinese-llm-benchmark logochinese-llm-benchmark
01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
04

Use Cases

freellmpool logofreellmpool
↳Run coding agents (e.g., Claude Code, aider) against pooled free LLM models locally
↳Benchmark and monitor the health and capacity of various free LLM providers in real-time
↳Integrate free LLM capabilities into Python applications with a simple library API for tasks like summarization or embeddings
↳Serve as a local OpenAI-compatible proxy for existing tools and scripts, redirecting requests to free tiers
↳Queue and manage slow, quota-aware LLM jobs for background processing and reporting
chinese-llm-benchmark logochinese-llm-benchmark
↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
05

Best For

freellmpool logofreellmpool
—
chinese-llm-benchmark logochinese-llm-benchmark
EssentialTrending
FAQ

FAQ

What is the difference between freellmpool and chinese-llm-benchmark?
Both freellmpool and chinese-llm-benchmark are in the LLM Infra category. freellmpool has 129 stars, while chinese-llm-benchmark has 6.5k stars.
Which is better, freellmpool or chinese-llm-benchmark?
The best choice depends on your use case. Choose freellmpool if Run coding agents (e.g., Claude Code, aider) against pooled free LLM models locally, and chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications..
Is freellmpool free or open source?
Yes, freellmpool is open source on GitHub (MIT).
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related