chinese-llm-benchmark
★ 6.5k
vs
OGAM
★ 3.3k
chinese-llm-benchmark vs OGAM
chinese-llm-benchmark: ReLE Benchmark (formerly CLiB) provides a continuously updated evaluation for Chinese AI large language models, covering over 337 commercial and open-source LLMs. It offers multi-dimensional capability assessments across various domains, along with comprehensive rankings and a large defect library for model improvement.; OGAM: Off Grid AI is a comprehensive offline AI suite that brings advanced capabilities like text and image generation, vision AI, and voice input directly to your phone or Mac. It ensures complete data privacy by running all AI operations on-device, without sending any data to the cloud.
01
TL;DR
chinese-llm-benchmarkLLM Infra · ★ 6.5k
Comparing and selecting the best performing LLMs for specific applications.
OGAMLLM Infra · ★ 3.3k
When to choose:
- You want chat, image generation, vision and voice input on your phone or Mac, offline, with no data leaving the device.
- You want to bring any GGUF model or connect to Ollama or LM Studio on your network.
- You want a local knowledge base: PDFs are embedded on-device and stored in SQLite.
When to skip:
- You need voice replies: they are in the paid Pro tier ($69 once or $49 a year).
- You rely on GPU or NPU acceleration: the README marks it experimental, only Q4_0 and Q8_0 quants are accelerated, and some architectures garble output.
- Your phone has little RAM: models are several GB.
02
Side-by-Side Comparison
Field
chinese-llm-benchmarkOGAMCategory
LLM Infra
LLM Infra
Stars
★ 6.5k
★ 3.3k
License
—
MIT
Install Command
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
git clone https://github.com/off-grid-ai/OGAM.git && cd OGAM && npm install
Updated
1d ago
1d ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Chinese LLMs, AI Benchmark
On-device AI, Offline LLM, Image Generation
03
Features
chinese-llm-benchmark01Extensive coverage of 337+ commercial and open-source Chinese LLMs.
02Multi-dimensional evaluation across 7 main domains and ~300 sub-dimensions.
03Provides detailed ranking lists for various capabilities and specific domains.
04Offers a large defect library with over 2 million LLM flaws for research and improvement.
05Supports customized model selection and free evaluation services for private models.
OGAM01On-device Text Generation with various LLMs
02Local Stable Diffusion for Image Generation
03Camera-based Vision AI for scene and document analysis
04Function calling with built-in tools (web search, calculator, knowledge base)
05On-device RAG for document analysis and knowledge retrieval
04
Use Cases
chinese-llm-benchmark↳Comparing and selecting the best performing LLMs for specific applications.
↳Identifying weaknesses and improving the capabilities of large language models.
↳Benchmarking private or custom LLMs against public models for performance and cost optimization.
OGAM↳Use as a private, offline AI assistant for chatting and brainstorming.
↳Generate images and text for creative projects without cloud dependency.
↳Analyze local documents (PDFs, text files) and ask questions using the knowledge base.
↳Interact hands-free with the AI using on-device voice input and text-to-speech (Pro feature).
↳Perform AI tasks locally, ensuring zero data leaves your device for privacy-sensitive applications.
05
Best For
chinese-llm-benchmarkEssentialTrending
OGAMTrending
FAQ
FAQ
What is the difference between chinese-llm-benchmark and OGAM?
Both chinese-llm-benchmark and OGAM are in the LLM Infra category. chinese-llm-benchmark has 6.5k stars, while OGAM has 3.3k stars.
Which is better, chinese-llm-benchmark or OGAM?
The best choice depends on your use case. Choose chinese-llm-benchmark if Comparing and selecting the best performing LLMs for specific applications., and OGAM if Use as a private, offline AI assistant for chatting and brainstorming..
Is chinese-llm-benchmark free or open source?
Yes, chinese-llm-benchmark is open source on GitHub.
Is OGAM free or open source?
Yes, OGAM is open source on GitHub (MIT).
Cloud Infrastructure
AdDeploy on DigitalOcean
Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.
→