Best Alternatives to LLMCompiler
LLM Infra·★ 1.9k·MIT
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
#LLM Orchestration#Function Calling#Parallel Computing#Performance Optimization#Python#Coding
01
Best Alternatives to LLMCompiler
ToolDescriptionStarsLicenseUpdated
01
cua
cuaOpen-source infrastructure that gives AI agents computers they can use: sandboxed desktops and VMs, drivers for operating native apps, SDKs and benchmarks for computer-use agents.
★ 31.1k
MIT
1d ago
Details →02
Cherry Studio
Cherry StudioA powerful desktop client for multiple LLMs. Supports local and cloud models.
★ 53.0k
AGPL-3.0
1d ago
Details →03
E2B
E2BOpen-source infrastructure for running AI-generated code in secure, isolated cloud sandboxes, with SDKs for code execution and desktop computer use.
★ 14.6k
Apache-2.0
1d ago
Details →04
bifrost
bifrostFastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
★ 9.1k
Apache-2.0
1d ago
Details →05
chinese-llm-benchmark
chinese-llm-benchmarkReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括335个大模型，覆盖chatgpt、gpt-5.2、o4-mini、谷歌gemini-3-pro、Claude-4.5、文心ERNIE-X1.1、ERNIE-5.0-Thinking、qwen3-max、百川、讯飞星火、商汤senseChat等商用模型， 以及kimi-k2、ernie4.5、minimax-M2、deepseek-v3.2、qwen3-2507、llama4、智谱GLM-4.6、gemma3、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大模型缺陷库！方便广大社区研究分析、改进大模型。
★ 6.5k
—
1d ago
Details →
07
ir-sim
ir-simA Python-based lightweight robot simulator designed for navigation, control, and reinforcement learning
★ 1.2k
MIT
2d ago
Details →08
xLAM
xLAMxLAM: A Family of Large Action Models to Empower AI Agent Systems
★ 641
Apache-2.0
4mo ago
Details →02
Side-by-Side Comparison
| Field | LLMCompiler | cua | Cherry Studio | E2B |
|---|---|---|---|---|
| Category | LLM Infra | LLM Infra | LLM Infra | LLM Infra |
| Stars | ★ 1.9k | ★ 31.1k | ★ 53.0k | ★ 14.6k |
| License | MIT | MIT | AGPL-3.0 | Apache-2.0 |
| Updated | 2y ago | 1d ago | 1d ago | 1d ago |
| Open Source | Yes | Yes | Yes | Yes |
03
Compare LLMCompiler With Others
04
FAQ
What is LLMCompiler?
LLMCompiler is a framework that orchestrates efficient and effective parallel function calls for large language models, both open and closed source. It achieves this by automatically identifying parallelizable and interdependent tasks, leading to significant improvements in latency, cost, and accuracy compared to sequential methods.
What is the best alternative to LLMCompiler?
cua is the top-rated alternative to LLMCompiler in the LLM Infra category.
Is there a free alternative to LLMCompiler?
cua is a free, open-source alternative.
Is LLMCompiler open source?
Yes, LLMCompiler is open source on GitHub, licensed under MIT.