LLM Infra (2026)
Infrastructure tools for deploying, serving, fine-tuning, and evaluating large language models at scale.
27 tools
| Name | Tagline | Category | Stars | License | Updated |
|---|
1–20 / 27
Infrastructure tools for deploying, serving, fine-tuning, and evaluating large language models at scale.
27 tools
| Name | Tagline | Category | Stars | License | Updated |
|---|
| MetaGPTMost PopularTrending··· | 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming | LLM Infra | ★ 68.4k | MIT | 2026-01-21 |
| cuaMost PopularTrending··· | Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows). | LLM Infra | ★ 17.3k | MIT | 2026-05-29 |
| xLAMTrending | xLAM: A Family of Large Action Models to Empower AI Agent Systems | LLM Infra | ★ 621 | APACHE | 2025-08-21 |
| on-policyTrendingReinforcement Learning··· | This is the official implementation of Multi-Agent PPO (MAPPO). | LLM Infra | ★ 2.0k | MIT | 2024-07-18 |
| youtu-agentTrending | A simple yet powerful agent framework that delivers with open-source models | LLM Infra | ★ 4.6k | NOASSERTION | 2026-03-21 |
| mini-swe-agentTrendingHidden Gem | The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified! | LLM Infra | ★ 4.7k | — | 2026-05-25 |
| FedMLTrendingEssential | FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale. | LLM Infra | ★ 4.0k | Apache-2.0 | 2025-10-28 |
| chatarenaTrending | ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs. | LLM Infra | ★ 1.5k | APACHE | 2025-08-11 |
| AgileRLTrendingHidden Gem | Streamlining reinforcement learning with RLOps. State-of-the-art RL algorithms and tools, with 10x faster training through evolutionary hyperparameter optimization. | LLM Infra | ★ 921 | — | 2026-05-29 |
| AReaLTrending | Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible. | LLM Infra | ★ 5.2k | — | 2026-05-29 |
| gym-pybullet-dronesTrending | PyBullet Gymnasium environments for single and multi-agent reinforcement learning of quadcopter control | LLM Infra | ★ 2.0k | — | 2026-05-05 |
| llama-cpp-agentTrendingHidden Gem | The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls. | LLM Infra | ★ 635 | — | 2026-03-09 |
| LLM-VMTrending | irresponsible innovation. Try now at https://chat.dev/ | LLM Infra | ★ 491 | — | 2024-05-14 |
| hevy-mcpTrendingMemory & Context··· | Manage your Hevy workouts, routines, folders, and exercise templates. Create and update sessions faster, organize plans, and search exercises to build workouts quickly. Stay synced with changes so your training log is always up to date. | LLM Infra | ★ 251 | MIT | 2026-05-23 |
| blockbench-mcp-pluginTrendingAPI Integration··· | Adds MCP server to Blockbench | LLM Infra | ★ 187 | GPL-3.0 | 2026-05-23 |
| claude-code-source-all-in-oneTrendingAPI Integration··· | Always up-to-date open-source mirror of Claude Code (currently v2.1.123). Run from source with Claude subscription/API, ChatGPT subscription (GPT-5.5 / GPT-5.4), OpenAI-compatible providers, or local Ollama. 18 deep-dive architecture articles included. For educational and reference purposes only. | LLM Infra | ★ 80 | — | 2026-05-28 |
| trainingpeaks-mcpTrendingLLM Infra··· | TrainingPeaks MCP server for Claude Desktop, Code and Cowork. No API approval needed - works with any account. Query workouts, CTL/ATL/TSB fitness data, power PRs via natural language. | LLM Infra | ★ 76 | MIT | 2026-05-27 |
| AgentRunKitTrendingLLM Infra | Lightweight Swift 6 framework for building LLM-powered agents — cloud + on-device inference via MLX on Apple Silicon | LLM Infra | ★ 24 | MIT | 2026-05-22 |
| llmqoreTrendingDev Tooling | Qt C++ library for working with AI/LLM Providers and MCP | LLM Infra | ★ 24 | MIT | 2026-05-29 |
| llmcoreTrendingDev Tooling | Qt C++ library for working with AI/LLM Providers and MCP | LLM Infra | ★ 24 | MIT | 2026-05-29 |
