AgentIndex icon
AgentIndex
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Submit Tool
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Home/
LLM Infra/
rllm
rllm logo

rllm

Active·★ 5.9k·Apache-2.0·Updated 2026-10-16
★ Trending

rLLM is an open-source framework for post-training language agents via reinforcement learning. You build custom agents and environments, train them with reinforcement learning and deploy them for real workloads. The README's release notes mention v0.2.1 (December 2025) with support for the Tinker backend, LoRA and vision-language model training and the Eval Protocol, v0.2 (October 2025) which introduced an AgentWorkflowEngine for training over arbitrary agentic programs, and open models released with the project such as DeepSWE-Preview, a 32B software-engineering agent, and DeepCoder-14B-Preview, a 14B coding model.

It requires Python 3.10 or newer (3.11 if you use the Tinker backend) and can be installed with pip or uv directly, built from source, or run with Docker; the verl or tinker backend is chosen at install time, for example `uv pip install "rllm[verl] @ git+https://github.com/rllm-org/rllm.git"`. The README also lists projects built with rLLM. The code is Apache-2.0 licensed.

This write-up is based on the project's README and public repository data. We have not hand-tested the tool. Data as of 2026-10-24.

License
Apache-2.0
Latest release
v0.3.0-pre · 2026-04-30
Last commit
2026-10-16
Contributors
91
Forks
634
Open issues and PRs
173
First published
2025-01-26

Source: GitHub, npm and PyPI public APIs.

#Reinforcement Learning#Language Agents#LLM#Deep Learning Framework#Post-training
$ Install
$ uv pip install "rllm[verl] @ git+https://github.com/rllm-org/rllm.git"
↗ Visit site★ GitHub
01

Features

01Open-source framework for reinforcement learning-based post-training of language agents.
02Supports building, training, and deploying custom agents and environments.
03Offers multiple training backends including 'verl' and 'tinker'.
04Enables LoRA and VLM training for advanced models.
05Includes AgentWorkflowEngine for training over arbitrary agentic programs.
02

Why choose it

+Purpose-built for reinforcement-learning post-training of language agents, with custom agents and environments.
+Supports multiple training backends (verl and Tinker), LoRA and vision-language model training.
+The AgentWorkflowEngine can train over arbitrary agentic programs.
+Open models released with it (DeepSWE-Preview, DeepCoder-14B-Preview); Apache-2.0 licensed.
03

Trade-offs

!It is a research and training framework, so you need GPU resources and RL experience; it is not a plug-in for using a ready agent.
!Installation depends on the backend you choose (verl or tinker), with different Python requirements (3.11 for tinker).
!The README's latest listed release notes are from December 2025, so check the repository for current features.
04

Maintenance check

ActiveChecked: 2026-10-27
Last commit
2026-10-09
Commits, last 90 days
7
Releases, last 90 days
0
Latest release
v0.3.0-pre (2026-04-30)
Open issues
172
Recent issues with at least one comment
5/10
Commits per week, last 12 weeks
Commits per week, last 12 weeks: 2, 0, 0, 2, 0, 0, 0, 0, 1, 0, 0, 0

Oldest week on the left; the latest four weeks are orange. Source: GitHub commit activity.

Status rule: archived on GitHub = Archived; last commit within 90 days = Active; 91 to 365 days = Slowing; older = Stale. All figures come from the GitHub API on the date shown.

Most discussed open issues

  • #30 oom when update_policy15 comments · 2025-02-15
  • #434 Qwen3.5 support13 comments · 2026-03-10
  • #29 Extremely Long Execution Time per Step12 comments · 2025-02-15
  • #33 Reproduce deepscaler10 comments · 2025-02-17
  • #7 great job!have some questions to ask10 comments · 2025-02-12

Issue titles are quoted from GitHub. Open the link to check whether a problem still applies to the version you use.

05

Compatibility

Python
Supported
Verified via docs
verl
Native Backend
Verified via docs
tinker
Native Backend
Verified via docs
uv
Recommended
Verified via docs
Docker
Supported
Verified via docs
06

Quick start

1
$ uv pip install "rllm[verl] @ git+https://github.com/rllm-org/rllm.git"
07

Use cases

↳Training powerful coding models for tasks like code generation and bug fixing.
↳Developing sophisticated software engineering agents for automated tasks.
↳Building and evaluating multi-agent systems using reinforcement learning techniques.
08

Alternatives

⚡Top VS:
VSCherry Studio★53.0k→VSrunanywhere-sdks★10.3k→VSAReaL★5.9k→VSrlcard★3.6k→
Cherry Studio logo
Cherry Studio★ 53.0k
A powerful desktop client for multiple LLMs. Supports local and cloud models.
VSCompare→
runanywhere-sdks logo
runanywhere-sdks★ 10.3k
Production ready toolkit to run AI locally
VSCompare→
AReaL logo
AReaL★ 5.9k
Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.
VSCompare→
rlcard logo
rlcard★ 3.6k
Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.
VSCompare→
verl-agent logo
verl-agent★ 2.4k
verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"
VSCompare→
on-policy logo
on-policy★ 2.1k
This is the official implementation of Multi-Agent PPO (MAPPO).
VSCompare→
AReaL logo
AReaL★ 5.9k
The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
VSCompare→
ir-sim logo
ir-sim★ 1.2k
A Python-based lightweight robot simulator designed for navigation, control, and reinforcement learning
VSCompare→
See all alternatives →

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Why choose it03Trade-offs04Maintenance check05Compatibility06Quick start07Use cases08Alternatives
rllm-org /
rllm
↗

Framework for post-training language agents with reinforcement learning

5.9k634Apache-2.0
Last commit1w ago
StatusActive
CategoryLLM Infra
Contributors91
Latest releasev0.3.0-pre
Links
Documentation↗Discussion↗Issues↗Releases↗
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
Best by use caseAboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

MCP ServersCode AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.