AgentIndex icon
AgentIndex
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Submit Tool
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Home/
LLM Infra/
skrl
skrl logo

skrl

Active·★ 1.1k·MIT·Updated 2026-10-27
★ Essential★ Trending

skrl is an open-source, modular Reinforcement Learning library implemented in Python, supporting PyTorch, JAX, and NVIDIA Warp. It focuses on modularity, readability, simplicity, and transparent algorithm implementation, also supporting various environment interfaces like Gym, Gymnasium, and Isaac Lab.

#Reinforcement Learning#Python#PyTorch#JAX#NVIDIA Warp#Coding
$ Install
$ pip install skrl
↗ Visit site★ GitHub
01

Features

01Modular and extensible design
02Transparent algorithm implementation
03Multi-framework support (PyTorch, JAX, NVIDIA Warp)
04Compatibility with various environment interfaces (Gym, Gymnasium, PettingZoo, ManiSkill)
05Simultaneous training in NVIDIA Isaac Lab and MuJoCo Playground with scope-based resource sharing
02

Compatibility

PyTorch
Native
Verified via docs
JAX
Native
Verified via docs
NVIDIA Warp
Native
Verified via docs
OpenAI Gym
Supported
Verified via docs
Farama Gymnasium
Supported
Verified via docs
Farama PettingZoo
Supported
Verified via docs
03

Quick start

1
$ pip install skrl
04

Use cases

↳Developing and testing new Reinforcement Learning algorithms
↳Training AI agents in various simulated environments (e.g., robotic control, game AI)
↳Research in Reinforcement Learning leveraging multiple backend frameworks
05

Alternatives

⚡Top VS:
VSrlcard★3.6k→VSir-sim★1.2k→VSLLMCompiler★1.9k→VSverl-agent★2.4k→
rlcard logo
rlcard★ 3.6k
Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.
VSCompare→
ir-sim logo
ir-sim★ 1.2k
A Python-based lightweight robot simulator designed for navigation, control, and reinforcement learning
VSCompare→
LLMCompiler logo
LLMCompiler★ 1.9k
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
VSCompare→
verl-agent logo
verl-agent★ 2.4k
verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"
VSCompare→
on-policy logo
on-policy★ 2.1k
This is the official implementation of Multi-Agent PPO (MAPPO).
VSCompare→
code-act logo
code-act★ 1.7k
Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.
VSCompare→
LLM-VM logo
LLM-VM★ 493
irresponsible innovation. Try now at https://chat.dev/
VSCompare→
cua logo
cua★ 31.1k
Open-source infrastructure that gives AI agents computers they can use: sandboxed desktops and VMs, drivers for operating native apps, SDKs and benchmarks for computer-use agents.
VSCompare→
See all alternatives →

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Compatibility03Quick start04Use cases05Alternatives
Toni-SM /
skrl
↗

Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments

1.1kMIT
Last commit1d ago
StatusActive
CategoryLLM Infra
Links
Documentation↗Discussion↗Issues↗Releases↗
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
Best by use caseAboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

MCP ServersCode AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.