AgentIndex icon
AgentIndex
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Submit Tool
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Home/
LLM Infra/
on-policy
on-policy logo

on-policy

★ 2.1k·MIT·Updated 2024-07-18

This repository implements MAPPO, a multi-agent variant of PPO, widely used in cooperative multi-agent games and research. It provides robust implementations for various multi-agent environments like StarCraft II, Hanabi, and Google Research Football, along with detailed training scripts and hyperparameter guidance.

#Multi-Agent Reinforcement Learning#PPO#MAPPO#Reinforcement Learning#PyTorch
$ Install
$ pip install -e .
↗ Visit site★ GitHub
01

Features

01Implementation of MAPPO (Multi-Agent PPO)
02Support for diverse multi-agent environments (e.g., StarCraft II, Hanabi)
03Ready-to-use training scripts for various scenarios
04Detailed hyperparameter guidance and updated results
05Default support for shared policy among agents
02

Compatibility

StarCraftII (SMAC)
Native
Verified via docs
Hanabi
Native
Verified via docs
Multiagent Particle-World Environments (MPEs)
Native
Verified via docs
Google Research Football (GRF)
Native
Verified via docs
StarCraftII (SMAC) v2
Native
Verified via docs
03

Quick start

1
$ pip install -e .
04

Use cases

↳Research and experimentation in cooperative multi-agent reinforcement learning
↳Benchmarking and evaluating PPO's effectiveness in MARL scenarios
↳Training AI agents for popular multi-agent games like StarCraft II and Hanabi
05

Alternatives

⚡Top VS:
VSskrl★1.1k→VSrllm★5.9k→VSAReaL★5.9k→VSrlcard★3.6k→
skrl logo
skrl★ 1.1k
Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments
VSCompare→
rllm logo
rllm★ 5.9k
Democratizing Reinforcement Learning for LLMs
VSCompare→
AReaL logo
AReaL★ 5.9k
Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.
VSCompare→
rlcard logo
rlcard★ 3.6k
Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.
VSCompare→
verl-agent logo
verl-agent★ 2.4k
verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"
VSCompare→
ir-sim logo
ir-sim★ 1.2k
A Python-based lightweight robot simulator designed for navigation, control, and reinforcement learning
VSCompare→
gym-pybullet-drones logo
gym-pybullet-drones★ 2.2k
PyBullet Gymnasium environments for single and multi-agent reinforcement learning of quadcopter control
VSCompare→
AgileRL logo
AgileRL★ 960
Streamlining reinforcement learning with RLOps. State-of-the-art RL algorithms and tools, with 10x faster training through evolutionary hyperparameter optimization.
VSCompare→
See all alternatives →

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Compatibility03Quick start04Use cases05Alternatives
marlbenchmark /
on-policy
↗

This is the official implementation of Multi-Agent PPO (MAPPO).

2.1kMIT
Last commit2y ago
StatusNo updates in 1y+
CategoryLLM Infra
Links
Documentation↗Discussion↗Issues↗Releases↗
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
Best by use caseAboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

MCP ServersCode AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.