← Open Source
shariqiqbal2810

maddpg-pytorch

PyTorch Implementation of MADDPG (Lowe et. al. 2017).

Model DevelopmentReinforcement LearningPython
Open on GitHub
Momentum
+0stars in 24 hours0.0%
692
Stars
134
Forks
+1
This week
1
Contributors
Created 2018-01-25 · Updated 2026-10-10 · #14934 today
Top developers
shariqiqbal2810

shariqiqbal2810/maddpg-pytorch is ranked 14,934 with 692 stars.

Same-category comparison

shariqiqbal2810/maddpg-pytorch is ranked 14,934 among these 8 peers; tensorflow/decision-forests is ranked 14,935.

Same-category comparison
NameRankMetrics
elastic/eland14,915
Language:
Python
Stars:
693
Forks:
112
Description:
Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch.
microsoft/LLM2CLIP14,920
Language:
Python
Stars:
693
Forks:
34
Description:
LLM2CLIP significantly improves already state-of-the-art CLIP models.
SciML/OrdinaryDiffEq.jl14,927
Language:
Julia
Stars:
692
Forks:
284
Description:
High performance ordinary differential equation (ODE) and differential-algebraic equation (DAE) solvers, including neural ordinary differential equations (neural ODEs) and scientific machine learning (SciML).
botaoye/OSTrack14,929
Language:
Python
Stars:
692
Forks:
97
Description:
[ECCV 2022] Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework.
tensorflow/decision-forests14,935
Language:
Python
Stars:
692
Forks:
114
Description:
A collection of state-of-the-art algorithms for the training, serving and interpretation of Decision Forest models in Keras.
xuehy/pytorch-maddpg14,938
Language:
Python
Stars:
692
Forks:
126
Description:
A pytorch implementation of MADDPG (multi-agent deep deterministic policy gradient).
Bobo-y/flexible-yolov514,939
Language:
Python
Stars:
691
Forks:
117
Description:
More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam,dcn and so on), and tensorrt.
PaulDanielML/MuJoCo_RL_UR514,942
Language:
Python
Stars:
691
Forks:
70
Description:
A MuJoCo/Gym environment for robot control using Reinforcement Learning. The task of agents in this environment is pixel-wise prediction of grasp success chances.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryModel Development
SubcategoryReinforcement Learning
KeywordsRL
Stars692
Forks134
Contributors1
Created date2018-01-25
Updated date2026-10-10
Stars in 1 day0
Stars in 7 days1
Rank14,934
Previous rank14,764
Rank change-170
7-day stars rank10,915
Previous 7-day stars rank10,973
7-day stars rank change58
Total stars rank15,014
Previous total stars rank14,993
Total stars rank change-21
CountryUK
README summary

MADDPG-PyTorch PyTorch Implementation of MADDPG from *Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments* (Lowe et. 2017) Requirements OpenAI baselines, commit hash: 98257ef8c9bd23a24a330731ae54ed086d9ce4a7 My fork of Multi-agent Particle Environments PyTorch, version: 0. 0rc3 and Tensorboard-Pytorch, version: 1. 0 (for logging) The versions are just what I used and not necessarily strict requirements. How to Run All training code is contained within . To view options simply run: Results Physical Deception In this task, the two blue agents

are rewarded by minimizing the closest of their distances to the green landmark (only one needs to be close to get optimal reward), while maximizing the distance of the red adversary from the green landmark. The red adversary is rewarded by minimizing it's distance to the green landmark; however, on any given trial, it does not know which landmark is green, so it must follow the blue agents. As such, the blue agents should learn to deceive the red agent

by covering *both* landmarks. Cooperative Communication This task involves two agents, one that is stationary and one that can move. The stationary agent sees the color of the other agent as its observation, and outputs a one-hot communication vector as its action. The moving agent receives the communication vector, as well as its relative distance to all landmarks on the screen; however, it does not know its own color. The goal of both agents is for the moving agent

to reach the landmark that matches its own color. Thus, the agents must learn to communicate such that the moving agent knows where to go on each randomized trial. Predator-Prey This task involves a single prey agent (in green) and a team of three predators (in red). The prey agent is 30% faster than the predators, so the predators must learn how to team up in order to catch the prey. In the trials below, the prey agent uses

DDPG as its learning algorithm. Not Implemented There are a few items from the paper that have not been implemented in this repo Ensemble Training Inferring other agents' policies Mixed continuous/discrete action spaces Acknowledgements The OpenAI baselines Tensorflow implementation and Ilya Kostrikov's Pytorch implementation of DDPG were used as references. After the majority of this codebase was complete, OpenAI released their code for MADDPG, and I made some tweaks to this repo to reflect some of the details in

their implementation (e. gradient norm clipping and policy regularization).

Frequently asked questions

How many stars and forks are recorded?

shariqiqbal2810/maddpg-pytorch has 692 stars and 134 forks.

What is the repository rank?

shariqiqbal2810/maddpg-pytorch is ranked 14,934.

What language and category are recorded?

shariqiqbal2810/maddpg-pytorch has 692 stars, uses Python and belongs to Model Development.

Which repository is closest in rank?

shariqiqbal2810/maddpg-pytorch is compared with tensorflow/decision-forests, ranked 14,935 with 692 stars.

README

MADDPG-PyTorch

PyTorch Implementation of MADDPG from Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments (Lowe et. al. 2017)

Requirements

The versions are just what I used and not necessarily strict requirements.

How to Run

All training code is contained within main.py. To view options simply run:

python main.py --help

Results

Physical Deception

In this task, the two blue agents are rewarded by minimizing the closest of their distances to the green landmark (only one needs to be close to get optimal reward), while maximizing the distance of the red adversary from the green landmark. The red adversary is rewarded by minimizing it's distance to the green landmark; however, on any given trial, it does not know which landmark is green, so it must follow the blue agents. As such, the blue agents should learn to deceive the red agent by covering both landmarks.

Cooperative Communication

This task involves two agents, one that is stationary and one that can move. The stationary agent sees the color of the other agent as its observation, and outputs a one-hot communication vector as its action. The moving agent receives the communication vector, as well as its relative distance to all landmarks on the screen; however, it does not know its own color. The goal of both agents is for the moving agent to reach the landmark that matches its own color. Thus, the agents must learn to communicate such that the moving agent knows where to go on each randomized trial.

Predator-Prey

This task involves a single prey agent (in green) and a team of three predators (in red). The prey agent is 30% faster than the predators, so the predators must learn how to team up in order to catch the prey.

In the trials below, the prey agent uses DDPG as its learning algorithm.

Not Implemented

There are a few items from the paper that have not been implemented in this repo

  • Ensemble Training
  • Inferring other agents' policies
  • Mixed continuous/discrete action spaces

Acknowledgements

The OpenAI baselines Tensorflow implementation and Ilya Kostrikov's Pytorch implementation of DDPG were used as references. After the majority of this codebase was complete, OpenAI released their code for MADDPG, and I made some tweaks to this repo to reflect some of the details in their implementation (e.g. gradient norm clipping and policy regularization).

Nearby in the ranking
Similar items