The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation".
Key parameters and specifications
Key parameters and specifications
Parameter
Value
Language
Python
Category
Models
Subcategory
Vision models
Stars
2,216
Forks
244
Contributors
2
Created date
2025-12-17
Updated date
2026-10-15
Stars in 1 day
1
Stars in 7 days
10
Rank
5,134
Previous rank
3,848
Rank change
-1,286
7-day stars rank
3,982
Previous 7-day stars rank
3,628
7-day stars rank change
-354
Total stars rank
5,845
Previous total stars rank
5,841
Total stars rank change
-4
Country
USA
README summary
NitroGen NitroGen is an open foundation model for generalist gaming agents. This multi-game model takes pixel input and predicts gamepad actions. It is trained through behavior cloning on the largest video-action gameplay dataset, assembled exclusively from internet videos. It can be adapted via post-training to unseen games. IMPORTANT] NitroGen is a research project to enable training generalist agent from internet data, please refer to the paper for full details. The current model is a 500M parameter DiT
that can only see the last frame. Therefore it has no ability yet to plan over long horizons, play games end-to-end, self improve over time, or play completely unseen game. It is a fast-reacting system-1 sensory model Installation Prerequisites We **do not distribute game environments**, you must use your own copies of the games. This repository only supports running the agent on **Windows games**. You can serve the model from a Linux machine for inference, but
the game ultimately has to run on Windows. We have tested on Windows 11 with Python ≥ 3. Setup Install this repo: Download NitroGen checkpoint from HuggingFace: Getting Started First, start an inference server for the model: Then, run the agent on the game of your choice: The parameter must be the exact executable name of the game you want to play. You can find it by right-clicking on the game process in Windows Task Manager (Ctrl+Shift+Esc), and
selecting . The process name should be in the tab and end with . Paper and Citation If you find our work useful, please consider citing us! **Disclaimer**: This project is strictly for research purposes and is not an official NVIDIA product.
Frequently asked questions
How many stars and forks are recorded?
MineDojo/NitroGen has 2,216 stars and 244 forks.
What is the repository rank?
MineDojo/NitroGen is ranked 5,134.
What language and category are recorded?
MineDojo/NitroGen has 2,216 stars, uses Python and belongs to Models.
Which repository is closest in rank?
MineDojo/NitroGen is compared with yyfz/Pi3, ranked 5,137 with 2,213 stars.
NitroGen is an open foundation model for generalist gaming agents. This multi-game model takes pixel input and predicts gamepad actions. It is trained through behavior cloning on the largest video-action gameplay dataset, assembled exclusively from internet videos. It can be adapted via post-training to unseen games.
[!IMPORTANT]
NitroGen is a research project to enable training generalist agent from internet data, please refer to the paper for full details. The current model is a 500M parameter DiT that can only see the last frame. Therefore it has no ability yet to plan over long horizons, play games end-to-end, self improve over time, or play completely unseen game. It is a fast-reacting system-1 sensory model
Installation
Prerequisites
We do not distribute game environments, you must use your own copies of the games. This repository only supports running the agent on Windows games. You can serve the model from a Linux machine for inference, but the game ultimately has to run on Windows. We have tested on Windows 11 with Python ≥ 3.12.
Setup
Install this repo:
git clone https://github.com/MineDojo/NitroGen.git
cd NitroGen
pip install -e .
The --process parameter must be the exact executable name of the game you want to play. You can find it by right-clicking on the game process in Windows Task Manager (Ctrl+Shift+Esc), and selecting Properties. The process name should be in the General tab and end with .exe.
Paper and Citation
If you find our work useful, please consider citing us!
@misc{magne2026nitrogen,
title={NitroGen: An Open Foundation Model for Generalist Gaming Agents},
author={Loïc Magne and Anas Awadalla and Guanzhi Wang and Yinzhen Xu and Joshua Belofsky and Fengyuan Hu and Joohwan Kim and Ludwig Schmidt and Georgia Gkioxari and Jan Kautz and Yisong Yue and Yejin Choi and Yuke Zhu and Linxi "Jim" Fan},
year={2026},
eprint={2601.02427},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2601.02427},
}
Disclaimer: This project is strictly for research purposes and is not an official NVIDIA product.
