← Open Source
sfujim

BCQ

Author's PyTorch implementation of BCQ for continuous and discrete actions.

Model DevelopmentArchitectureReinforcement LearningPython
Open on GitHub
Momentum
+0stars in 24 hours0.0%
665
Stars
147
Forks
+0
This week
1
Contributors
Created 2018-12-18 · Updated 2026-10-04 · #15290 today
Top developers

sfujim/BCQ is ranked 15,290 with 665 stars.

Same-category comparison

sfujim/BCQ is ranked 15,290 among these 8 peers; microsoft/prose is ranked 15,287.

Same-category comparison
NameRankMetrics
M-J-Murray/MAMEToolkit15,278
Language:
Python
Stars:
665
Forks:
116
Description:
A Python toolkit used to train reinforcement learning algorithms against arcade games.
google-deepmind/pycolab15,283
Language:
Python
Stars:
665
Forks:
123
Description:
A highly-customisable gridworld game engine with some batteries included. Make your own gridworld games to test reinforcement learning agents.
greentfrapp/lucent15,284
Language:
Python
Stars:
665
Forks:
95
Description:
Lucid library adapted for PyTorch.
microsoft/prose15,287
Language:
C#
Stars:
665
Forks:
101
Description:
Microsoft Program Synthesis using Examples SDK is a framework of technologies for the automatic generation of programs from input-output examples. This repo includes samples and sample data for the Microsoft Program Synthesis using Example SDK.
bingchenlll/FastGAN-pytorch15,298
Language:
Python
Stars:
664
Forks:
109
Description:
Official implementation of the paper "Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis" in ICLR 2021.
google-deepmind/searchless_chess15,300
Language:
Python
Stars:
664
Forks:
55
Description:
Grandmaster-Level Chess Without Search.
qdrant/quaterion15,301
Language:
Python
Stars:
664
Forks:
47
Description:
Blazing fast framework for fine-tuning similarity learning models.
vicariousinc/science_rcn15,303
Language:
Python
Stars:
664
Forks:
191
Description:
Reference implementation of a two-level RCN model.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryModel Development
SubcategoryArchitecture, Reinforcement Learning
Stars665
Forks147
Contributors1
Created date2018-12-18
Updated date2026-10-04
Stars in 1 day0
Stars in 7 days0
Rank15,290
Previous rank15,110
Rank change-180
7-day stars rank14,914
Previous 7-day stars rank14,927
7-day stars rank change13
Total stars rank15,479
Previous total stars rank15,455
Total stars rank change-24
CountryCanada
README summary

Batch-Constrained Deep Q-Learning (BCQ) Batch-Constrained deep Q-learning (BCQ) is the first batch deep reinforcement learning, an algorithm which aims to learn offline without interactions with the environment. BCQ was first introduced in our ICML 2019 paper which focused on continuous action domains. A discrete-action version of BCQ was introduced in a followup Deep RL workshop NeurIPS 2019 paper. Code for each of these algorithms can be found under their corresponding folder.

Frequently asked questions

How many stars and forks are recorded?

sfujim/BCQ has 665 stars and 147 forks.

What is the repository rank?

sfujim/BCQ is ranked 15,290.

What language and category are recorded?

sfujim/BCQ has 665 stars, uses Python and belongs to Model Development.

Which repository is closest in rank?

sfujim/BCQ is compared with microsoft/prose, ranked 15,287 with 665 stars.

README

Batch-Constrained Deep Q-Learning (BCQ)

Batch-Constrained deep Q-learning (BCQ) is the first batch deep reinforcement learning, an algorithm which aims to learn offline without interactions with the environment.

BCQ was first introduced in our ICML 2019 paper which focused on continuous action domains. A discrete-action version of BCQ was introduced in a followup Deep RL workshop NeurIPS 2019 paper. Code for each of these algorithms can be found under their corresponding folder.

Bibtex

@inproceedings{fujimoto2019off,
  title={Off-Policy Deep Reinforcement Learning without Exploration},
  author={Fujimoto, Scott and Meger, David and Precup, Doina},
  booktitle={International Conference on Machine Learning},
  pages={2052--2062},
  year={2019}
}
@article{fujimoto2019benchmarking,
  title={Benchmarking Batch Deep Reinforcement Learning Algorithms},
  author={Fujimoto, Scott and Conti, Edoardo and Ghavamzadeh, Mohammad and Pineau, Joelle},
  journal={arXiv preprint arXiv:1910.01708},
  year={2019}
}
Nearby in the ranking
Similar items