Skip to content

Commit 826dafd

Browse files
committed
fix citations
1 parent a62bc49 commit 826dafd

2 files changed

Lines changed: 21 additions & 15 deletions

File tree

paper.bib

Lines changed: 20 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -66,12 +66,11 @@ @article{raffin2021stable
6666
url = {http://jmlr.org/papers/v22/20-1364.html}
6767
}
6868

69-
@article{towers2026gymnasium,
70-
title={Gymnasium: A standard interface for reinforcement learning environments},
71-
author={Towers, Mark and Kwiatkowski, Ariel and Balis, John and De Cola, Gianluca and Deleu, Tristan and Goul{\~a}o, Manuel and Andreas, Kallinteris and Krimmel, Markus and Kg, Arjun and Perez-Vicente, Rodrigo and others},
72-
journal={Advances in Neural Information Processing Systems},
73-
volume={38},
74-
year={2026}
69+
@article{towers2024gymnasium,
70+
title={Gymnasium: A Standard Interface for Reinforcement Learning Environments},
71+
author={Towers, Mark and Kwiatkowski, Ariel and Terry, Jordan and Balis, John U and De Cola, Gianluca and Deleu, Tristan and Goul{\~a}o, Manuel and Kallinteris, Andreas and Krimmel, Markus and KG, Arjun and others},
72+
journal={arXiv preprint arXiv:2407.17032},
73+
year={2024}
7574
}
7675

7776
@inproceedings{verma2018programmatically,
@@ -82,16 +81,23 @@ @inproceedings{verma2018programmatically
8281
year = {2018},
8382
organization = {PMLR}
8483
}
85-
86-
@article{silva2020optimization,
87-
title = {Optimization Methods for Interpretable Differentiable Decision Trees Applied to Reinforcement Learning},
88-
author = {Andrew Silva and Matthew Gombolay and Taylor Killian and Ivan Jimenez and Sung-Hyun Son},
89-
journal = {Proceedings of the International Conference on Artificial Intelligence and Statistics},
90-
pages = {1855--1865},
91-
year = {2020},
92-
organization = {PMLR}
84+
@InProceedings{silva2020optimization,
85+
title = {Optimization Methods for Interpretable Differentiable Decision Trees Applied to Reinforcement Learning},
86+
author = {Silva, Andrew and Killian, Taylor and Jimenez, Ivan and Son, Sung-Hyun and Gombolay, Matthew},
87+
booktitle = {Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics},
88+
pages = {1855--1865},
89+
year = {2020},
90+
editor = {Chiappa, Silvia and Calandra, Roberto},
91+
volume = {108},
92+
series = {Proceedings of Machine Learning Research},
93+
month = {26--28 Aug},
94+
publisher = {PMLR},
95+
pdf = {http://proceedings.mlr.press/v108/silva20a/silva20a.pdf},
96+
url = {https://proceedings.mlr.press/v108/silva20a.html},
97+
abstract = { Decision trees are ubiquitous in machine learning for their ease of use and interpretability. Yet, these models are not typically employed in reinforcement learning as they cannot be updated online via stochastic gradient descent. We overcome this limitation by allowing for a gradient update over the entire tree that improves sample complexity affords interpretable policy extraction. First, we include theoretical motivation on the need for policy-gradient learning by examining the properties of gradient descent over differentiable decision trees. Second, we demonstrate that our approach equals or outperforms a neural network on all domains and can learn discrete decision trees online with average rewards up to 7x higher than a batch-trained decision tree. Third, we conduct a user study to quantify the interpretability of a decision tree, rule list, and a neural network with statistically significant results (p < 0.001).}
9398
}
9499

100+
95101
@inproceedings{panda2024vanilla,
96102
author = {Subrat Prasad Panda and
97103
Blaise Genest and

paper.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ bibliography: paper.bib
2626
BordAX is a Python framework for reinforcement learning (RL) built on JAX [@jax2018github].
2727
It provides a modular, fully JIT-compilable training pipeline that supports multiple policy representations, including standard multilayer perceptrons (MLPs), differentiable decision trees (DTSemNet, [@panda2024vanilla]), and boolean function networks (HyperBool).
2828
BordAX currently implements Proximal Policy Optimization (PPO) [@schulman2017proximal] and Deep Q-Networks (DQN) [@mnih2015human], and is designed so that additional algorithms can be composed from interchangeable collector, batch-builder, and updater components.
29-
The framework supports both Gymnax [@gymnax2022github] environments, which enable full JIT compilation of the training loop via `jax.lax.scan`, and standard Gymnasium [@towers2026gymnasium] environments.
29+
The framework supports both Gymnax [@gymnax2022github] environments, which enable full JIT compilation of the training loop via `jax.lax.scan`, and standard Gymnasium [@towers2024gymnasium] environments.
3030
On a CartPole-v1 benchmark with identical hyperparameters, BordAX with Gymnax achieves approximately 2.8 times higher throughput than Stable-Baselines3 [@raffin2021stable].
3131

3232
# Statement of need

0 commit comments

Comments
 (0)