The First International Competition in Machine Reconnaissance Blind Chess

Ryan W. Gardner, Corey Lowman, Casey Richardson, Ashley J. Llorens, Jared Markowitz, Nathan Drenkow, Andrew Newman, Gregory Clark, Gino Perrotta, Robert Perrotta, Timothy Highley, Vlad Shcherbina, William Bernadoni, Mark Jordan, Asen Asenov
Proceedings of the NeurIPS 2019 Competition and Demonstration Track, PMLR 123:121-130, 2020.

Abstract

Reconnaissance blind chess (RBC) is a chess variant in which a player cannot see her opponent’s pieces but can learn about them through private, explicit sensing actions. The game presents numerous research challenges, and was the focus of a competition held in conjunction with of the 2019 Conference on Neural Information Processing Systems (NeurIPS). The 22 bots that played in the tournament leveraged a diverse set of algorithms, including variations of multi-state tracking, piece-wise probability estimation, Gibbs sampling, bandit algorithms, tree search, counterfactual regret minimization (CFR), deep learning, and others. None of the algorithms of which we are aware converges to an optimal strategy. Top algorithms generally incorporated sensing strategies that successfully minimized uncertainty (as measured in the number of possible opponent states). The top two approaches reduced this raw uncertainty metric less than some others. Successful strategies sometimes defied conventional wisdom in chess, as evidenced by deviations between win rate and aggregate move strength as assessed by the leading available chess engine.

Cite this Paper


BibTeX
@InProceedings{pmlr-v123-gardner20a, title = {The First International Competition in Machine Reconnaissance Blind Chess}, author = {Gardner, Ryan W. and Lowman, Corey and Richardson, Casey and Llorens, Ashley J. and Markowitz, Jared and Drenkow, Nathan and Newman, Andrew and Clark, Gregory and Perrotta, Gino and Perrotta, Robert and Highley, Timothy and Shcherbina, Vlad and Bernadoni, William and Jordan, Mark and Asenov, Asen}, booktitle = {Proceedings of the NeurIPS 2019 Competition and Demonstration Track}, pages = {121--130}, year = {2020}, editor = {Escalante, Hugo Jair and Hadsell, Raia}, volume = {123}, series = {Proceedings of Machine Learning Research}, month = {08--14 Dec}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v123/gardner20a/gardner20a.pdf}, url = {https://proceedings.mlr.press/v123/gardner20a.html}, abstract = {Reconnaissance blind chess (RBC) is a chess variant in which a player cannot see her opponent’s pieces but can learn about them through private, explicit sensing actions. The game presents numerous research challenges, and was the focus of a competition held in conjunction with of the 2019 Conference on Neural Information Processing Systems (NeurIPS). The 22 bots that played in the tournament leveraged a diverse set of algorithms, including variations of multi-state tracking, piece-wise probability estimation, Gibbs sampling, bandit algorithms, tree search, counterfactual regret minimization (CFR), deep learning, and others. None of the algorithms of which we are aware converges to an optimal strategy. Top algorithms generally incorporated sensing strategies that successfully minimized uncertainty (as measured in the number of possible opponent states). The top two approaches reduced this raw uncertainty metric less than some others. Successful strategies sometimes defied conventional wisdom in chess, as evidenced by deviations between win rate and aggregate move strength as assessed by the leading available chess engine.} }
Endnote
%0 Conference Paper %T The First International Competition in Machine Reconnaissance Blind Chess %A Ryan W. Gardner %A Corey Lowman %A Casey Richardson %A Ashley J. Llorens %A Jared Markowitz %A Nathan Drenkow %A Andrew Newman %A Gregory Clark %A Gino Perrotta %A Robert Perrotta %A Timothy Highley %A Vlad Shcherbina %A William Bernadoni %A Mark Jordan %A Asen Asenov %B Proceedings of the NeurIPS 2019 Competition and Demonstration Track %C Proceedings of Machine Learning Research %D 2020 %E Hugo Jair Escalante %E Raia Hadsell %F pmlr-v123-gardner20a %I PMLR %P 121--130 %U https://proceedings.mlr.press/v123/gardner20a.html %V 123 %X Reconnaissance blind chess (RBC) is a chess variant in which a player cannot see her opponent’s pieces but can learn about them through private, explicit sensing actions. The game presents numerous research challenges, and was the focus of a competition held in conjunction with of the 2019 Conference on Neural Information Processing Systems (NeurIPS). The 22 bots that played in the tournament leveraged a diverse set of algorithms, including variations of multi-state tracking, piece-wise probability estimation, Gibbs sampling, bandit algorithms, tree search, counterfactual regret minimization (CFR), deep learning, and others. None of the algorithms of which we are aware converges to an optimal strategy. Top algorithms generally incorporated sensing strategies that successfully minimized uncertainty (as measured in the number of possible opponent states). The top two approaches reduced this raw uncertainty metric less than some others. Successful strategies sometimes defied conventional wisdom in chess, as evidenced by deviations between win rate and aggregate move strength as assessed by the leading available chess engine.
APA
Gardner, R.W., Lowman, C., Richardson, C., Llorens, A.J., Markowitz, J., Drenkow, N., Newman, A., Clark, G., Perrotta, G., Perrotta, R., Highley, T., Shcherbina, V., Bernadoni, W., Jordan, M. & Asenov, A.. (2020). The First International Competition in Machine Reconnaissance Blind Chess. Proceedings of the NeurIPS 2019 Competition and Demonstration Track, in Proceedings of Machine Learning Research 123:121-130 Available from https://proceedings.mlr.press/v123/gardner20a.html.

Related Material