NeurIPS 2020 Competition and Demonstration Track: Revised selected papers

Hugo Jair Escalante, Katja Hofmann; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:1-2

[abs][Download PDF]

Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020

Ryan Turner, David Eriksson, Michael McCourt, Juha Kiili, Eero Laaksonen, Zhen Xu, Isabelle Guyon; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:3-26

[abs][Download PDF]

tspDB: Time Series Predict DB

Anish Agarwal, Abdullah Alomar, Devavrat Shah; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:27-56

[abs][Download PDF]

Learning Cloth Dynamics: 3D+Texture Garment Reconstruction Benchmark

Meysam Madadi, Hugo Bertiche, Wafa Bouzouita, Isabelle Guyon, Sergio Escalera; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:57-76

[abs][Download PDF]

Solving Black-Box Optimization Challenge via Learning Search Space Partition for Local Bayesian Optimization

Mikita Sazanovich, Anastasiya Nikolskaya, Yury Belousov, Aleksei Shpilman; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:77-85

[abs][Download PDF]

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned

Sewon Min, Jordan Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:86-111

[abs][Download PDF]

Learning to run a Power Network Challenge: a Retrospective Analysis

Antoine Marot, Benjamin Donnot, Gabriel Dulac-Arnold, Adrian Kelly, Aidan O’Sullivan, Jan Viebahn, Mariette Awad, Isabelle Guyon, Patrick Panciatici, Camilo Romero; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:112-132

[abs][Download PDF]

MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval

Mark Hamilton, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, Chris Hoder, William T. Freeman; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:133-155

[abs][Download PDF]

Semi-Automated Data Labeling

Michael Desmond, Evelyn Duesterwald, Kristina Brimijoin, Michelle Brachman, Qian Pan; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:156-169

[abs][Download PDF]

Methods and Analysis of The First Competition in Predicting Generalization of Deep Learning

Yiding Jiang, Parth Natekar, Manik Sharma, Sumukh K. Aithal, Dhruva Kashyap, Natarajan Subramanyam, Carlos Lassance, Daniel M. Roy, Gintare Karolina Dziugaite, Suriya Gunasekar, Isabelle Guyon, Pierre Foret, Scott Yak, Hossein Mobahi, Behnam Neyshabur, Samy Bengio; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:170-190

[abs][Download PDF]

Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challenge

Zichao Wang, Angus Lamb, Evgeny Saveliev, Pashmina Cameron, Jordan Zaykov, Jose Miguel Hernandez-Lobato, Richard E. Turner, Richard G. Baraniuk, Craig Barton, Simon Peyton Jones, Simon Woodhead, Cheng Zhang ; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:191-205

[abs][Download PDF]

Hide-and-Seek Privacy Challenge: Synthetic Data Generation vs. Patient Re-identification

James Jordon, Daniel Jarrett, Evgeny Saveliev, Jinsung Yoon, Paul Elbers, Patrick Thoral, Ari Ercole, Cheng Zhang, Danielle Belgrave, Mihaela van der Schaar; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:206-215

[abs][Download PDF]

The SpaceNet Multi-Temporal Urban Development Challenge

Adam Van Etten, Daniel Hogan; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:216-232

[abs][Download PDF]

Towards robust and domain agnostic reinforcement learning competitions: MineRL 2020

William Hebgen Guss, Stephanie Milani, Nicholay Topin, Brandon Houghton, Sharada Mohanty, Andrew Melnik, Augustin Harter, Benoit Buschmaas, Bjarne Jaster, Christoph Berganski, Dennis Heitkamp, Marko Henning, Helge Ritter, Chengjie Wu, Xiaotian Hao, Yiming Lu, Hangyu Mao, Yihuan Mao, Chao Wang, Michal Opanowicz, Anssi Kanervisto, Yanick Schraner, Christian Scheller, Xiren Zhou, Lu Liu, Daichi Nishio, Toi Tsuneda, Karolis Ramanauskas, Gabija Juceviciute; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:233-252

[abs][Download PDF]

Musical Speech: A Transformer-based Composition Tool

Jason d’Eon, Sri Harsha Dumpla, Chandramouli Shama Sastry, Daniel Oore, Sageev Oore; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:253-274

[abs][Download PDF]

Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid World

Florian Laurent, Manuel Schneider, Christian Scheller, Jeremy Watson, Jiaoyang Li, Zhe Chen, Yi Zheng, Shao-Hung Chan, Konstantin Makhnev, Oleg Svidchenko, Vladimir Egorov, Dmitry Ivanov, Aleksei Shpilman, Evgenija Spirovska, Oliver Tanevski, Aleksandar Nikov, Ramon Grunder, David Galevski, Jakov Mitrovski, Guillaume Sartoretti, Zhiyao Luo, Mehul Damani, Nilabha Bhattacharya, Shivam Agarwal, Adrian Egli, Erik Nygren, Sharada Mohanty; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:275-301

[abs][Download PDF]

NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash Commands

Mayank Agarwal, Tathagata Chakraborti, Quchen Fu, David Gros, Xi Victoria Lin, Jaron Maene, Kartik Talamadupula, Zhongwei Teng, Jules White; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:302-324

[abs][Download PDF]

Traffic4cast at NeurIPS 2020 - yet more on the unreasonable effectiveness of gridded geo-spatial processes

Michael Kopp, David Kreil, Moritz Neun, David Jonietz, Henry Martin, Pedro Herruzo, Aleksandra Gruca, Ali Soleymani, Fanyou Wu, Yang Liu, Jingwei Xu, Jianjin Zhang, Jay Santokhi, Alabi Bojesomo, Hasan Al Marzouqi, Panos Liatsis, Pak Hay Kwok, Qi Qi, Sepp Hochreiter; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:325-343

[abs][Download PDF]

The Hateful Memes Challenge: Competition Report

Douwe Kiela, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Casey A. Fitzpatrick, Peter Bull, Greg Lipstein, Tony Nelli, Ron Zhu, Niklas Muennighoff, Riza Velioglu, Jewgeni Rose, Phillip Lippe, Nithin Holla, Shantanu Chandra, Santhosh Rajamanickam, Georgios Antoniou, Ekaterina Shutova, Helen Yannakoudakis, Vlad Sandulescu, Umut Ozertem, Patrick Pantel, Lucia Specia, Devi Parikh; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:344-360

[abs][Download PDF]

Measuring Sample Efficiency and Generalization in Reinforcement Learning Benchmarks: NeurIPS 2020 Procgen Benchmark

Sharada Mohanty, Jyotish Poonganam, Adrien Gaidon, Andrey Kolobov, Blake Wulfe, Dipam Chakraborty, Graz̆vydas S̆emetulskis, João Schapke, Jonas Kubilius, Jurgis Paükonis, Linas Klimas, Matthew Hausknecht, Patrick MacAlpine, Quang Nhat Tran, Thomas Tumiel, Xiaocheng Tang, Xinwei Chen, Christopher Hesse, Jacob Hilton, William Hebgen Guss, Sahika Genc, John Schulman, Karl Cobbe; Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR 133:361-395

[abs][Download PDF]