[edit]
Open Problem: Model Selection for Contextual Bandits
Proceedings of Thirty Third Conference on Learning Theory, PMLR 125:3842-3846, 2020.
Abstract
In statistical learning, algorithms for model selection allow the learner to adapt to the complexity of the best hypothesis class in a sequence. We ask whether similar guarantees are possible for contextual bandit learning.