GAAVI: Global Asymptotic Anytime Valid Inference for the Conditional Mean Function

Brian M Cho, Raaz Dwivedi, Nathan Kallus
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:19717-19748, 2026.

Abstract

Inference on the conditional mean function (CMF) is central to tasks from adaptive experimentation to optimal treatment assignment and algorithmic fairness auditing. In this work, we provide a novel asymptotic anytime-valid test for a CMF global null (e.g., that all conditional means are zero) and contrasts between CMFs, enabling experimenters to make high confidence decisions at any time during the experiment beyond a minimum sample size. We provide mild conditions under which our tests achieve (i) asymptotic type-I error guarantees, (i) power one, and, unlike past tests, (iii) optimal sample complexity relative to a Gaussian location testing. By inverting our tests, we show how to construct function-valued asymptotic confidence sequences for the CMF and contrasts thereof. Experiments on both synthetic and real-world data show our method is well-powered across various distributions while preserving the nominal error rate under continuous monitoring.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-cho26c, title = {{GAAVI}: Global Asymptotic Anytime Valid Inference for the Conditional Mean Function}, author = {Cho, Brian M and Dwivedi, Raaz and Kallus, Nathan}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {19717--19748}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/cho26c/cho26c.pdf}, url = {https://proceedings.mlr.press/v306/cho26c.html}, abstract = {Inference on the conditional mean function (CMF) is central to tasks from adaptive experimentation to optimal treatment assignment and algorithmic fairness auditing. In this work, we provide a novel asymptotic anytime-valid test for a CMF global null (e.g., that all conditional means are zero) and contrasts between CMFs, enabling experimenters to make high confidence decisions at any time during the experiment beyond a minimum sample size. We provide mild conditions under which our tests achieve (i) asymptotic type-I error guarantees, (i) power one, and, unlike past tests, (iii) optimal sample complexity relative to a Gaussian location testing. By inverting our tests, we show how to construct function-valued asymptotic confidence sequences for the CMF and contrasts thereof. Experiments on both synthetic and real-world data show our method is well-powered across various distributions while preserving the nominal error rate under continuous monitoring.} }
Endnote
%0 Conference Paper %T GAAVI: Global Asymptotic Anytime Valid Inference for the Conditional Mean Function %A Brian M Cho %A Raaz Dwivedi %A Nathan Kallus %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-cho26c %I PMLR %P 19717--19748 %U https://proceedings.mlr.press/v306/cho26c.html %V 306 %X Inference on the conditional mean function (CMF) is central to tasks from adaptive experimentation to optimal treatment assignment and algorithmic fairness auditing. In this work, we provide a novel asymptotic anytime-valid test for a CMF global null (e.g., that all conditional means are zero) and contrasts between CMFs, enabling experimenters to make high confidence decisions at any time during the experiment beyond a minimum sample size. We provide mild conditions under which our tests achieve (i) asymptotic type-I error guarantees, (i) power one, and, unlike past tests, (iii) optimal sample complexity relative to a Gaussian location testing. By inverting our tests, we show how to construct function-valued asymptotic confidence sequences for the CMF and contrasts thereof. Experiments on both synthetic and real-world data show our method is well-powered across various distributions while preserving the nominal error rate under continuous monitoring.
APA
Cho, B.M., Dwivedi, R. & Kallus, N.. (2026). GAAVI: Global Asymptotic Anytime Valid Inference for the Conditional Mean Function. Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:19717-19748 Available from https://proceedings.mlr.press/v306/cho26c.html.

Related Material