Statistically Efficient Estimation for Non-Smooth Probability Densities

Masaaki Imaizumi, Takanori Maehara, Yuichi Yoshida
Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics, PMLR 84:978-987, 2018.

Abstract

We investigate statistical efficiency of estimators for non-smooth density functions. The density estimation problem appears in various situations, and it is intensively used in statistics and machine learning. The statistical efficiencies of estimators, i.e., their convergence rates, play a central role in advanced statistical analysis. Although estimators and their convergence rates for smooth density functions are well investigated in the literature, those for non-smooth density functions remain elusive despite their importance in application fields. In this paper, we propose new estimators for non-smooth density functions by employing the notion of Szemeredi partitions from graph theory. We derive convergence rates of the proposed estimators. One of them has the optimal convergence rate in minimax sense, and the other has slightly worse convergence rate but runs in polynomial time. Experimental results support the theoretical performance of our estimators.

Cite this Paper

BibTeX
@InProceedings{pmlr-v84-imaizumi18a, title = {Statistically Efficient Estimation for Non-Smooth Probability Densities}, author = {Imaizumi, Masaaki and Maehara, Takanori and Yoshida, Yuichi}, booktitle = {Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics}, pages = {978--987}, year = {2018}, editor = {Storkey, Amos and Perez-Cruz, Fernando}, volume = {84}, series = {Proceedings of Machine Learning Research}, month = {09--11 Apr}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v84/imaizumi18a/imaizumi18a.pdf}, url = {https://proceedings.mlr.press/v84/imaizumi18a.html}, abstract = {We investigate statistical efficiency of estimators for non-smooth density functions. The density estimation problem appears in various situations, and it is intensively used in statistics and machine learning. The statistical efficiencies of estimators, i.e., their convergence rates, play a central role in advanced statistical analysis. Although estimators and their convergence rates for smooth density functions are well investigated in the literature, those for non-smooth density functions remain elusive despite their importance in application fields. In this paper, we propose new estimators for non-smooth density functions by employing the notion of Szemeredi partitions from graph theory. We derive convergence rates of the proposed estimators. One of them has the optimal convergence rate in minimax sense, and the other has slightly worse convergence rate but runs in polynomial time. Experimental results support the theoretical performance of our estimators.} }
Endnote
%0 Conference Paper %T Statistically Efficient Estimation for Non-Smooth Probability Densities %A Masaaki Imaizumi %A Takanori Maehara %A Yuichi Yoshida %B Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics %C Proceedings of Machine Learning Research %D 2018 %E Amos Storkey %E Fernando Perez-Cruz %F pmlr-v84-imaizumi18a %I PMLR %P 978--987 %U https://proceedings.mlr.press/v84/imaizumi18a.html %V 84 %X We investigate statistical efficiency of estimators for non-smooth density functions. The density estimation problem appears in various situations, and it is intensively used in statistics and machine learning. The statistical efficiencies of estimators, i.e., their convergence rates, play a central role in advanced statistical analysis. Although estimators and their convergence rates for smooth density functions are well investigated in the literature, those for non-smooth density functions remain elusive despite their importance in application fields. In this paper, we propose new estimators for non-smooth density functions by employing the notion of Szemeredi partitions from graph theory. We derive convergence rates of the proposed estimators. One of them has the optimal convergence rate in minimax sense, and the other has slightly worse convergence rate but runs in polynomial time. Experimental results support the theoretical performance of our estimators.
APA
Imaizumi, M., Maehara, T. & Yoshida, Y.. (2018). Statistically Efficient Estimation for Non-Smooth Probability Densities. Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics, in Proceedings of Machine Learning Research 84:978-987 Available from https://proceedings.mlr.press/v84/imaizumi18a.html.

Related Material