Structured Gaussian Processes with Twin Multiple Kernel Learning

Çiğdem Ak, Önder Ergönül, Mehmet Gönen
Proceedings of The 10th Asian Conference on Machine Learning, PMLR 95:65-80, 2018.

Abstract

Vanilla Gaussian processes (GPs) have prohibitive computational needs for very large data sets. To overcome this difficulty, special structures in the covariance matrix, if exist, should be exploited using decomposition methods such as the Kronecker product. In this paper, we integrated the Kronecker decomposition approach into a multiple kernel learning (MKL) framework for GP regression. We first formulated a regression algorithm with the Kronecker decomposition of structured kernels for spatiotemporal modeling to learn the contribution of spatial and temporal features as well as learning a model for out-of-sample prediction. We then evaluated the performance of our proposed computational framework, namely, structured GPs with twin MKL, on two different real data sets to show its efficiency and effectiveness. MKL helped us extract relative importance of input features by assigning weights to kernels calculated on different subsets of temporal and spatial features.

Cite this Paper

BibTeX
@InProceedings{pmlr-v95-ak18a, title = {Structured Gaussian Processes with Twin Multiple Kernel Learning}, author = {Ak, {\c{C}}i\u{g}dem and Erg\"{o}n\"{u}l, {\"{O}}nder and G\"{o}nen, Mehmet}, booktitle = {Proceedings of The 10th Asian Conference on Machine Learning}, pages = {65--80}, year = {2018}, editor = {Zhu, Jun and Takeuchi, Ichiro}, volume = {95}, series = {Proceedings of Machine Learning Research}, month = {14--16 Nov}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v95/ak18a/ak18a.pdf}, url = {https://proceedings.mlr.press/v95/ak18a.html}, abstract = {Vanilla Gaussian processes (GPs) have prohibitive computational needs for very large data sets. To overcome this difficulty, special structures in the covariance matrix, if exist, should be exploited using decomposition methods such as the Kronecker product. In this paper, we integrated the Kronecker decomposition approach into a multiple kernel learning (MKL) framework for GP regression. We first formulated a regression algorithm with the Kronecker decomposition of structured kernels for spatiotemporal modeling to learn the contribution of spatial and temporal features as well as learning a model for out-of-sample prediction. We then evaluated the performance of our proposed computational framework, namely, structured GPs with twin MKL, on two different real data sets to show its efficiency and effectiveness. MKL helped us extract relative importance of input features by assigning weights to kernels calculated on different subsets of temporal and spatial features.} }
Endnote
%0 Conference Paper %T Structured Gaussian Processes with Twin Multiple Kernel Learning %A Çiğdem Ak %A Önder Ergönül %A Mehmet Gönen %B Proceedings of The 10th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2018 %E Jun Zhu %E Ichiro Takeuchi %F pmlr-v95-ak18a %I PMLR %P 65--80 %U https://proceedings.mlr.press/v95/ak18a.html %V 95 %X Vanilla Gaussian processes (GPs) have prohibitive computational needs for very large data sets. To overcome this difficulty, special structures in the covariance matrix, if exist, should be exploited using decomposition methods such as the Kronecker product. In this paper, we integrated the Kronecker decomposition approach into a multiple kernel learning (MKL) framework for GP regression. We first formulated a regression algorithm with the Kronecker decomposition of structured kernels for spatiotemporal modeling to learn the contribution of spatial and temporal features as well as learning a model for out-of-sample prediction. We then evaluated the performance of our proposed computational framework, namely, structured GPs with twin MKL, on two different real data sets to show its efficiency and effectiveness. MKL helped us extract relative importance of input features by assigning weights to kernels calculated on different subsets of temporal and spatial features.
APA
Ak, Ç., Ergönül, Ö. & Gönen, M.. (2018). Structured Gaussian Processes with Twin Multiple Kernel Learning. Proceedings of The 10th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 95:65-80 Available from https://proceedings.mlr.press/v95/ak18a.html.

Related Material