Gaussian Process Regression for Continuous Emotion Recognition with Global Temporal Invariance

Mia Atcheson, Vidhyasaharan Sethu, Julien Epps
Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing, PMLR 66:34-44, 2017.

Abstract

Continuous emotion recognition (CER) is a task which requires the prediction of time series emotional parameter outputs corresponding to query time series inputs given training data in the form of matched pairs of input and output time series. In order to address this task, it is important to be abletomodelnotonly relationshipsbetweenpoints inthe inputandoutput spaces, butalso temporal relationships between points within the output space. Gaussian process regression (GPR) is an inference technique which has desirable properties for CER, including its ability to produce predictive distributions over the outputs rather than only point estimates. However, GPR is generally appliedtopointwisepredictionorinterpolationtasks,ratherthantopredictionsofentirefunctional outputs. We propose a covariance structure that is able to incorporate both input-output and temporal information to produce predictions that take into account the functional nature of CER data. We demonstrate the application of this method to simulated data, and to the AVEC2016 CER task, showing that GPR with this covariance structure is able to make predictions of emotional arousal from audio with over twice the accuracy of a straightforward pointwise application of GPR in the input feature space, and is furthermore able to produce predictions with accuracy approaching that of a competitive CER system using only very general component covariance models.

Cite this Paper

BibTeX
@InProceedings{pmlr-v66-atcheson17a, title = {Gaussian Process Regression for Continuous Emotion Recognition with Global Temporal Invariance}, author = {Atcheson, Mia and Sethu, Vidhyasaharan and Epps, Julien}, booktitle = {Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing}, pages = {34--44}, year = {2017}, editor = {Lawrence, Neil and Reid, Mark}, volume = {66}, series = {Proceedings of Machine Learning Research}, month = {20 Aug}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v66/atcheson17a/atcheson17a.pdf}, url = {https://proceedings.mlr.press/v66/atcheson17a.html}, abstract = {Continuous emotion recognition (CER) is a task which requires the prediction of time series emotional parameter outputs corresponding to query time series inputs given training data in the form of matched pairs of input and output time series. In order to address this task, it is important to be abletomodelnotonly relationshipsbetweenpoints inthe inputandoutput spaces, butalso temporal relationships between points within the output space. Gaussian process regression (GPR) is an inference technique which has desirable properties for CER, including its ability to produce predictive distributions over the outputs rather than only point estimates. However, GPR is generally appliedtopointwisepredictionorinterpolationtasks,ratherthantopredictionsofentirefunctional outputs. We propose a covariance structure that is able to incorporate both input-output and temporal information to produce predictions that take into account the functional nature of CER data. We demonstrate the application of this method to simulated data, and to the AVEC2016 CER task, showing that GPR with this covariance structure is able to make predictions of emotional arousal from audio with over twice the accuracy of a straightforward pointwise application of GPR in the input feature space, and is furthermore able to produce predictions with accuracy approaching that of a competitive CER system using only very general component covariance models.} }
Endnote
%0 Conference Paper %T Gaussian Process Regression for Continuous Emotion Recognition with Global Temporal Invariance %A Mia Atcheson %A Vidhyasaharan Sethu %A Julien Epps %B Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing %C Proceedings of Machine Learning Research %D 2017 %E Neil Lawrence %E Mark Reid %F pmlr-v66-atcheson17a %I PMLR %P 34--44 %U https://proceedings.mlr.press/v66/atcheson17a.html %V 66 %X Continuous emotion recognition (CER) is a task which requires the prediction of time series emotional parameter outputs corresponding to query time series inputs given training data in the form of matched pairs of input and output time series. In order to address this task, it is important to be abletomodelnotonly relationshipsbetweenpoints inthe inputandoutput spaces, butalso temporal relationships between points within the output space. Gaussian process regression (GPR) is an inference technique which has desirable properties for CER, including its ability to produce predictive distributions over the outputs rather than only point estimates. However, GPR is generally appliedtopointwisepredictionorinterpolationtasks,ratherthantopredictionsofentirefunctional outputs. We propose a covariance structure that is able to incorporate both input-output and temporal information to produce predictions that take into account the functional nature of CER data. We demonstrate the application of this method to simulated data, and to the AVEC2016 CER task, showing that GPR with this covariance structure is able to make predictions of emotional arousal from audio with over twice the accuracy of a straightforward pointwise application of GPR in the input feature space, and is furthermore able to produce predictions with accuracy approaching that of a competitive CER system using only very general component covariance models.
APA
Atcheson, M., Sethu, V. & Epps, J.. (2017). Gaussian Process Regression for Continuous Emotion Recognition with Global Temporal Invariance. Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing, in Proceedings of Machine Learning Research 66:34-44 Available from https://proceedings.mlr.press/v66/atcheson17a.html.

Related Material