Multi-Branch Network for Cross-Subject EEG-based Emotion Recognition

Guang Lin, Li Zhu, Bin Ren, Yiteng Hu, Jianhai Zhang
Proceedings of The 13th Asian Conference on Machine Learning, PMLR 157:705-720, 2021.

Abstract

In recent years, electrocardiogram (EEG)-based emotion recognition has received increasing attention in affective computing. Since the individual differences of EEG signals are large, most models are trained for specific subjects, and the generalization is poor when applied to new subjects. In this paper, we propose a Multi-Branch Network (MBN) model to solve this problem. According to the characteristics of the cross-subject data, different branch networks are designed to separate the background features and task features of the EEG signals for classification to have better model performance. Besides, there is no new-subject data needed during model training. In order to avoid the negative improvement caused by samples with significant differences to model training, a tiny amount of new-subject data is used to filter the training samples to improve the model performance further. Before training the model, the samples with significant differences from the new subject were deleted by comparing the background features between the subjects. The experimental results show that compared with Single-Branch Network (SBN) model, the accuracy of the MBN model is improved by 20.89% on the SEED dataset. Furthermore, compared with other common methods, the proposed method uses less new-subject data, which improves its practicability in practical application.

Cite this Paper

BibTeX
@InProceedings{pmlr-v157-lin21a, title = {Multi-Branch Network for Cross-Subject EEG-based Emotion Recognition}, author = {Lin, Guang and Zhu, Li and Ren, Bin and Hu, Yiteng and Zhang, Jianhai}, booktitle = {Proceedings of The 13th Asian Conference on Machine Learning}, pages = {705--720}, year = {2021}, editor = {Balasubramanian, Vineeth N. and Tsang, Ivor}, volume = {157}, series = {Proceedings of Machine Learning Research}, month = {17--19 Nov}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v157/lin21a/lin21a.pdf}, url = {https://proceedings.mlr.press/v157/lin21a.html}, abstract = {In recent years, electrocardiogram (EEG)-based emotion recognition has received increasing attention in affective computing. Since the individual differences of EEG signals are large, most models are trained for specific subjects, and the generalization is poor when applied to new subjects. In this paper, we propose a Multi-Branch Network (MBN) model to solve this problem. According to the characteristics of the cross-subject data, different branch networks are designed to separate the background features and task features of the EEG signals for classification to have better model performance. Besides, there is no new-subject data needed during model training. In order to avoid the negative improvement caused by samples with significant differences to model training, a tiny amount of new-subject data is used to filter the training samples to improve the model performance further. Before training the model, the samples with significant differences from the new subject were deleted by comparing the background features between the subjects. The experimental results show that compared with Single-Branch Network (SBN) model, the accuracy of the MBN model is improved by 20.89% on the SEED dataset. Furthermore, compared with other common methods, the proposed method uses less new-subject data, which improves its practicability in practical application.} }
Endnote
%0 Conference Paper %T Multi-Branch Network for Cross-Subject EEG-based Emotion Recognition %A Guang Lin %A Li Zhu %A Bin Ren %A Yiteng Hu %A Jianhai Zhang %B Proceedings of The 13th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2021 %E Vineeth N. Balasubramanian %E Ivor Tsang %F pmlr-v157-lin21a %I PMLR %P 705--720 %U https://proceedings.mlr.press/v157/lin21a.html %V 157 %X In recent years, electrocardiogram (EEG)-based emotion recognition has received increasing attention in affective computing. Since the individual differences of EEG signals are large, most models are trained for specific subjects, and the generalization is poor when applied to new subjects. In this paper, we propose a Multi-Branch Network (MBN) model to solve this problem. According to the characteristics of the cross-subject data, different branch networks are designed to separate the background features and task features of the EEG signals for classification to have better model performance. Besides, there is no new-subject data needed during model training. In order to avoid the negative improvement caused by samples with significant differences to model training, a tiny amount of new-subject data is used to filter the training samples to improve the model performance further. Before training the model, the samples with significant differences from the new subject were deleted by comparing the background features between the subjects. The experimental results show that compared with Single-Branch Network (SBN) model, the accuracy of the MBN model is improved by 20.89% on the SEED dataset. Furthermore, compared with other common methods, the proposed method uses less new-subject data, which improves its practicability in practical application.
APA
Lin, G., Zhu, L., Ren, B., Hu, Y. & Zhang, J.. (2021). Multi-Branch Network for Cross-Subject EEG-based Emotion Recognition. Proceedings of The 13th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 157:705-720 Available from https://proceedings.mlr.press/v157/lin21a.html.

Related Material