TY - JOUR
T1 - Research on EEG emotion recognition based on CNN+BiLSTM+self-attention model
AU - Li, Xueqing
AU - Li, Penghai
AU - Fang, Zhendong
AU - Cheng, Longlong
AU - Wang, Zhiyong
AU - Wang, Weijie
N1 - Funding Information:
This work has been supported by the National Key Research and Development Program of China (No.2021YFF1200600), the National Natural Science Foundation of China (No.61806146), and the Natural Science Foundation of Tianjin City (Nos.18JCYBJC95400 and 19JCTPJC56000).
Publisher Copyright:
© 2023, Tianjin University of Technology.
PY - 2023/8
Y1 - 2023/8
N2 - To address the problems of insufficient dimensionality of electroencephalogram (EEG) feature extraction, the tendency to ignore the importance of different sequential data segments, and the poor generalization ability of the model in EEG based emotion recognition, the model of convolutional neural network and bi-directional long short-term memory and self-attention (CNN+BiLSTM+self-attention) is proposed. This model uses convolutional neural network (CNN) to extract more distinctive features from both spatial and temporal dimensions. The bi-directional long short-term memory (BiLSTM) is used to further preserve the long-term dependencies between the temporal phases of sequential data. The self-attention mechanism can change the weights of different channels to extract and highlight important information and address the often-ignored importance of different channels and samples when extracting EEG features. The subject-dependent experiment and subject-independent experiment are performed on the database for emotion analysis using physiological signals (DEAP) and collected datasets to verify the recognition performance. The experimental results show that the model proposed in this paper has excellent recognition performance and generalization ability.
AB - To address the problems of insufficient dimensionality of electroencephalogram (EEG) feature extraction, the tendency to ignore the importance of different sequential data segments, and the poor generalization ability of the model in EEG based emotion recognition, the model of convolutional neural network and bi-directional long short-term memory and self-attention (CNN+BiLSTM+self-attention) is proposed. This model uses convolutional neural network (CNN) to extract more distinctive features from both spatial and temporal dimensions. The bi-directional long short-term memory (BiLSTM) is used to further preserve the long-term dependencies between the temporal phases of sequential data. The self-attention mechanism can change the weights of different channels to extract and highlight important information and address the often-ignored importance of different channels and samples when extracting EEG features. The subject-dependent experiment and subject-independent experiment are performed on the database for emotion analysis using physiological signals (DEAP) and collected datasets to verify the recognition performance. The experimental results show that the model proposed in this paper has excellent recognition performance and generalization ability.
UR - http://www.scopus.com/inward/record.url?scp=85168559281&partnerID=8YFLogxK
U2 - 10.1007/s11801-023-2207-x
DO - 10.1007/s11801-023-2207-x
M3 - Article
AN - SCOPUS:85168559281
SN - 1673-1905
VL - 19
SP - 506
EP - 512
JO - Optoelectronics Letters
JF - Optoelectronics Letters
IS - 8
ER -