Paper
9 October 2023 Text sentiment analysis model based on RoBERTa-BiLSTM-Attention
Jingjing Sun, Gongwu Chen
Author Affiliations +
Proceedings Volume 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023); 127911F (2023) https://doi.org/10.1117/12.3004930
Event: Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 2023, Qingdao, SD, China
Abstract
This paper aims to apply sentiment analysis techniques to cope with the rapid growth of public opinion data. Due to the complexity of Chinese semantics and the sparsity and high-dimensionality of text data, sentiment analysis faces great challenges. To this end, this paper proposes a deep learning model based on RoBERTa. The model uses the RoBERTa model to encode text into word vectors, and weights the word vectors with a weight matrix to enhance the emotional features in the sentence. Then, the contextual features of the word vectors are extracted by BiLSTM, and the hidden feature vectors are weighted by the attention mechanism, and finally classified by the fully connected layer. Experiments show that compared with the BERT model and other text classification models, the accuracy of the model proposed in this paper is significantly improved in the three public data sets.
(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Jingjing Sun and Gongwu Chen "Text sentiment analysis model based on RoBERTa-BiLSTM-Attention", Proc. SPIE 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 127911F (9 October 2023); https://doi.org/10.1117/12.3004930
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data modeling

Feature extraction

Analytical research

Deep learning

Emotion

Machine learning

Data processing

Back to Top