Dependency parsing masking and BERT for sentiment analysis

Qing-song Wang; Qing-meng Zhang

doi:10.1117/12.3003965

11 October 2023 Dependency parsing masking and BERT for sentiment analysis

Qing-song Wang, Qing-meng Zhang

Proceedings Volume 12800, Sixth International Conference on Computer Information Science and Application Technology (CISAT 2023); 1280032 (2023) https://doi.org/10.1117/12.3003965
Event: 6th International Conference on Computer Information Science and Application Technology (CISAT 2023), 2023, Hangzhou, China

Abstract

Sentiment Analysis (SA) is one of the most challenging tasks in natural language processing. It is the process of analyzing, processing, generalizing, and reasoning about subjective text with emotional overtones. To cope with sentiment analysis tasks, current deep learning approaches typically use large-scale pre-trained language models and attention mechanisms that apply computed attention weights without any restrictions on attention allocation. This mechanism is not an ideal model for dealing with the task of sentiment analysis, because in all kinds of language used in life, a semantically complete sentence is composed of words with different semantics connected to a complex and diverse grammar. Factors influencing the sentiment tendency of a sentence include the meaning of words and the change in semantics by the superposition of grammars with different structures. This paper proposes a sentiment analysis model that incorporates information about dependency syntax structure. Dependent syntactic information treats words as nodes and establishes syntactic grammatical structures between words by establishing node-to-node relationships. The undirected graph composed of the dependent syntactic structure information screens the text embedding derived from the attention mechanism in multiple layers, so that each layer focuses only on the associated text, and the sentiment classifier uses the text information containing the syntactic structure of the grammar in the classification. Experiments on the Online_Shopping_10_Cats dataset show a significant improvement in the final results compared to current state-of-the-art sentiment analysis models.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Qing-song Wang and Qing-meng Zhang "Dependency parsing masking and BERT for sentiment analysis", Proc. SPIE 12800, Sixth International Conference on Computer Information Science and Application Technology (CISAT 2023), 1280032 (11 October 2023); https://doi.org/10.1117/12.3003965

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Matrices

Performance modeling

Statistical modeling

Deep learning

Multilayers

Semantics

Show All Keywords

Keywords/Phrases

Search In:

Publication Years