Research on multi-label long text classification algorithm based on transformer-LDA

Mingjie Tang; Weichun Yang; Yeli Li; Qingtao Zeng

doi:10.1117/12.2667798

28 March 2023 Research on multi-label long text classification algorithm based on transformer-LDA

Mingjie Tang, Weichun Yang, Yeli Li, Qingtao Zeng

Proceedings Volume 12566, Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022); 125663V (2023) https://doi.org/10.1117/12.2667798
Event: Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022), 2022, Chongqing, China

Abstract

Text classification is an important research area in the field of natural language processing. In view of the low efficiency of the traditional CNN and RNN algorithms for multi-label classification of long text due to timing and spatial displacement problems, this paper proposes a long text classification model with improved Transformer attention mechanism, and combines LDA topic classification algorithm to achieve multi-label classification of document length text. Firstly, the paper introduces the industry's solutions to the problem of multi-classification of long texts. Compared with traditional algorithms such as truncation method and pooling method, the PAPER proposes the LDA topic classification model combined with the improved Transformer-XL text classification model to extract text features with fine granularity, so as to classify texts with higher accuracy. Finally, comparative experiments show that the proposed solution has a significant improvement in P value, R value and F1 value compared with the traditional classification method in the field of long text multi-label classification.

Citation Download Citation

Mingjie Tang, Weichun Yang, Yeli Li, and Qingtao Zeng "Research on multi-label long text classification algorithm based on transformer-LDA", Proc. SPIE 12566, Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022), 125663V (28 March 2023); https://doi.org/10.1117/12.2667798

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Transformers

Education and training

Classification systems

Computer programming

Machine learning

Feature extraction

Show All Keywords

Keywords/Phrases

Search In:

Publication Years