Paper
27 September 2022 Fraudulent SMS identification based on enhanced BERT
Yanlong Shu, Hao Li
Author Affiliations +
Proceedings Volume 12346, 2nd International Conference on Information Technology and Intelligent Control (CITIC 2022); 123460S (2022) https://doi.org/10.1117/12.2653454
Event: 2nd International Conference on Information Technology and Intelligent Control (CITIC 2022), 2022, Kunming, China
Abstract
With the popularity of SMS services, telecommunication fraud incidents occur frequently, which seriously threaten people's life and property safety. The existing fraudulent SMS recognition techniques have the problems of feature selection relying on manual and low recognition. To solve this problem, a fraudulent SMS identification method (referred to as BERT-SIG) that combines BERT (bidirectional encoder representation from transformers) and Sigmoid is designed. The method performs automatic feature extraction by multi-headed attention mechanism, improves the quality of recognition by Sigmoid activation function, and performs the task of recognizing fraudulent SMS by fine-tuning to improve the efficiency of fraudulent SMS recognition. In the experiments, two open-source datasets, "Spam Email" and "E-Mail classification NLP", are used to check the persistence and robustness, and the BERT-SIG is compared with various machine learning models. The experimental results show that BERT-SIG has the best performance accuracy and F1 score, reaching 99.72% and 99.53% respectively, and can effectively identify fraudulent SMS.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yanlong Shu and Hao Li "Fraudulent SMS identification based on enhanced BERT", Proc. SPIE 12346, 2nd International Conference on Information Technology and Intelligent Control (CITIC 2022), 123460S (27 September 2022); https://doi.org/10.1117/12.2653454
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data modeling

Computer programming

Feature selection

Head

Machine learning

Binary data

Feature extraction

RELATED CONTENT

Stock text topic recognition based on Stu-BERT
Proceedings of SPIE (June 15 2022)
Research on DDoS detection method based on XGB-Trans
Proceedings of SPIE (April 20 2023)
Use transformer encoder for KPI anomaly detection
Proceedings of SPIE (May 05 2022)
Dense pedestrian detection based on improved YOLO-v5
Proceedings of SPIE (September 07 2022)
CAPP: context analyzer and printability predictor
Proceedings of SPIE (March 20 2019)

Back to Top