Incremental one-class learning using regularized null-space training for industrial defect detection

Matthias Hermann; Georg Umlauf; Bastian Goldlücke; Matthias O. Franz

doi:10.1117/12.3023369

3 April 2024 Incremental one-class learning using regularized null-space training for industrial defect detection

Matthias Hermann, Georg Umlauf, Bastian Goldlücke, Matthias O. Franz

Proceedings Volume 13072, Sixteenth International Conference on Machine Vision (ICMV 2023); 130720L (2024) https://doi.org/10.1117/12.3023369
Event: Sixteenth International Conference on Machine Vision (ICMV 2023), 2023, Yerevan, Armenia

Abstract

One-class incremental learning is a special case of class-incremental learning, where only a single novel class is incrementally added to an existing classifier instead of multiple classes. This case is relevant in industrial defect detection scenarios, where novel defects usually appear during operation. Existing rolled-out classifiers must be updated incrementally in this scenario with only a few novel examples. In addition, it is often required that the base classifier must not be altered due to approval and warranty restrictions. While simple finetuning often gives the best performance across old and new classes, it comes with the drawback of potentially losing performance on the base classes (catastrophic forgetting [1]). Simple prototype approaches [2] work without changing existing weights and perform very well when the classes are well separated but fail dramatically when not. In theory, null-space training (NSCL) [3] should retain the basis classifier entirely, as parameter updates are restricted to the null space of the network with respect to existing classes. However, as we show, this technique promotes overfitting in the case of one-class incremental learning. In our experiments, we found that unconstrained weight growth in null space is the underlying issue, leading us to propose a regularization term (R-NSCL) that penalizes the magnitude of amplification. The regularization term is added to the standard classification loss and stabilizes null-space training in the one-class scenario by counteracting overfitting. We test the method’s capabilities on two industrial datasets, namely AITEX and MVTec, and compare the performance to state-of-the-art algorithms for class-incremental learning.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Matthias Hermann, Georg Umlauf, Bastian Goldlücke, and Matthias O. Franz "Incremental one-class learning using regularized null-space training for industrial defect detection", Proc. SPIE 13072, Sixteenth International Conference on Machine Vision (ICMV 2023), 130720L (3 April 2024); https://doi.org/10.1117/12.3023369

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Machine learning

Education and training

Covariance matrices

Defect detection

Overfitting

Feature extraction

Deep learning

Show All Keywords

Keywords/Phrases

Search In:

Publication Years