Steel surface defect (SSD) recognition plays a critical role in guaranteeing the quality and economic benefits of industrial metal products. At present, deep-learning-based recognition methods have achieved excellent performance within related fields. However, these methods usually depend on the availability of extensive training data and label information. For SSD recognition, the SSD data are often insufficient and labels are scarce, making it hard to train a supervised deep model. In this article, we proposed a novel few-shot SSD recognition method based on self-supervised contrastive learning (self-SCL), which can effectively learn data representation with unlabeled data in the pretraining stage and learn categories from a few labeled samples in the fine-tuning stage. In this method, we proposed an information-guided teacher–student (TS) pretrained model with min–max instances similarity (MMIS) regularization. In the pretraining stage, we utilized the multicrop mechanism to build a teacher encoder (TE) with multiview information and leveraged the TE to guide the student encoder (SE) with information. Meanwhile, the SE also provided the TE with “questions” during the update process, which the SE also shared updated information with the TE for further refinement. Specifically, we introduced MMIS to address the problem of ambiguity between intraclass and interclass distances in SSD data. During the fine-tuning phase, we fine-tuned the pretrained model obtained by teacher–student with min–max instance similarity (TSMMIS) with a few labeled data and tested the SSD recognition accuracy in four SSD datasets. As the experimental results indicate, our method significantly outperforms other state-of-the-art methods on the four SSD datasets.
Few-Shot Steel Surface Defect Recognition via Self-Supervised Teacher-Student Model with Min-Max Instances Similarity / T. Wang, Z. Li, Y. Xu, J. Chen, A. Genovese, V. Piuri, F. Scotti. - In: IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT. - ISSN 0018-9456. - 72:(2023), pp. 5026016.1-5026016.16. [10.1109/TIM.2023.3315404]
Few-Shot Steel Surface Defect Recognition via Self-Supervised Teacher-Student Model with Min-Max Instances Similarity
A. Genovese;V. PiuriPenultimo
;F. ScottiUltimo
2023
Abstract
Steel surface defect (SSD) recognition plays a critical role in guaranteeing the quality and economic benefits of industrial metal products. At present, deep-learning-based recognition methods have achieved excellent performance within related fields. However, these methods usually depend on the availability of extensive training data and label information. For SSD recognition, the SSD data are often insufficient and labels are scarce, making it hard to train a supervised deep model. In this article, we proposed a novel few-shot SSD recognition method based on self-supervised contrastive learning (self-SCL), which can effectively learn data representation with unlabeled data in the pretraining stage and learn categories from a few labeled samples in the fine-tuning stage. In this method, we proposed an information-guided teacher–student (TS) pretrained model with min–max instances similarity (MMIS) regularization. In the pretraining stage, we utilized the multicrop mechanism to build a teacher encoder (TE) with multiview information and leveraged the TE to guide the student encoder (SE) with information. Meanwhile, the SE also provided the TE with “questions” during the update process, which the SE also shared updated information with the TE for further refinement. Specifically, we introduced MMIS to address the problem of ambiguity between intraclass and interclass distances in SSD data. During the fine-tuning phase, we fine-tuned the pretrained model obtained by teacher–student with min–max instance similarity (TSMMIS) with a few labeled data and tested the SSD recognition accuracy in four SSD datasets. As the experimental results indicate, our method significantly outperforms other state-of-the-art methods on the four SSD datasets.File | Dimensione | Formato | |
---|---|---|---|
Few-Shot_Steel_Surface_Defect_Recognition_via_Self-Supervised_Teacher-Student_Model_with_Min-Max_Instances_Similarity_compressed.pdf
accesso riservato
Descrizione: Article
Tipologia:
Publisher's version/PDF
Dimensione
8.38 MB
Formato
Adobe PDF
|
8.38 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.