Steel surface defect (SSD) recognition plays a critical role in guaranteeing the quality and economic benefits of industrial metal products. At present, deep-learning-based recognition methods have achieved excellent performance within related fields. However, these methods usually depend on the availability of extensive training data and label information. For SSD recognition, the SSD data are often insufficient and labels are scarce, making it hard to train a supervised deep model. In this article, we proposed a novel few-shot SSD recognition method based on self-supervised contrastive learning (self-SCL), which can effectively learn data representation with unlabeled data in the pretraining stage and learn categories from a few labeled samples in the fine-tuning stage. In this method, we proposed an information-guided teacher–student (TS) pretrained model with min–max instances similarity (MMIS) regularization. In the pretraining stage, we utilized the multicrop mechanism to build a teacher encoder (TE) with multiview information and leveraged the TE to guide the student encoder (SE) with information. Meanwhile, the SE also provided the TE with “questions” during the update process, which the SE also shared updated information with the TE for further refinement. Specifically, we introduced MMIS to address the problem of ambiguity between intraclass and interclass distances in SSD data. During the fine-tuning phase, we fine-tuned the pretrained model obtained by teacher–student with min–max instance similarity (TSMMIS) with a few labeled data and tested the SSD recognition accuracy in four SSD datasets. As the experimental results indicate, our method significantly outperforms other state-of-the-art methods on the four SSD datasets.

Few-Shot Steel Surface Defect Recognition via Self-Supervised Teacher-Student Model with Min-Max Instances Similarity / T. Wang, Z. Li, Y. Xu, J. Chen, A. Genovese, V. Piuri, F. Scotti. - In: IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT. - ISSN 0018-9456. - 72:(2023), pp. 5026016.1-5026016.16. [10.1109/TIM.2023.3315404]

Few-Shot Steel Surface Defect Recognition via Self-Supervised Teacher-Student Model with Min-Max Instances Similarity

A. Genovese;V. Piuri
Penultimo
;
F. Scotti
Ultimo
2023

Abstract

Steel surface defect (SSD) recognition plays a critical role in guaranteeing the quality and economic benefits of industrial metal products. At present, deep-learning-based recognition methods have achieved excellent performance within related fields. However, these methods usually depend on the availability of extensive training data and label information. For SSD recognition, the SSD data are often insufficient and labels are scarce, making it hard to train a supervised deep model. In this article, we proposed a novel few-shot SSD recognition method based on self-supervised contrastive learning (self-SCL), which can effectively learn data representation with unlabeled data in the pretraining stage and learn categories from a few labeled samples in the fine-tuning stage. In this method, we proposed an information-guided teacher–student (TS) pretrained model with min–max instances similarity (MMIS) regularization. In the pretraining stage, we utilized the multicrop mechanism to build a teacher encoder (TE) with multiview information and leveraged the TE to guide the student encoder (SE) with information. Meanwhile, the SE also provided the TE with “questions” during the update process, which the SE also shared updated information with the TE for further refinement. Specifically, we introduced MMIS to address the problem of ambiguity between intraclass and interclass distances in SSD data. During the fine-tuning phase, we fine-tuned the pretrained model obtained by teacher–student with min–max instance similarity (TSMMIS) with a few labeled data and tested the SSD recognition accuracy in four SSD datasets. As the experimental results indicate, our method significantly outperforms other state-of-the-art methods on the four SSD datasets.
Deep learning; few-shot; self-supervised constrastive learning; steel surface defect recognition;
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
2023
22-set-2023
Article (author)
File in questo prodotto:
File Dimensione Formato  
Few-Shot_Steel_Surface_Defect_Recognition_via_Self-Supervised_Teacher-Student_Model_with_Min-Max_Instances_Similarity_compressed.pdf

accesso riservato

Descrizione: Article
Tipologia: Publisher's version/PDF
Dimensione 8.38 MB
Formato Adobe PDF
8.38 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1004291
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact