Image segmentation is a key topic in image processing and computer vision and several approaches have been proposed in the literature to address it. The formulation of the image segmentation problem as the minimization of the Mumford-Shah energy has been one of the most commonly used techniques in the last past decades. More recently, deep learning methods have yielded a new generation of image segmentation models with remarkable performance. In this paper we propose an unsupervised deep learning approach for piece-wise image segmentation based on the so called Deep Image Prior by parameterizing the Mumford-Shah functional in terms of the weights of a convolutional neural network. Several numerical experiments on both biomedical and natural images highlight the goodness of the suggested approach. The implicit regularization provided by the Deep Image Prior model allows to also consider noisy input images and to investigate the robustness of the proposed technique with respect to the level of noise.

Piece-wise Constant Image Segmentation with a Deep Image Prior Approach / A. Benfenati, A. Catozzi, G. Franchini, F. Porta (LECTURE NOTES IN COMPUTER SCIENCE). - In: Scale Space and Variational Methods in Computer Vision / [a cura di] L. Calatroni, M. Donatelli, S. Morigi, M. Prato, M. Santacesaria. - [s.l] : Springer, 2023. - ISBN 978-3-031-31974-7. - pp. 352-362 (( Intervento presentato al 9. convegno Scale Space and Variational Methods in Computer Vision tenutosi a Santa Margherita di Pula nel 2023 [10.1007/978-3-031-31975-4_27].

Piece-wise Constant Image Segmentation with a Deep Image Prior Approach

A. Benfenati
Primo
;
2023

Abstract

Image segmentation is a key topic in image processing and computer vision and several approaches have been proposed in the literature to address it. The formulation of the image segmentation problem as the minimization of the Mumford-Shah energy has been one of the most commonly used techniques in the last past decades. More recently, deep learning methods have yielded a new generation of image segmentation models with remarkable performance. In this paper we propose an unsupervised deep learning approach for piece-wise image segmentation based on the so called Deep Image Prior by parameterizing the Mumford-Shah functional in terms of the weights of a convolutional neural network. Several numerical experiments on both biomedical and natural images highlight the goodness of the suggested approach. The implicit regularization provided by the Deep Image Prior model allows to also consider noisy input images and to investigate the robustness of the proposed technique with respect to the level of noise.
Image segmentation; Image segmentation with noise; Deep image prior; Neural Network; Unsupervised deep learning
Settore MAT/08 - Analisi Numerica
2023
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
SSVM2023-1.pdf

accesso riservato

Tipologia: Pre-print (manoscritto inviato all'editore)
Dimensione 694.8 kB
Formato Adobe PDF
694.8 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
978-3-031-31975-4_27.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 2.06 MB
Formato Adobe PDF
2.06 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/991430
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact