Visual saliency refers to the part of the visual scene in which the subject’s gaze is focused, allowing significant applications in various fields including automotive. Indeed, the car driver decides to focus on specific objects rather than others by deterministic brain-driven saliency mechanisms inherent perceptual activity. In the automotive industry, vision saliency estimation is one of the most common technologies in Advanced Driver Assistant Systems (ADAS). In this work, we proposed an intelligent system consisting of: (1) an ad-hoc Non-Local Semantic Segmentation Deep Network to process the frames captured by automotive-grade camera device placed outside the car, (2) an innovative bio-sensor to perform car driver PhotoPlethysmoGraphy (PPG) signal sampling for monitoring related drowsiness and, (3) ad-hoc designed 1D Temporal Deep Convolutional Network designed to classify the so collected PPG time-series providing an assessment of the driver attention level. A downstream check-block verifies if the car driver attention level is adequate for the saliency-based scene classification. Our approach is extensively evaluated on DH1FK dataset, and experimental results show the effectiveness of the proposed pipeline.

Advanced car driving assistant system: A deep non-local pipeline combined with 1D dilated CNN for safety driving / F. Rundo, R. Leotta, F. Trenta, G. Bellitto, F. Proietto Salanitri, V. Piuri, A. Genovese, R. Donida Labati, F. Scotti, C. Spampinato, S. Battiato - In: Proceedings of the International Conference on Image Processing and Vision Engineering. 1 / [a cura di] F. Imai, C. Distante, S. Battiato. - [s.l] : SCITEPRESS, 2021. - ISBN 9789897585111. - pp. 81-90 (( convegno IMPROVE tenutosi a Virtual event nel 2021 [10.5220/0010381000810090].

Advanced car driving assistant system: A deep non-local pipeline combined with 1D dilated CNN for safety driving

V. Piuri;A. Genovese;R. Donida Labati;F. Scotti;
2021

Abstract

Visual saliency refers to the part of the visual scene in which the subject’s gaze is focused, allowing significant applications in various fields including automotive. Indeed, the car driver decides to focus on specific objects rather than others by deterministic brain-driven saliency mechanisms inherent perceptual activity. In the automotive industry, vision saliency estimation is one of the most common technologies in Advanced Driver Assistant Systems (ADAS). In this work, we proposed an intelligent system consisting of: (1) an ad-hoc Non-Local Semantic Segmentation Deep Network to process the frames captured by automotive-grade camera device placed outside the car, (2) an innovative bio-sensor to perform car driver PhotoPlethysmoGraphy (PPG) signal sampling for monitoring related drowsiness and, (3) ad-hoc designed 1D Temporal Deep Convolutional Network designed to classify the so collected PPG time-series providing an assessment of the driver attention level. A downstream check-block verifies if the car driver attention level is adequate for the saliency-based scene classification. Our approach is extensively evaluated on DH1FK dataset, and experimental results show the effectiveness of the proposed pipeline.
Drowsiness; Deep learning; D-CNN; Deep-LSTM; PPG (PhotoPlethysmoGraphy)
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
improve21.pdf

accesso aperto

Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 601.51 kB
Formato Adobe PDF
601.51 kB Adobe PDF Visualizza/Apri
103810.pdf

non disponibili

Tipologia: Publisher's version/PDF
Dimensione 443.18 kB
Formato Adobe PDF
443.18 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2434/812608
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact