Smartphone apps may help promoting the early diagnosis of melanoma. The reliability of specialist judgment on lesions should be assessed. Hereby, we evaluated the agreement of six young dermatologists, after a specific training. Clinical judgment was evaluated during two online sessions, one month apart, on a series of 45 pigmentary lesions. Lesions were classified as highly suspicious, suspicious, non suspicious or not assessable. Cohen’s and Fleiss’ kappa were used to calculate intra- and inter-rater agreement. The overall intra-rater agreement was 0.42 (95% confidence interval - CI: 0.33-0.50), varying between 0.12-0.59 on single raters. The inter-rater agreement during the first phase was 0.29 (95% CI: 0.24-0.34). When considering the agreement for each category of judgment, kappa varied from 0.19 for not assessable to 0.48 for highly suspected lesions. Similar results were obtained in the second exercise. The study showed a less than satisfactory agreement among young dermatologists. Our data point to the need for improving the reliability of the clinical diagnoses of melanoma especially when assessing small lesions and when dealing with thin melanomas at a population level.

Agreement on classification of clinical photographs of pigmentary lesions: Exercise after a training course with young dermatologists / S. Cazzaniga, L. De Ponti, G.M. Baratelli, S. Francione, C. La Vecchia, A. Di Landro, A. Carugno, M. Di Mercurio, L. Germi, G. Trevisan, M. Fenaroli, C. Capasso, M. Pezza, P. Dri, E. Castelli, L. Naldi. - In: DERMATOLOGY REPORTS. - ISSN 2036-7406. - (2022), pp. 1-8. [Epub ahead of print] [10.4081/dr.2022.9500]

Agreement on classification of clinical photographs of pigmentary lesions: Exercise after a training course with young dermatologists

C. La Vecchia;M. Fenaroli;
2022

Abstract

Smartphone apps may help promoting the early diagnosis of melanoma. The reliability of specialist judgment on lesions should be assessed. Hereby, we evaluated the agreement of six young dermatologists, after a specific training. Clinical judgment was evaluated during two online sessions, one month apart, on a series of 45 pigmentary lesions. Lesions were classified as highly suspicious, suspicious, non suspicious or not assessable. Cohen’s and Fleiss’ kappa were used to calculate intra- and inter-rater agreement. The overall intra-rater agreement was 0.42 (95% confidence interval - CI: 0.33-0.50), varying between 0.12-0.59 on single raters. The inter-rater agreement during the first phase was 0.29 (95% CI: 0.24-0.34). When considering the agreement for each category of judgment, kappa varied from 0.19 for not assessable to 0.48 for highly suspected lesions. Similar results were obtained in the second exercise. The study showed a less than satisfactory agreement among young dermatologists. Our data point to the need for improving the reliability of the clinical diagnoses of melanoma especially when assessing small lesions and when dealing with thin melanomas at a population level.
teledermatology; skin cancer; melanoma; classification; agreement;
Settore MED/01 - Statistica Medica
Settore MED/06 - Oncologia Medica
14-lug-2022
Article (author)
File in questo prodotto:
File Dimensione Formato  
Agreement Cazzaniga S_Dermatology Reports.pdf

accesso aperto

Tipologia: Publisher's version/PDF
Dimensione 762.64 kB
Formato Adobe PDF
762.64 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/939110
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact