DANKMEMES is a shared task proposed for the 2020 EVALITA campaign, focusing on the automatic classification of Internet memes. Providing a corpus of 2.361 memes on the 2019 Italian Government Crisis, DANKMEMES features three tasks: A) Meme Detection, B) Hate Speech Identification, and C) Event Clustering. Overall, 5 groups took part in the first task, 2 in the second and 1 in the third. The best system was proposed by the UniTor group and achieved a F1 score of 0.8501 for task A, 0.8235 for task B and 0.2657 for task C. In this report, we describe how the task was set up, we report the system results and we discuss them.
DANKMEMES @ EVALITA 2020: The memeing of life: Memes, multimodality and politics / M. Miliani, G. Giorgi, I. Rama, G. Anselmi, G.E. Lebani (CEUR WORKSHOP PROCEEDINGS). - In: EVALITA / [a cura di] V. Basile, D. Croce, M. Di Maro, L. C. Passaro. - [s.l] : CEUR-WS, 2020 Dec 17. - pp. 1-10 (( Intervento presentato al 7. convegno Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop tenutosi a (online) nel 2020.
DANKMEMES @ EVALITA 2020: The memeing of life: Memes, multimodality and politics
G. GiorgiSecondo
;I. Rama;G. AnselmiPenultimo
;
2020
Abstract
DANKMEMES is a shared task proposed for the 2020 EVALITA campaign, focusing on the automatic classification of Internet memes. Providing a corpus of 2.361 memes on the 2019 Italian Government Crisis, DANKMEMES features three tasks: A) Meme Detection, B) Hate Speech Identification, and C) Event Clustering. Overall, 5 groups took part in the first task, 2 in the second and 1 in the third. The best system was proposed by the UniTor group and achieved a F1 score of 0.8501 for task A, 0.8235 for task B and 0.2657 for task C. In this report, we describe how the task was set up, we report the system results and we discuss them.File | Dimensione | Formato | |
---|---|---|---|
paper174.pdf
accesso aperto
Tipologia:
Publisher's version/PDF
Dimensione
822.95 kB
Formato
Adobe PDF
|
822.95 kB | Adobe PDF | Visualizza/Apri |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.