By means of a split-ballot survey experiment, we study whether a normative instruction not to use the internet when answering political knowledge questions reduces cheating in web surveys. The knowledge questions refer to basic facts about the European Union and the data come from the Italian National Election Study web panel carried out in Italy before the 2014 European Election. Our analysis shows that a simple normative instruction significantly reduces cheating. We also show that reducing cheating is important to achieve a correct assessment of reliability of knowledge scales, while a decrease of cheating leaves unaltered the knowledge gap between lower and higher educated respondents. These results invite caution when including political knowledge questions in an online survey. Our advice is to include a normative instruction not to search the internet to reduce cheating and obtain more genuine answers. More generally, we conclude by stressing the need to consider the implications of online data collection when building questionnaires for public opinion research.

Thou shalt not cheat : how to reduce internet use in web surveys on political knowledge / C. Vezzoni, R. Ladini. - In: RIVISTA ITALIANA DI SCIENZA POLITICA. - ISSN 0048-8402. - 47:3(2017), pp. 251-265. [10.1017/ipo.2016.25]

Thou shalt not cheat : how to reduce internet use in web surveys on political knowledge

C. Vezzoni;R. Ladini
2017

Abstract

By means of a split-ballot survey experiment, we study whether a normative instruction not to use the internet when answering political knowledge questions reduces cheating in web surveys. The knowledge questions refer to basic facts about the European Union and the data come from the Italian National Election Study web panel carried out in Italy before the 2014 European Election. Our analysis shows that a simple normative instruction significantly reduces cheating. We also show that reducing cheating is important to achieve a correct assessment of reliability of knowledge scales, while a decrease of cheating leaves unaltered the knowledge gap between lower and higher educated respondents. These results invite caution when including political knowledge questions in an online survey. Our advice is to include a normative instruction not to search the internet to reduce cheating and obtain more genuine answers. More generally, we conclude by stressing the need to consider the implications of online data collection when building questionnaires for public opinion research.
cheating in web surveys; survey experiments; political knowledge; European Union; reliability and validity
Settore SPS/07 - Sociologia Generale
Settore SPS/11 - Sociologia dei Fenomeni Politici
   Come cambia la rappresentanza politica in Italia La decisione di voto nel ciclo elettorale 2013-2015
   MINISTERO DELL'ISTRUZIONE E DEL MERITO
   2010943X4L_001
2017
Article (author)
File in questo prodotto:
File Dimensione Formato  
Vezzoni_Ladini_RISP_Thou shalt not cheat_2016_preprint.pdf

accesso aperto

Descrizione: Pdf pre-print
Tipologia: Pre-print (manoscritto inviato all'editore)
Dimensione 524.17 kB
Formato Adobe PDF
524.17 kB Adobe PDF Visualizza/Apri
thou_shalt_not_cheat_how_to_reduce_internet_use_in_web_surveys_on_political_knowledge.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 239.69 kB
Formato Adobe PDF
239.69 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/563721
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 4
social impact