By means of a split-ballot survey experiment, we study whether a normative instruction not to use the internet when answering political knowledge questions reduces cheating in web surveys. The knowledge questions refer to basic facts about the European Union and the data come from the Italian National Election Study web panel carried out in Italy before the 2014 European Election. Our analysis shows that a simple normative instruction significantly reduces cheating. We also show that reducing cheating is important to achieve a correct assessment of reliability of knowledge scales, while a decrease of cheating leaves unaltered the knowledge gap between lower and higher educated respondents. These results invite caution when including political knowledge questions in an online survey. Our advice is to include a normative instruction not to search the internet to reduce cheating and obtain more genuine answers. More generally, we conclude by stressing the need to consider the implications of online data collection when building questionnaires for public opinion research.
Thou shalt not cheat : how to reduce internet use in web surveys on political knowledge / C. Vezzoni, R. Ladini. - In: RIVISTA ITALIANA DI SCIENZA POLITICA. - ISSN 0048-8402. - 47:3(2017), pp. 251-265. [10.1017/ipo.2016.25]
Thou shalt not cheat : how to reduce internet use in web surveys on political knowledge
C. Vezzoni;R. Ladini
2017
Abstract
By means of a split-ballot survey experiment, we study whether a normative instruction not to use the internet when answering political knowledge questions reduces cheating in web surveys. The knowledge questions refer to basic facts about the European Union and the data come from the Italian National Election Study web panel carried out in Italy before the 2014 European Election. Our analysis shows that a simple normative instruction significantly reduces cheating. We also show that reducing cheating is important to achieve a correct assessment of reliability of knowledge scales, while a decrease of cheating leaves unaltered the knowledge gap between lower and higher educated respondents. These results invite caution when including political knowledge questions in an online survey. Our advice is to include a normative instruction not to search the internet to reduce cheating and obtain more genuine answers. More generally, we conclude by stressing the need to consider the implications of online data collection when building questionnaires for public opinion research.File | Dimensione | Formato | |
---|---|---|---|
Vezzoni_Ladini_RISP_Thou shalt not cheat_2016_preprint.pdf
accesso aperto
Descrizione: Pdf pre-print
Tipologia:
Pre-print (manoscritto inviato all'editore)
Dimensione
524.17 kB
Formato
Adobe PDF
|
524.17 kB | Adobe PDF | Visualizza/Apri |
thou_shalt_not_cheat_how_to_reduce_internet_use_in_web_surveys_on_political_knowledge.pdf
accesso riservato
Tipologia:
Publisher's version/PDF
Dimensione
239.69 kB
Formato
Adobe PDF
|
239.69 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.