In online surveys, the control of respondents is almost absent: for this reason, the use of screener questions or “screeners” has been suggested to evaluate respondent attention. Screeners ask respondents to follow a certain number of instructions described in a text that contains a varying amount of misleading information. Previous work focused on ad-hoc experimental designs composed of a few questions, generally administered to small samples. Using an experiment inserted into an Italian National Election Study survey (N=3,000), we show that short screeners – namely, questions with a reduced amount of misleading information – should be preferred to longer screeners in evaluating the attentiveness of respondents. We also show there is no effect of screener questions in activating respondent attention.
Short is Better : Evaluating the Attentiveness of Online Respondents Through Screener Questions in a Real Survey Environment / M. Mancosu, R. Ladini, C. Vezzoni. - In: BULLETIN DE MÉTHODOLOGIE SOCIOLOGIQUE. - ISSN 0759-1063. - 141:1(2019 Jan), pp. 30-45. [10.1177/0759106318812788]
Short is Better : Evaluating the Attentiveness of Online Respondents Through Screener Questions in a Real Survey Environment
R. Ladini;C. Vezzoni
2019
Abstract
In online surveys, the control of respondents is almost absent: for this reason, the use of screener questions or “screeners” has been suggested to evaluate respondent attention. Screeners ask respondents to follow a certain number of instructions described in a text that contains a varying amount of misleading information. Previous work focused on ad-hoc experimental designs composed of a few questions, generally administered to small samples. Using an experiment inserted into an Italian National Election Study survey (N=3,000), we show that short screeners – namely, questions with a reduced amount of misleading information – should be preferred to longer screeners in evaluating the attentiveness of respondents. We also show there is no effect of screener questions in activating respondent attention.File | Dimensione | Formato | |
---|---|---|---|
0759106318812788.pdf
accesso aperto
Tipologia:
Publisher's version/PDF
Dimensione
197.69 kB
Formato
Adobe PDF
|
197.69 kB | Adobe PDF | Visualizza/Apri |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.