University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Detecting and understanding interviewer effects on survey data by using a cross-classified mixed effects location–scale model

Brunton-Smith, Ian, Sturgis, P and Leckie, G (2016) Detecting and understanding interviewer effects on survey data by using a cross-classified mixed effects location–scale model Journal of the Royal Statistical Society Series A: Statistics in Society, 180 (2). pp. 551-568.

Detecting and understanding interviewer effects on survey data.pdf - Version of Record
Available under License Creative Commons Attribution.

Download (1MB) | Preview


We propose a cross-classified mixed-effects location scale model for the analysis of interviewer effects in survey data. The model extends the standard two-way cross-classified random-intercept model (respondents nested in interviewers crossed with areas) by specifying the residual variance to be a function of covariates and an additional interviewer random effect. This extension provides a way to study interviewers’ effects on not just the ‘location’ (mean) of respondents’ responses, but additionally on their ‘scale’ (variability). It therefore allows researchers to address new questions such as: Do interviewers influence the variability of their respondents’ responses in addition to their average, and if so why? In doing so, the model facilitates a more complete and flexible assessment of the factors associated with interviewer error. We illustrate this model using data from wave 3 of the UK Household Longitudinal Survey (UKHLS), which we link to a range of interviewer characteristics measured in an independent survey of interviewers. By identifying both interviewer characteristics in general, but also specific interviewers who are associated with unusually high or low or homogeneous or heterogeneous responses, the model provides a way to inform improvements to survey quality.

Item Type: Article
Divisions : Faculty of Arts and Social Sciences > Department of Sociology
Authors :
Sturgis, P
Leckie, G
Date : 13 May 2016
Funders : Economic and Social Research Council (ESRC)
DOI : 10.1111/rssa.12205
Copyright Disclaimer : © 2016 The Authors Journal of the Royal Statistical Society: Series A (Statistics in Society) Published by John Wiley & Sons Ltd on behalf of the Royal Statistical Society. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Uncontrolled Keywords : Interviewer effect; Measurement error; Mixed effects location–scale model; Stat-JR software; Understanding society
Depositing User : Symplectic Elements
Date Deposited : 01 Apr 2016 08:02
Last Modified : 11 Dec 2018 11:22

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800