University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Regression-based response probing for assessing the validity of survey questions

Sturgis, Patrick, Brunton-Smith, Ian and Jackson, Jonathan (2018) Regression-based response probing for assessing the validity of survey questions In: Question Design Testing and Evaluation. Wiley, Chichester.

[img] Text
Regression-based response probing for assessing the validity of survey questions.doc - Accepted version Manuscript
Restricted to Repository staff only

Download (445kB)

Abstract

We describe a procedure for assessing the validity of survey questions. Response probes are administered which ask respondents to say in their own words what came to mind when answering the question. The verbatim responses are coded to a frame which captures the conceptual content of the responses and are then included as predictors in a regression model, where the question that was used to elicit the verbatim responses is specified as the outcome. Controls are included so that the estimated coefficients of the model can be used to interpret whether and to what extent the different cognitive frames identified in the verbatim data align with responses to the question. The technique can be extended to include split-ballot designs, where variants of the target question are randomised across groups. We illustrate the procedure using two example questions: interpersonal trust and fear of crime.

Item Type: Book Section
Divisions : Faculty of Arts and Social Sciences > Department of Sociology
Authors :
NameEmailORCID
Sturgis, Patrick
Brunton-Smith, IanI.R.Brunton-Smith@surrey.ac.uk
Jackson, Jonathan
Editors :
NameEmailORCID
Beatty, P.
Willis, G.
Padilla, J-L.
Date : 2018
Related URLs :
Depositing User : Clive Harris
Date Deposited : 01 Jun 2018 11:42
Last Modified : 16 Jan 2019 19:11
URI: http://epubs.surrey.ac.uk/id/eprint/846981

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800