When experts disagree: Response aggregation and Its consequences in expert surveys

View Researcher's Other Codes

Disclaimer: The provided code links for this paper are external links. Science Nest has no responsibility for the accuracy, legality or content of these links. Also, by downloading this code(s), you agree to comply with the terms of use as set out by the author(s) of the code(s).

Authors Rene Lindstaedt, Sven-Oliver Proksch, Jonathan B. Slapin
Journal/Conference Name POLITICAL SCIENCE RESEARCH AND METHODS
Paper Category
Paper Abstract Political scientists use expert surveys to assess latent features of political actors. Experts, though, are unlikely to be equally informed and assess all actors equally well. The literature acknowledges variance in measurement quality, but pays little attention to the implications of uncertainty for aggregating responses. We discuss the nature of the measurement problem in expert surveys. We then propose methods to assess the ability of experts to judge where actors stand and to aggregate expert responses. We examine the effects of aggregation for a prominent survey in the literature on party politics and EU integration. Using a Monte Carlo simulation, we demonstrate that it is better to aggregate expert responses using the median or modal response, rather than the mean.
Date of publication 2018
Code Programming Language R
Comment

Copyright Researcher 2022