Two approaches to evaluate measurement quality in online surveys : an application using the Norwegian Citizen Panel

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author DeCastellarnau, Annaca
• dc.contributor.author Revilla, Melanieca
• dc.date.accessioned 2018-01-26T10:41:00Z
• dc.date.available 2018-01-26T10:41:00Z
• dc.date.issued 2017-05
• dc.description.abstract Previous research has shown that measurement errors are large in data collected through surveys. However, the size of these errors varies depending on the language, the mode of data collection, the question‟s characteristics, etc. Information about the size of these errors, or their complement, the measurement quality, can be used for designing better questionnaires, and to correct for measurement errors in substantive analyses. Getting further information about the measurement quality is therefore crucial. However, little is known about the measurement quality of questions in web surveys. Thus, in this paper, we evaluate the measurement quality of a set of survey questions from the Norwegian Citizen Panel; one of the few probability-based online panels existing at this day. To do so, we use two different approaches: (1) we implement two Multitrait-Multimethod experiments in this panel‟s 5th wave, and (2) we predict the quality of the questions using the software Survey Quality Predictor. Overall, measurements‟ quality is quite high (between 0.60 and 0.89), even if comparing the results of the two approaches, we observe some minor differences in quality. In addition, using 11-point scales with two fixed reference points, usually, provides the highest quality.ca
• dc.description.sponsorship We are thankful to the Norwegian Citizen Panel to accept our experimental proposal and specially to Sveinung Arnesen for his help in setting up the experiment and his valuable comments. The authors also appreciate the feedback from Willem Saris, Diana Zavala-Rojas and Teresa Queralt.en
• dc.format.mimetype application/pdfca
• dc.identifier.uri http://hdl.handle.net/10230/33767
• dc.language.iso engca
• dc.relation.ispartofseries RECSM Working Paper Series;53
• dc.rights This is an Open Access article distributed under the terms of the Creative Commons Attribution License Creative Commons Attribution 4.0 International, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properlyattributed.ca
• dc.rights.accessRights info:eu-repo/semantics/openAccessca
• dc.rights.uri http://creativecommons.org/licenses/by/4.0/ca
• dc.subject.other Measurement qualityca
• dc.subject.other Multitrait-Multimethod (MTMM)ca
• dc.subject.other SQPca
• dc.subject.other web surveysca
• dc.subject.other Norwegian Citizen Panelca
• dc.title Two approaches to evaluate measurement quality in online surveys : an application using the Norwegian Citizen Panelca
• dc.type info:eu-repo/semantics/workingPaperca
• dc.type.version info:eu-repo/semantics/draft