Saris, Willem E.2017-03-302017-03-302012http://hdl.handle.net/10230/28336In this paper different criteria for the choice of an evaluation procedure for survey questions are discussed. Firstly, we mention a practical criterion: the amount of data collection the procedures require. Secondly, we suggest the distinction between subjective judgments and evaluations based on empirical data. Thirdly , we   suggest that it would be attractive if the procedure could evaluate the following aspects of the questions: 1. The relationship between the concept to be measured and the question specified, 2. The effects of the form of the question on the quality of the question with respect to: a. the complexity of the formulation, b. the precision, c. possible method effects, d. many other characteristics, 3. The social desirability of  some of the response categories. Besides that, it would be attractive if the procedure could indicate  the effect of the lack of the knowledge of the respondents about the topic on the respondents answers.  We compare 13 procedures for the evaluation of questions with respect to these criteria and will derive some conclusions from this overview.application/pdfengThis is an Open Access article distributed under the terms of the Creative Commons Attribution License Creative Commons Attribution 4.0 International, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properlyattributed.info:eu-repo/semantics/workingPaperinfo:eu-repo/semantics/openAccess