Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Mokkink, Lidwine B.ca
• dc.contributor.author Terwee, Caroline B.ca
• dc.contributor.author Gibbons, Elisabethca
• dc.contributor.author Stratford, Paul W.ca
• dc.contributor.author Alonso Caballero, Jordica
• dc.contributor.author Patrick, Donald L.ca
• dc.contributor.author Knol, Dirk L.ca
• dc.contributor.author Bouter, Lex M.ca
• dc.contributor.author De Vet, Henrica C. W.ca
• dc.date.accessioned 2012-05-11T07:29:23Z
• dc.date.available 2012-05-11T07:29:23Z
• dc.date.issued 2010ca
• dc.description.abstract Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions./nConclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.
• dc.format.mimetype application/pdfca
• dc.identifier.citation Mokkink LB, Terwee CB, Gibbons E, Stratford PW, Alonso J, Patrick DL et al. Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist. BMC Med Res Methodol. 2010;10:82. DOI: 10.1186/1471-2288-10-82ca
• dc.identifier.doi http://dx.doi.org/10.1186/1471-2288-10-82
• dc.identifier.issn 1471-2288ca
• dc.identifier.uri http://hdl.handle.net/10230/16458
• dc.language.iso engca
• dc.publisher BioMed Centralca
• dc.relation.ispartof BMC Medical Research Methodology. 2010;10:82
• dc.rights © 2010 Mokkink et al. Creative Commons Attribution Licenseca
• dc.rights.accessRights info:eu-repo/semantics/openAccess
• dc.rights.uri http://creativecommons.org/licenses/by/2.0/
• dc.subject.other Indicadors de salut
• dc.subject.other Salut pública -- Avaluació
• dc.subject.other Salut pública -- Enquestes
• dc.title Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklistca
• dc.type info:eu-repo/semantics/articleca
• dc.type.version info:eu-repo/semantics/publishedVersion