Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Gignac, Florence
  • dc.contributor.author Gresle, Anne-Sophie
  • dc.contributor.author Santoro Lamelas, Valeria
  • dc.contributor.author Yepes-Baldó, Montserrat
  • dc.contributor.author de la Torre, Leonardo
  • dc.contributor.author Pinazo, Maria-Jesus
  • dc.contributor.author InSPIRES Consortium
  • dc.date.accessioned 2022-06-01T05:32:10Z
  • dc.date.available 2022-06-01T05:32:10Z
  • dc.date.issued 2021
  • dc.description.abstract Research projects involving science shops and citizen science in their promotion of participatory approaches are flourishing globally. However, an instrument evaluating the impacts of such approaches at different stages of a participatory research processes has yet to be validated. The InSPIRES H2020 project developed an impact evaluation tool for just this purpose, consisting of 64 items that reflect upon the dimensions of knowledge democracy, citizen-led research, participatory dynamics, transformative change, and integrity. In this article, we seek to test the content validity of this tool and to provide recommendations that can ensure its validity. A panel of nine experts was created to evaluate each item as regards the following three criteria: representativeness, relevance, and clarity. The Aiken’s V and Wilson Score methods were used to assess the tool’s content validity based on the experts’ ratings. Experts’ written comments were also reviewed. At the panel level, 75% of the items were considered satisfactory in relation to each of the three validity criteria. However, at the population level, 72% of the items suggested that parts of the tool were not valid and required revision. The main suggestions from the experts pointed to the need to reformulate items in which the separation between science and society appeared reinforced and to develop more items about the gender perspective of a research project. The revised version of the tool should serve as a well-founded, comprehensive evaluation instrument for on-going and future projects whose goal is to self-reflect and compare participatory research processes.
  • dc.description.sponsorship This work was supported by the European Union’s Horizon 2020 research and innovation programme [under grant agreement No 741677]. The European Commission is not responsible for any use that may be made of the information it contains.
  • dc.format.mimetype application/pdf
  • dc.identifier.citation Gignac F, Gresle AS, Santoro Lamelas V, Yepes-Baldó M, de la Torre L, Pinazo MJ; InSPIRES Consortium. Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool. Research Evaluation. 2021;30(4):500-13. DOI: 10.1093/reseval/rvab026
  • dc.identifier.doi http://dx.doi.org/10.1093/reseval/rvab026
  • dc.identifier.issn 0958-2029
  • dc.identifier.uri http://hdl.handle.net/10230/53337
  • dc.language.iso eng
  • dc.publisher Oxford University Press
  • dc.relation.ispartof Research Evaluation. 2021;30(4):500-13
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/741677
  • dc.rights © The Author(s) 2021. Published by Oxford University Press. This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.rights.uri https://creativecommons.org/licenses/by-nc/4.0/
  • dc.title Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool
  • dc.type info:eu-repo/semantics/article
  • dc.type.version info:eu-repo/semantics/publishedVersion