Flexibility in reaction time analysis: many roads to a false positive?

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Morís Fernández, Luis, 1982-
• dc.contributor.author Vadillo, Miguel A.
• dc.date.accessioned 2021-04-20T07:48:43Z
• dc.date.available 2021-04-20T07:48:43Z
• dc.date.issued 2020
• dc.description.abstract In the present article, we explore the influence of undisclosed flexibility in the analysis of reaction times (RTs). RTs entail some degrees of freedom of their own, due to their skewed distribution, the potential presence of outliers and the availability of different methods to deal with these issues. Moreover, these degrees of freedom are usually not considered part of the analysis itself, but preprocessing steps that are contingent on data. We analysed the impact of these degrees of freedom on the false-positive rate using simulations over real and simulated data. When several preprocessing methods are used in combination, the false-positive rate can easily rise to 17%. This figure becomes more concerning if we consider that more degrees of freedom are awaiting down the analysis pipeline, potentially making the final false-positive rate much higher.en
• dc.description.sponsorship The present work was supported by grant no. 2016-T1/SOC-1395 from Comunidad de Madrid (Programa de Atracción de Talento Investigador), grant nos. PSI2017-85159-P and PSI2016-75558-P from Agencia Estatal de Investigación (AEI, National Research Agency) and Fondo Europeo de Desarrollo Regional (FEDER, European Regional Development Fund), and grant no. 2017 SGR 1545 financed by the AGAUR (Catalan government).
• dc.format.mimetype application/pdf
• dc.identifier.citation Morís Fernández L, Vadillo MA. Flexibility in reaction time analysis: many roads to a false positive?. R Soc Open Sci. 2020 Feb 5;7(2):190831. DOI: 10.1098/rsos.190831
• dc.identifier.doi http://dx.doi.org/10.1098/rsos.190831
• dc.identifier.issn 2054-5703
• dc.identifier.uri http://hdl.handle.net/10230/47161
• dc.language.iso eng
• dc.publisher Royal Society
• dc.relation.ispartof Royal Society open science. 2020 Feb 5;7(2):190831
• dc.relation.projectID info:eu-repo/grantAgreement/ES/2PE/PSI2017-85159-P
• dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/PSI2016-75558-P
• dc.rights © 2020 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.
• dc.rights.accessRights info:eu-repo/semantics/openAccess
• dc.rights.uri http://creativecommons.org/licenses/by/4.0/
• dc.subject.keyword Reaction timeen
• dc.subject.keyword Questionable research practicesen
• dc.subject.keyword P-hackingen
• dc.subject.keyword False positivesen
• dc.title Flexibility in reaction time analysis: many roads to a false positive?en
• dc.type info:eu-repo/semantics/article
• dc.type.version info:eu-repo/semantics/publishedVersion