Welcome to the UPF Digital Repository

Flexibility in reaction time analysis: many roads to a false positive?

Show simple item record

dc.contributor.author Morís Fernández, Luis, 1982-
dc.contributor.author Vadillo, Miguel A.
dc.date.accessioned 2021-04-20T07:48:43Z
dc.date.available 2021-04-20T07:48:43Z
dc.date.issued 2020
dc.identifier.citation Morís Fernández L, Vadillo MA. Flexibility in reaction time analysis: many roads to a false positive?. R Soc Open Sci. 2020 Feb 5;7(2):190831. DOI: 10.1098/rsos.190831
dc.identifier.issn 2054-5703
dc.identifier.uri http://hdl.handle.net/10230/47161
dc.description.abstract In the present article, we explore the influence of undisclosed flexibility in the analysis of reaction times (RTs). RTs entail some degrees of freedom of their own, due to their skewed distribution, the potential presence of outliers and the availability of different methods to deal with these issues. Moreover, these degrees of freedom are usually not considered part of the analysis itself, but preprocessing steps that are contingent on data. We analysed the impact of these degrees of freedom on the false-positive rate using simulations over real and simulated data. When several preprocessing methods are used in combination, the false-positive rate can easily rise to 17%. This figure becomes more concerning if we consider that more degrees of freedom are awaiting down the analysis pipeline, potentially making the final false-positive rate much higher.
dc.description.sponsorship The present work was supported by grant no. 2016-T1/SOC-1395 from Comunidad de Madrid (Programa de Atracción de Talento Investigador), grant nos. PSI2017-85159-P and PSI2016-75558-P from Agencia Estatal de Investigación (AEI, National Research Agency) and Fondo Europeo de Desarrollo Regional (FEDER, European Regional Development Fund), and grant no. 2017 SGR 1545 financed by the AGAUR (Catalan government).
dc.format.mimetype application/pdf
dc.language.iso eng
dc.publisher Royal Society
dc.relation.ispartof Royal Society open science. 2020 Feb 5;7(2):190831
dc.rights © 2020 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.
dc.rights.uri http://creativecommons.org/licenses/by/4.0/
dc.title Flexibility in reaction time analysis: many roads to a false positive?
dc.type info:eu-repo/semantics/article
dc.identifier.doi http://dx.doi.org/10.1098/rsos.190831
dc.subject.keyword Reaction time
dc.subject.keyword Questionable research practices
dc.subject.keyword P-hacking
dc.subject.keyword False positives
dc.relation.projectID info:eu-repo/grantAgreement/ES/2PE/PSI2017-85159-P
dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/PSI2016-75558-P
dc.rights.accessRights info:eu-repo/semantics/openAccess
dc.type.version info:eu-repo/semantics/publishedVersion


This item appears in the following Collection(s)

Show simple item record

Search DSpace

Advanced Search


My Account


Compliant to Partaking