Multisource assessment for development purposes: revisiting the methodology of data analysis
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Batista-Foguet, Joan Manuel
- dc.contributor.author Saris, Willem E.
- dc.contributor.author Boyatzis, Richard E.
- dc.contributor.author Serlavós, Ricard
- dc.contributor.author Velasco Moreno, Ferran
- dc.date.accessioned 2023-01-17T09:11:31Z
- dc.date.available 2023-01-17T09:11:31Z
- dc.date.issued 2019
- dc.description.abstract Multisource assessment (MSA) is based on the belief that assessments are valid inferences about an individual’s behavior. When used for performance management purposes, convergence of views among raters is important, and therefore testing factor invariance across raters is critical. However, when MSA is used for development purposes, raters usually come from a greater number of contexts, a fact that requires a different data analysis approach. We revisit the MSA data analysis methodology when MSA is used for development, with the aim of improving its effectiveness. First, we argue that having raters from different contexts is an integral element of the assessment, with the trait–context dyad being the actual latent variable. This leads to the specification of an Aggregate (instead of the usual Latent) multidimensional factor model. Second, since data analysis usually aggregates scores for each rater group into a single mean that is then compared with the self-rating score, we propose that the test for factor invariance must also include scalar invariance, a pre-requisite for mean comparison. To illustrate this methodology we conducted a 360° survey on a sample of over 1100 MBA students enrolled in a leadership development course. Finally, by means of the study we show how the survey can be customized to each rater group to make the MSA process more effective.
- dc.description.sponsorship This research was part of the Spanish Ministry of Sciences and Innovation (MICINN) project. Award number: “EDU2015-68610-R (MINECO/FEDER)” on “Emotional and Social Competencies Development Program within the European Higher Education.” The research work to produce this article was undertaken in the framework of Leadership Development Research Group (GLEAD) that receives funding from the Generalitat de Catalunya, ref. 2017 SGR 619.
- dc.format.mimetype application/pdf
- dc.identifier.citation Batista-Foguet JM, Saris W, Boyatzis RE, Serlavós R, Velasco F. Multisource assessment for development purposes: revisiting the methodology of data analysis. Front Psychol. 2019 Jan 04;9:2646. DOI: 10.3389/fpsyg.2018.02646
- dc.identifier.doi http://dx.doi.org/10.3389/fpsyg.2018.02646
- dc.identifier.issn 1664-1078
- dc.identifier.uri http://hdl.handle.net/10230/55309
- dc.language.iso eng
- dc.publisher Frontiers
- dc.relation.ispartof Frontiers in Psychology. 2019 Jan 04;9:2646
- dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/EDU2015-68610-R
- dc.rights Copyright © 2019 Batista-Foguet, Saris, Boyatzis, Serlavós and Velasco Moreno. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.rights.uri http://creativecommons.org/licenses/by/4.0/
- dc.subject.keyword Multisource assessment
- dc.subject.keyword Social and emotional competencies
- dc.subject.keyword Factorial invariance
- dc.subject.keyword Leadership development
- dc.subject.keyword Structural equation modeling
- dc.title Multisource assessment for development purposes: revisiting the methodology of data analysis
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/publishedVersion