The CLEF-2024 CheckThat! Lab: check-worthiness, subjectivity, persuasion, roles, authorities, and adversarial robustness.

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Barrón Cedeño, Alberto
• dc.contributor.author Alam, Firoj
• dc.contributor.author Chakraborty, Tanmoy
• dc.contributor.author Elsayed, Tamer
• dc.contributor.author Nakov, Preslav
• dc.contributor.author Przybyła, Piotr
• dc.contributor.author Struß, Julia Maria
• dc.contributor.author Haouari, Fatima
• dc.contributor.author Hasanain, Maram
• dc.contributor.author Ruggeri, Federico
• dc.contributor.author Song, Xingyi
• dc.contributor.author Suwaileh, Reem
• dc.date.accessioned 2024-04-09T08:34:06Z
• dc.date.embargoEnd info:eu-repo/date/embargoEnd/2025-03-23
• dc.date.issued 2024
• dc.description Comunicació presentada a 46th European Conference on Information Retrieval, ECIR 2024, celebrada del 24 al 28 de març de 2024 a Glasgow, Regne Unit
• dc.description.abstract The first five editions of the CheckThat! lab focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, it has been focusing on new problems that can support the research and decision making during the verification process. In this new edition, we focus on new problems and —for the first time— we propose six tasks in fifteen languages (Arabic, Bulgarian, English, Dutch, French, Georgian, German, Greek, Italian, Polish, Portuguese, Russian, Slovene, Spanish, and code-mixed Hindi-English): Task 1 estimation of check-worthiness (the only task that has been present in all CheckThat! editions), Task 2 identification of subjectivity (a follow up of CheckThat! 2023 edition), Task 3 identification of persuasion (a follow up of SemEval 2023), Task 4 detection of hero, villain, and victim from memes (a follow up of CONSTRAINT 2022), Task 5 Rumor Verification using Evidence from Authorities (a first), and Task 6 robustness of credibility assessment with adversarial examples (a first). These tasks represent challenging classification and retrieval problems at the document and at the span level, including multilingual and multimodal settings.
• dc.description.sponsorship The work of F. Haouari is supported by GSRA grant #GSRA6-1-0611-19074 from the Qatar National Research Fund. The work of T. Elsayed was made possible by NPRP grant #NPRP-11S-1204-170060 from the Qatar National Research Fund (a member of Qatar Foundation). The work of F. Alam, M. Hasanain and R. Suwaileh is partially supported by NPRP 14C-0916-210015 from the Qatar National Research Fund (a member of Qatar Foundation). The work of P. Przybyła is part of the ERINIA project, which has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101060930.
• dc.embargo.liftdate 2025-03-23
• dc.format.mimetype application/pdf
• dc.identifier.citation Barrón-Cedeño A, Alam F, Chakraborty T, Elsayed T, Nakov P, Przybyła P, et al. The CLEF-2024 CheckThat! Lab: check-worthiness, subjectivity, persuasion, roles, authorities, and adversarial robustness. In: Goharian N, Tonellotto N, He Y, Lipani A, McDonald G, Macdonald C, Ounis I, editors. Advances in Information Retrieval. 46th European Conference on Information Retrieval, ECIR 2024; 2024 March 24–28; Glasgow, UK. Cham: Springer; 2024. p. 449–58. DOI: 10.1007/978-3-031-56069-9_62
• dc.identifier.doi http://dx.doi.org/10.1007/978-3-031-56069-9_62
• dc.identifier.issn 0302-9743
• dc.identifier.uri http://hdl.handle.net/10230/59697
• dc.language.iso eng
• dc.publisher Springer
• dc.relation.ispartof Goharian N, Tonellotto N, He Y, Lipani A, McDonald G, Macdonald C, Ounis I, editors. Advances in Information Retrieval. 46th European Conference on Information Retrieval, ECIR 2024; 2024 March 24–28; Glasgow, UK. Cham: Springer; 2024. p. 449–58.
• dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/101060930
• dc.rights © 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
• dc.rights.accessRights info:eu-repo/semantics/embargoedAccess
• dc.subject.keyword disinformation
• dc.subject.keyword fact-checking
• dc.subject.keyword check-worthiness
• dc.subject.keyword subjectivity
• dc.subject.keyword political bias
• dc.subject.keyword factuality
• dc.subject.keyword authority finding
• dc.subject.keyword model robustness
• dc.title The CLEF-2024 CheckThat! Lab: check-worthiness, subjectivity, persuasion, roles, authorities, and adversarial robustness.
• dc.type info:eu-repo/semantics/conferenceObject
• dc.type.version info:eu-repo/semantics/acceptedVersion