The role of large language models in musicology: are we ready to trust the machines?
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Ramoneda, Pedro
- dc.contributor.author Parada-Cabaleiro, Emilia
- dc.contributor.author Weck, Benno
- dc.contributor.author Serra, Xavier
- dc.date.accessioned 2025-05-30T05:49:49Z
- dc.date.available 2025-05-30T05:49:49Z
- dc.date.issued 2024
- dc.description.abstract In this work, we explore the use and reliability of Large Language Models (LLMs) in musicology. From a discussion with experts and students, we assess the current acceptance and concerns regarding this, nowadays ubiquitous, technology. We aim to go one step further, proposing a semi-automatic method to create an initial benchmark using retrieval-augmented generation models and multiple-choice question generation, validated by human experts. Our evaluation on 400 human-validated questions shows that current vanilla LLMs are less reliable than retrieval augmented generation from music dictionaries. This paper suggests that the potential of LLMs in musicology requires musicology-driven research that can specialize LLMs by including accurate and reliable domain knowledge.
- dc.format.mimetype application/pdf
- dc.identifier.citation Ramoneda P, Parada-Cabaleiro E, Weck B, Serra X. The role of large language models in musicology: are we ready to trust the machines? In: Proceedings of the 3rd Workshop on NLP for Music and Audio (NLP4MusA); 2024 Nov 15; San Francisco, USA. Stroudsburg: Association for Computational Linguistics (ACL); 2024. p.81-6.
- dc.identifier.uri http://hdl.handle.net/10230/70566
- dc.language.iso eng
- dc.publisher ACL (Association for Computational Linguistics)
- dc.relation.ispartof Proceedings of the 3rd Workshop on NLP for Music and Audio (NLP4MusA); 2024 Nov 15; San Francisco, USA. Stroudsburg: Association for Computational Linguistics (ACL); 2024.
- dc.rights © ACL, Creative Commons Attribution 4.0 License
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.rights.uri http://creativecommons.org/licenses/by/4.0
- dc.subject.keyword Language models
- dc.subject.keyword Musicology
- dc.title The role of large language models in musicology: are we ready to trust the machines?
- dc.type info:eu-repo/semantics/conferenceObject
- dc.type.version info:eu-repo/semantics/publishedVersion