A brief analysis of SLAVC method for sound source
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Juanola, Xavier
- dc.contributor.author Haro Ortega, Gloria
- dc.date.accessioned 2025-06-10T08:51:55Z
- dc.date.available 2025-06-10T08:51:55Z
- dc.date.issued 2024
- dc.description.abstract Mo and Morgado introduced in 2022 a novel self-supervised learning approach for Visual Sound Source Localization, denoted as SLAVC [Mo, S. and Mordado, P., A Closer Look at Weakly-Supervised Audio-Visual Source Localization, Advances in Neural Information Processing Systems, 2022]. The proposed method is based on multiple-instance contrastive learning. In addition to improving the results of previous methods, it also solves two critical problems that former methods faced: 1) excessive overfitting despite training on extensive datasets, 2) tendency to hallucinate sound sources even without visual evidence to support it in the video. In this paper, we briefly present the method, offer an online executable version allowing the users to test it on their own image-audio pairs and propose some improvements that could benefit the model as future work.
- dc.description.sponsorship This work has been supported by MICINN/FEDER UE project PID2021-127643NB-I00.
- dc.format.mimetype application/pdf
- dc.identifier.citation Juanola X, Haro G. A brief analysis of SLAVC method for sound source. Image Processing On Line. 2024;14:159-72. DOI: 10.5201/ipol.2024.525
- dc.identifier.doi http://dx.doi.org/10.5201/ipol.2024.525
- dc.identifier.issn 2105-1232
- dc.identifier.uri http://hdl.handle.net/10230/70650
- dc.language.iso eng
- dc.publisher IPOL
- dc.relation.ispartof Image Processing On Line. 2024;14:159-72
- dc.relation.projectID info:eu-repo/grantAgreement/ES/3PE/PID2021-127643NB-I00
- dc.rights © 2024 IPOL & the authors. The article is distributed under a Creative Commons CC-BY-NC-SA license (http://creativecommons.org/licenses/by-nc-sa/3.0/).
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.rights.uri http://creativecommons.org/licenses/by-nc-sa/3.0/
- dc.subject.keyword Audio-visual
- dc.subject.keyword Sound source localization
- dc.title A brief analysis of SLAVC method for sound source
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/publishedVersion