Zinemanas, PabloRocamora, MartÃnFonseca, EduardoFont, FredericSerra, Xavier2021-12-142021-12-142021Zinemanas P, Rocamora M, Fonseca E, Font F, Serra X. Toward interpretable polyphonic sound event detection with attention maps based on local prototypes. In: Font F, Mesaros A, Ellis DPW, Fonseca E, Fuentes M, Elizalde B, editors. Proceedings of the 6th Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE 2021); 2021 Nov 15-19; Online. Barcelona: Music Technology Group, Universitat Pompeu Fabra; 2021. p.50-4. DOI: 10.5281/zenodo.5770113978-84-09-36072-7http://hdl.handle.net/10230/49196Comunicació presentada a: DCASE 2021 celebrat del 15 al 19 de novembre de 2021 de manera virtual.Understanding the reasons behind the predictions of deep neural networks is a pressing concern as it can be critical in several application scenarios. In this work, we present a novel interpretable model for polyphonic sound event detection. It tackles one of the limitations of our previous work, i.e. the difficulty to deal with a multi-label setting properly. The proposed architecture incorporates a prototype layer and an attention mechanism. The network learns a set of local prototypes in the latent space representing a patch in the input representation. Besides, it learns attention maps for positioning the local prototypes and reconstructing the latent space. Then, the predictions are solely based on the attention maps. Thus, the explanations provided are the attention maps and the corresponding local prototypes. Moreover, one can reconstruct the prototypes to the audio domain for inspection. The obtained results in urban sound event detection are comparable to that of two opaque baselines but with fewer parameters while offering interpretability.application/pdfengThis work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit: http://creativecommons.org/licenses/by/4.0/Toward interpretable polyphonic sound event detection with attention maps based on local prototypesinfo:eu-repo/semantics/conferenceObjecthttp://dx.doi.org/10.5281/zenodo.5770113InterpretabilitySound event detectionPrototypesinfo:eu-repo/semantics/openAccess