Gialampoukidis, IliasMoumtzidou, AnastasiaTsikrika, TheodoraVrochidis, StefanosKompatsiaris, Ioannis2017-02-242017-02-242016Gialampoukidis I, Moumtzidou A, Tsikrika T, Vrochidis S, Kompatsiaris I. Retrieval of multimedia objects by fusing multiple modalities. In: ICMR'16. International Conference on Multimedia Retrieval; 2016 June 6-9; New York (NY, USA). New York: ACM; 2016. p. 359-62. DOI: 10.1145/2911996.2912068http://hdl.handle.net/10230/28140Comunicació presentada a: ICMR'16. International Conference on Multimedia Retrieval 2016, celebrat a Nova York del 6 al 9 de juny de 2016Searching for multimedia objects with heterogeneous modalities is critical for the construction of effective multimedia retrieval systems. Towards this direction, we propose a framework for the multimodal fusion of visual and textual similarities, based on visual features, visual concepts and textual concepts. Our method is compared to the baseline method that only fuses two modalities but integrates all early, late, linearly weighted, diffusion and graph-based models in one unifying framework. Our framework integrates more than two modalities and high-level information, so as to retrieve multimedia objects enriched with high-level textual and visual concepts, in response to a multimodal query. The experimental comparison is done under the same memory complexity, in two multimedia collections in the multimedia retrieval task. The results have shown that we outperform the baseline method, in terms of Mean Average Precision.application/pdfeng© ACM, 2016. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, (2016) http://doi.acm.org/10.1145/2911996.2912068Recuperació de la informacióInformació -- Sistemes d'emmagatzematge i recuperacióinfo:eu-repo/semantics/conferenceObjecthttp://dx.doi.org/10.1145/2911996.2912068info:eu-repo/semantics/openAccess