A Hybrid graph-based and non-linear late fusion approach for multimedia retrieval

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Gialampoukidis, Iliasca
  • dc.contributor.author Moumtzidou, Anastasiaca
  • dc.contributor.author Liparas, Dimitrisca
  • dc.contributor.author Vrochidis, Stefanosca
  • dc.contributor.author Kompatsiaris, Ioannisca
  • dc.date.accessioned 2017-02-27T13:35:18Z
  • dc.date.available 2017-02-27T13:35:18Z
  • dc.date.issued 2016
  • dc.description Comunicació presentada a: 14th International Workshop on Content-Based Multimedia Indexing (CBMI 2016) celebrat del 15 al 17 de juny de 2016 a Bucarest, Romania.ca
  • dc.description.abstract Nowadays, multimedia retrieval has become a task of high importance, due to the need for efficient and fast access to very large and heterogeneous multimedia collections. An interesting challenge within the aforementioned task is the efficient combination of different modalities in a multimedia object and especially the fusion between textual and visual information. The fusion of multiple modalities for retrieval in an unsupervised way has been mostly based on early, weighted linear, graph-based and diffusion-based techniques. In contrast, we present a strategy for fusing textual and visual modalities, through the combination of a non-linear fusion model and a graph-based late fusion approach. The fusion strategy is based on the construction of a uniform multimodal contextual similarity matrix and the non-linear combination of relevance scores from query-based similarity vectors. The proposed late fusion approach is evaluated in the multimedia retrieval task, by applying it to two multimedia collections, namely the WIKI11 and IAPR-TC12. The experimental results indicate its superiority over the baseline method in terms of Mean Average Precision for both considered datasets.en
  • dc.description.sponsorship This work was supported by the projects MULTISENSOR (FP7-610411) and KRISTINA (H2020-645012), funded by the European Commission.en
  • dc.format.mimetype application/pdfca
  • dc.identifier.citation Gialampoukidis I, Moumtzidou A, Liparas D, Vrochidis S, Kompatsiaris I. A Hybrid graph-based and non-linear late fusion approach for multimedia retrieval. In: 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI 2016); 2016 June 15-17; Bucharest (Romania). [place unknown]: IEEE; 2016. p. 85-90. DOI: 10.1109/CBMI.2016.7500252
  • dc.identifier.doi http://dx.doi.org/10.1109/CBMI.2016.7500252
  • dc.identifier.issn 1949-3991
  • dc.identifier.uri http://hdl.handle.net/10230/28144
  • dc.language.iso eng
  • dc.publisher Institute of Electrical and Electronics Engineers (IEEE)ca
  • dc.relation.ispartof 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI 2016); 2016 June 15-17; Bucharest (Romania). [place unknown]: IEEE; 2016. p. 85-90. DOI: 10.1109/CBMI.2016.7500252en
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/645012
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/FP7/610411
  • dc.rights © 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published article can be found at http://dx.doi.org/10.1109/CBMI.2016.7500252
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.subject.keyword Multimedia retrievalen
  • dc.subject.keyword Non-linear fusionen
  • dc.subject.keyword Unsupervised multimodal fusionen
  • dc.title A Hybrid graph-based and non-linear late fusion approach for multimedia retrievalca
  • dc.type info:eu-repo/semantics/conferenceObject
  • dc.type.version info:eu-repo/semantics/acceptedVersion