Towards a multimedia knowledge-based agent with social competence and human interaction capabilities

Wanner, Leo; Blat, Josep; Dasiopoulou, Stamatia; Domínguez Bajo, Mónica; Llorach, Gerard; Mille, Simon; Sukno, Federico Mateo; Kamateri, Eleni; Kompatsiaris, Ioannis; Vrochidis, Stefanos; André, Elisabeth; Lingenfelser, Florian; Mehlmann, Gregor; Stam, Andries; Stellingwerff, Ludo; Lamel, Lori; Vieru, Bianca; Minker, Wolfgang; Pragst, Louisa; Ultes, Stefan

doi:http://dx.doi.org/10.1145/2927006.2927011

Towards a multimedia knowledge-based agent with social competence and human interaction capabilities

Citation

Wanner L, Blat J, Dasiopoulou S, Domínguez M, Llorach G, Mille S, Sukno F, Kamateri E, Kompatsiaris I, Vrochidis S, André E, Lingenfelser F, Mehlmann G, Stam A, Stellingwerff L, Lames. Towards a multimedia knowledge-based agent with social competence and human interaction capabilities. In: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction (MARMI 2016); 2016 Jun 6; New York, USA. New York: ACM, 2016. p. 21-6. DOI: 10.1145/2927006.2927011

Abstract

We present work in progress on an intelligent embodied conversation agent in the basic care and healthcare domain. In contrast to most of the existing agents, the presented agent is aimed to have linguistic cultural, social and emotional competence needed to interact with elderly and migrants. It is composed of an ontology-based and reasoning-driven dialogue manager, multimodal communication analysis and generation modules and a search engine for the retrieval of multimedia background content from the web needed for conducting a conversation on a given topic.