Dynamic modulation of portable device interface with the assessment of
cognitive load using built-in sensors

Küçüktütüncü, Esen

Dynamic modulation of portable device interface with the assessment of cognitive load using built-in sensors

License

Citation

Küçüktütüncü, E. Dynamic modulation of portable device interface with the assessment of cognitive load using built-in sensors. 2021. handle: http://hdl.handle.net/10230/48962

This citation was generated automatically.

Abstract

With more and more intelligent systems surrounding us, many design decisions and system architectures that facilitate the flow of information and the scope of interaction have become crucial for the sustainability and the longevity of the Human Computer Interaction. With the field expanding each year at an exponential rate, the amount of exposure augments drastically as well. With the restrictions and regulations that happened after the outbreak of COVID-19, this number surely has doubled. With people attending work and school through virtual environments, almost every duty or social interaction we had outside our homes was mediated through screens. Although it is clear that the interaction can be done via direct input(touch screen, camera, microphone) making use of the built-in sensors to extract implicit data from the user is a promising step in HCI that could potentially change the way we use our phones. The purpose of this study is to investigate possible ways in which sensors embedded into mobile devices can be used to assess cognitive load or emotional state that dynamically modulate the device interface in order to allow the user to better engage and interact. The hypothesis is that we can use the built-smartphone camera to measure Pulse Rate Variability (PRV), and derive the users cognitive load based on it. Furthermore, this would allow us to not only measure it real-time but to dynamically modulate the interface based on it to control the induced cognitive load.