Understanding and leveraging the impact of response latency on user behaviour in web wearch

Arapakis, Ioannis; Cambazoglu, B. Barla; Freire, Ana

doi:http://dx.doi.org/10.1145/3106372

Understanding and leveraging the impact of response latency on user behaviour in web wearch

Citation

Bai X, Arapakis I, Cambazoglu BB, Freire A. Understanding and leveraging the impact of response latency on user behaviour in web search. ACM Trans Manag Inf Syst; 2017 Sept;36(2):21. DOI: 10.1145/3106372

Abstract

The interplay between the response latency of web search systems and users’ search experience has only recently started to attract research attention, despite the important implications of response latency on monetisation of such systems. In this work, we carry out two complementary studies to investigate the impact of response latency on users’ searching behaviour in web search engines. We first conduct a controlled user study to investigate the sensitivity of users to increasing delays in response latency. This study shows that the users of a fast search system are more sensitive to delays than the users of a slow search system. Moreover, the study finds that users are more likely to notice the response latency delays beyond a certain latency threshold, their search experience potentially being affected. We then analyse a large number of search queries obtained from Yahoo Web Search to investigate the impact of response latency on users’ click behaviour. This analysis demonstrates the significant change in click behaviour as the response latency increases. We also find that certain user, context, and query attributes play a role in the way increasing response latency affects the click behaviour. To demonstrate a possible use case for our findings, we devise a machine learning framework that leverages the latency impact, together with other features, to predict whether a user will issue any clicks on web search results. As a further extension of this use case, we investigate whether this machine learning framework can be exploited to help search engines reduce their energy consumption during query processing.