Test time transform prediction for open set histopathological image recognition

Galdran, Adrian; Hewitt, Katherine J.; Ghaffari Laleh, Narmin; Kather, Jakob N.; Carneiro, Gustavo; González Ballester, Miguel Ángel, 1973-

doi:http://dx.doi.org/10.1007/978-3-031-16434-7_26

Test time transform prediction for open set histopathological image recognition

Citation

Galdran A, Hewitt KJ, Ghaffari Laleh N, Kather JN, Carneiro G, González Ballester MA. Test time transform prediction for open set histopathological image recognition. In: Wang L, Dou Q, Fletcher PT, Speidel S, Li S, editors. Medical Image Computing and Computer Assisted Intervention (MICCAI 2022): 25th International Conference; 2022 Sep 18-22; Sentosa Island, Singapore. Cham: Springer; 2022. p. 263-72. DOI: 10.1007/978-3-031-16434-7_26

Abstract

Tissue typology annotation in Whole Slide histological images is a complex and tedious, yet necessary task for the development of computational pathology models. We propose to address this problem by applying Open Set Recognition techniques to the task of jointly classifying tissue that belongs to a set of annotated classes, e.g. clinically relevant tissue categories, while rejecting in test time Open Set samples, i.e. images that belong to categories not present in the training set. To this end, we introduce a new approach for Open Set histopathological image recognition based on training a model to accurately identify image categories and simultaneously predict which data augmentation transform has been applied. In test time, we measure model confidence in predicting this transform, which we expect to be lower for images in the Open Set. We carry out comprehensive experiments in the context of colorectal cancer assessment from histological images, which provide evidence on the strengths of our approach to automatically identify samples from unknown categories. Code is released at https://github.com/agaldran/t3po.

Description

Comunicació presentada a 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022), celebrat del 18 al 22 de setembre de 2022 a Sentosa, Singapur.