Hardy-Werbin, MaxMaiques Llácer, José MaríaBusto Barrera, MarcosCirera Lorenzo, IsabelAguirre Tejedo, AlfonsGarcía Gisbert, Nieves, 1994-Zuccarino, FlavioCarbullanca Toledo, SantiagoCarpio, Luis Alexander delRamal, DidacGayete, ÁngelMartínez Roldán, JordiMárquez Colomé, AlbertBellosillo Paricio, BeatrizGibert Fernandez, Joan, 1988-2024-06-032024-06-032023Hardy-Werbin M, Maiques JM, Busto M, Cirera I, Aguirre A, Garcia-Gisbert N, et al. MultiCOVID: a multi modal deep learning approach for COVID-19 diagnosis. Sci Rep. 2023 Oct 31;13(1):18761. DOI: 10.1038/s41598-023-46126-82045-2322http://hdl.handle.net/10230/60327The rapid spread of the severe acute respiratory syndrome coronavirus 2 led to a global overextension of healthcare. Both Chest X-rays (CXR) and blood test have been demonstrated to have predictive value on Coronavirus Disease 2019 (COVID-19) diagnosis on different prevalence scenarios. With the objective of improving and accelerating the diagnosis of COVID-19, a multi modal prediction algorithm (MultiCOVID) based on CXR and blood test was developed, to discriminate between COVID-19, Heart Failure and Non-COVID Pneumonia and healthy (Control) patients. This retrospective single-center study includes CXR and blood test obtained between January 2017 and May 2020. Multi modal prediction models were generated using opensource DL algorithms. Performance of the MultiCOVID algorithm was compared with interpretations from five experienced thoracic radiologists on 300 random test images using the McNemar-Bowker test. A total of 8578 samples from 6123 patients (mean age 66 ± 18 years of standard deviation, 3523 men) were evaluated across datasets. For the entire test set, the overall accuracy of MultiCOVID was 84%, with a mean AUC of 0.92 (0.89-0.94). For 300 random test images, overall accuracy of MultiCOVID was significantly higher (69.6%) compared with individual radiologists (range, 43.7-58.7%) and the consensus of all five radiologists (59.3%, P < .001). Overall, we have developed a multimodal deep learning algorithm, MultiCOVID, that discriminates among COVID-19, heart failure, non-COVID pneumonia and healthy patients using both CXR and blood test with a significantly better performance than experienced thoracic radiologists.application/pdfeng© The Author(s) 2023. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.info:eu-repo/semantics/articlehttp://dx.doi.org/10.1038/s41598-023-46126-8BiomarkersComputational biology and bioinformaticsDiseasesHealth careinfo:eu-repo/semantics/openAccess