Cross-attention fusion of biparametric MRI sequences with demographic and clinical variables for patient-level classification of clinically significant prostate cancer

A. Dimitriadis, G. Kalliatakis, R. Osuala, D. Kessler, O. Diaz, S. Mazzetti, D. Regge, K. Lekadir, D. Fotiadis, M. Tsiknakis, N. Papanikolaou, T. Consortium, S. Sfakianakis, V. Kalokyri, E. Trivizakis, N. Tachos, E. Mylona, D. Zaridis, C. Kalantzopoulos, J. de Almeida, A. Verde, A. Rodrigues, N. Rodrigues, M. Chambel, H. Huisman, M. de Rooij, A. Saha, J. Twilt, J. Futterer, L. Martí-Bonmatí, L. Cerdá-Alberich, G. Ribas, S. Navarro, M. Marfil, E. Neri, G. Aringhieri, L. Tumminello, V. Mendola, D. Akata, M. Özmen, A. Karaosmanoglu, F. Atak, M. Karcaaltincaba, J. Vilanova, J. Usinskiene, R. Briediene, A. Untanas, K. Slidevska, K. Vasilis, G. Georgios, D. Koh, R. Emsley, S. Vit, A. Ribeiro, S. Doran, T. Jacobs, G. García-Martí, V. Giannini, G. Cappello, G. Maimone, V. Napolitano, S. Colantonio, M. Pascali, E. Pachetti, G. del Corso, D. Germanese, A. Berti, G. Carloni, J. Kalpathy-Cramer, C. Bridge, J. Correia, W. Hernandez, Z. Giavri, C. Pollalis, D. Agraniotis, A. Pastor, J. Mora, C. Saillant, T. Henne, R. Marquez and K. Marias

Scientific Reports 2026.

DOI

Abstract

Accurate patient-level risk stratification of clinically significant prostate cancer (csPCa) on biparametric MRI remains challenging, as most existing approaches require costly lesion-level annotations or have not been evaluated in large temporally separated cohorts. We developed and validated a multimodal deep learning framework combining T2-weighted (T2w), diffusion-weighted (DWI), and apparent diffusion coefficient (ADC) volumes with age, prostate-specific antigen (PSA), and PSA density (PSAD) for patient-level csPCa classification, trained without lesion-level annotations. The study included a retrospective development cohort of 3, 939 examinations and an independent temporal validation cohort comprising 1, 409 prospectively acquired examinations from 13 centers. The model employs three sequence-specific encoders with asymmetric cross-attention fusion and a two-stage transfer-learning strategy. Adding demographic and clinical variables consistently improved performance over MRI-only models, with PSAD emerging as the most informative complementary factor, primarily by improving specificity. The best-performing model--combining MRI, age, PSA, and PSAD with cross-attention--achieved a mean AUC of

$$0.765!\pm !0.006$$

on the retrospective held-out test set and

$$0.741!\pm !0.006$$

on the independent temporal validation cohort. Post hoc subgroup analyses suggested broadly stable rank-order discrimination (AUC) across most strata, though fixed-threshold sensitivity and specificity varied substantially, while Grad-CAM maps offered a qualitative indication of more frequent overlap with suspicious regions under cross-attention. These findings support PSAD-informed multimodal patient-level models as a viable tool for refined csPCa risk stratification on biparametric MRI, with potential to reduce false-positive classification of ISUP grade group 1 disease as clinically significant.