E. Lanza, F. Catapano, C. Lisi, F. D'Orazio, R. Levi, A. Laghi
Purpose: To develop an automated pipeline (PERADS.net) that segments acute pulmonary embolism on CT pulmonary angiography, assigns a Pulmonary Embolism Reporting and Data System (PE-RADS) grade with named anatomic localization, and measures the right-to-left ventricular (RV/LV) diameter ratio, and to assess radiologist agreement. Materials and Methods: In this retrospective study, 120 CT pulmonary angiograms (70 peripheral, 35 central, 15 negative) from the public RSNA Pulmonary Embolism CT dataset were analyzed. A two-channel five-fold nnU-Net ensemble segmented the embolus; the pulmonary arterial tree was reduced to a branching graph, and the grade was set by the most proximal level with at least 1% of embolic volume. Three radiologists, blinded to the algorithm-assigned grade, independently assigned grades and rated RV/LV plausibility. Agreement was assessed with percent agreement and Cohen or Fleiss kappa on five-grade and grouped scales (grade 0 versus 1-2 versus 3-4). The automated ratio was compared with the dataset's binary RV/LV label in 2119 examinations. Results: Agreement between the algorithm and three-radiologist consensus (n = 119) was 60.5% (kappa, 0.38) for individual grades and 90.8% (kappa, 0.74; 95% CI: 0.59, 0.87) for the grouped scale; 34 of 47 discordant examinations fell within grades 3-4. As a fourth reader, the algorithm matched grouped-scale interobserver agreement (mean kappa, 0.62 versus 0.67). Radiologists showed no agreement rating RV/LV plausibility as favorable or incorrect (Fleiss kappa, -0.00), whereas the automated ratio agreed with the external label (kappa, 0.49), overestimating strain 3.1:1. Conclusion: Automated PE-RADS grading agreed with radiologist consensus comparably to a fourth reader on the grouped scale.