Variability Among Radiologists in Interpreting Low-Dose CT Lung Cancer Screens.

BACKGROUND: Lung cancer screening (LCS) with low-dose CT (LDCT) reduces lung cancer mortality, but false positive tests remain a concern. Radiologist variability in interpreting LDCT scans may contribute to higher false positive rates (FPRs). METHODS: Radiologists were identified from the LCS registry (LCSR) maintained by the American College of Radiology. Registry data were merged with Medicare files to create a LCSR-Medicare database. Radiologists with ≥50 baseline or ≥50 post-baseline LDCT screens in the database were included in the analysis. The sensitivity and FPR were defined as the proportion of positive (Lung-RADS 3-4) screens among those with and without a lung cancer diagnosis, respectively. Distributions, including median and interquartile range (IQR), of radiologists' FPRs were evaluated based on observed data and mixed-effects models, where the radiologist was the random effect. Sensitivity was computed on an aggregate level based on radiologists' FPR quartiles. RESULTS: 1130 radiologists read ≥50 baseline screens; 935 read ≥50 post-baseline screens. Median (IQR) FPR for baseline screens was 15.9% (11.3%-21.8%) and 16.3% (11.8%-21.8%) based on observed data and the mixed-effects model, respectively. Corresponding values for post-baseline screens were 8.5% (5.7%-12.8%) and 8.8% (6.3%-11.8%). Sensitivity increased significantly with radiologist FPR quartile for baseline and post-baseline screens. For baseline screens, radiologists in the lower two FPR quartiles had aggregate FPR and sensitivity of 10.9% and 89.6%, respectively, versus 24.1% and 94.4% for radiologists in the upper two quartiles. CONCLUSIONS: Variability in radiologists' false positive rates with LDCT screening was high. Higher FPRs were associated with increased sensitivity rates.