Fully Automated AI-Based Lymph Node Measurements in Chest CT: Accuracy and Reproducibility Compared with Multi-Reader Assessment

Background/Objectives: Accurate and reproducible lymph node (LN) measurement is essential for oncologic staging and therapy monitoring but is subject to inter-reader variability. This study evaluated the accuracy and reproducibility of a fully automated artificial intelligence (AI)-based LN measurement workflow in contrast-enhanced chest CT, using multi-reader manual measurements as reference. Methods: Sixty thoracic LNs from seven patients were independently measured by 13 radiologists in two reading rounds. The median of all measurements served as the ground truth (GT). Automated short- and long-axis diameters were derived from fully automated 3D CNN-based segmentations. Agreement between AI and manual measurements was assessed using Friedman testing, intraclass correlation coefficients (ICCs), and concordance correlation coefficients (CCCs). Measurement stability was evaluated across repeated runs on different hardware systems. Results: A total of 2280 manual measurements were analyzed. Manual assessment showed significant inter-reader variability (p < 0.01), while intra-reader agreement was high. No significant differences were observed between AI-based measurements and the GT (all p > 0.01). Agreement was good, with CCC values of 0.86 (SAD) and 0.79 (LAD). AI-based measurements were numerically stable across hardware configurations. Conclusions: Fully automated AI-based LN measurements in chest CT scans provide strong agreement with multi-reader consensus and high numerical stability. Automated measurement may support more standardized and reproducible oncologic imaging assessment.