Twin AGXNet for Anatomy-specific Progression Classification in Chest Radiographs
2025-11-23https://doi.org/10.1148/atlas.1763916235003
41
Overview
Schema Version
https://atlas.rsna.org/schemas/2025-11/model.json
Name
Twin AGXNet for Anatomy-specific Progression Classification in Chest Radiographs
Link
https://dx.doi.org/10.1148/ryai.230277
Indexing
Keywords: Prognosis, Unsupervised Learning, Transfer Learning, Convolutional Neural Network, Emergency Radiology, Named Entity Recognition, progression classification, chest radiograph, weakly supervised learning, localization
Content: CH, ER
RadLex: RID4867, RID34539, RID28493, RID43255, RID5352
Author(s)
Ke Yu
Shantanu Ghosh
Zhexiong Liu
Christopher Deible
Clare B. Poynton
Kayhan Batmanghelich
Organization(s)
University of Pittsburgh, School of Computing and Information
Boston University, Department of Electrical and Computer Engineering
University of Pittsburgh, Department of Radiology
Boston University, Chobanian & Avedisian School of Medicine
Version
1.0
Contact
ude.ub@namtab
Funding
Pennsylvania Department of Health (grant 4100087331); National Institutes of Health (R01HL141813); National Science Foundation (1839332); computational resources: Bridges-2 system at Pittsburgh Supercomputing Center (NSF award OAC-1928147).
Ethical review
Retrospective study using publicly available MIMIC-CXR dataset; institutional review board approval and patient informed consent were not required.
Date
Updated: 2024-06-28
Published: 2024-07-24
Created: 2023-07-21
References
[1] Yu K, Ghosh S, Liu Z, Deible C, Poynton CB, Batmanghelich K. "Anatomy-specific Progression Classification in Chest Radiographs via Weakly Supervised Learning". Radiology: Artificial Intelligence. 2024;6(5):e230277. 2024-07-24. doi:10.1148/ryai.230277. PMID: 39046325. PMCID: PMC11427915.
Model
Architecture
Twin (siamese-style) Anatomy-Guided chest x-ray Network (AGXNet) with two branches (anatomy and observation networks) linked by a residual attention module; each branch uses DenseNet121 backbone with ImageNet initialization; pretraining with 69 weak labels, fine-tuning on paired images for four-class progression classification.
Clinical benefit
Automated monitoring of interval changes and detection of new pathologic conditions on chest radiographs to support timely clinical interventions.
Clinical workflow phase
Clinical decision support systems; potential alerting of new or progressing findings during image interpretation.
Degree of automation
Assistive decision support; provides classification and localization outputs to aid but not replace clinician judgment.
Indications for use
Classification of progression (improved, unchanged, worsened, new) for six observations—atelectasis, consolidation, edema, effusion, pneumonia, pneumothorax—on pairs of frontal chest radiographs from the same patient within one year; intended for hospital settings with chest radiography and associated reports.
Input
Two consecutive frontal chest radiographs from the same patient and the referenced anatomic landmark (when available) derived from prior report; images resized to 512×512.
Instructions
Model is pretrained on single images with weak labels and fine-tuned on consecutive image pairs; during inference for improved/unchanged/worsened classes, use anatomy CAMs for conditioning; for 'new' class, use constant attention in place of unknown CAMs.
Limitations
Trained and evaluated only on MIMIC-CXR (primarily ICU patients); terminology for progression extraction not exhaustive; only frontal radiographs used; variability from acquisition factors (positioning, inspiration) not adjusted; progression modeled categorically and pairwise (not quantitative over multiple studies); no external dataset evaluation; performance metrics based on five random splits and paired t tests; manual verification limited to sampled labels.
Output
CDEs: RDE2375, RDE2378, RDE1705
Description: For each specified observation and anatomic landmark, classification into four progression categories (improved, unchanged, worsened, new); for 'new' cases, bounding-box localization of suspected new pathology via Grad-CAM-derived heat maps.
Recommendation
Further validation on external datasets and non-ICU populations is necessary before clinical deployment.
Reproducibility
Five random 70:10:20 data partitions with consistent pretraining/fine-tuning splits and no patient overlap; model selection by validation loss/accuracy; optimization details and software versions reported (AdamW, SciPy 1.13.1).
Use
Intended: Detection and diagnosis
Out-of-scope: Detection and diagnosis
Excluded: Detection and diagnosis
User
Intended: Referring provider, Radiologist, Researcher
Out-of-scope: Patient
Excluded: Layperson