Twin AGXNet for Anatomy-specific Progression Classification in Chest Radiographs
model2025-11-23https://doi.org/10.1148/atlas.1763916235003
41

Overview

Schema Version

https://atlas.rsna.org/schemas/2025-11/model.json

Name

Twin AGXNet for Anatomy-specific Progression Classification in Chest Radiographs

Link

https://dx.doi.org/10.1148/ryai.230277

Indexing

Keywords: Prognosis, Unsupervised Learning, Transfer Learning, Convolutional Neural Network, Emergency Radiology, Named Entity Recognition, progression classification, chest radiograph, weakly supervised learning, localization
Content: CH, ER
RadLex: RID4867, RID34539, RID28493, RID43255, RID5352

Author(s)

Ke Yu
Shantanu Ghosh
Zhexiong Liu
Christopher Deible
Clare B. Poynton
Kayhan Batmanghelich

Organization(s)

University of Pittsburgh, School of Computing and Information
Boston University, Department of Electrical and Computer Engineering
University of Pittsburgh, Department of Radiology
Boston University, Chobanian & Avedisian School of Medicine

Version

1.0

Contact

ude.ub@namtab

Funding

Pennsylvania Department of Health (grant 4100087331); National Institutes of Health (R01HL141813); National Science Foundation (1839332); computational resources: Bridges-2 system at Pittsburgh Supercomputing Center (NSF award OAC-1928147).

Ethical review

Retrospective study using publicly available MIMIC-CXR dataset; institutional review board approval and patient informed consent were not required.

Date

Updated: 2024-06-28
Published: 2024-07-24
Created: 2023-07-21

References

[1] Yu K, Ghosh S, Liu Z, Deible C, Poynton CB, Batmanghelich K. "Anatomy-specific Progression Classification in Chest Radiographs via Weakly Supervised Learning". Radiology: Artificial Intelligence. 2024;6(5):e230277. 2024-07-24. doi:10.1148/ryai.230277. PMID: 39046325. PMCID: PMC11427915.

Model

Architecture

Twin (siamese-style) Anatomy-Guided chest x-ray Network (AGXNet) with two branches (anatomy and observation networks) linked by a residual attention module; each branch uses DenseNet121 backbone with ImageNet initialization; pretraining with 69 weak labels, fine-tuning on paired images for four-class progression classification.

Clinical benefit

Automated monitoring of interval changes and detection of new pathologic conditions on chest radiographs to support timely clinical interventions.

Clinical workflow phase

Clinical decision support systems; potential alerting of new or progressing findings during image interpretation.

Degree of automation

Assistive decision support; provides classification and localization outputs to aid but not replace clinician judgment.

Indications for use

Classification of progression (improved, unchanged, worsened, new) for six observations—atelectasis, consolidation, edema, effusion, pneumonia, pneumothorax—on pairs of frontal chest radiographs from the same patient within one year; intended for hospital settings with chest radiography and associated reports.

Input

Two consecutive frontal chest radiographs from the same patient and the referenced anatomic landmark (when available) derived from prior report; images resized to 512×512.

Instructions

Model is pretrained on single images with weak labels and fine-tuned on consecutive image pairs; during inference for improved/unchanged/worsened classes, use anatomy CAMs for conditioning; for 'new' class, use constant attention in place of unknown CAMs.

Limitations

Trained and evaluated only on MIMIC-CXR (primarily ICU patients); terminology for progression extraction not exhaustive; only frontal radiographs used; variability from acquisition factors (positioning, inspiration) not adjusted; progression modeled categorically and pairwise (not quantitative over multiple studies); no external dataset evaluation; performance metrics based on five random splits and paired t tests; manual verification limited to sampled labels.

Output

CDEs: RDE2375, RDE2378, RDE1705
Description: For each specified observation and anatomic landmark, classification into four progression categories (improved, unchanged, worsened, new); for 'new' cases, bounding-box localization of suspected new pathology via Grad-CAM-derived heat maps.

Recommendation

Further validation on external datasets and non-ICU populations is necessary before clinical deployment.

Reproducibility

Five random 70:10:20 data partitions with consistent pretraining/fine-tuning splits and no patient overlap; model selection by validation loss/accuracy; optimization details and software versions reported (AdamW, SciPy 1.13.1).

Use

Intended: Detection and diagnosis
Out-of-scope: Detection and diagnosis
Excluded: Detection and diagnosis

User

Intended: Referring provider, Radiologist, Researcher
Out-of-scope: Patient
Excluded: Layperson