Style Transfer–assisted Deep Learning Method for Kidney Segmentation at Multiphase MRI
model2025-12-03https://doi.org/10.1148/atlas.1764793051246
41

Overview

Schema Version

https://atlas.rsna.org/schemas/2025-11/model.json

Name

Style Transfer–assisted Deep Learning Method for Kidney Segmentation at Multiphase MRI

Link

https://dx.doi.org/10.1148/ryai.230043

Indexing

Keywords: Kidney Segmentation, Generative Adversarial Network, CycleGAN, Convolutional Neural Network, Transfer Learning, multiphase contrast-enhanced MRI, Mask R-CNN
Content: GU, MR
RadLex: RID39213, RID209, RID39214, RID34325, RID49531

Author(s)

Junyu Guo
Manu Goyal
Yin Xi
Lauren Hinojosa
Gaelle Haddad
Emin Albayrak
Ivan Pedrosa

Organization(s)

University of Texas Southwestern Medical Center, Department of Radiology
University of Texas Southwestern Medical Center, Department of Urology
Advanced Imaging Research Center, University of Texas Southwestern Medical Center

Version

1.0

License

Text: CC BY 4.0
URL: https://creativecommons.org/licenses/by/4.0/

Contact

Corresponding author: Ivan Pedrosa, MD, PhD, University of Texas Southwestern Medical Center, 2201 Inwood Rd, Suite 202, Dallas, TX 75390-9085.

Funding

Partially funded by the National Institutes of Health (grant R01CA154475). Computational resources provided by the BioHPC supercomputing facility, Lyda Hill Department of Bioinformatics, UT Southwestern Medical Center.

Ethical review

Retrospective, HIPAA-compliant, institutional review board–approved study with waiver of informed consent.

Date

Updated: 2023-11-01
Published: 2023-09-13
Created: 2023-02-12

References

[1] Guo J, Goyal M, Xi Y, Hinojosa L, Haddad G, Albayrak E, Pedrosa I.. "Style Transfer–assisted Deep Learning Method for Kidney Segmentation at Multiphase MRI". Radiology: Artificial Intelligence. 2023 Nov;5(6):e230043.. 2023-09-13. doi:10.1148/ryai.230043. PMID: 38074795. PMCID: PMC10698598.

Model

Architecture

Semisupervised pipeline combining CycleGAN (PyTorch) for style transfer to synthetic MCE MRI and Mask R-CNN (TensorFlow, InceptionResNetV2 backbone; segmentation head only) for kidney segmentation.

Availability

CycleGAN implementation: https://github.com/junyanz/CycleGAN; TensorFlow Object Detection (Mask R-CNN): https://github.com/tensorflow/models/tree/master/research/object_detection. Trained study models not publicly released.

Clinical benefit

Automates kidney segmentation on multiphase contrast-enhanced MRI, reducing manual annotation burden and enabling downstream quantitative analyses and radiomics workflows.

Clinical workflow phase

Workflow optimization (automated image segmentation to support analysis of mpMRI examinations).

Degree of automation

Fully automatic segmentation at inference; semisupervised training using synthetic images generated from T2-weighted images.

Indications for use

Automated segmentation of kidneys in coronal multiphase contrast-enhanced (precontrast, corticomedullary, early nephrographic, nephrographic) MRI examinations in patients with renal masses, in a research setting.

Input

Coronal MCE T1-weighted MRI acquisitions across four phases (precontrast, corticomedullary, early nephrographic, nephrographic). T2-weighted coronal images and kidney masks used for style transfer training and as ground truth during training on synthetic images.

Instructions

1) Train CycleGAN to generate corticomedullary-style images from T2W (Cohort 1). 2) Train additional CycleGANs to generate precontrast, early nephrographic, and nephrographic images from corticomedullary images (Cohort 2). 3) Train four phase-specific Mask R-CNN models on synthetic phase images using T2W kidney masks as ground truth. 4) Apply inference to original MCE MRI phases; perform 3D morphologic postprocessing (dilation, erosion, clean, majority, fill).

Limitations

Small cohorts; validation limited to coronal-plane MCE MRI; generalizability to axial acquisitions and other institutions not established; focuses on kidney segmentation only (renal masses not segmented); training and evaluation limited to patients with renal masses.

Output

Description: Binary kidney segmentation masks for each phase of MCE MRI; final 3D kidney volumes after morphologic postprocessing.

Recommendation

Research use for automated kidney segmentation in MCE MRI; authors suggest future extension to renal mass segmentation and other mpMRI acquisitions.

Reproducibility

Implementation details: CycleGAN (PyTorch); Mask R-CNN (TensorFlow, InceptionResNetV2); grayscale input, 512×512; batch size 4; 100 epochs; initial learning rate 0.008; momentum 0.9; gradient clipping norm 10; pretrained weights (COCO); real-time flips for augmentation; model selection by minimum validation loss; hardware: Nvidia Titan V100 32 GB GPU. N4 bias field correction applied. 3D morphologic postprocessing applied after 2D inference.

Use

Intended: Image segmentation
Out-of-scope: Other
Excluded: Decision support

User

Intended: Researcher