Style Transfer–assisted Deep Learning Method for Kidney Segmentation at Multiphase MRI
2025-12-03https://doi.org/10.1148/atlas.1764793051246
41
Overview
Schema Version
https://atlas.rsna.org/schemas/2025-11/model.json
Name
Style Transfer–assisted Deep Learning Method for Kidney Segmentation at Multiphase MRI
Link
https://dx.doi.org/10.1148/ryai.230043
Indexing
Keywords: Kidney Segmentation, Generative Adversarial Network, CycleGAN, Convolutional Neural Network, Transfer Learning, multiphase contrast-enhanced MRI, Mask R-CNN
Content: GU, MR
RadLex: RID39213, RID209, RID39214, RID34325, RID49531
Author(s)
Junyu Guo
Manu Goyal
Yin Xi
Lauren Hinojosa
Gaelle Haddad
Emin Albayrak
Ivan Pedrosa
Organization(s)
University of Texas Southwestern Medical Center, Department of Radiology
University of Texas Southwestern Medical Center, Department of Urology
Advanced Imaging Research Center, University of Texas Southwestern Medical Center
Version
1.0
License
Text: CC BY 4.0
URL: https://creativecommons.org/licenses/by/4.0/
Contact
Corresponding author: Ivan Pedrosa, MD, PhD, University of Texas Southwestern Medical Center, 2201 Inwood Rd, Suite 202, Dallas, TX 75390-9085.
Funding
Partially funded by the National Institutes of Health (grant R01CA154475). Computational resources provided by the BioHPC supercomputing facility, Lyda Hill Department of Bioinformatics, UT Southwestern Medical Center.
Ethical review
Retrospective, HIPAA-compliant, institutional review board–approved study with waiver of informed consent.
Date
Updated: 2023-11-01
Published: 2023-09-13
Created: 2023-02-12
References
[1] Guo J, Goyal M, Xi Y, Hinojosa L, Haddad G, Albayrak E, Pedrosa I.. "Style Transfer–assisted Deep Learning Method for Kidney Segmentation at Multiphase MRI". Radiology: Artificial Intelligence. 2023 Nov;5(6):e230043.. 2023-09-13. doi:10.1148/ryai.230043. PMID: 38074795. PMCID: PMC10698598.
Model
Architecture
Semisupervised pipeline combining CycleGAN (PyTorch) for style transfer to synthetic MCE MRI and Mask R-CNN (TensorFlow, InceptionResNetV2 backbone; segmentation head only) for kidney segmentation.
Availability
CycleGAN implementation: https://github.com/junyanz/CycleGAN; TensorFlow Object Detection (Mask R-CNN): https://github.com/tensorflow/models/tree/master/research/object_detection. Trained study models not publicly released.
Clinical benefit
Automates kidney segmentation on multiphase contrast-enhanced MRI, reducing manual annotation burden and enabling downstream quantitative analyses and radiomics workflows.
Clinical workflow phase
Workflow optimization (automated image segmentation to support analysis of mpMRI examinations).
Degree of automation
Fully automatic segmentation at inference; semisupervised training using synthetic images generated from T2-weighted images.
Indications for use
Automated segmentation of kidneys in coronal multiphase contrast-enhanced (precontrast, corticomedullary, early nephrographic, nephrographic) MRI examinations in patients with renal masses, in a research setting.
Input
Coronal MCE T1-weighted MRI acquisitions across four phases (precontrast, corticomedullary, early nephrographic, nephrographic). T2-weighted coronal images and kidney masks used for style transfer training and as ground truth during training on synthetic images.
Instructions
1) Train CycleGAN to generate corticomedullary-style images from T2W (Cohort 1). 2) Train additional CycleGANs to generate precontrast, early nephrographic, and nephrographic images from corticomedullary images (Cohort 2). 3) Train four phase-specific Mask R-CNN models on synthetic phase images using T2W kidney masks as ground truth. 4) Apply inference to original MCE MRI phases; perform 3D morphologic postprocessing (dilation, erosion, clean, majority, fill).
Limitations
Small cohorts; validation limited to coronal-plane MCE MRI; generalizability to axial acquisitions and other institutions not established; focuses on kidney segmentation only (renal masses not segmented); training and evaluation limited to patients with renal masses.
Output
Description: Binary kidney segmentation masks for each phase of MCE MRI; final 3D kidney volumes after morphologic postprocessing.
Recommendation
Research use for automated kidney segmentation in MCE MRI; authors suggest future extension to renal mass segmentation and other mpMRI acquisitions.
Reproducibility
Implementation details: CycleGAN (PyTorch); Mask R-CNN (TensorFlow, InceptionResNetV2); grayscale input, 512×512; batch size 4; 100 epochs; initial learning rate 0.008; momentum 0.9; gradient clipping norm 10; pretrained weights (COCO); real-time flips for augmentation; model selection by minimum validation loss; hardware: Nvidia Titan V100 32 GB GPU. N4 bias field correction applied. 3D morphologic postprocessing applied after 2D inference.
Use
Intended: Image segmentation
Out-of-scope: Other
Excluded: Decision support
User
Intended: Researcher