MRSegmentator
model2025-11-21https://doi.org/10.1148/atlas.1762467403315
121

Overview

Schema Version

https://atlas.rsna.org/schemas/2025-11/model.json

Name

MRSegmentator

Link

https://doi.org/10.1148/ryai.240777

Indexing

Keywords: MR Imaging, Segmentation, Computer Vision, Supervised Learning
Content: BQ, CA, CH, CT, GI, GU, MK, MR, OI, OT, VA

Author(s)

Hartmut Häntze
Lina Xu
Christian J. Mertens
Felix J. Dorfner
Leonhard Donle
Felix Busch
Avan Kader
Sebastian Ziegelmayer
Nadine Bayerl
Nassir Navab
Daniel Rueckert
Julia Schnabel
Hugo J. W. L. Aerts
Daniel Truhn
Fabian Bamberg
Jakob Weiss
Christopher L. Schlett
Steffen Ringhof
Thoralf Niendorf
Tobias Pischon
Hans-Ulrich Kauczor
Tobias Nonnenmacher
Thomas Kröncke
Henry Völzke
Jeanette Schulz-Menger
Klaus Maier-Hein
Alessa Hering
Mathias Prokop
Bram van Ginneken
Marcus R. Makowski
Lisa C. Adams
Keno K. Bressem

Organization(s)

Charité - Universitätsmedizin Berlin
Radboud University Medical Center
Klinikum rechts der Isar, TUM University Hospital, Technical University of Munich
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School
Institute of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität (FAU) Erlangen-Nürnberg
Laboratory for Computer Aided Medical Procedures, Technical University of Munich
Chair for AI in Medicine and Healthcare, Klinikum rechts der Isar, Technical University Munich
Department of Computing, Imperial College London
Institute for Advanced Study, Technical University Munich
Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School
Departments of Radiation Oncology and Radiology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital
Radiology and Nuclear Medicine, CARIM & GROW, Maastricht University
Department of Diagnostic and Interventional Radiology, University Hospital Aachen
Department of Diagnostic and Interventional Radiology, University Medical Center Freiburg, Faculty of Medicine, University of Freiburg
Berlin Ultrahigh Field Facility (B.U.F.F.), Max Delbrück Center for Molecular Medicine in the Helmholtz Association
Clinic for Diagnostic and Interventional Radiology, Heidelberg University Hospital
Department of Diagnostic and Interventional Radiology and Neuroradiology, Universitätsklinikum Augsburg
Institute for Community Medicine, University Medicine Greifswald
Experimental Clinical Research Center, Charité - Universitätsmedizin Berlin
Division of Medical Image Computing, German Cancer Research Center
Department of Cardiovascular Radiology and Nuclear Medicine, School of Medicine and Health, German Heart Center, TUM University Hospital, Technical University of Munich

Contact

keno.bressem@tum.de

Funding

This work was in large part funded by the Wilhelm Sander Foundation. It was also funded by the European Union (grant no. 101079894). The NAKO is funded by the Federal Ministry of Education and Research (BMBF) (project funding reference no. 01ER1301A/B/C, 01ER1511D, and 01ER1801A/B/C/D), federal states of Germany and the Helmholtz Association, the participating universities and the institutes of the Leibniz Association.

Ethical review

This retrospective study was conducted in accordance with the Declaration of Helsinki and received approval from the local ethics committee (EA4/062/20) with a waiver of patient consent.

Comments

This retrospective study developed MRSegmentator, an nnU-Net-based cross-modality deep learning model for multiorgan segmentation of MRI and CT scans, segmenting 40 anatomic structures. It was trained on UK Biobank Dixon MRI, in-house abdominal MRI, and TotalSegmentator CT data, using a human-in-the-loop annotation workflow. The model was validated on NAKO, AMOS22, and TotalSegmentator MRI datasets, demonstrating high class-wise Dice similarity coefficients for well-defined organs and generalizability to CT, outperforming existing open-source tools.

Model

Architecture

nnU-Net-based cross-modality image segmentation model (nnU-Net version 2)

Availability

Code and trained weights are publicly available at https://github.com//hhaentze/MRSegmentator.

Clinical benefit

Automated segmentation of anatomic structures in medical imaging enables precise organ volumetry, facilitates anatomic context for AI-based diagnosis, and supports quantitative imaging biomarker extraction. It allows researchers to obtain biomarkers relevant for various research questions and clinical tasks.

Clinical workflow phase

Diagnosis

Degree of automation

Fully automated

Indications for use

Multiorgan segmentation of MRI and CT scans for 40 anatomic structures, including well-defined organs, organs with anatomic variability, and smaller structures. Applicable for whole-body imaging from shoulders to knees.

Input

Three-dimensional (3D) MR or CT images, including UK Biobank Dixon MRI sequences, in-house abdominal MRI sequences, TotalSegmentator CT dataset, NAKO MRI sequences (T1-weighted 3D volumetric interpolated breath-hold examination two-point Dixon sequences (in-phase, opposed-phase, water-only, fat-only, and T2-weighted half-Fourier acquisition single-shot turbo spin echo [HASTE] sequences)), AMOS22 MRI sequences, and TotalSegmentator MRI sequences.

Instructions

Code and trained weights are publicly available at https://github.com//hhaentze/MRSegmentator. The model was trained with fivefold cross-validation using the 3d_fullres_no_flipping configuration of nnU-Net version 2 with an increased batch size of eight, keeping other training parameters at default values. Preprocessing steps for MRI scans included intensity inversion and histogram equalization.

Limitations

Human-in-the-loop annotation may have introduced bias, but strong performance on independent datasets suggests minimal impact. UKBB training data represents only 50 unique participants, limiting anatomic variety. Observed sex-based performance differences highlight the need for more balanced training datasets. Model occasionally confused left and right structures, likely due to nnU-Net’s patch-wise design limiting global context. Struggled with postoperative anatomy and some irregular tumor borders.

Output

Description: Segmentation masks for 40 anatomic structures in whole-body MRI and CT images. Structures include spine, sacrum, hips, femurs, heart, aorta, inferior vena cava, portal or splenic vein, iliac arteries and veins, left and right lungs, liver, spleen, pancreas, gallbladder, stomach, duodenum, small bowel, colon, left and right kidneys, adrenal glands, urinary bladder, and muscles (gluteal, autochthonous, iliopsoas).

Recommendation

MRSegmentator is a valuable tool for researchers and clinicians for reproducible, high-accuracy delineation of whole-body anatomy on MRI and CT, offering practical advantages over modality-specific solutions.

Reproducibility

Objective cross-modality segmentation with MRSegmentator provided reproducible, high-accuracy delineation of whole-body anatomy on MRI.

Use

Intended: Image segmentation, Organ volumetry, Biomarker extraction, Anatomic context for AI diagnosis
Out-of-scope: Prostate segmentation, Bladder segmentation (AMOS22), Brain imaging

User

Intended: Researcher, Clinician, Diagnostic Radiologist