Detection Transformer (DETR) for detection, localization, and characterization of focal liver lesions on abdominal ultrasound
model2026-01-24https://doi.org/10.1148/atlas.1769275897396
301

Overview

Schema Version

https://atlas.rsna.org/schemas/2025-11/model.json

Name

Detection Transformer (DETR) for detection, localization, and characterization of focal liver lesions on abdominal ultrasound

Link

https://gitlab.inria.fr/hdadoun/focal-liver-lesions-us

Indexing

Keywords: Focal liver lesion, Ultrasound, Liver, Detection, Localization, Characterization, Benign vs malignant, DETR, Transformer, Object detection
Content: US, GI, OI

Author(s)

Hind Dadoun
Anne-Laure Rousseau
Eric de Kerviler
Jean-Michel Correas
Anne-Marie Tissier
Fanny Joujou
Sylvain Bodard
Kemel Khezzane
Constance de Margerie-Mellon
Hervé Delingette
Nicholas Ayache

Organization(s)

Université Côte d’Azur, Inria, Epione Team
Georges Pompidou European Hospital APHP, Université de Paris
NHance.ngo
Hôpital Saint Louis APHP, Université de Paris
Université de Paris and Université de l’Hôpital Necker

Version

1.0

Contact

rf.airni@nuodad.dnih

Funding

Supported in part by the French government through the 3IA Côte d’Azur Investments in the Future project managed by ANR (ANR-19-P3IA-0002).

Ethical review

Institutional review board–approved retrospective multicenter study (IRB00011591); informed consent waived.

Date

Updated: 2022-02-16
Published: 2022-03-02
Created: 2021-04-23

References

[1] Dadoun H, Rousseau AL, de Kerviler E, Correas JM, Tissier AM, Joujou F, Bodard S, Khezzane K, de Margerie-Mellon C, Delingette H, Ayache N.. "Deep Learning for the Detection, Localization, and Characterization of Focal Liver Lesions on Abdominal US Images". Radiology: Artificial Intelligence. 2022;4(3):e210110.. 2022-03-02. doi:10.1148/ryai.210110. PMID: 35652113. PMCID: PMC9152842.

Model

Architecture

Detection Transformer (DETR) vision transformer–based end-to-end object detection network fine-tuned for ultrasound FLL detection, localization, and characterization.

Availability

All code used for this study: https://gitlab.inria.fr/hdadoun/focal-liver-lesions-us

Clinical benefit

Assists in screening by detecting and localizing focal liver lesions and characterizing them as benign or malignant on abdominal ultrasound images; performance matched or exceeded experts in several tasks, potentially aiding nonexpert caregivers.

Clinical workflow phase

Patients’ triage / screening decision support during ultrasound interpretation.

Decision threshold

Class-specific probability thresholds selected to maximize F1 score on validation; IOU threshold of 0.3 used to assign true positives for localization/classification.

Degree of automation

Automated detection, localization, and classification; supports clinician decision-making.

Indications for use

Image-based aid for detecting, localizing, and characterizing focal liver lesions on noncontrast B-mode abdominal ultrasound images of adult patients (≥18 years) in hospital settings.

Input

Preprocessed B-mode abdominal ultrasound images (JPEG converted from DICOM; US fan retained; text/graphics and biometric overlays removed).

Instructions

Apply to noncontrast B-mode abdominal US images after de-identification and fan/overlay removal as described. Use class-specific probability thresholds (chosen on validation) and IOU > 0.3 to consider matches. Intended for images similar to those from the two participating hospitals and vendors in the study.

Limitations

Retrospective study with small external test set (48 patients, 155 images). Reference standard for localization required unanimous adjudication, which may bias dataset and limit scalability. Poor-quality or uninterpretable images were excluded; performance on such images is unknown. Networks and experts were blinded to clinical context; real-world performance with clinical data may differ. Operator dependence of ultrasound may affect generalizability across sites/operators/vendors. Lower performance for cyst detection, likely due to class imbalance and confusion with vascular structures.

Output

CDEs: RDE65, RDE2077
Description: Bounding boxes for liver and focal liver lesions with labels indicating presence/absence of lesions, lesion malignancy (benign vs malignant), and benign/malignant subtypes (cyst, angioma, focal nodular hyperplasia, adenoma, metastasis, hepatocellular carcinoma).

Recommendation

Research-use decision support to assist nonexpert and expert users in screening for and assessing focal liver lesions on abdominal US images.

Reproducibility

Training details reported: 100 epochs; SGD with Nesterov momentum; learning rate 0.0048; batch size 4; momentum 0.9; weight decay 0.0001; warm-up first epoch; LR decay at epochs 75 and 90; data augmentation via learned bounding-box policies. Code repository provided.

Use

Intended: Detection and diagnosis
Out-of-scope: Diagnosis
Excluded: Image quality enhancement

User

Intended: Radiologist, Other, Caregiver