Cine-CNNTrans: Deep learning–based risk stratification system for thyroid nodules using ultrasound cine-clip images
2026-01-24https://doi.org/10.1148/atlas.1769276321298
261
Overview
Schema Version
https://atlas.rsna.org/schemas/2025-11/model.json
Name
Cine-CNNTrans: Deep learning–based risk stratification system for thyroid nodules using ultrasound cine-clip images
Link
https://dx.doi.org/10.1148/ryai.210174
Indexing
Keywords: Thyroid nodule, Ultrasound, Cine clip, Deep learning, Transformer, MobileNetV2, Risk stratification, TI-RADS, Focal loss, Radiomics
Content: US, HN
RadLex: RID50134, RID49885, RID49880
Author(s)
Rikiya Yamashita
Tara Kapoor
Minhaj Nur Alam
Alfiia Galimzianova
Saad Ali Syed
Mete Ugur Akdogan
Emel Alkim
Andrew Louis Wentland
Nikhil Madhuripan
Daniel Goff
Victoria Barbee
Natasha Diba Sheybani
Hersh Sagreiya
Daniel L. Rubin
Terry S. Desser
Organization(s)
Stanford University School of Medicine
Version
1.0
Funding
Supported in part by Yahoo Faculty Research and Engagement Program; NIH awards (PADLY, PADPM, PAEPI, PAFFL, PAWAO, PCOXK, PCQUD, PCRMR); NIH NCI F99/K00 (K00CA234954); National Science Foundation grant(s); additional support acknowledged from ACR, AstraZeneca, Philips (per author disclosures).
Ethical review
Institutional review board–approved, HIPAA-compliant retrospective study; informed consent waived.
Date
Published: 2022-05-11
References
[1] Yamashita R, Kapoor T, Alam MN, et al.. "Toward Reduction in False-Positive Thyroid Nodule Biopsies with a Deep Learning–based Risk Stratification System Using US Cine-Clip Images". Radiology: Artificial Intelligence. 2022;4(3):e210174.. 2022-05-11. doi:10.1148/ryai.210174. PMID: 35652118. PMCID: PMC9152684.
Model
Architecture
Hybrid deep learning model combining a CNN feature extractor (MobileNetV2 pretrained on ImageNet) operating on adjacent-frame stacks (AF-stacks) with a transformer encoder for sequence modeling of framewise embeddings; weakly supervised training at nodule level; focal loss with weighted oversampling to address class imbalance.
Availability
Source code and model weights: https://github.com/tarakapoor/thyroid_deep_learning. Dataset (US cine clips, segmentations, and labels): https://stanfordaimi.azurewebsites.net/datasets/a72f2b02-7b53-4c5d-963c-d7253220bfd5
Clinical benefit
Improves diagnostic performance for thyroid nodule malignancy risk estimation using US cine images and increases specificity of ACR TI-RADS management recommendations, reducing unnecessary biopsies while maintaining sensitivity.
Clinical workflow phase
Clinical decision support systems; secondary risk stratification to revise management recommendations.
Decision threshold
Operating point chosen per cross-validation fold using a weighted Youden index maximizing (2/3 × sensitivity + 1/3 × specificity − 1), placing 2× weight on sensitivity; outputs binarized into low vs high risk.
Degree of automation
Computer-aided decision support; provides malignancy risk score and suggested one-level adjustment to ACR TI-RADS recommendation; requires prior ROI segmentation.
Indications for use
Risk stratification of thyroid nodules in adult patients undergoing thyroid ultrasound with cine sweeps in a clinical radiology setting to inform follow-up vs biopsy recommendations in conjunction with ACR TI-RADS.
Input
Ultrasound cine-clip images of thyroid nodules (grayscale, transverse/longitudinal sweeps) with radiologist-drawn ROI segmentations; AF-stacks of three adjacent frames cropped to lesion bounding box with 5-pixel buffer.
Instructions
Acquire standard grayscale thyroid US cine clips (12–18 MHz) with transverse/longitudinal sweeps; create ROI segmentations for nodules; generate AF-stacks; run Cine-CNNTrans to obtain continuous malignancy risk and binarize using predefined operating point; optionally revise ACR TI-RADS by one level (upgrade from no-biopsy to follow-up if high risk; downgrade from biopsy to follow-up if low risk; no change if original follow-up).
Limitations
Single-center, retrospective dataset of 192 nodules (17 malignant); strong class imbalance (175 benign:17 malignant); cross-validation only (no held-out or external validation); manual segmentation required; ground truth from fine-needle aspiration biopsies may be subject to sampling error; operating point determined per fold; potential domain shift across scanners/sites not evaluated.
Output
CDEs: RDE2817, RDE1042, RDE2074
Description: Continuous malignancy risk score per nodule, further binarized into low vs high risk; used to suggest one-level revision to ACR TI-RADS management recommendation.
Recommendation
Use as a secondary tool to revise ACR TI-RADS management by one level: upgrade no-biopsy to follow-up when high risk; downgrade biopsy to follow-up when low risk; do not change follow-up recommendations.
Reproducibility
Fivefold cross-validation with fixed folds (patient-level separation); code and pretrained weights publicly available to reproduce training/evaluation.
Use
Intended: Risk assessment
Out-of-scope: Decision support
Excluded: Detection and diagnosis
User
Intended: Researcher, Radiologist, Other
Out-of-scope: Layperson
Excluded: Layperson