科研速览 · Science Skim继续刷下去 · Keep skimming →
◆ IEEE transactions on medical imaging2026-09-01

Prototype-guided Multimodal Retrieval for Knowledge-assisted Interventional Radiology.

Jingxiong Li, Chenglu Zhu, Yuxuan Sun, Yixuan Si, Lin Yang, Guojun Li, Yizhe Zhang, Liang Xiao, Tao Zhou

原始摘要(英文原文)· Original abstract
Interventional radiology (IR) requires joint reasoning over procedural images and domain-specific clinical knowledge. Existing medical retrieval-augmented generation (RAG) methods are mainly text-oriented or designed for general medical vision-language tasks, and therefore remain limited in retrieving fine-grained visual-textual evidence for IR scenarios. To address this limitation, we present Prototype-guided Retrieval for Interventional Medical Assistance (PRIMA), a multimodal RAG framework that jointly leverages multimodal imaging and clinical text to support IR decision-making. PRIMA constructs a multimodal IR knowledge index through anatomy-aware visual-textual alignment and modality-preserving representation learning. It then introduces domain-informed prototype learning to organize IR concepts, enabling prototype-guided retrieval that re-ranks evidence using both query similarity and prototype affinity. We conduct comprehensive evaluations on literature-curated and clinically collected IR datasets. Experimental results show that PRIMA consistently improves generation quality, question-answering accuracy and expert-rated clinical interpretability compared with existing RAG baselines. These findings demonstrate the effectiveness of clinically grounded prototype-guided retrieval for multimodal knowledge assistance in interventional radiology. Related resources are available at https://github.com/StonHamA/PRIMA.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

Prototype-guided Multimodal Retrieval for Knowledge-assisted Interventional Radiology. — 科研速览 Science Skim