科研速览 · Science Skim继续刷下去 · Keep skimming →
◆ Lecture notes in computer science2026-08-02· Computer science

Text Conditioned Implicit Visual Chain-of-Reasoning for Unsupervised 3D Medical Image Registration

Muhammad Zafar Iqbal, Anwaar Ulhaq, Srimannarayana Grandhi, Zafar Saeed

原始摘要(英文原文)· Original abstract
This paper proposes a text-conditioned progressive reasoning framework for anatomically consistent 3D deformable medical image registration. Unlike conventional registration models that rely on image intensities or features, our approach targets progressive enhancement of deformation vector fields. It is conditioned on expert textual guidance to achieve the desired coverage of salient anatomical structures. Textual prompts are embedded into semantic representations that drive a purpose-built modulation pathway. This pathway supports joint reasoning over fixed and moving volumetric features. These text-enhanced features guide a coarse-to-fine stack of deformation vector fields, including DVF1, DVF2, and DVF3. Each level performs an attention mechanism between reference and source features. The network is trained in an unsupervised manner using image similarity and regularisation losses. It does not require ground truth deformations. Experiments on 3D brain MRI from the IXI dataset show improved global alignment and better region-focused accuracy in prompt relevant anatomical structures. Results are compared with a text-free baseline. We also augmented a dataset of 1,064 text descriptions derived from the standard 133 FreeSurfer brain regions. In addition, the model produces interpretable intermediate deformation fields that illustrate how deformation evolves across scales. This highlights the potential of a multimodal chain of reasoning as a strong driver of anatomically consistent 3D image registration.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

Text Conditioned Implicit Visual Chain-of-Reasoning for Unsupervised 3D Medical Image Registration — 科研速览 Science Skim