科研速览 · Science Skim继续刷下去 · Keep skimming →
◆ Medical image analysis2026-09-07

Lesion-aware visio-linguistic context regularization for radiology report generation.

Guanqun Sun, Yunbin Tu, Yingying Zhu, Liang Wan, Qun Jin, Jianhua Ma

原始摘要(英文原文)· Original abstract
While Large Language Models (LLMs) have revolutionized image captioning, their direct application to radiology report generation (RRG) faces two key challenges: the semantic dilution of lesion features due to indiscriminate global image encoding, and the stylistic drift resulting from LLMs' lack of strict clinical constraints. In this paper, we propose a Lesion-Aware Visio-Linguistic Context (LAVIC) regularization architecture, which synergizes focal anatomical attention with report structural consistency. In the visual encoding phase, we first design an anatomy-prioritized feature amplification pipeline that leverages a chest mask as explicit visual context to amplify the signal-to-noise ratio of chest-specific regions, thereby guiding the encoder to prioritize lesion-relevant semantics over background artifacts. Subsequently, we devise an anatomy-prioritized feature enhancement module to refine the expressiveness of the extracted features by modeling the implicit contextual dependencies among them. In the linguistic decoding phase, we mitigate the domain gap using regularization through complementary linguistic contexts. By injecting retrieved entity-level terminologies and summary-level report templates, we establish structural guardrails that regularize the LLM to adhere to radiological conventions without the need for retraining. LAVIC demonstrates strong NLG performance across three benchmarks and consistent advantages on clinically oriented automatic metrics for MIMIC-CXR and CheXPlus. Code will be released.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

Lesion-aware visio-linguistic context regularization for radiology report generation. — 科研速览 Science Skim