科研速览 · Science Skim继续刷下去 · Keep skimming →
◆ ACM AI Letters2026-03-26· Interpretability

Proto-Interpretation: The Temporality of Large Language Model Inference

Mattias Rost

原始摘要(英文原文)· Original abstract
We show that autoregressive generation in large language models exhibits a temporal structure: each token is not only conditioned on the past but also reshapes the future continuation space. We call this process proto-interpretation : the probabilistic redistribution across competing continuations through which the model gradually commits to one emerging branch of meaning. Using a minimal ambiguity case, we demonstrate branch competition and sequential commitment during inference. These findings reveal meaning in LLMs as a dynamic, temporally unfolding process, shifting interpretability from static model states to inference-time dynamics.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

Proto-Interpretation: The Temporality of Large Language Model Inference — 科研速览 Science Skim