科研速览 · Science Skim继续刷下去 · Keep skimming →
◆ Sensors (Basel, Switzerland)2026-09-03

Adaptive Task Planning for Long-Horizon Robotic Manipulation Based on Video Priors and Dynamic Scene Graphs.

Guanghui Ma, Jiahui Guo, Xinhua Tang, Huaidong Zhou, Yongfeng Rong

原始摘要(英文原文)· Original abstract
Robots are now expected to execute increasingly complex long-horizon tasks in unstructured environments. Despite the strong potential of pretrained Vision-Language Models (VLMs) in task planning, their direct application to robotic manipulation is hindered by logical reasoning deviations and inadequate geometric scene perception. This work proposes an adaptive task planning method based on video priors and dynamic scene graphs (ATP-VPDSG). It leverages the VLM to extract manipulation logic from video demonstrations, thus supplementing manipulation priors. Meanwhile, scene graphs were integrated to convert unstructured environments into structured representations with spatial topological relations, compensating for perceptual deficiencies. A dual-track feedback mechanism based on visual expectations was further incorporated to enable failure diagnosis and adaptive replanning in complex environments. Extensive long-horizon robotic manipulation experiments were conducted on the LIBERO-10 benchmark with Qwen3-VL as the core VLM. Results showed that ATP-VPDSG achieved an average task planning accuracy of 91.2% and a task execution success rate of 74.67%, outperforming the selected task planning baselines. Ablation studies verified that video priors and dynamic scene graphs exerted complementary effects on logical constraints and physical feasibility. Furthermore, a real-robot experiment on an industrial slider-rail assembly task demonstrated successful sim-to-real transfer, achieving an 82.0% success rate without task-specific fine-tuning.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

Adaptive Task Planning for Long-Horizon Robotic Manipulation Based on Video Priors and Dynamic Scene Graphs. — 科研速览 Science Skim