A Survey on Interaction-Aware Decision-Making for Autonomous Driving: Challenges, Solutions, and Perspectives

Interacting with diverse and stochastic traffic participants is a critical challenge for autonomous vehicles (AVs), as it necessitates advanced decision-making systems to replicate the natural adaptability of human drivers. In particular, navigating safely and efficiently in dense traffic scenarios poses a significant challenge for decision-making, which is inherently an interactive task,i.e., nearby traffic participants will influence AVs’ action, and vice versa. Decision-making solutions that rely solely on unidirectional interaction schemes, neglecting the mutual influence between AVs and other traffic participants, may lead to overly defensive behaviors or the “freezing robot problem”. In recent years, researchers have been increasingly focused on incorporating bidirectional interactions into the decision-making process to make safe, intelligent, and socially compatible decisions. Currently, a comprehensive review of interaction-aware decision-making techniques remains lacking. To this end, this paper aims to provide a systematic review of interaction-aware decision-making methodologies for autonomous driving. Specifically, this paper analyzes the challenges in considering bidirectional interactions between AVs and other traffic participants. In addition, the state-of-the-art techniques for interaction-aware decision-making solutions are reviewed. More importantly, simulation and benchmarks for interaction-aware decision-making validation are also presented. Finally, research perspectives are highlighted to facilitate future studies for interaction-aware decision-making policy design.