Multi-Agent Deep Reinforcement Learning for Coding-Aware and Energy-Balanced Routing in Dynamic Drone Networks

By incorporating opportunistic coding, network throughput is enhanced, resulting in improved overall performance. However, applying this paradigm to Flying Ad-hoc Networks (FANETS) faces significant challenges due to the highly dynamic topology caused by the high-velocity mobility of UAVs, alongside the NP-hard complexity of identifying optimal coding opportunities in rapidly evolving aerial network architectures. To address these challenges, this paper proposes a novel coding-aware routing protocol based on Multi-Agent Deep Deterministic Policy Gradient (MADDPG). We formulate the routing problem as a multi-agent continuous decision-making process, employing the MADDPG algorithm to optimize routing policies in real-time through decentralized execution and centralized training. To maximize network utility, we design a comprehensive reward function that integrates coding benefits, throughput, energy distribution, and end-to-end delay, ensuring a balance between throughput maximization and the energy sustainability of individual UAV nodes. Simulation results demonstrate that the proposed protocol significantly outperforms state-of-the-art coding-aware routing protocols in terms of throughput, Packet Delivery Ratio (PDR), and transmission delay, exhibiting superior robustness in highly dynamic FANET scenarios. Notably, at a network density of 20 UAVs, MARL-CAR outperforms COPE, DCAR, TSCAR, and RLCAR in terms of coding ratio by 32.23%, 18.93%, 20.35%, and 5.5%, respectively. This research provides a scalable and intelligent networking solution for the next generation of autonomous UAV swarms and collaborative aerial missions.