深度强化学习驱动的无人机群抗干扰用户接入优化

    Deep Reinforcement Learning-driven Anti-interference User Access Optimization in UAV Swarms

    • 摘要: 针对无人机集群通信系统在干扰环境下,面临用户连接不稳定与系统多维度优化耦合复杂等难题,本文开展抗干扰用户接入优化研究。无人机集群为地面用户提供通信服务时,常受到恶意干扰机发射干扰信号攻击,破坏无人机与用户间通信链路。面对此对抗场景,本文提出一种基于多智能体深度强化学习的联合优化方法。该方法通过构建干扰感知状态空间、设计“三维移动轨迹−功率”复合动作及多维度复合奖励函数,实现无人机空间部署与发射功率的协同优化,从而最大化满足通信质量门限的稳定连接用户数。仿真结果表明,本文算法在多种用户分布场景与不同干扰强度下,均表现出良好的收敛性与鲁棒性,在干扰机发射功率为25 dBm、通信质量门限为5 dB时,其系统平均总连接用户数相较基准方案最高提升约56%,能够有效提升干扰环境下无人机集群通信系统的抗干扰接入性能。

       

      Abstract: Unstable user connections and the complex coupling of multi-dimensional system optimization severely constrain the performance of unmanned aerial vehicle (UAV) cluster communication systems in jamming environments. Malicious jammers frequently attack these clusters with jamming signals, severely disrupting the air-to-ground communication links during service provision. Facing this adversarial scenario, a joint optimization method based on multi-agent deep reinforcement learning was proposed to enhance anti-jamming user access. Specifically, a jamming-aware state space, a joint three-dimensional (3D) trajectory and transmit power control action, and a multi-dimensional composite reward function were constructed. This approach achieved the coordinated optimization of UAV spatial deployment and transmit power, successfully maximizing the number of stably connected users meeting the communication quality threshold. Simulation results demonstrate that the proposed algorithm exhibits superior convergence performance and robustness across diverse user distribution scenarios and jamming intensities. Furthermore, under the condition of a jamming power of 25 dBm and a communication quality threshold of 5 dB, the proposed algorithm improves the system average total number of connected users by up to 56% compared with benchmark schemes, thereby effectively enhancing the anti-jamming access capability of UAV swarm communication systems.

       

    /

    返回文章
    返回