Yun Bai, Yizhuang Liu
UAV object detection is still difficult to achieve due to large-scale variation, dense small objects, a complicated background, and resource constraints from onboard computing. To solve these problems, we develop a diffusion-enhanced detection network, DL-DEIM, tailored for aerial images. The proposed scheme generalizes the DEIM baseline across three orthogonal axes. First, we propose a lightweight backbone network called DCFNet, which utilizes a DRFD module and a FasterC3k2 module to maintain spatial information and reduce computational complexity. Second, we propose a LFDPN module, which can conduct bidirectional multi-scale fusion via frequency-spatial self-attention and deep feature refinement and largely enhance cross-scale contextual propagation for small objects. Third, we propose LAWDown, an adaptive-content-aware downsampling to preserve the discriminative representation with higher accuracy at lower resolutions, which can effectively capture the spatially-variant weights and group channel interactions. On the VisDrone2019 dataset, DL-DEIM achieves a mAP@0.5 of 34.9% and a mAP@0.5:0.95 of 20.0%, outperforming the DEIM baseline by +4.6% and +2.9%, respectively. The model maintains real-time inference speed (356 FPS) with only 4.64 M parameters and 11.73 GFLOPs. Ablation studies validate the fact that DCFNet, LFDPN, and LAWDown collaboratively contribute to the accuracy and efficiency. Visualizations also display clustered and better localized activation in crowded scenes. These results show that DL-DEIM achieves a good tradeoff between detection probability and computation burden and it can be used in practice on resource-limited UAV systems.