Search arXivSearch

arXiv · 2406.16875

Multi-Stage Fusion Architecture for Small-Drone Localization and Identification Using Passive RF and EO Imagery: A Case Study

Abstract

Reliable detection, localization and identification of small drones is essential to promote safe, secure and privacy-respecting operation of Unmanned-Aerial Systems (UAS), or simply, drones. This is an increasingly challenging problem with only single modality sensing, especially, to detect and identify small drones. In this work, a multi-stage fusion architecture using passive radio frequency (RF) and electro-optic (EO) imagery data is developed to leverage the synergies of the modalities to improve the overall tracking and classification capabilities. For detection with EO-imagery, supervised deep learning based techniques as well as unsupervised foreground/background separation techniques are explored to cope with challenging environments. Using real collected data for Group 1 and 2 drones, the capability of each algorithm is quantified. In order to compensate for any performance gaps in detection with only EO imagery as well as to provide a unique device identifier for the drones, passive RF is integrated with EO imagery whenever available. In particular, drone detections in the image plane are combined with passive RF location estimates via detection-to-detection association after 3D to 2D transformation. Final tracking is performed on the composite detections in the 2D image plane. Each track centroid is given a unique identification obtained via RF fingerprinting. The proposed fusion architecture is tested and the tracking and performance is quantified over the range to illustrate the effectiveness of the proposed approaches using simultaneously collected passive RF and EO data at the Air Force Research Laboratory (AFRL) through ESCAPE-21 (Experiments, Scenarios, Concept of Operations, and Prototype Engineering) data collect

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Thakshila Wimalajeewa Wewelwala, Thomas W. Tedesso, Tony Davis. 2024-03-30. Multi-Stage Fusion Architecture for Small-Drone Localization and Identification Using Passive RF and EO Imagery: A Case Study. https://arxiv.org/abs/2406.16875

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Adaptive Polynomial Chaos Expansion for Uncertainty Quantification of Radio Wave Propagation over Irregular Terrains

Accurate modeling of radio wave propagation over irregular terrains is crucial for designing reliable wireless communication systems in such environments, yet uncertainties in the antenna configuration are not quantified within deterministic models. This paper develops a fixed number of samples adaptive polynomial chaos expansion (APCE) method for uncertainty quantification (UQ) of radio wave propagation over realistic irregular terrains, where the model evaluations are obtained using a two-way parabolic wave equation (PWE) method. The proposed APCE method is designed to construct a compact and stable PCE model from a prescribed and limited set of simulations. The polynomial basis is enriched using an anisotropic basis extension algorithm driven by variance contributions, while validation behavior and the available sample size are used to control basis growth. The convergence analysis shows decreasing validation errors and improved robustness as the sampling budget increases, with lower trial-to-trial variability than the baseline adaptive PCE method, which uses the same variance-driven basis extension strategy. For two realistic terrain profiles, the proposed method accurately predicts the mean and the 5-95 percentile range of the path loss, and improves the estimation of the standard deviation compared with standard and sparse PCE, using only 30 PWE simulations. APCE outperforms standard and sparse PCE, with the largest gains observed for the 5th and 95th percentile estimates, and its construction time is close to that of standard PCE and much lower than that of sparse PCE based on least angle regression. As the sample size increases, APCE maintains low errors with reduced trial-to-trial variability.

eess.SP

Overlap-Summation-Based Pulse Shaping Transceiver for Affine Frequency Division Multiplexing

Affine frequency division multiplexing (AFDM) has recently emerged as a promising waveform for doubly-selective channels. A direct-windowing-based pulse shaping transceiver (PS-AFDM) was proposed to suppress the Doppler sidelobes, thus improving the accuracy of channel estimation. We observe that, when the path delays and Doppler shifts are randomly distributed, the legacy PS-AFDM scheme significantly increases the condition number of the effective channel matrix. The resulting ill-conditioning degrades the numerical stability of channel equalization in noise and consequently increases the BER. To address this issue, this letter applies the existing weighted overlap-summation (WOLA) transceiver to AFDM and proposes a novel channel-aware (CA) receive shaping window design, which simultaneously achieves accurate channel estimation and robust equalization performance, at the cost of additional prefix overhead and receive-window calculation. The resulting scheme is termed CAWOLA-AFDM. Compared with the legacy WOLA scheme, which employs a fixed receive window, the proposed CAWOLA design exploits the channel estimates of slowly varying power gains and Doppler shifts to design a channel-tailored receive shaping window in closed form, thereby further enhancing channel-estimation accuracy while maintaining the channel condition number when a Nyquist prototype window is adopted. The proposed CAWOLA receive-window design aims to produce an effective AFDM channel with more compact support in the DAFT domain. The source code for the simulations is provided at https://github.com/SANIS-HITSZ/Waveform_AFDM.

eess.SP

Parametric Channel Estimation with Hardware Impaired Hybrid Beamformers: Sensing, Communications, and Power Efficiency Tradeoffs

Due to high power consumption and hardware costs of fully digital arrays, hybrid beamformers are often considered as a more economic alternative. Furthermore, using high resolution analog to digital converters (ADCs) can also have prohibitive power consumption, which leads to lower resolution converters being considered for radio frequency (RF) front end design. The finite quantization resolution as well as the nonlinearities caused by the power amplifiers (PAs) and low noise amplifiers (LNAs) can have a substantial impact on system performance. While widely studied for communications, the impact of hardware impairments on sensing performance is considerably less explored. In this work, we study the interplay between hybrid beamforming architectures, hardware impairments, and sensing and communications performance. Additionally, we define the concept of double-isotropy for pilot-combiner pairs, formalizing the notion of a perfectly energy-fair beam sweep. The multiple start (MS) space alternating generalized expectation maximization algorithm (SAGE) is also introduced, aimed at addressing the optimization issues arising from parametric channel estimation (PCE) in hybrid beamformed systems. We then provide a set of numerical results assessing the impacts of beamformer architecture and ADC resolution on PCE, sensing, and communications performance. The results show that medium resolution ADCs lead to the most power efficient configurations, with the best tradeoff between power consumption and performance for the majority of beamforming architectures. Additionally, fully digital beamforming architectures with high resolution converters can often be substituted for a hybrid beamformer setup with medium resolution converters without significant performance loss at a lower power consumption and overall hardware cost.

eess.SP