Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC

Bo Lin; Chuanbin Zhao; Feifei Gao; Geoffrey Ye Li

Home/Archive/arXiv

arXiv · 2403.17810

Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC

Bo Lin·Chuanbin Zhao·Feifei Gao·Geoffrey Ye Li

View original source ↗Read source document ↗Export metadata ↓

Abstract

Integrated sensing and communications (ISAC) has been deemed as a key technology for the sixth generation (6G) wireless communications systems. In this paper, we explore the inherent clustered nature of wireless users and design a multi-user based environment reconstruction scheme. Specifically, we first select users based on the estimation precision of channel's multipath, including the line-of-sight (LOS) and the non-line-of-sight (NLOS) paths, to enhance the accuracy of environment reconstruction. Then, we develop a fusion strategy that merges communications signalling with camera image to increase the accuracy and robustness of environment reconstruction. The simulation results demonstrate that the proposed algorithm can achieve a remarkable sensing accuracy of centimeter level, which is about 17 times better than the scheme without user selection. Meanwhile, the fusion of communications data and vision data leads to a threefold accuracy improvement over the image only method, especially under challenging weather conditions like raining and snowing.

Explore related subjects

eess.SP

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Bo Lin, Chuanbin Zhao, Feifei Gao, Geoffrey Ye Li. 2024-03-26. Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC. https://arxiv.org/abs/2403.17810

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Multi-Carrier Rydberg Atomic Quantum Receivers with Enhanced Bandwidth Feature for Communication and Sensing

Rydberg atomic quantum receivers (RAQRs) have attracted significant attention in recent years due to their ultra-high sensitivity. Although capable of precisely detecting the amplitude and phase of weak signals, conventional RAQRs face inherent limitations in accurately receiving wideband RF signals, due to the discrete nature of atomic energy levels and their intrinsic instantaneous bandwidth constraints. These limitations hinder their direct application to multi-carrier communication and sensing. To address this issue, this paper proposes a multi-carrier Rydberg atomic quantum receiver (MC-RAQR) structure with five energy levels. We derive the amplitude and phase of the MC-RAQR and extract the baseband electrical signal for signal processing. In terms of multi-carrier communication and sensing, we analyze the channel capacity and accuracy of angle of arrival (AoA) and distance parameters, respectively. Numerical results validate our proposed model, showing that the MC-RAQR can achieve up to a bandwidth of 11.7 MHz, which is 17-fold larger than the conventional RAQRs. As a result, the channel capacity and the resolution for multi-target sensing are improved significantly. Specifically, the channel capacity of MC-RAQR is 110-fold and 2.8-fold larger than the classical RF receivers and RAQRs, respectively. For sensing performance, the RMSE of AoA estimation for MC-RAQR exhibits 7.6-fold reduction, compared with the conventional RAQRs. Furthermore, the RMSE of distance estimation is $634$-fold smaller than that of the root-CRB of classical RF receivers, showing the superior performance of the MC-RAQR. This demonstrates its compatibility with waveforms such as orthogonal frequency-division multiplexing (OFDM) and its significant advantages for multi-carrier signal reception.

eess.SP↗

arXiv2026

Channel Estimation in MIMO Systems Aided by Microwave Linear Analog Computers (MiLACs)

Microwave linear analog computers (MiLACs) have recently emerged as a promising solution for future gigantic multiple-input multiple-output (MIMO) systems, enabling beamforming with greatly reduced hardware and computational cost. However, channel estimation for MiLAC-aided systems remains an open problem. Conventional least squares (LS) and minimum mean square error (MMSE) estimation rely on intensive digital computation, which undermines the computational advantage offered by MiLACs. In this letter, we propose efficient LS and MMSE channel estimation schemes for MiLAC-aided MIMO systems. By designing the training precoder and combiner implemented by lossless and reciprocal MiLACs, the proposed schemes perform LS and MMSE estimation in the analog domain, leaving only simple digital scaling. They achieve identical estimation performance to their digital counterparts while significantly reducing computational complexity. Numerical results verify the effectiveness of the proposed schemes.

eess.SP↗

arXiv2026

Joint Subcarrier Phase Recovery for Nonlinearity Mitigation

We propose a low-complexity phase recovery scheme that simultaneously mitigates laser phase noise and fiber nonlinearity across several subcarriers. In a long single-span link with Raman amplification, the scheme achieves 0.9 dB gain with 99 real multiplications per complex symbol.

eess.SP↗