Search arXivSearch

arXiv · 2003.04832

Reinforcement Learning for Mitigating Intermittent Interference in Terahertz Communication Networks

Abstract

Emerging wireless services with extremely high data rate requirements, such as real-time extended reality applications, mandate novel solutions to further increase the capacity of future wireless networks. In this regard, leveraging large available bandwidth at terahertz frequency bands is seen as a key enabler. To overcome the large propagation loss at these very high frequencies, it is inevitable to manage transmissions over highly directional links. However, uncoordinated directional transmissions by a large number of users can cause substantial interference in terahertz networks. While such interference will be received over short random time intervals, the received power can be large. In this work, a new framework based on reinforcement learning is proposed that uses an adaptive multi-thresholding strategy to efficiently detect and mitigate the intermittent interference from directional links in the time domain. To find the optimal thresholds, the problem is formulated as a multidimensional multi-armed bandit system. Then, an algorithm is proposed that allows the receiver to learn the optimal thresholds with very low complexity. Another key advantage of the proposed approach is that it does not rely on any prior knowledge about the interference statistics, and hence, it is suitable for interference mitigation in dynamic scenarios. Simulation results confirm the superior bit-error-rate performance of the proposed method compared with two traditional time-domain interference mitigation approaches.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Reza Barazideh, Omid Semiari, Solmaz Niknam, Balasubramaniam Natarajan. 2020-03-10. Reinforcement Learning for Mitigating Intermittent Interference in Terahertz Communication Networks. https://arxiv.org/abs/2003.04832

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Adaptive Polynomial Chaos Expansion for Uncertainty Quantification of Radio Wave Propagation over Irregular Terrains

Accurate modeling of radio wave propagation over irregular terrains is crucial for designing reliable wireless communication systems in such environments, yet uncertainties in the antenna configuration are not quantified within deterministic models. This paper develops a fixed number of samples adaptive polynomial chaos expansion (APCE) method for uncertainty quantification (UQ) of radio wave propagation over realistic irregular terrains, where the model evaluations are obtained using a two-way parabolic wave equation (PWE) method. The proposed APCE method is designed to construct a compact and stable PCE model from a prescribed and limited set of simulations. The polynomial basis is enriched using an anisotropic basis extension algorithm driven by variance contributions, while validation behavior and the available sample size are used to control basis growth. The convergence analysis shows decreasing validation errors and improved robustness as the sampling budget increases, with lower trial-to-trial variability than the baseline adaptive PCE method, which uses the same variance-driven basis extension strategy. For two realistic terrain profiles, the proposed method accurately predicts the mean and the 5-95 percentile range of the path loss, and improves the estimation of the standard deviation compared with standard and sparse PCE, using only 30 PWE simulations. APCE outperforms standard and sparse PCE, with the largest gains observed for the 5th and 95th percentile estimates, and its construction time is close to that of standard PCE and much lower than that of sparse PCE based on least angle regression. As the sample size increases, APCE maintains low errors with reduced trial-to-trial variability.

eess.SP

Overlap-Summation-Based Pulse Shaping Transceiver for Affine Frequency Division Multiplexing

Affine frequency division multiplexing (AFDM) has recently emerged as a promising waveform for doubly-selective channels. A direct-windowing-based pulse shaping transceiver (PS-AFDM) was proposed to suppress the Doppler sidelobes, thus improving the accuracy of channel estimation. We observe that, when the path delays and Doppler shifts are randomly distributed, the legacy PS-AFDM scheme significantly increases the condition number of the effective channel matrix. The resulting ill-conditioning degrades the numerical stability of channel equalization in noise and consequently increases the BER. To address this issue, this letter applies the existing weighted overlap-summation (WOLA) transceiver to AFDM and proposes a novel channel-aware (CA) receive shaping window design, which simultaneously achieves accurate channel estimation and robust equalization performance, at the cost of additional prefix overhead and receive-window calculation. The resulting scheme is termed CAWOLA-AFDM. Compared with the legacy WOLA scheme, which employs a fixed receive window, the proposed CAWOLA design exploits the channel estimates of slowly varying power gains and Doppler shifts to design a channel-tailored receive shaping window in closed form, thereby further enhancing channel-estimation accuracy while maintaining the channel condition number when a Nyquist prototype window is adopted. The proposed CAWOLA receive-window design aims to produce an effective AFDM channel with more compact support in the DAFT domain. The source code for the simulations is provided at https://github.com/SANIS-HITSZ/Waveform_AFDM.

eess.SP

Parametric Channel Estimation with Hardware Impaired Hybrid Beamformers: Sensing, Communications, and Power Efficiency Tradeoffs

Due to high power consumption and hardware costs of fully digital arrays, hybrid beamformers are often considered as a more economic alternative. Furthermore, using high resolution analog to digital converters (ADCs) can also have prohibitive power consumption, which leads to lower resolution converters being considered for radio frequency (RF) front end design. The finite quantization resolution as well as the nonlinearities caused by the power amplifiers (PAs) and low noise amplifiers (LNAs) can have a substantial impact on system performance. While widely studied for communications, the impact of hardware impairments on sensing performance is considerably less explored. In this work, we study the interplay between hybrid beamforming architectures, hardware impairments, and sensing and communications performance. Additionally, we define the concept of double-isotropy for pilot-combiner pairs, formalizing the notion of a perfectly energy-fair beam sweep. The multiple start (MS) space alternating generalized expectation maximization algorithm (SAGE) is also introduced, aimed at addressing the optimization issues arising from parametric channel estimation (PCE) in hybrid beamformed systems. We then provide a set of numerical results assessing the impacts of beamformer architecture and ADC resolution on PCE, sensing, and communications performance. The results show that medium resolution ADCs lead to the most power efficient configurations, with the best tradeoff between power consumption and performance for the majority of beamforming architectures. Additionally, fully digital beamforming architectures with high resolution converters can often be substituted for a hybrid beamformer setup with medium resolution converters without significant performance loss at a lower power consumption and overall hardware cost.

eess.SP