Search arXivSearch

arXiv · 2302.03606

Merging satellite and gauge-measured precipitation using LightGBM with an emphasis on extreme quantiles

Abstract

Knowing the actual precipitation in space and time is critical in hydrological modelling applications, yet the spatial coverage with rain gauge stations is limited due to economic constraints. Gridded satellite precipitation datasets offer an alternative option for estimating the actual precipitation by covering uniformly large areas, albeit related estimates are not accurate. To improve precipitation estimates, machine learning is applied to merge rain gauge-based measurements and gridded satellite precipitation products. In this context, observed precipitation plays the role of the dependent variable, while satellite data play the role of predictor variables. Random forests is the dominant machine learning algorithm in relevant applications. In those spatial predictions settings, point predictions (mostly the mean or the median of the conditional distribution) of the dependent variable are issued. The aim of the manuscript is to solve the problem of probabilistic prediction of precipitation with an emphasis on extreme quantiles in spatial interpolation settings. Here we propose, issuing probabilistic spatial predictions of precipitation using Light Gradient Boosting Machine (LightGBM). LightGBM is a boosting algorithm, highlighted by prize-winning entries in prediction and forecasting competitions. To assess LightGBM, we contribute a large-scale application that includes merging daily precipitation measurements in contiguous US with PERSIANN and GPM-IMERG satellite precipitation data. We focus on extreme quantiles of the probability distribution of the dependent variable, where LightGBM outperforms quantile regression forests (QRF, a variant of random forests) in terms of quantile score at extreme quantiles. Our study offers understanding of probabilistic predictions in spatial settings using machine learning.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Hristos Tyralis, Georgia Papacharalampous, Nikolaos Doulamis, Anastasios Doulamis. 2023-08-03. Merging satellite and gauge-measured precipitation using LightGBM with an emphasis on extreme quantiles. https://doi.org/10.1109/jstars.2023.3297013

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Multi-Carrier Rydberg Atomic Quantum Receivers with Enhanced Bandwidth Feature for Communication and Sensing

Rydberg atomic quantum receivers (RAQRs) have attracted significant attention in recent years due to their ultra-high sensitivity. Although capable of precisely detecting the amplitude and phase of weak signals, conventional RAQRs face inherent limitations in accurately receiving wideband RF signals, due to the discrete nature of atomic energy levels and their intrinsic instantaneous bandwidth constraints. These limitations hinder their direct application to multi-carrier communication and sensing. To address this issue, this paper proposes a multi-carrier Rydberg atomic quantum receiver (MC-RAQR) structure with five energy levels. We derive the amplitude and phase of the MC-RAQR and extract the baseband electrical signal for signal processing. In terms of multi-carrier communication and sensing, we analyze the channel capacity and accuracy of angle of arrival (AoA) and distance parameters, respectively. Numerical results validate our proposed model, showing that the MC-RAQR can achieve up to a bandwidth of 11.7 MHz, which is 17-fold larger than the conventional RAQRs. As a result, the channel capacity and the resolution for multi-target sensing are improved significantly. Specifically, the channel capacity of MC-RAQR is 110-fold and 2.8-fold larger than the classical RF receivers and RAQRs, respectively. For sensing performance, the RMSE of AoA estimation for MC-RAQR exhibits 7.6-fold reduction, compared with the conventional RAQRs. Furthermore, the RMSE of distance estimation is $634$-fold smaller than that of the root-CRB of classical RF receivers, showing the superior performance of the MC-RAQR. This demonstrates its compatibility with waveforms such as orthogonal frequency-division multiplexing (OFDM) and its significant advantages for multi-carrier signal reception.

eess.SP

Channel Estimation in MIMO Systems Aided by Microwave Linear Analog Computers (MiLACs)

Microwave linear analog computers (MiLACs) have recently emerged as a promising solution for future gigantic multiple-input multiple-output (MIMO) systems, enabling beamforming with greatly reduced hardware and computational cost. However, channel estimation for MiLAC-aided systems remains an open problem. Conventional least squares (LS) and minimum mean square error (MMSE) estimation rely on intensive digital computation, which undermines the computational advantage offered by MiLACs. In this letter, we propose efficient LS and MMSE channel estimation schemes for MiLAC-aided MIMO systems. By designing the training precoder and combiner implemented by lossless and reciprocal MiLACs, the proposed schemes perform LS and MMSE estimation in the analog domain, leaving only simple digital scaling. They achieve identical estimation performance to their digital counterparts while significantly reducing computational complexity. Numerical results verify the effectiveness of the proposed schemes.

eess.SP

Joint Subcarrier Phase Recovery for Nonlinearity Mitigation

We propose a low-complexity phase recovery scheme that simultaneously mitigates laser phase noise and fiber nonlinearity across several subcarriers. In a long single-span link with Raman amplification, the scheme achieves 0.9 dB gain with 99 real multiplications per complex symbol.

eess.SP