Search arXivSearch

arXiv subjects

Qian Gong

Publications and source records attributed to Qian Gong.

3 recordsLinked to original sources

Improving Progressive Compression with Adaptive Interpolation and Coefficient Decomposition

Exascale simulations generate data far faster than it can be stored or analyzed, making efficient data reduction essential. Error-controlled lossy compression offers high compression ratios under user-specified error bounds, but the target tolerance must be fixed at compression time. Progressive compression relaxes this restriction, yet existing methods still rely on fixed refactoring strategies and do not fully exploit correlations among decomposed coefficients, limiting the efficiency of progressive retrieval. In this work, we present an adaptive progressive compression framework that improves retrieval efficiency for two common targets, namely error-bound and peak Signal-to-Noise ratios. Our contributions are fourfold. (1) We propose to leverage two complementary interpolation schemes for adaptive progressive compression toward different targets, and we optimize them to achieve high efficiency. (2) We propose coefficient decomposition, a novel method that exploits the commonly overlooked spatial correlations among decorrelated data, which further improves the efficiency. (3) We develop the adaptive progressive compression workflow with automatic selection of the best-fit refactoring pipeline and tailored optimizations. (4) We evaluate the proposed framework on five real-world scientific datasets against three state-of-the-art progressive compressors. Experimental results demonstrate that the proposed framework improves the compression ratio by up to $42.3\%$ under the same requested error tolerance and up to $92.5\%$ at the same PSNR, compared with the best-performing existing methods. When transferring $512$ GB of scientific data to remote sites, the framework delivers up to $1.26\times$ speedup in the end-to-end data transfer performance. Furthermore, our method achieves the highest visualization quality while retrieving the least amount of data from storage.

cs.DC

BlockMGARD: Accelerating Adaptive Scientific Data Reduction with Region-of-Interest Error Control on GPUs

The growing scale of scientific data makes lossy compression essential for reducing data volume under controllable error. Transformation-based compressors using multilevel decomposition, such as MGARD, achieve strong compression ratios but map poorly to GPU architectures. We propose BlockMGARD, an adaptive, Region-of-Interest (ROI)-supported GPU lossy compressor, with four contributions: (1) an In-cache Block decomposition leveraging GPU on-chip memory and constant lookup tables to accelerate decomposition; (2) a hybrid hierarchy combining In-cache Block and global decomposition to balance speed and compression ratio; (3) an end-to-end pipeline with fine-grained ROI error control for feature preservation; and (4) an evaluation against state-of-the-art methods on five real-world datasets. Compared to MGARD-X, BlockMGARD achieves up to 4.2x and 9.1x higher compression and decompression throughput, and up to 8.63x higher compression ratio than uniform-tolerance baselines under ROI-aware error control. Across four GPUs, BlockMGARD achieves near-ideal linear scaling and up to 1.58x I/O cost reduction over MGARD-X.

cs.DC

QoI-Aware Provisional Rollout and Retrospective Reconciliation for Reduced-State Scientific Twins

Scientific twins may need to continue operating when updates from an authoritative primary system are temporarily unavailable. Once synchronization resumes, the new boundary can also be used to revise the intervening history. We distinguish an immediately available causal provisional trajectory from a delayed, future-conditioned reconciled trajectory. For reduced-state twins, we introduce a deterministic, calibration-based reconciliation method. A smooth temporal bridge carries the residual observed at the next synchronization block backward through the provisional interval. An analytic energy-matching stage then applies smooth regional gains and a global rescaling to match a component-energy trajectory estimated by cubic regression in log-energy space from synchronized frames on both sides of the gap. The method uses no additional correction network and revises decoded history without changing the latent state used for later rollouts. We evaluate 64 spatial patches from 16 JHTDB isotropic-turbulence slices for both velocity components and gaps S in {4, 6, 8}. During the longest gap, field error and gradient-sensitive QoI error degrade at markedly different rates, so field error alone does not characterize provisional fidelity. At S = 8, full reconciliation reduces window-averaged NRMSE by about 60% for both components and global gradient-intensity error from 4.21% to 2.91% for vx, whereas future-aware physical interpolation reaches 20.40% on the same metric. Energy matching additionally makes the reconciled history match its boundary-inferred global energy trajectory exactly. Future boundary information therefore substantially improves scientifically relevant properties within the evaluated regime.

cs.CE