arXiv subjects

Hui Li

Publications and source records attributed to Hui Li.

At least 415 records · Page 23Linked to original sources

arXiv2024

FusionBooster: A Unified Image Fusion Boosting Paradigm

In recent years, numerous ideas have emerged for designing a mutually reinforcing mechanism or extra stages for the image fusion task, ignoring the inevitable gaps between different vision tasks and the computational burden. We argue that there is a scope to improve the fusion performance with the help of the FusionBooster, a model specifically designed for the fusion task. In particular, our booster is based on the divide-and-conquer strategy controlled by an information probe. The booster is composed of three building blocks: the probe units, the booster layer, and the assembling module. Given the result produced by a backbone method, the probe units assess the fused image and divide the results according to their information content. This is instrumental in identifying missing information, as a step to its recovery. The recovery of the degraded components along with the fusion guidance are the role of the booster layer. Lastly, the assembling module is responsible for piecing these advanced components together to deliver the output. We use concise reconstruction loss functions in conjunction with lightweight autoencoder models to formulate the learning task, with marginal computational complexity increase. The experimental results obtained in various fusion tasks, as well as downstream detection tasks, consistently demonstrate that the proposed FusionBooster significantly improves the performance. Our code will be publicly available at https://github.com/AWCXV/FusionBooster.

cs.CV↗

arXiv2024

TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusion

Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content makes it difficult to design a robust and controllable fusion process. We argue that this issue can be alleviated with the help of higher-level semantics, conveyed by the text modality, which should enable us to generate fused images for different purposes, such as visualisation and downstream tasks, in a controllable way. This is achieved by exploiting a vision-and-language model to build a coarse-to-fine association mechanism between the text and image signals. With the guidance of the association maps, an affine fusion unit is embedded in the transformer network to fuse the text and vision modalities at the feature level. As another ingredient of this work, we propose the use of textual attention to adapt image quality assessment to the fusion task. To facilitate the implementation of the proposed text-guided fusion paradigm, and its adoption by the wider research community, we release a text-annotated image fusion dataset IVT. Extensive experiments demonstrate that our approach (TextFusion) consistently outperforms traditional appearance-based fusion methods. Our code and dataset will be publicly available at https://github.com/AWCXV/TextFusion.

cs.CV↗

arXiv2024

An invariance constrained deep learning network for PDE discovery

The discovery of partial differential equations (PDEs) from datasets has attracted increased attention. However, the discovery of governing equations from sparse data with high noise is still very challenging due to the difficulty of derivatives computation and the disturbance of noise. Moreover, the selection principles for the candidate library to meet physical laws need to be further studied. The invariance is one of the fundamental laws for governing equations. In this study, we propose an invariance constrained deep learning network (ICNet) for the discovery of PDEs. Considering that temporal and spatial translation invariance (Galilean invariance) is a fundamental property of physical laws, we filter the candidates that cannot meet the requirement of the Galilean transformations. Subsequently, we embedded the fixed and possible terms into the loss function of neural network, significantly countering the effect of sparse data with high noise. Then, by filtering out redundant terms without fixing learnable parameters during the training process, the governing equations discovered by the ICNet method can effectively approximate the real governing equations. We select the 2D Burgers equation, the equation of 2D channel flow over an obstacle, and the equation of 3D intracranial aneurysm as examples to verify the superiority of the ICNet for fluid mechanics. Furthermore, we extend similar invariance methods to the discovery of wave equation (Lorentz Invariance) and verify it through Single and Coupled Klein-Gordon equation. The results show that the ICNet method with physical constraints exhibits excellent performance in governing equations discovery from sparse and noisy data.

cs.LG↗

arXiv2024

Multi-species Ion Acceleration in 3D Magnetic Reconnection with Hybrid-kinetic Simulations

Magnetic reconnection drives multi-species particle acceleration broadly in space and astrophysics. We perform the first 3D hybrid simulations (fluid electrons, kinetic ions) that contain sufficient scale separation to produce nonthermal heavy-ion acceleration, with fragmented flux ropes critical for accelerating all species. We demonstrate the acceleration of all ion species (up to Fe) into power-law spectra with similar indices, by a common Fermi acceleration mechanism. The upstream ion velocities influence the first Fermi reflection for injection. The subsequent onsets of Fermi acceleration are delayed for ions with lower charge-mass ratios (Q/M), until growing flux ropes magnetize them. This leads to a species-dependent maximum energy/nucleon $\propto(Q/M)^α$. These findings are consistent with in-situ observations in reconnection regions, suggesting Fermi acceleration as the dominant multi-species ion acceleration mechanism.

astro-ph.SR↗

arXiv2024

A Statistical Study of Solar White-Light Flares Observed by the White-light Solar Telescope of the Lyman-alpha Solar Telescope on the Advanced Space-based Solar Observatory (ASO-S/LST/WST) at 360 nm

Solar white-light flares (WLFs) are those accompanied by brightenings in the optical continuum or integrated light. The White-light Solar Telescope (WST), as an instrument of the Lyman-alpha Solar Telescope (LST) on the Advanced Space-based Solar Observatory (ASO-S), provides continuous solar full-disk images at 360 nm, which can be used to study WLFs. We analyze 205 major flares above M1.0 from October 2022 to May 2023 and identify 49 WLFs at 360 nm from WST observations, i.e. with an occurrence rate of 23.9%. The percentages of WLFs for M1 - M4 (31 out of 180), M5 - M9 (11 out of 18), and above X1 (7 for all) flares are 17.2%, 61.1%, and 100%, respectively, namely the larger the flares, the more likely they are WLFs at 360 nm. We further analyze 39 WLFs among the identified WLFs and investigate their properties such as white-light enhancement, duration, and brightening area. It is found that the relative enhancement of the white-light emission at 360 nm is mostly (>90%) less than 30% and the mean enhancement is 19.4%. The WLFs' duration at 360 nm is mostly (>80%) less than 20 minutes and its mean is 10.3 minutes. The brightening area at 360 nm is mostly (>75%) less than 500 arcsecond2 and the median value is 225. We find that there exist good correlations between the white-light enhancement/duration/area and the peak soft X-ray (SXR) flux of the flare, with correlation coefficients of 0.68, 0.58, and 0.80, respectively. In addition, the white-light emission in most WLFs peaks around the same time as the temporal derivative of SXR flux as well as the hard X-ray emission at 20 - 50 keV, indicative of Neupert effect. It is also found that the limb WLFs are more likely to have a greater enhancement, which is consistent with numerical simulations.

astro-ph.SR↗

arXiv2024

Precision test of the weak interaction with slow muons

We propose to use slow muons facilities combined with cyclotron radiation detection for precision test of the weak interaction in the muon decays. Slow positive muon bunches are first injected into a cylindrical superconducting vacuum chamber with uniform strong axial magnetic fields to radially confine the muons. The positrons resulting from muon decays can be detected by their cyclotron radiation, which can be transported to low-noise electronic devices through waveguides coupled to the chamber. The decay positron's energy can be precisely measured down to eV level in the low energy region, which is sensitive to new physics effects such as Majorana neutrinos and new structures of weak interactions.

physics.ins-det↗

arXiv2023

BusReF: Infrared-Visible images registration and fusion focus on reconstructible area using one set of features

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more precise fusion results, as a way to improve the performance of downstream high-level vision tasks. In order to relax this assumption, one can attempt to register images first. However, the existing methods for registering multiple modalities have limitations, such as complex structures and reliance on significant semantic information. This paper aims to address the problem of image registration and fusion in a single framework, called BusRef. We focus on Infrared-Visible image registration and fusion task (IVRF). In this framework, the input unaligned image pairs will pass through three stages: Coarse registration, Fine registration and Fusion. It will be shown that the unified approach enables more robust IVRF. We also propose a novel training and evaluation strategy, involving the use of masks to reduce the influence of non-reconstructible regions on the loss functions, which greatly improves the accuracy and robustness of the fusion task. Last but not least, a gradient-aware fusion network is designed to preserve the complementary information. The advanced performance of this algorithm is demonstrated by

cs.CV↗

arXiv2023

Globular Clusters Contribute to the Nuclear Star Cluster and Galaxy Center Gamma-Ray Excess, Moderated by Galaxy Assembly History

Two unresolved questions at galaxy centers, namely the formation of the nuclear star cluster (NSC) and the origin of the gamma-ray excess in the Milky Way (MW) and Andromeda (M31), are both related to the formation and evolution of globular clusters (GCs). They migrate towards the galaxy center due to dynamical friction, and get tidally disrupted to release the stellar mass content including millisecond pulsars (MSPs), which contribute to the NSC and gamma-ray excess. In this study, we propose a semi-analytical model of GC formation and evolution that utilizes the Illustris cosmological simulation to accurately capture the formation epochs of GCs and simulate their subsequent evolution. Our analysis confirms that our GC properties at z=0 are consistent with observations, and our model naturally explains the formation of a massive NSC in a galaxy similar to the MW and M31. We also find a remarkable similarity in our model prediction with the gamma-ray excess signal in the MW. However, our predictions fall short by approximately an order of magnitude in M31, indicating distinct origins for the two gamma-ray excesses. Meanwhile, we utilize the catalog of Illustris halos to investigate the influence of galaxy assembly history. We find that the earlier a galaxy is assembled, the heavier and spatially more concentrated its GC system behaves at z=0. This results in a larger NSC mass and brighter gamma-ray emission from deposited MSPs

astro-ph.GA↗

arXiv2023

Parameter Estimation of LAMOST Medium-resolution Stellar Spectra

This paper investigates the problem of estimating three stellar atmospheric physical parameters and thirteen elemental abundances for medium-resolution spectra from Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST). Typical characteristics of these spectra are their huge scale, wide range of spectral signal-to-noise ratios, and uneven distribution in parameter space.These characteristics lead to unsatisfactory results on the spectra with low temperature, high temperature or low metallicity.To this end, this paper proposes a Stellar Parameter Estimation method based on Multiple Regions (SPEMR) that effectively improves parameter estimation accuracy. On the spectra with {S/N $\geq 10$}, the precisions are 47 K, 0.08 dex, 0.03 dex respectively for the estimations of ($T_{\rm eff}$, $\log \,g$ and $\rm [Fe/H]$), 0.03 dex to 0.06 dex for elements C, Mg, Al, Si, Ca, Mn and Ni, 0.07 dex to 0.13 dex for N, O, S, K and Ti, while that of Cr is 0.16 dex.For the reference of astronomical science researchers and algorithm researchers, we released a catalog for 4.19 million medium-resolution spectra from the LAMOST DR8, experimental code, trained model, training data, and test data.

astro-ph.SR↗

arXiv2023

Runaway Eccentricity Growth: A Pathway for Binary Black Hole Mergers in AGN Disks

Binary black holes embedded within the accretion disks that fuel active galactic nuclei (AGN) are promising progenitors for the source of gravitational wave events detected by LIGO/VIRGO. Several recent studies have shown that when these binaries form they should be highly eccentric and retrograde. However, many uncertainties remain concerning the orbital evolution of these binaries as they either inspiral towards merger or disassociate. Previous hydrodynamical simulations exploring their orbital evolution have been predominantly two-dimensional, or have been restricted to binaries on nearly circular orbits. We present the first high-resolution, three-dimensional local shearing-box simulations of both prograde and retrograde eccentric binary black holes embedded in AGN disks. We find that retrograde binaries shrink several times faster than their prograde counterparts and exhibit significant orbital eccentricity growth, the rate of which monotonically increases with binary eccentricity. Our results suggest that retrograde binaries may experience runaway orbital eccentricity growth, which may bring them close enough together at pericenter for gravitational wave emission to drive them to coalescence. Although their eccentricity is damped, prograde binaries shrink much faster than their orbital eccentricity decays, suggesting they should remain modestly eccentric as they contract towards merger. Finally, binary precession driven by the AGN disk may dominate over precession induced by the supermassive black hole depending on the binary accretion rate and its location in the AGN disk, which can subdue the evection resonance and von Ziepel-Lidov-Kozai cycles.

astro-ph.HE↗

arXiv2023

Multi-dimensional Fair Federated Learning

Federated learning (FL) has emerged as a promising collaborative and secure paradigm for training a model from decentralized data without compromising privacy. Group fairness and client fairness are two dimensions of fairness that are important for FL. Standard FL can result in disproportionate disadvantages for certain clients, and it still faces the challenge of treating different groups equitably in a population. The problem of privately training fair FL models without compromising the generalization capability of disadvantaged clients remains open. In this paper, we propose a method, called mFairFL, to address this problem and achieve group fairness and client fairness simultaneously. mFairFL leverages differential multipliers to construct an optimization objective for empirical risk minimization with fairness constraints. Before aggregating locally trained models, it first detects conflicts among their gradients, and then iteratively curates the direction and magnitude of gradients to mitigate these conflicts. Theoretical analysis proves mFairFL facilitates the fairness in model development. The experimental evaluations based on three benchmark datasets show significant advantages of mFairFL compared to seven state-of-the-art baselines.

cs.LG↗

arXiv2023

Linker-Tuning: Optimizing Continuous Prompts for Heterodimeric Protein Prediction

Predicting the structure of interacting chains is crucial for understanding biological systems and developing new drugs. Large-scale pre-trained Protein Language Models (PLMs), such as ESM2, have shown impressive abilities in extracting biologically meaningful representations for protein structure prediction. In this paper, we show that ESMFold, which has been successful in computing accurate atomic structures for single-chain proteins, can be adapted to predict the heterodimer structures in a lightweight manner. We propose Linker-tuning, which learns a continuous prompt to connect the two chains in a dimer before running it as a single sequence in ESMFold. Experiment results show that our method successfully predicts 56.98% of interfaces on the i.i.d. heterodimer test set, with an absolute improvement of +12.79% over the ESMFold-Linker baseline. Furthermore, our model can generalize well to the out-of-distribution (OOD) test set HeteroTest2 and two antibody test sets Fab and Fv while being $9\times$ faster than AF-Multimer.

q-bio.BM↗

arXiv2023

Velocity Space Signatures of Resonant Energy Transfer between Whistler Waves and Electrons in the Earth's Magnetosheath

Wave--particle interactions play a crucial role in transferring energy between electromagnetic fields and charged particles in space and astrophysical plasmas. Despite the prevalence of different electromagnetic waves in space, there is still a lack of understanding of fundamental aspects of wave--particle interactions, particularly in terms of energy flow and velocity-space characteristics. In this study, we combine a novel quasilinear model with observations from the Magnetospheric Multiscale (MMS) mission to reveal the signatures of resonant interactions between electrons and whistler waves in magnetic holes, which are coherent structures often found in the Earth's magnetosheath. We investigate the energy transfer rates and velocity-space characteristics associated with Landau and cyclotron resonances between electrons and slightly oblique propagating whistler waves. In the case of our observed magnetic hole, the loss of electron kinetic energy primarily contributes to the growth of whistler waves through the $n=-1$ cyclotron resonance, where $n$ is the order of the resonance expansion in linear Vlasov--Maxwell theory. The excitation of whistler waves leads to a reduction of the temperature anisotropy and parallel heating of the electrons. Our study offers a new and self-consistent understanding of resonant energy transfer in turbulent plasmas.

physics.plasm-ph↗

arXiv2023

Riemannian Self-Attention Mechanism for SPD Networks

Symmetric positive definite (SPD) matrix has been demonstrated to be an effective feature descriptor in many scientific areas, as it can encode spatiotemporal statistics of the data adequately on a curved Riemannian manifold, i.e., SPD manifold. Although there are many different ways to design network architectures for SPD matrix nonlinear learning, very few solutions explicitly mine the geometrical dependencies of features at different layers. Motivated by the great success of self-attention mechanism in capturing long-range relationships, an SPD manifold self-attention mechanism (SMSA) is proposed in this paper using some manifold-valued geometric operations, mainly the Riemannian metric, Riemannian mean, and Riemannian optimization. Then, an SMSA-based geometric learning module (SMSA-GLM) is designed for the sake of improving the discrimination of the generated deep structured representations. Extensive experimental results achieved on three benchmarking datasets show that our modification against the baseline network further alleviates the information degradation problem and leads to improved accuracy.

cs.CV↗

arXiv2023

Low- and High-velocity \ion{O}{6} in Milky Way-like Galaxies: the Role of Stellar Feedback

Milky Way-type galaxies are surrounded by a warm-hot gaseous halo containing a considerable amount of baryons and metals. The kinematics and spatial distribution of highly-ionized ion species such as \ion{O}{6} can be significantly affected by supernova (SN) explosions and early (pre-SN) stellar feedback (e.g., stellar winds, radiation pressure). Here, we investigate effects of stellar feedback on \ion{O}{6} absorptions in Milky Way-like galaxies by analyzing the suites of high-resolution hydrodynamical simulations under the framework of {\it SMUGGLE}, a physically motivated subgrid interstellar medium and stellar feedback model for the moving-mesh code {\sc Arepo}. We find that the fiducial run with the full suite of stellar feedback and moderate star formation activities can reasonably reproduce Galactic \ion{O}{6} absorptions observed by space telescopes such as {\it FUSE}, including the scale height of low-velocity ($|v_{\rm LSR}|< 100\, \rm km~s^{-1}$) \ion{O}{6}, the column density $-$ line width relation for high-velocity ($100 \leq |v_{\rm LSR}|< 400\, \rm km~s^{-1}$) \ion{O}{6}, and the cumulative \ion{O}{6} column densities. In contrast, model variations with more intense star formation activities deviate from observations further. Additionally, we find that the run considering only SN feedback is in broad agreement with the observations, whereas in runs without SN feedback this agreement is absent, which indicates a dominant role of SN feedback in heating and accelerating interstellar \ion{O}{6}. This is consistent with the current picture that interstellar \ion{O}{6} is predominantly produced by collisional ionization where mechanical feedback can play a central role. In contrast, photoionization is negligible for \ion{O}{6} production due to the lack of high-energy ($\gtrsim114\ {\rm eV}$) photons required.

astro-ph.GA↗

arXiv2023

FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugin

Given the capability of mitigating the long-tail deficiencies and intricate-shaped absence prevalent in 3D object detection, occupancy prediction has become a pivotal component in autonomous driving systems. However, the procession of three-dimensional voxel-level representations inevitably introduces large overhead in both memory and computation, obstructing the deployment of to-date occupancy prediction approaches. In contrast to the trend of making the model larger and more complicated, we argue that a desirable framework should be deployment-friendly to diverse chips while maintaining high precision. To this end, we propose a plug-and-play paradigm, namely FlashOCC, to consolidate rapid and memory-efficient occupancy prediction while maintaining high precision. Particularly, our FlashOCC makes two improvements based on the contemporary voxel-level occupancy prediction approaches. Firstly, the features are kept in the BEV, enabling the employment of efficient 2D convolutional layers for feature extraction. Secondly, a channel-to-height transformation is introduced to lift the output logits from the BEV into the 3D space. We apply the FlashOCC to diverse occupancy prediction baselines on the challenging Occ3D-nuScenes benchmarks and conduct extensive experiments to validate the effectiveness. The results substantiate the superiority of our plug-and-play paradigm over previous state-of-the-art methods in terms of precision, runtime efficiency, and memory costs, demonstrating its potential for deployment. The code will be made available.

cs.CV↗

arXiv2023

DP-starJ: A Differential Private Scheme towards Analytical Star-Join Queries

Star-join query is the fundamental task in data warehouse and has wide applications in On-line Analytical Processing (OLAP) scenarios. Due to the large number of foreign key constraints and the asymmetric effect in the neighboring instance between the fact and dimension tables, even those latest DP efforts specifically designed for join, if directly applied to star-join query, will suffer from extremely large estimation errors and expensive computational cost. In this paper, we are thus motivated to propose DP-starJ, a novel Differentially Private framework for star-Join queries. DP-starJ consists of a series of strategies tailored to specific features of star-join, including 1) we unveil the different effect of fact and dimension tables on the neighboring database instances, and accordingly revisit the definitions tailored to different cases of star-join; 2) we propose Predicate Mechanism (PM), which utilizes predicate perturbation to inject noise into the join procedure instead of the results; 3) to further boost the robust performance, we propose a DP-compliant star-join algorithm for various types of star-join tasks based on PM. We provide both theoretical analysis and empirical study, which demonstrate the superiority of the proposed methods over the state-of-the-art solutions in terms of accuracy, efficiency, and scalability.

cs.CR↗

arXiv2023

Bar-driven Gas Dynamics of M31

The large-scale gaseous shocks in the bulge of M31 can be naturally explained by a rotating stellar bar. We use gas dynamical models to provide an independent measurement of the bar pattern speed in M31. The gravitational potentials of our simulations are from a set of made-to-measure models constrained by stellar photometry and kinematics. If the inclination of the gas disk is fixed at $i = 77^{\circ}$, we find that a low pattern speed of $16-20\;\rm km\;s^{-1}\;kpc^{-1}$ is needed to match the observed position and amplitude of the shock features, as shock positions are too close to the bar major axis in high $Ω_{b}$ models. The pattern speed can increase to $20-30\;\rm km\;s^{-1}\;kpc^{-1}$ if the inner gas disk has a slightly smaller inclination angle compared with the outer one. Including sub-grid physics such as star formation and stellar feedback has minor effects on the shock amplitude, and does not change the shock position significantly. If the inner gas disk is allowed to follow a varying inclination similar to the HI and ionized gas observations, the gas models with a pattern speed of $38\;\rm km\;s^{-1}\;kpc^{-1}$, which is consistent with stellar-dynamical models, can match both the shock features and the central gas features.

astro-ph.GA↗