arXiv subjects

Hao Zhang

Publications and source records attributed to Hao Zhang.

At least 811 records · Page 45Linked to original sources

arXiv2023

Neural Packing: from Visual Sensing to Reinforcement Learning

We present a novel learning framework to solve the transport-and-packing (TAP) problem in 3D. It constitutes a full solution pipeline from partial observations of input objects via RGBD sensing and recognition to final box placement, via robotic motion planning, to arrive at a compact packing in a target container. The technical core of our method is a neural network for TAP, trained via reinforcement learning (RL), to solve the NP-hard combinatorial optimization problem. Our network simultaneously selects an object to pack and determines the final packing location, based on a judicious encoding of the continuously evolving states of partially observed source objects and available spaces in the target container, using separate encoders both enabled with attention mechanisms. The encoded feature vectors are employed to compute the matching scores and feasibility masks of different pairings of box selection and available space configuration for packing strategy optimization. Extensive experiments, including ablation studies and physical packing execution by a real robot (Universal Robot UR5e), are conducted to evaluate our method in terms of its design choices, scalability, generalizability, and comparisons to baselines, including the most recent RL-based TAP solution. We also contribute the first benchmark for TAP which covers a variety of input settings and difficulty levels.

cs.LG↗

arXiv2023

Non-Hermitian Optical Parametric Systems with Anti-parity-time Symmetry

The continuous advancements in ultrafast lasers, characterized by high pulse energy, great average power, and ultrashort pulse duration, have opened up new frontiers and applications in various fields such as high-energy-density science. In this study, we investigated the implementation of non-Hermitian nonlinear parametric amplification by introducing anti-parity-time (anti-PT) symmetry to three-wave interaction processes. By exploring the parameter space defined by the coupling coefficient, phase mismatch, and absorption, we categorized the behavior of the non-Hermitian optical parametric system into four distinct quadrants, representing unbroken/broken anti-PT symmetry and amplification/attenuation, and amplification-attenuation boundaries and exceptional lines can be observed in such parametric space. Through simulations of the dynamical behavior of the interacting waves, we demonstrated the rich evolutions of the signal and idler waves in systems belonging to the respective quadrants and near exceptional points, revealed by the unique performance of eigenmodes. Our findings provide insights into the evaluation of energy flow direction in optical parametric amplification engineering by the directly linked parameter space, which contribute to a deeper understanding of photonics and laser science, potentially leading to new applications in these fields.

physics.optics↗

arXiv2023

Explaining How a Neural Network Play the Go Game and Let People Learn

The AI model has surpassed human players in the game of Go, and it is widely believed that the AI model has encoded new knowledge about the Go game beyond human players. In this way, explaining the knowledge encoded by the AI model and using it to teach human players represent a promising-yet-challenging issue in explainable AI. To this end, mathematical supports are required to ensure that human players can learn accurate and verifiable knowledge, rather than specious intuitive analysis. Thus, in this paper, we extract interaction primitives between stones encoded by the value network for the Go game, so as to enable people to learn from the value network. Experiments show the effectiveness of our method.

cs.AI↗

arXiv2023

Dynamic Prediction of Full-Ocean Depth SSP by Hierarchical LSTM: An Experimental Result

SSP distribution is an important parameter for underwater positioning, navigation and timing (PNT) because it affects the propagation mode of underwater acoustic signals. To accurate predict future sound speed distribution, we propose a hierarchical long short--term memory (H--LSTM) neural network for future sound speed prediction, which explore the distribution pattern of sound velocity in the time dimension. To verify the feasibility and effectiveness, we conducted both simulations and real experiments. The ocean experiment was held in the South China Sea in April, 2023. Results show that the accuracy of the proposed method outperforms the state--of--the--art methods.

cs.SD↗

arXiv2023

Non-linear magnons and exchange Hamiltonians of delafossite proximate quantum spin liquids

Quantum spin liquids (QSL) are theoretical states of matter with long-range entanglement and exotic quasiparticles. However, they generally elude quantitative theory, rendering their underlying phases mysterious and hampering efforts to identify experimental QSL states. Here we study triangular lattice resonating valence bond QSL candidate materials KYbSe$_2$ and NaYbSe$_2$. We measure the magnon modes in their 1/3 plateau phase, where quantitative theory is tractable, using inelastic neutron scattering and fit them using nonlinear spin wave theory. We also fit the KYbSe$_2$ heat capacity using high temperature series expansion. Both KYbSe$_2$ fits yield the same magnetic Hamiltonian to within uncertainty, confirming previous estimates and showing the Heisenberg $J_2/J_1$ to be an accurate model for these materials. Most importantly, comparing KYbSe$_2$ and NaYbSe$_2$ shows that smaller $A$-site Na$^+$ ion has a larger $J_2/J_1$ ratio. However, hydrostatic pressure applied to KYbSe$_2$ increases the ordering temperature (a result consistent with density functional theory calculations), indicating that pressure decreases $J_2/J_1$. These results show how periodic table and hydrostatic pressure can tune the $A$YbSe$_2$ materials in a controlled way.

cond-mat.str-el↗

arXiv2023

Fast Ray-Tracing-Based Precise Underwater Acoustic Localization without Prior Acknowledgment of Target Depth

Underwater localization is of great importance for marine observation and building positioning, navigation, timing (PNT) systems that could be widely applied in disaster warning, underwater rescues and resources exploration. The uneven distribution of underwater sound velocity poses great challenge for precise underwater positioning. The current soundline correction positioning method mainly aims at scenarios with known target depth. However, for nodes that are non-cooperative nodes or lack of depth information, soundline tracking strategies cannot work well due to nonunique positional solutions. To tackle this issue, we propose an iterative ray tracing 3D underwater localization (IRTUL) method for stratification compensation. To demonstrate the feasibility of fast stratification compensation, we first derive the signal path as a function of glancing angle, and then prove that the signal propagation time and horizontal propagation distance are monotonic functions of the initial grazing angle, so that fast ray tracing can be achieved. Then, we propose an sound velocity profile (SVP) simplification method, which reduces the computational cost of ray tracing. Experimental results show that the IRTUL has the most significant distance correction in the depth direction, and the average accuracy of IRTUL has been improved by about 3 meters compared to localization model with constant sound velocity. Also, the simplified SVP can significantly improve real-time performance with average accuracy loss less than 0.2 m when used for positioning.

eess.SP↗

arXiv2023

Underwater Sound Speed Profile Construction: A Review

Real--time and accurate construction of regional sound speed profiles (SSP) is important for building underwater positioning, navigation, and timing (PNT) systems as it greatly affect the signal propagation modes such as trajectory. In this paper, we summarizes and analyzes the current research status in the field of underwater SSP construction, and the mainstream methods include direct SSP measurement and SSP inversion. In the direct measurement method, we compare the performance of popular international commercial temperature, conductivity, and depth profilers (CTD). While for the inversion methods, the framework and basic principles of matched field processing (MFP), compressive sensing (CS), and deep learning (DL) for constructing SSP are introduced, and their advantages and disadvantages are compared. The traditional direct measurement method has good accuracy performance, but it usually takes a long time. The proposal of SSP inversion method greatly improves the convenience and real--time performance, but the accuracy is not as good as the direct measurement method. Currently, the SSP inversion relies on sonar observation data, making it difficult to apply to areas that couldn't be covered by underwater observation systems, and these methods are unable to predict the distribution of sound velocity at future times. How to comprehensively utilize multi-source data and provide elastic sound velocity distribution estimation services with different accuracy and real-time requirements for underwater users without sonar observation data is the mainstream trend in future research on SSP construction.

eess.SP↗

arXiv2023

Hybrid packet switching assisted by classical frame for entanglement-based quantum networks

One of the first problems of studying the quantum internet is how to realize quantum interconnection between users in a quantum network. To address above problem, by referencing the classical Internet, developing the packet switching of quantum networks is a promising way. In this paper, we propose a new hybrid packet switching for entanglement-based quantum networks assisted by classical frame. Different from the previous packet switching for quantum networks based on single photon, the frame used in our scheme is pure classical rather than the classical-quantum structure, and the transmission of classical and quantum signals over physical channels can be independent, which makes our scheme is also valid for quantum networks with heralded entanglement generation. Using our hybrid packet switching, the process of building entanglement channel between end nodes is analogous to the classical packet-switched networks, which provides an effective way to build large-scale packet-switched entanglement-based quantum internet. To verify the feasibility, we perform end-to-end entanglement distribution using our hybrid packet switching in a quantum network and simulate the fidelities of distributed state with respect to the number of hops.

quant-ph↗

arXiv2023

Tuning Large language model for End-to-end Speech Translation

With the emergence of large language models (LLMs), multimodal models based on LLMs have demonstrated significant potential. Models such as LLaSM, X-LLM, and SpeechGPT exhibit an impressive ability to comprehend and generate human instructions. However, their performance often falters when faced with complex tasks like end-to-end speech translation (E2E-ST), a cross-language and cross-modal translation task. In comparison to single-modal models, multimodal models lag behind in these scenarios. This paper introduces LST, a Large multimodal model designed to excel at the E2E-ST task. LST consists of a speech frontend, an adapter, and a LLM backend. The training of LST consists of two stages: (1) Modality adjustment, where the adapter is tuned to align speech representation with text embedding space, and (2) Downstream task fine-tuning, where both the adapter and LLM model are trained to optimize performance on the E2EST task. Experimental results on the MuST-C speech translation benchmark demonstrate that LST-13B achieves BLEU scores of 30.39/41.55/35.33 on En-De/En-Fr/En-Es language pairs, surpassing previous models and establishing a new state-of-the-art. Additionally, we conduct an in-depth analysis of single-modal model selection and the impact of training strategies, which lays the foundation for future research. We will open up our code and models after review.

cs.CL↗

arXiv2023

Generalized spectral characterization of signed trees

Let $T$ be a tree with an irreducible characteristic polynomial $ϕ(x)$ over $\mathbb{Q}$. Let $Δ(T)$ be the discriminant of $ϕ(x)$. It is proved that if $2^{-\frac n2}\sqrt{Δ(T)}$ (which is always an integer) is odd and square free, then every signed tree with underlying graph $T$ is determined by its generalized spectrum.

math.CO↗

arXiv2023

Advancing Acoustic Howling Suppression through Recursive Training of Neural Networks

In this paper, we introduce a novel training framework designed to comprehensively address the acoustic howling issue by examining its fundamental formation process. This framework integrates a neural network (NN) module into the closed-loop system during training with signals generated recursively on the fly to closely mimic the streaming process of acoustic howling suppression (AHS). The proposed recursive training strategy bridges the gap between training and real-world inference scenarios, marking a departure from previous NN-based methods that typically approach AHS as either noise suppression or acoustic echo cancellation. Within this framework, we explore two methodologies: one exclusively relying on NN and the other combining NN with the traditional Kalman filter. Additionally, we propose strategies, including howling detection and initialization using pre-trained offline models, to bolster trainability and expedite the training process. Experimental results validate that this framework offers a substantial improvement over previous methodologies for acoustic howling suppression.

eess.AS↗

arXiv2023

Neural Network Augmented Kalman Filter for Robust Acoustic Howling Suppression

Acoustic howling suppression (AHS) is a critical challenge in audio communication systems. In this paper, we propose a novel approach that leverages the power of neural networks (NN) to enhance the performance of traditional Kalman filter algorithms for AHS. Specifically, our method involves the integration of NN modules into the Kalman filter, enabling refining reference signal, a key factor in effective adaptive filtering, and estimating covariance metrics for the filter which are crucial for adaptability in dynamic conditions, thereby obtaining improved AHS performance. As a result, the proposed method achieves improved AHS performance compared to both standalone NN and Kalman filter methods. Experimental evaluations validate the effectiveness of our approach.

eess.AS↗

arXiv2023

Boundary-Aware Proposal Generation Method for Temporal Action Localization

The goal of Temporal Action Localization (TAL) is to find the categories and temporal boundaries of actions in an untrimmed video. Most TAL methods rely heavily on action recognition models that are sensitive to action labels rather than temporal boundaries. More importantly, few works consider the background frames that are similar to action frames in pixels but dissimilar in semantics, which also leads to inaccurate temporal boundaries. To address the challenge above, we propose a Boundary-Aware Proposal Generation (BAPG) method with contrastive learning. Specifically, we define the above background frames as hard negative samples. Contrastive learning with hard negative mining is introduced to improve the discrimination of BAPG. BAPG is independent of the existing TAL network architecture, so it can be applied plug-and-play to mainstream TAL models. Extensive experimental results on THUMOS14 and ActivityNet-1.3 demonstrate that BAPG can significantly improve the performance of TAL.

cs.CV↗

arXiv2023

Quality-Cost Trade-off on Constructing Logical Views for Vehicular Cyber-Physical Systems: A Deep Reinforcement Learning Approach

With the development of sensing technologies, vehicle-to-everything (V2X) communications, edge computing paradigm, vehicular cyber-physical systems (VCPS) are emerging as the most fundamental platform for realizing future intelligent transportation systems (ITSs). In particular, the construction of logical views at the edge nodes based on heterogeneous information sensing and uploading are critical to the realization of VCPS. However, a higher-quality view in terms of timeliness and accuracy may require higher cost on sensing and uploading. In view of this, this paper is dedicated to striking a balance between the quality and the cost for constructing logical views of VCPS. Specifically, we first derive an information sensing model based on multi-class M/G/1 priority queue and a data uploading model based on reliability-guaranteed vehicle-to-infrastructure (V2I) communications. On this basis, we design two metrics, namely, age of view (AoV) and cost of view (CoV), simultaneously. Then, we formulate a bi-objective problem to maximize the AoV and minimize the CoV. Further, we propose a distributed distributional deep deterministic policy gradient (D4PG) solution to determine sensing information, frequency, uploading priority, transmission power, and V2I bandwidth. Finally, we build a simulation model and give a comprehensive performance evaluation, and the simulation results conclusively demonstrate the superiority of the proposed solution.

cs.NI↗

arXiv2023

Source-free Active Domain Adaptation for Diabetic Retinopathy Grading Based on Ultra-wide-field Fundus Image

Domain adaptation (DA) has been widely applied in the diabetic retinopathy (DR) grading of unannotated ultra-wide-field (UWF) fundus images, which can transfer annotated knowledge from labeled color fundus images. However, suffering from huge domain gaps and complex real-world scenarios, the DR grading performance of most mainstream DA is far from that of clinical diagnosis. To tackle this, we propose a novel source-free active domain adaptation (SFADA) in this paper. Specifically, we focus on DR grading problem itself and propose to generate features of color fundus images with continuously evolving relationships of DRs, actively select a few valuable UWF fundus images for labeling with local representation matching, and adapt model on UWF fundus images with DR lesion prototypes. Notably, the SFADA also takes data privacy and computational efficiency into consideration. Extensive experimental results demonstrate that our proposed SFADA achieves state-of-the-art DR grading performance, increasing accuracy by 20.9% and quadratic weighted kappa by 18.63% compared with baseline and reaching 85.36% and 92.38% respectively. These investigations show that the potential of our approach for real clinical practice is promising.

cs.CV↗

arXiv2023

Unifying Robustness and Fidelity: A Comprehensive Study of Pretrained Generative Methods for Speech Enhancement in Adverse Conditions

Enhancing speech signal quality in adverse acoustic environments is a persistent challenge in speech processing. Existing deep learning based enhancement methods often struggle to effectively remove background noise and reverberation in real-world scenarios, hampering listening experiences. To address these challenges, we propose a novel approach that uses pre-trained generative methods to resynthesize clean, anechoic speech from degraded inputs. This study leverages pre-trained vocoder or codec models to synthesize high-quality speech while enhancing robustness in challenging scenarios. Generative methods effectively handle information loss in speech signals, resulting in regenerated speech that has improved fidelity and reduced artifacts. By harnessing the capabilities of pre-trained models, we achieve faithful reproduction of the original speech in adverse conditions. Experimental evaluations on both simulated datasets and realistic samples demonstrate the effectiveness and robustness of our proposed methods. Especially by leveraging codec, we achieve superior subjective scores for both simulated and realistic recordings. The generated speech exhibits enhanced audio quality, reduced background noise, and reverberation. Our findings highlight the potential of pre-trained generative techniques in speech processing, particularly in scenarios where traditional methods falter. Demos are available at https://whmrtm.github.io/SoundResynthesis.

eess.AS↗

arXiv2023

An isotropic antenna based on Rydberg atoms

Governed by the hairy ball theorem, classical antennas with isotropic responses to linearly polarized radio waves are unrealizable. This work shows that the antenna based on Rydberg atoms can theoretically achieve an ideal isotropic response to linearly polarized radio waves; that is, it has zero isotropic deviation. Experimental results of isotropic deviation within 5 dB, and 0.3 dB achievable after optimization, in microwave and terahertz wave measurements support the theory and are at least 15 dB improvement than the classical omnidirectional antenna. Combined with the SI traceable and ultrawideband property, the ideal isotropic response will make radio wave measurement based on atomic antenna much more accurate and reliable than the traditional method. This isotropic atomic antenna is an excellent example of what a tailored quantum sensor can realize, but a classical sensor cannot. It has crucial applications in fields such as radio wave electrometry.

quant-ph↗

arXiv2023

Differential current noise as an identifier of Andreev bound states that induce nearly quantized conductance plateaus

Quantized conductance plateaus, a celebrated hallmark of Majorana bound states (MBSs) predicted a decade ago, have recently been observed with small deviations in iron-based superconductors and hybrid nanowires. Here, we demonstrate that nearly quantized conductance plateaus can also arise from trivial Andreev bound states (ABSs). To avoid ABS interruptions, we propose identifying ABS-induced quantized conductance plateaus by measuring the associated differential current noise $P$ versus bias voltage $V$. Specifically, for a quantized conductance plateau induced by one or multiple low-energy ABSs, the associated $P(V)$ curve exhibits a double-peak around zero bias, with the peak positions at $e|V|\approx 3k_B T$ (where $T$ is the temperature) and peak values larger than $2e^3/h$. These features greatly contrast those of an MBS or quasi-MBS, whose $P(V)$ curve displays a broad zero-bias dip and is consistently below $2e^3/h$. This protocol can be practically implemented in a variety of MBS candidate platforms using an electrode or STM tip as a probe.

cond-mat.mes-hall↗