arXiv subjects

Hao Zhang

Publications and source records attributed to Hao Zhang.

At least 631 records · Page 35Linked to original sources

arXiv2024

A new criterion for oriented graphs to be determined by their generalized skew spectrum

Spectral characterizations of graphs is an important topic in spectral graph theory which has been studied extensively by researchers in recent years. The study of oriented graphs, however, has received less attention so far. In Qiu et al.~\cite{QWW} (Linear Algebra Appl. 622 (2021) 316-332), the authors gave an arithmetic criterion for an oriented graph to be determined by its \emph{generalized skew spectrum} (DGSS for short). More precisely, let $Σ$ be an $n$-vertex oriented graph with skew adjacency matrix $S$ and $W(Σ)=[e,Se,\ldots,S^{n-1}e]$ be the \emph{walk-matrix} of $Σ$, where $e$ is the all-one vector. A theorem of Qiu et al.~\cite{QWW} shows that a self-converse oriented graph $Σ$ is DGSS, provided that the Smith normal form of $W(Σ)$ is ${\rm diag}(1,\ldots,1,2,\ldots,2,2d)$, where $d$ is an odd and square-free integer and the number of $1$'s appeared in the diagonal is precisely $\lceil \frac{n}{2}\rceil$. In this paper, we show that the above square-freeness assumptions on $d$ can actually be removed, which significantly improves upon the above theorem. Our new ingredient is a key intermediate result, which is of independent interest: for a self-converse oriented graphs $Σ$ and an odd prime $p$, if the rank of $W(Σ)$ is $n-1$ over $\mathbb{F}_p$, then the kernel of $W(Σ)^{\rm T}$ over $\mathbb{F}_p$ is \emph{anisotropic}, i.e., $v^{\rm T}v\neq 0$ for any $0\ne v\in{{\rm ker}\,W(Σ)^{\rm T}}$ over $\mathbb{F}_p$.

math.CO↗

arXiv2024

Annihilating polynomial, Jordan canonical from, and generalized spectral characterizations of Eulerian graphs

Let $G$ be an Eulerian graph on $n$ vertices with adjacency matrix $A$ and characteristic polynomial $ϕ(x)$. We show that when $n$ is even (resp. odd), the square-root of $ϕ(x)$ (resp. $xϕ(x)$) is an annihilating polynomial of $A$, over $\mathbb{F}_2$. The result was achieved by applying the Jordan canonical form of $A$ over the algebraic closure $\bar{\mathbb{F}}_2$. Based on this, we show a family of Eulerian graphs are determined by their generalized spectrum among all Eulerian graphs, which significantly simplifies and strengthens the previous result.

math.CO↗

arXiv2024

UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation

Image segmentation is a crucial vision task that groups pixels within an image into semantically meaningful segments, which is pivotal in obtaining a fine-grained understanding of real-world scenes. However, an increasing privacy concern exists regarding training large-scale image segmentation models on unauthorized private data. In this work, we exploit the concept of unlearnable examples to make images unusable to model training by generating and adding unlearnable noise into the original images. Particularly, we propose a novel Unlearnable Segmentation (UnSeg) framework to train a universal unlearnable noise generator that is capable of transforming any downstream images into their unlearnable version. The unlearnable noise generator is finetuned from the Segment Anything Model (SAM) via bilevel optimization on an interactive segmentation dataset towards minimizing the training error of a surrogate model that shares the same architecture with SAM but is trained from scratch. We empirically verify the effectiveness of UnSeg across 6 mainstream image segmentation tasks, 10 widely used datasets, and 7 different network architectures, and show that the unlearnable images can reduce the segmentation performance by a large margin. Our work provides useful insights into how to leverage foundation models in a data-efficient and computationally affordable manner to protect images against image segmentation models.

cs.CV↗

arXiv2024

GALA: Geometry-Aware Local Adaptive Grids for Detailed 3D Generation

We propose GALA, a novel representation of 3D shapes that (i) excels at capturing and reproducing complex geometry and surface details, (ii) is computationally efficient, and (iii) lends itself to 3D generative modelling with modern, diffusion-based schemes. The key idea of GALA is to exploit both the global sparsity of surfaces within a 3D volume and their local surface properties. Sparsity is promoted by covering only the 3D object boundaries, not empty space, with an ensemble of tree root voxels. Each voxel contains an octree to further limit storage and compute to regions that contain surfaces. Adaptivity is achieved by fitting one local and geometry-aware coordinate frame in each non-empty leaf node. Adjusting the orientation of the local grid, as well as the anisotropic scales of its axes, to the local surface shape greatly increases the amount of detail that can be stored in a given amount of memory, which in turn allows for quantization without loss of quality. With our optimized C++/CUDA implementation, GALA can be fitted to an object in less than 10 seconds. Moreover, the representation can efficiently be flattened and manipulated with transformer networks. We provide a cascaded generation pipeline capable of generating 3D shapes with great geometric detail.

cs.CV↗

arXiv2024

Training Overhead Ratio: A Practical Reliability Metric for Large Language Model Training Systems

Large Language Models (LLMs) are revolutionizing the AI industry with their superior capabilities. Training these models requires large-scale GPU clusters and significant computing time, leading to frequent failures that significantly increase training costs. Despite its significance, this field lacks a metric for evaluating reliability. In this work, we introduce a novel reliability metric called \emph{Training Overhead Ratio} (TOR) to evaluate the reliability of fault-tolerant LLM training systems. TOR is defined as the ratio of optimal training time to the observed training time of a system, serving as a practical tool for users to estimate the actual time required to train an LLM on a given system. Furthermore, our investigation identifies the key factor for enhancing reliability and present TOR equations for various types of failures encountered in practice.

cs.DC↗

arXiv2024

Learning Recommender Systems with Soft Target: A Decoupled Perspective

Learning recommender systems with multi-class optimization objective is a prevalent setting in recommendation. However, as observed user feedback often accounts for a tiny fraction of the entire item pool, the standard Softmax loss tends to ignore the difference between potential positive feedback and truly negative feedback. To address this challenge, we propose a novel decoupled soft label optimization framework to consider the objectives as two aspects by leveraging soft labels, including target confidence and the latent interest distribution of non-target items. Futhermore, based on our carefully theoretical analysis, we design a decoupled loss function to flexibly adjust the importance of these two aspects. To maximize the performance of the proposed method, we additionally present a sensible soft-label generation algorithm that models a label propagation algorithm to explore users' latent interests in unobserved feedback via neighbors. We conduct extensive experiments on various recommendation system models and public datasets, the results demonstrate the effectiveness and generality of the proposed method.

cs.IR↗

arXiv2024

Towards Natural Image Matting in the Wild via Real-Scenario Prior

Recent approaches attempt to adapt powerful interactive segmentation models, such as SAM, to interactive matting and fine-tune the models based on synthetic matting datasets. However, models trained on synthetic data fail to generalize to complex and occlusion scenes. We address this challenge by proposing a new matting dataset based on the COCO dataset, namely COCO-Matting. Specifically, the construction of our COCO-Matting includes accessory fusion and mask-to-matte, which selects real-world complex images from COCO and converts semantic segmentation masks to matting labels. The built COCO-Matting comprises an extensive collection of 38,251 human instance-level alpha mattes in complex natural scenarios. Furthermore, existing SAM-based matting methods extract intermediate features and masks from a frozen SAM and only train a lightweight matting decoder by end-to-end matting losses, which do not fully exploit the potential of the pre-trained SAM. Thus, we propose SEMat which revamps the network architecture and training objectives. For network architecture, the proposed feature-aligned transformer learns to extract fine-grained edge and transparency features. The proposed matte-aligned decoder aims to segment matting-specific objects and convert coarse masks into high-precision mattes. For training objectives, the proposed regularization and trimap loss aim to retain the prior from the pre-trained model and push the matting logits extracted from the mask decoder to contain trimap-based semantic information. Extensive experiments across seven diverse datasets demonstrate the superior performance of our method, proving its efficacy in interactive natural image matting. We open-source our code, models, and dataset at https://github.com/XiaRho/SEMat.

cs.CV↗

arXiv2024

Coulomb blockade in open superconducting islands on InAs nanowires

Electrons in closed systems can exhibit Coulomb blockade (CB) oscillations due to charge quantization. Here, we report CB oscillations in aluminum superconducting islands on InAs nanowires in the open regime. The Al island is connected to the source/drain leads through two contacts: One is fully transmitting while the other is tuned into the tunneling regime. This device configuration is typical for tunneling spectroscopy where charging energy is generally considered negligible. The oscillation periods are 2$e$ or 1$e$, depending on the gate settings. A magnetic field can induce the 2$e$ to 1$e$ transition. Our result is reminiscent of the "mesoscopic Coulomb blockade" in open quantum dots caused by electron interference.

cond-mat.mes-hall↗

arXiv2024

Electric field driven spin textures in heavy fermion van der Waals magnets

The recently discovered van der Waals material CeSiI exhibits both heavy fermion behavior and spiral order with strong magnetic anisotropy which makes it a potential host for topological spin textures such as skyrmions through electrical gating. A monolayer of CeSiI consists of two layers of Ce atoms on triangular lattices that sandwich a silicene layer. Motivated by the experiments, we explore magnetic phase diagram in van der Waals heavy fermion materials as a function of anisotropy and applied magnetic field using an effective spin model. We demonstrate that application of an external electric field can tune the Kondo coupling on each Ce layer differently, in turn allowing for controlling the intra- and interlayer magnetic couplings. Our analysis indicates that this fine-tuning leads to the coexistence of different magnetic orders in a single monolayer. In particular, we show that a novel vortex phase can be stabilized only in the presence of an external electric field. Our results highlight the unique advantages and the tunability of van der Waals heavy fermion materials for manipulation of chiral magnetic phases.

cond-mat.mes-hall↗

arXiv2024

MFE-ETP: A Comprehensive Evaluation Benchmark for Multi-modal Foundation Models on Embodied Task Planning

In recent years, Multi-modal Foundation Models (MFMs) and Embodied Artificial Intelligence (EAI) have been advancing side by side at an unprecedented pace. The integration of the two has garnered significant attention from the AI research community. In this work, we attempt to provide an in-depth and comprehensive evaluation of the performance of MFM s on embodied task planning, aiming to shed light on their capabilities and limitations in this domain. To this end, based on the characteristics of embodied task planning, we first develop a systematic evaluation framework, which encapsulates four crucial capabilities of MFMs: object understanding, spatio-temporal perception, task understanding, and embodied reasoning. Following this, we propose a new benchmark, named MFE-ETP, characterized its complex and variable task scenarios, typical yet diverse task types, task instances of varying difficulties, and rich test case types ranging from multiple embodied question answering to embodied task reasoning. Finally, we offer a simple and easy-to-use automatic evaluation platform that enables the automated testing of multiple MFMs on the proposed benchmark. Using the benchmark and evaluation platform, we evaluated several state-of-the-art MFMs and found that they significantly lag behind human-level performance. The MFE-ETP is a high-quality, large-scale, and challenging benchmark relevant to real-world tasks.

cs.AI↗

arXiv2024

CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control

Retrieval-augmented generation (RAG) has emerged as a promising solution for mitigating hallucinations of large language models (LLMs) with retrieved external knowledge. Adaptive RAG enhances this approach by enabling dynamic retrieval during generation, activating retrieval only when the query exceeds LLM's internal knowledge. Existing methods primarily focus on detecting LLM's confidence via statistical uncertainty. Instead, we present the first attempts to solve adaptive RAG from a representation perspective and develop an inherent control-based framework, termed \name. Specifically, we extract the features that represent the honesty and confidence directions of LLM and adopt them to control LLM behavior and guide retrieval timing decisions. We also design a simple yet effective query formulation strategy to support adaptive retrieval. Experiments show that \name is superior to existing adaptive RAG methods on a diverse set of tasks, the honesty steering can effectively make LLMs more honest and confidence monitoring is a promising indicator of retrieval trigger.Our code is available at \url{https://github.com/HSLiu-Initial/CtrlA}.

cs.CL↗

arXiv2024

Retrieval-Oriented Knowledge for Click-Through Rate Prediction

Click-through rate (CTR) prediction is crucial for personalized online services. Sample-level retrieval-based models, such as RIM, have demonstrated remarkable performance. However, they face challenges including inference inefficiency and high resource consumption due to the retrieval process, which hinder their practical application in industrial settings. To address this, we propose a universal plug-and-play \underline{r}etrieval-\underline{o}riented \underline{k}nowledge (\textbf{\name}) framework that bypasses the real retrieval process. The framework features a knowledge base that preserves and imitates the retrieved \& aggregated representations using a decomposition-reconstruction paradigm. Knowledge distillation and contrastive learning optimize the knowledge base, enabling the integration of retrieval-enhanced representations with various CTR models. Experiments on three large-scale datasets demonstrate \name's exceptional compatibility and performance, with the neural knowledge base serving as an effective surrogate for the retrieval pool. \name surpasses the teacher model while maintaining superior inference efficiency and demonstrates the feasibility of distilling knowledge from non-parametric methods using a parametric approach. These results highlight \name's strong potential for real-world applications and its ability to transform retrieval-based methods into practical solutions. Our implementation code is available to support reproducibility in \url{https://github.com/HSLiu-Initial/ROK.git}.

cs.IR↗

arXiv2024

Restorative Speech Enhancement: A Progressive Approach Using SE and Codec Modules

In challenging environments with significant noise and reverberation, traditional speech enhancement (SE) methods often lead to over-suppressed speech, creating artifacts during listening and harming downstream tasks performance. To overcome these limitations, we propose a novel approach called Restorative SE (RestSE), which combines a lightweight SE module with a generative codec module to progressively enhance and restore speech quality. The SE module initially reduces noise, while the codec module subsequently performs dereverberation and restores speech using generative capabilities. We systematically explore various quantization techniques within the codec module to optimize performance. Additionally, we introduce a weighted loss function and feature fusion that merges the SE output with the original mixture, particularly at segments where the SE output is heavily distorted. Experimental results demonstrate the effectiveness of our proposed method in enhancing speech quality under adverse conditions. Audio demos are available at: https://sophie091524.github.io/RestorativeSE/.

eess.AS↗

arXiv2024

Open-Vocabulary Animal Keypoint Detection with Semantic-feature Matching

Current image-based keypoint detection methods for animal (including human) bodies and faces are generally divided into full-supervised and few-shot class-agnostic approaches. The former typically relies on laborious and time-consuming manual annotations, posing considerable challenges in expanding keypoint detection to a broader range of keypoint categories and animal species. The latter, though less dependent on extensive manual input, still requires necessary support images with annotation for reference during testing. To realize zero-shot keypoint detection without any prior annotation, we introduce the Open-Vocabulary Keypoint Detection (OVKD) task, which is innovatively designed to use text prompts for identifying arbitrary keypoints across any species. In pursuit of this goal, we have developed a novel framework named Open-Vocabulary Keypoint Detection with Semantic-feature Matching (KDSM). This framework synergistically combines vision and language models, creating an interplay between language features and local keypoint visual features. KDSM enhances its capabilities by integrating Domain Distribution Matrix Matching (DDMM) and other special modules, such as the Vision-Keypoint Relational Awareness (VKRA) module, improving the framework's generalizability and overall performance.Our comprehensive experiments demonstrate that KDSM significantly outperforms the baseline in terms of performance and achieves remarkable success in the OVKD task.Impressively, our method, operating in a zero-shot fashion, still yields results comparable to state-of-the-art few-shot species class-agnostic keypoint detection methods.We will make the source code publicly accessible.

cs.CV↗

arXiv2024

Decomposition squared

In this paper, we test and extend a proposal of Gu, Pei, and Zhang for an application of decomposition to three-dimensional theories with one-form symmetries and to quantum K theory. The theories themselves do not decompose, but, OPEs of parallel one-dimensional objects (such as Wilson lines) and dimensional reductions to two dimensions do decompose, sometimes in two independent ways. We apply this to extend conjectures for quantum K theory rings of gerbes (realized by three-dimensional gauge theories with one-form symmetries) via both orbifold partition functions and gauged linear sigma models.

hep-th↗

arXiv2024

Observation of Superoscillation Superlattices

Superoscillation (SO) wavefunctions, that locally oscillate much faster than its fastest Fourier component, in light waves have enhanced optical technologies beyond diffraction limits, but never been controlled into 2D periodic lattices. Here, we report the 2D superoscillation lattices (SOL) with controlled symmetries, where the local wavevector can be 700 times larger than the global maximal wavevector (k0) in a localized region 100 times smaller than the global minimal wavelength (λ0). We also demonstrate the superoscillation superlattices (SOSL) as twisted bilayer Moiré patterns of two SOL, akin to the magic angle tuning in advanced twistronics, we can continually tune the ondemand SO with local maximal wavevector in a range of 450k0 to 700k0 and with λ0/100 toλ0/1000. The twistronic SOSL will advance optical imaging and metrology into extreme higher dimensional superresolution.

physics.optics↗

arXiv2024

Pre-trained Language Model and Knowledge Distillation for Lightweight Sequential Recommendation

Sequential recommendation models user interests based on historical behaviors to provide personalized recommendation. Previous sequential recommendation algorithms primarily employ neural networks to extract features of user interests, achieving good performance. However, due to the recommendation system datasets sparsity, these algorithms often employ small-scale network frameworks, resulting in weaker generalization capability. Recently, a series of sequential recommendation algorithms based on large pre-trained language models have been proposed. Nonetheless, given the real-time demands of recommendation systems, the challenge remains in applying pre-trained language models for rapid recommendations in real scenarios. To address this, we propose a sequential recommendation algorithm based on a pre-trained language model and knowledge distillation. The key of proposed algorithm is to transfer pre-trained knowledge across domains and achieve lightweight inference by knowledge distillation. The algorithm operates in two stages: in the first stage, we fine-tune the pre-trained language model on the recommendation dataset to transfer the pre-trained knowledge to the recommendation task; in the second stage, we distill the trained language model to transfer the learned knowledge to a lightweight model. Extensive experiments on multiple public recommendation datasets show that the proposed algorithm enhances recommendation accuracy and provide timely recommendation services.

cs.IR↗

arXiv2024

Empowering Sequential Recommendation from Collaborative Signals and Semantic Relatedness

Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp user interests. It is also significant to model the \textit{semantic relatedness} reflected in content features, e.g., images and text. Towards that end, in this paper, we aim to enhance the SRS tasks by effectively unifying collaborative signals and semantic relatedness together. Notably, we empirically point out that it is nontrivial to achieve such a goal due to semantic gap issues. Thus, we propose an end-to-end two-stream architecture for sequential recommendation, named TSSR, to learn user preferences from ID-based and content-based sequence. Specifically, we first present novel hierarchical contrasting module, including coarse user-grained and fine item-grained terms, to align the representations of inter-modality. Furthermore, we also design a two-stream architecture to learn the dependence of intra-modality sequence and the complex interactions of inter-modality sequence, which can yield more expressive capacity in understanding user interests. We conduct extensive experiments on five public datasets. The experimental results show that the TSSR could yield superior performance than competitive baselines. We also make our experimental codes publicly available at https://github.com/Mingyue-Cheng/TSSR.

cs.IR↗