arXiv subjects

Shuo Zhang

Publications and source records attributed to Shuo Zhang.

At least 163 records · Page 9Linked to original sources

arXiv2024

AI-Powered Algorithm-Centric Quantum Processor Topology Design

Quantum computing promises to revolutionize various fields, yet the execution of quantum programs necessitates an effective compilation process. This involves strategically mapping quantum circuits onto the physical qubits of a quantum processor. The qubits' arrangement, or topology, is pivotal to the circuit's performance, a factor that often defies traditional heuristic or manual optimization methods due to its complexity. In this study, we introduce a novel approach leveraging reinforcement learning to dynamically tailor qubit topologies to the unique specifications of individual quantum circuits, guiding algorithm-driven quantum processor topology design for reducing the depth of mapped circuit, which is particularly critical for the output accuracy on noisy quantum processors. Our method marks a significant departure from previous methods that have been constrained to mapping circuits onto a fixed processor topology. Experiments demonstrate that we have achieved notable enhancements in circuit performance, with a minimum of 20\% reduction in circuit depth in 60\% of the cases examined, and a maximum enhancement of up to 46\%. Furthermore, the pronounced benefits of our approach in reducing circuit depth become increasingly evident as the scale of the quantum circuits increases, exhibiting the scalability of our method in terms of problem size. This work advances the co-design of quantum processor architecture and algorithm mapping, offering a promising avenue for future research and development in the field.

quant-ph↗

arXiv2024

Finite element spaces by Whitney k-forms on cubical meshes

Finite element spaces by Whitney $k$-forms on cubical meshes in $\mathbb{R}^n$ are presented. Based on the spaces, compatible discretizations to $HΛ^k$ problems are provided, and discrete de Rham complexes and commutative diagrams are constructed.

math.NA↗

arXiv2024

Unlocking the Potential of Reverse Distillation for Anomaly Detection

Knowledge Distillation (KD) is a promising approach for unsupervised Anomaly Detection (AD). However, the student network's over-generalization often diminishes the crucial representation differences between teacher and student in anomalous regions, leading to detection failures. To addresses this problem, the widely accepted Reverse Distillation (RD) paradigm designs the asymmetry teacher and student, using an encoder as teacher and a decoder as student. Yet, the design of RD does not ensure that the teacher encoder effectively distinguishes between normal and abnormal features or that the student decoder generates anomaly-free features. Additionally, the absence of skip connections results in a loss of fine details during feature reconstruction. To address these issues, we propose RD with Expert, which introduces a novel Expert-Teacher-Student network for simultaneous distillation of both the teacher encoder and student decoder. The added expert network enhances the student's ability to generate normal features and optimizes the teacher's differentiation between normal and abnormal features, reducing missed detections. Additionally, Guided Information Injection is designed to filter and transfer features from teacher to student, improving detail reconstruction and minimizing false positives. Experiments on several benchmarks prove that our method outperforms existing unsupervised AD methods under RD paradigm, fully unlocking RD's potential.

cs.CV↗

arXiv2024

Identifying the Galactic Substructures in 5D Space Using All-sky RR Lyrae Stars in Gaia DR3

Motivated by the vast gap between photometric and spectroscopic data volumes, there is great potential in using 5D kinematic information to identify and study substructures of the Milky Way. We identify substructures in the Galactic halo using 46,575 RR Lyrae stars (RRLs) from Gaia DR3 with the photometric metallicities and distances newly estimated by Li et al. (2023). Assuming a Gaussian prior distribution of radial velocity, we calculate the orbital distribution characterized by the integrals of motion for each RRL based on its 3D positions, proper motions and corresponding errors, and then apply the friends-of-friends algorithm to identify groups moving along similar orbits. We have identified several known substructures, including Sagittarius (Sgr) Stream, Hercules-Aquila Cloud (HAC), Virgo Overdensity (VOD), Gaia-Enceladus-Sausage (GES), Orphan-Chenab stream, Cetus-Palca, Helmi Streams, Sequoia, Wukong and Large Magellanic Cloud (LMC) leading arm, along with 18 unknown groups. Our findings indicate that HAC and VOD have kinematic and chemical properties remarkably similar to GES, with most HAC and VOD members exhibiting eccentricity as high as GES, suggesting that they may share a common origin with GES. The ability to identify the low mass and spatially dispersed substructures further demonstrates the potential of our method, which breaks the limit of spectroscopic survey and is competent to probe the substructures in the whole Galaxy. Finally, we have also identified 18 unknown groups with good spatial clustering and proper motion consistency, suggesting more excavation of Milky Way substructures in the future with only 5D data.

astro-ph.GA↗

arXiv2024

Investigation of the non-thermal X-ray emission from the supernova remnant CTB 37B hosting the magnetar CXOU J171405.7$-$381031

We present a detailed X-ray investigation of a region (S1) exhibiting non-thermal X-ray emission within the supernova remnant (SNR) CTB 37B hosting the magnetar CXOU J171405.7$-$381031. Previous analyses modeled this emission with a power law (PL), inferring various values for the photon index ($Γ$) and absorbing column density ($N_{\rm H}$). Based on these, S1 was suggested to be the SNR shell, a background pulsar wind nebula (PWN), or an interaction region between the SNR and a molecular cloud. Our analysis of a larger dataset favors a steepening (broken or curved PL) spectrum over a straight PL, with the best-fit broken power-law (BPL) parameters of $Γ=1.23\pm0.23$ and $2.24\pm0.16$ below and above a break at $5.57\pm0.52$ keV, respectively. However, a simple PL or srcut model cannot be definitively ruled out. For the BPL model, the inferred $N_{\rm H}=(4.08\pm0.72)\times 10^{22}\rm \ cm^{-2}$ towards S1 is consistent with that of the SNR, suggesting a physical association. The BPL-inferred spectral break $ΔΓ\approx 1$ and hard $Γ$ can be naturally explained by a non-thermal bremsstrahlung (NTB) model. We present an evolutionary NTB model that reproduces the observed spectrum, which indicates the presence of sub-relativistic electrons within S1. However, alternate explanations for S1, an unrelated PWN or the SNR shock with unusually efficient acceleration, cannot be ruled out. We discuss these explanations and their implications for gamma-ray emission from CTB 37B, and describe future observations that could settle the origin of S1.

astro-ph.HE↗

arXiv2024

A Natural Deep Ritz Method for Essential Boundary Value Problems

Deep neural network approaches show promise in solving partial differential equations. However, unlike traditional numerical methods, they face challenges in enforcing essential boundary conditions. The widely adopted penalty-type methods, for example, offer a straightforward implementation but introduces additional complexity due to the need for hyper-parameter tuning; moreover, the use of a large penalty parameter can lead to artificial extra stiffness, complicating the optimization process. In this paper, we propose a novel, intrinsic approach to impose essential boundary conditions through a framework inspired by intrinsic structures. We demonstrate the effectiveness of this approach using the deep Ritz method applied to Poisson problems, with the potential for extension to more general equations and other deep learning techniques. Numerical results are provided to substantiate the efficiency and robustness of the proposed method.

math.NA↗

arXiv2024

DipMe: Haptic Recognition of Granular Media for Tangible Interactive Applications

While tangible user interface has shown its power in naturally interacting with rigid or soft objects, users cannot conveniently use different types of granular materials as the interaction media. We introduce DipMe as a smart device to recognize the types of granular media in real time, which can be used to connect the granular materials in the physical world with various virtual content. Other than vision-based solutions, we propose a dip operation of our device and exploit the haptic signals to recognize different types of granular materials. With modern machine learning tools, we find the haptic signals from different granular media are distinguishable by DipMe. With the online granular object recognition, we build several tangible interactive applications, demonstrating the effects of DipMe in perceiving granular materials and its potential in developing a tangible user interface with granular objects as the new media.

cs.HC↗

arXiv2024

Data Cleaning Using Large Language Models

Data cleaning is a crucial yet challenging task in data analysis, often requiring significant manual effort. To automate data cleaning, previous systems have relied on statistical rules derived from erroneous data, resulting in low accuracy and recall. This work introduces Cocoon, a novel data cleaning system that leverages large language models for rules based on semantic understanding and combines them with statistical error detection. However, data cleaning is still too complex a task for current LLMs to handle in one shot. To address this, we introduce Cocoon, which decomposes complex cleaning tasks into manageable components in a workflow that mimics human cleaning processes. Our experiments show that Cocoon outperforms state-of-the-art data cleaning systems on standard benchmarks.

cs.DB↗

arXiv2024

Dual-Modeling Decouple Distillation for Unsupervised Anomaly Detection

Knowledge distillation based on student-teacher network is one of the mainstream solution paradigms for the challenging unsupervised Anomaly Detection task, utilizing the difference in representation capabilities of the teacher and student networks to implement anomaly localization. However, over-generalization of the student network to the teacher network may lead to negligible differences in representation capabilities of anomaly, thus affecting the detection effectiveness. Existing methods address the possible over-generalization by using differentiated students and teachers from the structural perspective or explicitly expanding distilled information from the content perspective, which inevitably result in an increased likelihood of underfitting of the student network and poor anomaly detection capabilities in anomaly center or edge. In this paper, we propose Dual-Modeling Decouple Distillation (DMDD) for the unsupervised anomaly detection. In DMDD, a Decouple Student-Teacher Network is proposed to decouple the initial student features into normality and abnormality features. We further introduce Dual-Modeling Distillation based on normal-anomaly image pairs, fitting normality features of anomalous image and the teacher features of the corresponding normal image, widening the distance between abnormality features and the teacher features in anomalous regions. Synthesizing these two distillation ideas, we achieve anomaly detection which focuses on both edge and center of anomaly. Finally, a Multi-perception Segmentation Network is proposed to achieve focused anomaly map fusion based on multiple attention. Experimental results on MVTec AD show that DMDD surpasses SOTA localization performance of previous knowledge distillation-based methods, reaching 98.85% on pixel-level AUC and 96.13% on PRO.

cs.CV↗

arXiv2024

Circuit-Noise-Resilient Virtual Distillation

Quantum error mitigation (QEM) is vital for improving quantum algorithms' accuracy on noisy near-term devices. A typical QEM method, called Virtual Distillation (VD), can suffer from imperfect implementation, potentially leading to worse outcomes than without mitigation. To address this, we introduce Circuit-Noise-Resilient Virtual Distillation (CNR-VD), which includes a calibration process using simple input states to enhance VD's performance despite circuit noise, aiming to recover the results of an ideally conducted VD circuit. Simulations show that CNR-VD significantly mitigates noise-induced errors in VD circuits, boosting accuracy by up to tenfold over standard VD. It provides positive error mitigation even under high noise, where standard VD fails. Furthermore, our estimator's versatility extends its utility beyond VD, enhancing outcomes in general Hadamard-Test circuits. The proposed CNR-VD significantly enhances the noise-resilience of VD, and thus is anticipated to elevate the performance of quantum algorithm implementations on near-term quantum devices.

quant-ph↗

arXiv2024

Quantum Advantage: A Single Qubit's Experimental Edge in Classical Data Storage

We implement an experiment on a photonic quantum processor establishing efficacy of the elementary quantum system in classical information storage. The advantage is established by considering a class of simple bipartite games played with the communication resource qubit and classical bit (c-bit), respectively. Conventional wisdom, supported by the no-go theorems of Holevo and Frenkel-Weiner, suggests that such a quantum advantage is unattainable when the sender and receiver share randomness or classical correlations. However, our results reveal a quantum advantage in a scenario devoid of any shared randomness. Our experiment involves the development of a variational triangular polarimeter, enabling the realization of positive operator value measurements crucial for establishing the targeted quantum advantage. Beyond showcasing a robust communication advantage with a single qubit, our work paves the way for immediate applications in near-term quantum technologies. It provides a semi-device-independent certification scheme for quantum encoding-decoding systems and offers an efficient method for information loading and transmission in quantum networks.

quant-ph↗

arXiv2024

Enhancing Question Answering on Charts Through Effective Pre-training Tasks

To completely understand a document, the use of textual information is not enough. Understanding visual cues, such as layouts and charts, is also required. While the current state-of-the-art approaches for document understanding (both OCR-based and OCR-free) work well, a thorough analysis of their capabilities and limitations has not yet been performed. Therefore, in this work, we addresses the limitation of current VisualQA models when applied to charts and plots. To investigate shortcomings of the state-of-the-art models, we conduct a comprehensive behavioral analysis, using ChartQA as a case study. Our findings indicate that existing models particularly underperform in answering questions related to the chart's structural and visual context, as well as numerical information. To address these issues, we propose three simple pre-training tasks that enforce the existing model in terms of both structural-visual knowledge, as well as its understanding of numerical questions. We evaluate our pre-trained model (called MatCha-v2) on three chart datasets - both extractive and abstractive question datasets - and observe that it achieves an average improvement of 1.7% over the baseline model.

cs.CL↗

arXiv2024

Discovery of interstellar 1-cyanopyrene: a four-ring polycyclic aromatic hydrocarbon in TMC-1

Polycyclic aromatic hydrocarbons (PAHs) are expected to be the most abundant class of organic molecules in space. Their interstellar lifecycle is not well understood, and progress is hampered by difficulties detecting individual PAH molecules. Here, we present the discovery of CN-functionalized pyrene, a 4-ring PAH, in the dense cloud TMC-1 using the 100-m Green Bank Telescope. We derive an abundance of 1-cyanopyrene of ~1.52 x $10^{12}$ cm$^{-2}$, and from this estimate that the un-substituted pyrene accounts for up to ~0.03-0.3% of the carbon budget in the dense interstellar medium which trace the birth sites of stars and planets. The presence of pyrene in this cold (~10 K) molecular cloud agrees with its recent measurement in asteroid Ryugu where isotopic clumping suggest a cold, interstellar origin. The direct link to the birth site of our solar system is strengthened when we consider the solid state pyrene content in the pre-stellar materials compared to comets, which represent the most pristine material in the solar system. We estimate that solid state pyrene can account for 1% of the carbon within comets carried by this one single organic molecule. The abundance indicates pyrene is an "island of stability" in interstellar PAH chemistry and suggests a potential cold molecular cloud origin of the carbon carried by PAHs that is supplied to forming planetary systems, including habitable worlds such as our own.

astro-ph.GA↗

arXiv2024

Detections of interstellar 2-cyanopyrene and 4-cyanopyrene in TMC-1

Polycyclic aromatic hydrocarbons (PAHs) are among the most ubiquitous compounds in the universe, accounting for up to ~25% of all interstellar carbon. Since most unsubstituted PAHs do not possess permanent dipole moments, they are invisible to radio astronomy. Constraining their abundances relies on the detection of polar chemical proxies, such as aromatic nitriles. We report the detection of 2- and 4-cyanopyrene, isomers of the recently detected 1-cyanopyrene. We find that these isomers are present in an abundance ratio of ~2:1:2, which mirrors the number of equivalent sites available for CN addition. We conclude that there is evidence that the cyanopyrene isomers formed by direct CN addition to pyrene under kinetic control in hydrogen-rich gas at 10 K and discuss constraints on the H/CN ratio for PAHs in TMC-1.

astro-ph.GA↗

arXiv2024

Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generation

Towards human-like dialogue systems, current emotional dialogue approaches jointly model emotion and semantics with a unified neural network. This strategy tends to generate safe responses due to the mutual restriction between emotion and semantics, and requires rare emotion-annotated large-scale dialogue corpus. Inspired by the "think twice" behavior in human dialogue, we propose a two-stage conversational agent for the generation of emotional dialogue. Firstly, a dialogue model trained without the emotion-annotated dialogue corpus generates a prototype response that meets the contextual semantics. Secondly, the first-stage prototype is modified by a controllable emotion refiner with the empathy hypothesis. Experimental results on the DailyDialog and EmpatheticDialogues datasets demonstrate that the proposed conversational outperforms the comparison models in emotion generation and maintains the semantic performance in automatic and human evaluations.

cs.CL↗

arXiv2024

Seed-Music: A Unified Framework for High Quality and Controlled Music Generation

We introduce Seed-Music, a suite of music generation systems capable of producing high-quality music with fine-grained style control. Our unified framework leverages both auto-regressive language modeling and diffusion approaches to support two key music creation workflows: controlled music generation and post-production editing. For controlled music generation, our system enables vocal music generation with performance controls from multi-modal inputs, including style descriptions, audio references, musical scores, and voice prompts. For post-production editing, it offers interactive tools for editing lyrics and vocal melodies directly in the generated audio. We encourage readers to listen to demo audio examples at https://team.doubao.com/seed-music "https://team.doubao.com/seed-music".

cs.SD↗

arXiv2024

Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models

Large Multimodal Models (LMMs) have shown promise in vision-language tasks but struggle with high-resolution input and detailed scene understanding. Addressing these challenges, we introduce Monkey to enhance LMM capabilities. Firstly, Monkey processes input images by dividing them into uniform patches, each matching the size (e.g., 448x448) used in the original training of the well-trained vision encoder. Equipped with individual adapter for each patch, Monkey can handle higher resolutions up to 1344x896 pixels, enabling the detailed capture of complex visual information. Secondly, it employs a multi-level description generation method, enriching the context for scene-object associations. This two-part strategy ensures more effective learning from generated data: the higher resolution allows for a more detailed capture of visuals, which in turn enhances the effectiveness of comprehensive descriptions. Extensive ablative results validate the effectiveness of our designs. Additionally, experiments on 18 datasets further demonstrate that Monkey surpasses existing LMMs in many tasks like Image Captioning and various Visual Question Answering formats. Specially, in qualitative tests focused on dense text question answering, Monkey has exhibited encouraging results compared with GPT4V. Code is available at https://github.com/Yuliang-Liu/Monkey.

cs.CV↗

arXiv2024

Spin-2 operators in two-dimensional $\mathcal{N}=(4,0)$ quivers from massive type IIA

In this work we revisit the problem of studying spin-2 fluctuations around a class of solutions in massive type IIA that is given by a warped $\text{AdS}_3 \times \text{S}^2 \times \text{T}^4 \times \mathcal{I}_ρ$ and with $\mathcal{N}=(4,0)$ supersymmetry. We were able to identify a class of fluctuations, which is known as the ``minimal universal class'' that is independent of the background data and saturates the bound on the mass related to the field theory unitarity bound. These operators have conformal dimension $Δ= 2(\ell+1)$, with $\ell$ being the quantum number of the angular momentum on the $\text{S}^2$. We also computed the normalisation of the $2$-point function of stress-energy tensors from the effective $3$-dimensional graviton action. We comment on the relation of our results to the related $\text{AdS}_3$ and $\text{AdS}_2$ solutions in massive type IIA and type IIB theories respectively.

hep-th↗