Search arXiv⌕ Search

arXiv subjects

Xiao Liu

Publications and source records attributed to Xiao Liu.

At least 91 records · Page 5Linked to original sources

Estimating Treatment and Spillover Effects with the Ego-Cluster Experimental Design

Network interference occurs when a unit's outcome depends not only on its own treatment but also on the treatments received by connected units in the network. Experimental designs and analysis methods that ignore such interference can yield biased estimators of causal effects. In this paper, we develop a new experimental design for the estimation and inference of global treatment effect and spillover effect under a model-based framework and ego-cluster randomization. Under this design, the network is partitioned into a collection of ego-clusters, each consisting of a focal unit (the ego) and its network neighbors (the alters), with randomization conducted at the cluster level. We propose model-based estimators for the global treatment effect and spillover effect and establish their consistency and asymptotic normality, with asymptotic variances determined by the ego-cluster structure. Building on these theoretical results, we introduce an ego-clustering algorithm that sequentially selects egos and assigns alters to minimize asymptotic variances. Simulation studies and two empirical applications demonstrate that the proposed procedure yields accurate inference and efficiency improvements over existing network experimental designs.

stat.ME↗

DFT-assisted natural abundance 13C zero-field NMR via optical magnetometry

Zero-field (ZF) nuclear magnetic resonance (NMR) spectroscopy probes scalar J-couplings between nuclei while dispensing with large homogeneous magnetic fields, enabling low-cost and geometrically flexible detection, including through conductive enclosures. Despite these advantages, its broader use for chemical analysis has been limited by sensitivity and by the difficulty of predicting the dense spectral multiplets that arise at zero field. Here we demonstrate natural-abundance (1.1%) 13C ZF spectroscopy on off-the-shelf liquids using a compact commercial 87Rb magnetometer for the first time, without hyperpolarization or special sample preparation. Instrumental advances yield improved sensitivity, <250-mHz linewidths and >week-long stability, enabling isotopomer-resolved fingerprint spectra across a 13-molecule library, including the ability to discern rare (0.0121%) doubly 13C-labelled species. In parallel, we demonstrate vibrationally corrected density-functional theory (DFT) based prediction of ZF NMR spectra for chemically diverse molecules with few-hertz accuracy. Comparing experiment with these calculations renders residual deviations as chemically informative, reporting on hydrogen bonding, hydration and ion pairing at high ionic strength. Together, these results contribute towards DFT-assisted ZF NMR as a general platform for field-constraint-free molecular identification and for extracting transient solution-state structure from responsive J-coupling observables.

physics.chem-ph↗

Discovery of parity-violating chiral polar-nematic charge density wave and superconductivity in kagome metals

Nonmagnetic kagome metals and superconductors AV3Sb5 (A = K, Rb, Cs) host unconventional charge density wave (CDW) and superconducting (SC) phases accompanied by multiple electronic symmetry breaking. Due to the centrosymmetric crystal structure, inversion symmetry has generally been assumed to hold. Here, using scanning tunneling microscopy complemented by atomic force microscopy and optical second-harmonic generation, we directly reveal that inversion symmetry in the kagome plane is spontaneously broken in the CDW state. The mixed-parity CDW state exhibits ferroelectric dipolar and nematic quadrupolar ordered moments. The coexistence and coupling between the dipole and quadrupole favor noncollinear ferro-polar and nematic alignment that breaks all mirror symmetries and gives rise to robust electronic chirality in the 3Q CDW. The multipolar coupling to in-plane electric field enables electric field control and manipulation of the chiral polar-nematic CDW state, including its chirality. Below the SC transition, we observe parity-violating pair density modulations at both the original and the CDW lattice wavevectors. Our findings of parity-violating electronic chiral multipolar order provide microscopic insights into the magnetoelectric and nonreciprocal transport, loop current order, pairing density waves, and unconventional superconductivity in kagome metals and related quantum materials.

cond-mat.supr-con↗

LayerNorm Induces Recency Bias in Transformer Decoders

Causal self-attention provides positional information to Transformer decoders. Prior work has shown that stacks of causal self-attention layers alone induce a positional bias in attention scores toward earlier tokens. However, this differs from the bias toward later tokens typically observed in Transformer decoders, known as recency bias. We address this discrepancy by analyzing the interaction between causal self-attention and other architectural components. We show that stacked causal self-attention layers combined with LayerNorm induce recency bias. Furthermore, we examine the effects of residual connections and the distribution of input token embeddings on this bias. Our results provide new theoretical insights into how positional information interacts with architectural components and suggest directions for improving positional encoding strategies.

cs.CL↗

A Metropolitan-scale Multiplexed Quantum Repeater with Bell Nonlocality

Quantum repeaters can overcome exponential photon loss in optical fibers, enabling heralded entanglement between distant quantum memories. The definitive benchmark for this entanglement is Bell nonlocality; however, recent metropolitan-scale demonstrations based on single-photon interference (SPI) schemes have been limited to generating low-quality entanglement, falling short of Bell nonlocality certification. Here, we introduce a multiplexed quantum repeater protocol based on time measurements (MQR-TM), successfully combining the high heralding rate of SPI schemes with the phase robustness of two-photon interference (TPI) schemes. This approach achieves heralded entanglement distribution between two solid-state quantum memories over a record 14.5~km separation, generating a Bell state with a fidelity of $78.6 \pm 2.0\%$. We observe a CHSH-Bell inequality violation by 3.7 standard deviations, marking the first certification of Bell nonlocality in metropolitan-scale quantum repeaters. Our architecture supports autonomous quantum node operation without fiber channel phase stabilization, offering a practical framework for scalable quantum-repeater networks.

quant-ph↗

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training

Continual pre-training on small-scale task-specific data is an effective method for improving large language models in new target fields, yet it risks catastrophic forgetting of their original capabilities. A common solution is to re-weight training data mixtures from source and target fields on a domain space to achieve balanced performance. Previous domain reweighting strategies rely on manual designation with certain heuristics based on human intuition or empirical results. In this work, we prove that more general heuristics can be parameterized by proposing Data Mixing Agent, the first model-based, end-to-end framework that learns to re-weight domains. The agent learns generalizable heuristics through reinforcement learning on large quantities of data mixing trajectories with corresponding feedback from an evaluation environment. Experiments in continual pre-training on math reasoning show that Data Mixing Agent outperforms strong baselines in achieving balanced performance across source and target field benchmarks. Furthermore, it generalizes well across unseen source fields, target models, and domain spaces without retraining. Direct application to the code generation field also indicates its adaptability across target domains. Further analysis showcases the agents' well-aligned heuristics with human intuitions and their efficiency in achieving superior model performance with less source-field data.

cs.LG↗

MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding

Vision-language models (VLMs) have achieved strong performance in multimodal understanding and reasoning, yet grounded reasoning in 3D scenes remains underexplored. Effective 3D reasoning hinges on accurate grounding: to answer open-ended queries, a model must first identify query-relevant objects and regions in a complex scene, and then reason about their spatial and geometric relationships. Recent approaches have demonstrated strong potential for grounded 3D reasoning. However, they often rely on in-domain tuning or hand-crafted reasoning pipelines, which limit their flexibility and zero-shot generalization to novel environments. In this work, we present MAG-3D, a training-free multi-agent framework for grounded 3D reasoning with off-the-shelf VLMs. Instead of relying on task-specific training or fixed reasoning procedures, MAG-3D dynamically coordinates expert agents to address the key challenges of 3D reasoning. Specifically, we propose a planning agent that decomposes the task and orchestrates the overall reasoning process, a grounding agent that performs free-form 3D grounding and relevant frame retrieval from extensive 3D scene observations, and a coding agent that conducts flexible geometric reasoning and explicit verification through executable programs. This multi-agent collaborative design enables flexible training-free 3D grounded reasoning across diverse scenes and achieves state-of-the-art performance on challenging benchmarks.

cs.CV↗

Aligned Vector Quantization for Edge-Cloud Collabrative Vision-Language Models

Vision Language Models (VLMs) are central to Visual Question Answering (VQA) systems and are typically deployed in the cloud due to their high computational demands. However, this cloud-only approach underutilizes edge computational resources and requires significant bandwidth for transmitting raw images. In this paper, we introduce an edge-cloud collaborative VQA system, called LLaVA-AlignedVQ, which features a novel Aligned Vector Quantization algorithm (AlignedVQ) that efficiently compress intermediate features without compromising accuracy to support partitioned execution. Our experiments demonstrate that LLaVA-AlignedVQ achieves approximately 1365x compression rate of intermediate features, reducing data transmission overhead by 96.8% compared to transmitting JPEG90-compressed images to the cloud. LLaVA-AlignedVQ achieves an inference speedup of 2-15x while maintaining high accuracy, remaining within -2.23% to +1.6% of the original model's accuracy performance across eight VQA datasets, compared to the cloud-only solution.

cs.CV↗

How Does Alignment Enhance LLMs' Multilingual Capabilities? A Language Neurons Perspective

Multilingual Alignment is an effective and representative paradigm to enhance LLMs' multilingual capabilities, which transfers the capabilities from the high-resource languages to the low-resource languages. Meanwhile, some research on language-specific neurons provides a new perspective to analyze and understand LLMs' mechanisms. However, we find that there are many neurons that are shared by multiple but not all languages and cannot be correctly classified. In this work, we propose a ternary classification methodology that categorizes neurons into three types, including language-specific neurons, language-related neurons, and general neurons. And we propose a corresponding identification algorithm to distinguish these different types of neurons. Furthermore, based on the distributional characteristics of different types of neurons, we divide the LLMs' internal process for multilingual inference into four parts: (1) multilingual understanding, (2) shared semantic space reasoning, (3) multilingual output space transformation, and (4) vocabulary space outputting. Additionally, we systematically analyze the models before and after alignment with a focus on different types of neurons. We also analyze the phenomenon of "Spontaneous Multilingual Alignment". Overall, our work conducts a comprehensive investigation based on different types of neurons, providing empirical results and valuable insights to better understand multilingual alignment and multilingual capabilities of LLMs.

cs.CL↗

Mean Masked Autoencoder with Flow-Mixing for Encrypted Traffic Classification

Network traffic classification using self-supervised pre-training models based on Masked Autoencoders (MAE) has demonstrated a huge potential. However, existing methods are confined to isolated byte-level reconstruction of individual flows, lacking adequate perception of the multi-granularity contextual relationship in traffic. To address this limitation, we propose Mean MAE (MMAE), a teacher-student MAE paradigm with flow mixing strategy for building encrypted traffic pre-training model. MMAE employs a self-distillation mechanism for teacher-student interaction, where the teacher provides unmasked flow-level semantic supervision to advance the student from local byte reconstruction to multi-granularity comprehension. To break the information bottleneck in individual flows, we introduce a dynamic Flow Mixing (FlowMix) strategy to replace traditional random masking mechanism. By constructing challenging cross-flow mixed samples with interferences, it compels the model to learn discriminative representations from distorted tokens. Furthermore, we design a Packet-importance aware Mask Predictor (PMP) equipped with an attention bias mechanism that leverages packet-level side-channel statistics to dynamically mask tokens with high semantic density. Numerous experiments on a number of datasets covering encrypted applications, malware, and attack traffic demonstrate that MMAE achieves state-of-the-art performance. The code is available at https://github.com/lx6c78/MMAE

cs.CR↗

LongCat-Next: Lexicalizing Modalities as Discrete Tokens

The prevailing Next-Token Prediction (NTP) paradigm has driven the success of large language models through discrete autoregressive modeling. However, contemporary multimodal systems remain language-centric, often treating non-linguistic modalities as external attachments, leading to fragmented architectures and suboptimal integration. To transcend this limitation, we introduce Discrete Native Autoregressive (DiNA), a unified framework that represents multimodal information within a shared discrete space, enabling a consistent and principled autoregressive modeling across modalities. A key innovation is the Discrete Native Any-resolution Visual Transformer (dNaViT), which performs tokenization and de-tokenization at arbitrary resolutions, transforming continuous visual signals into hierarchical discrete tokens. Building on this foundation, we develop LongCat-Next, a native multimodal model that processes text, vision, and audio under a single autoregressive objective with minimal modality-specific design. As an industrial-strength foundation model, it excels at seeing, painting, and talking within a single framework, achieving strong performance across a wide range of multimodal benchmarks. In particular, LongCat-Next addresses the long-standing performance ceiling of discrete vision modeling on understanding tasks and provides a unified approach to effectively reconcile the conflict between understanding and generation. As an attempt toward native multimodality, we open-source the LongCat-Next and its tokenizers, hoping to foster further research and development in the community. GitHub: https://github.com/meituan-longcat/LongCat-Next

cs.CV↗

Tailoring Quasi-Bound States in the Continuum for Infrared Photodetection in Black Phosphorus

High-performance infrared photodetection underpins various applications spanning surveillance, environmental monitoring, optical communications and biomedical imaging. However, conventional bulk detectors remain limited by poor spectral tunability, mechanical rigidity, and high dark currents, motivating the pursuit of low-dimensional material platforms such as graphene and transition metal dichalgenides. Black phosphorus (BP) is particularly compelling in this context, owing to its thickness-tunable direct bandgap, high carrier mobility, and pronounced in-plane anisotropy. Nevertheless, its atomically thin nature inherently restricts light absorption, posing a fundamental bottleneck for device performance. Here, we demonstrate quasi-bound states in the continuum (quasi-BICs) within a dielectric metasurface integrated with BP, enabling strongly enhanced and spectrally selective light-matter interactions. By introducing controlled symmetry breaking at the unit-cell level, high-quality-factor resonances are realized, resulting in pronounced electromagnetic field confinement within the BP layer. This resonant enhancement substantially increases photocarrier generation while preserving the intrinsic polarization anisotropy of BP, which elucidates a robust pathway for overcoming the optical absorption bottleneck in anisotropic 2D optoelectronics via quasi-BIC platforms.

physics.optics↗

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies

Automating immersive VR scene creation remains a primary research challenge. Existing methods typically rely on complex geometry with post-simplification, resulting in inefficient pipelines or limited realism. In this paper, we introduce ImmerseGen, a novel agent-guided framework for compact and photorealistic world generation that decouples realism from exhaustive geometric modeling. ImmerseGen represents scenes as hierarchical compositions of lightweight geometric proxies with synthesized RGBA textures, facilitating real-time rendering on mobile VR headsets. We propose terrain-conditioned texturing for base world generation, combined with context-aware texturing for scenery, to produce diverse and visually coherent worlds. VLM-based agents employ semantic grid-based analysis for precise asset placement and enrich scenes with multimodal enhancements such as visual dynamics and ambient sound. Experiments and real-time VR applications demonstrate that ImmerseGen achieves superior photorealism, spatial coherence, and rendering efficiency compared to existing methods.

cs.GR↗

A Survey of AI-Generated Video Evaluation

The growing capabilities of AI in generating video content have brought forward significant challenges in effectively evaluating these videos. Unlike static images or text, video content involves complex spatial and temporal dynamics which may require a more comprehensive and systematic evaluation of its contents in aspects like video presentation quality, semantic information delivery, alignment with human intentions, and the virtual-reality consistency with our physical world. This survey identifies the emerging field of AI-Generated Video Evaluation (AIGVE), highlighting the importance of assessing how well AI-generated videos align with human perception and meet specific instructions. We provide a structured analysis of existing methodologies that could be potentially used to evaluate AI-generated videos. By outlining the strengths and gaps in current approaches, we advocate for the development of more robust and nuanced evaluation frameworks that can handle the complexities of video content, which include not only the conventional metric-based evaluations, but also the current human-involved evaluations, and the future model-centered evaluations. This survey aims to establish a foundational knowledge base for both researchers from academia and practitioners from the industry, facilitating the future advancement of evaluation methods for AI-generated video content.

cs.CV↗

SUBTA: A Framework for Supported User-Guided Bimanual Teleoperation in Structured Assembly

In human-robot collaboration, shared autonomy enhances human performance through precise, intuitive support. Effective robotic assistance requires accurately inferring human intentions and understanding task structures to determine optimal support timing and methods. In this paper, we present SUBTA, a supported teleoperation system for bimanual assembly that couples learned intention estimation, scene-graph task planning, and context-dependent motion assists. We validate our approach through a user study (N=12) comparing standard teleoperation, motion-support only, and SUBTA. Linear mixed-effects analysis revealed that SUBTA significantly outperformed standard teleoperation in position accuracy (p<0.001, d=1.18) and orientation accuracy (p<0.001, d=1.75), while reducing mental demand (p=0.002, d=1.34). Post-experiment ratings indicate clearer, more trustworthy visual feedback and predictable interventions in SUBTA. The results demonstrate that SUBTA greatly improves both effectiveness and user experience in teleoperation.

cs.RO↗

Exploiting the Final Component of Generator Architectures for AI-Generated Image Detection

With the rapid proliferation of powerful image generators, accurate detection of AI-generated images has become essential for maintaining a trustworthy online environment. However, existing deepfake detectors often generalize poorly to images produced by unseen generators. Notably, despite being trained under vastly different paradigms, such as diffusion or autoregressive modeling, many modern image generators share common final architectural components that serve as the last stage for converting intermediate representations into images. Motivated by this insight, we propose to "contaminate" real images using the generator's final component and train a detector to distinguish them from the original real images. We further introduce a taxonomy based on generators' final components and categorize 21 widely used generators accordingly, enabling a comprehensive investigation of our method's generalization capability. Using only 100 samples from each of three representative categories, our detector-fine-tuned on the DINOv3 backbone-achieves an average accuracy of 98.83% across 22 testing sets from unseen generators.

cs.CV↗

Auto-Generating Personas from User Reviews in VR App Stores

Personas are a valuable tool for discussing accessibility requirements in software design and development practices. However, the use of personas for accessibility-focused requirements elicitation in VR projects remains limited and is accompanied by several challenges. To fill this gap, we developed an auto-generated persona system in a VR course, where the personas were used to facilitate discussions on accessibility requirements and to guide VR design and development. Our findings indicate that the auto-generated persona system enabled students to develop empathy more efficiently. This study demonstrates the use of automatically generated personas in VR course settings as a means of eliciting latent accessibility requirements.

cs.HC↗

Bidirectional Curriculum Generation: A Multi-Agent Framework for Data-Efficient Mathematical Reasoning

Enhancing mathematical reasoning in Large Language Models typically demands massive datasets, yet data efficiency remains a critical bottleneck. While Curriculum Learning attempts to structure this process, standard unidirectional approaches (simple-to-complex) suffer from inefficient sample utilization: they blindly escalate complexity even when foundational gaps persist, leading to wasted computation on unsolvable problems. To maximize the instructional value of every training sample, we introduce a novel Bidirectional Curriculum Generation framework. Unlike rigid trajectories, our multi-agent ecosystem mimics adaptive pedagogy to establish a closed feedback loop. It dynamically generates data by either complicating problems to challenge the model or, crucially, simplying them to repair specific reasoning failures. This mechanism ensures that the model consumes only the most effective data at any given stage. Grounded in the Optimal Pacing Theorem, our approach optimizes the learning trajectory, significantly outperforming baselines while achieving superior reasoning performance with substantially fewer instruction samples.

cs.AI↗