arXiv subjects

Xiaoyu Wang

Publications and source records attributed to Xiaoyu Wang.

At least 109 records · Page 6Linked to original sources

arXiv2025

A Foundation Model for Material Fracture Prediction

Accurately predicting when and how materials fail is critical to designing safe, reliable structures, mechanical systems, and engineered components that operate under stress. Yet, fracture behavior remains difficult to model across the diversity of materials, geometries, and loading conditions in real-world applications. While machine learning (ML) methods show promise, most models are trained on narrow datasets, lack robustness, and struggle to generalize. Meanwhile, physics-based simulators offer high-fidelity predictions but are fragmented across specialized methods and require substantial high-performance computing resources to explore the input space. To address these limitations, we present a data-driven foundation model for fracture prediction, a transformer-based architecture that operates across simulators, a wide range of materials (including plastic-bonded explosives, steel, aluminum, shale, and tungsten), and diverse loading conditions. The model supports both structured and unstructured meshes, combining them with large language model embeddings of textual input decks specifying material properties, boundary conditions, and solver settings. This multimodal input design enables flexible adaptation across simulation scenarios without changes to the model architecture. The trained model can be fine-tuned with minimal data on diverse downstream tasks, including time-to-failure estimation, modeling fracture evolution, and adapting to combined finite-discrete element method simulations. It also generalizes to unseen materials such as titanium and concrete, requiring as few as a single sample, dramatically reducing data needs compared to standard ML. Our results show that fracture prediction can be unified under a single model architecture, offering a scalable, extensible alternative to simulator-specific workflows.

cs.LG↗

arXiv2025

A universal augmentation framework for long-range electrostatics in machine learning interatomic potentials

Most current machine learning interatomic potentials (MLIPs) rely on short-range approximations, without explicit treatment of long-range electrostatics. To address this, we recently developed the Latent Ewald Summation (LES) method, which infers electrostatic interactions, polarization, and Born effective charges (BECs), just by learning from energy and force training data. Here, we present LES as a standalone library, compatible with any short-range MLIP, and demonstrate its integration with methods such as MACE, NequIP, CACE, and CHGNet. We benchmark LES-enhanced models on distinct systems, including bulk water, polar dipeptides, and gold dimer adsorption on defective substrates, and show that LES not only captures correct electrostatics but also improves accuracy. Additionally, we scale LES to large and chemically diverse data by training MACELES-OFF on the SPICE set containing molecules and clusters, making a universal MLIP with electrostatics for organic systems including biomolecules. MACELES-OFF is more accurate than its short-range counterpart (MACE-OFF) trained on the same dataset, predicts dipoles and BECs reliably, and has better descriptions of bulk liquids. By enabling efficient long-range electrostatics without directly training on electrical properties, LES paves the way for electrostatic foundation MLIPs.

physics.chem-ph↗

arXiv2025

Extended Fractional Chern Insulators Near Half Flux in Twisted Bilayer Graphene Above the Magic Angle

Fractional Chern insulators (FCIs) -- the lattice analog of fractional quantum Hall states -- form as fractionalized quasiparticles emerge in a partially-filled Chern band. This fractionalization is driven by the interplay of electronic interaction and quantum geometry of the underlying wavefunctions. Bilayer graphene with an interlayer twist near the magic angle of 1.1\textdegree\ hosts diverse correlated electronic states at zero magnetic field. When the twist angle exceeds 1.3\textdegree, the electronic bandwidth is sufficient to suppress the zero-field correlated states. Yet applying a magnetic field can restore the importance of electron-electron interactions. Here, we report strongly-correlated phases when a 1.37\textdegree\ twisted bilayer graphene sample is tuned to near half a magnetic flux quantum per moiré cell, deep into the Hofstadter regime. Most notably, well-quantized odd-denominator FCI states appear in multiple Hofstadter subbands over unusually large ranges of density. We also observe a bending and resetting of the Landau minifan reminiscent of behavior commonly seen in magic-angle samples near integer filling at low magnetic field.

cond-mat.mes-hall↗

arXiv2025

4KAgent: Agentic Any Image to 4K Super-Resolution

We present 4KAgent, a unified agentic super-resolution generalist system designed to universally upscale any image to 4K resolution (and even higher, if applied iteratively). Our system can transform images from extremely low resolutions with severe degradations, for example, highly distorted inputs at 256x256, into crystal-clear, photorealistic 4K outputs. 4KAgent comprises three core components: (1) Profiling, a module that customizes the 4KAgent pipeline based on bespoke use cases; (2) A Perception Agent, which leverages vision-language models alongside image quality assessment experts to analyze the input image and make a tailored restoration plan; and (3) A Restoration Agent, which executes the plan, following a recursive execution-reflection paradigm, guided by a quality-driven mixture-of-expert policy to select the optimal output for each step. Additionally, 4KAgent embeds a specialized face restoration pipeline, significantly enhancing facial details in portrait and selfie photos. We rigorously evaluate our 4KAgent across 11 distinct task categories encompassing a total of 26 diverse benchmarks, setting new state-of-the-art on a broad spectrum of imaging domains. Our evaluations cover natural images, portrait photos, AI-generated content, satellite imagery, fluorescence microscopy, and medical imaging like fundoscopy, ultrasound, and X-ray, demonstrating superior performance in terms of both perceptual (e.g., NIQE, MUSIQ) and fidelity (e.g., PSNR) metrics. By establishing a novel agentic paradigm for low-level vision tasks, we aim to catalyze broader interest and innovation within vision-centric autonomous agents across diverse research communities. We will release all the code, models, and results at: https://4kagent.github.io.

cs.CV↗

arXiv2025

Collaborative Perception Datasets for Autonomous Driving: A Review

Collaborative perception has attracted growing interest from academia and industry due to its potential to enhance perception accuracy, safety, and robustness in autonomous driving through multi-agent information fusion. With the advancement of Vehicle-to-Everything (V2X) communication, numerous collaborative perception datasets have emerged, varying in cooperation paradigms, sensor configurations, data sources, and application scenarios. However, the absence of systematic summarization and comparative analysis hinders effective resource utilization and standardization of model evaluation. As the first comprehensive review focused on collaborative perception datasets, this work reviews and compares existing resources from a multi-dimensional perspective. We categorize datasets based on cooperation paradigms, examine their data sources and scenarios, and analyze sensor modalities and supported tasks. A detailed comparative analysis is conducted across multiple dimensions. We also outline key challenges and future directions, including dataset scalability, diversity, domain adaptation, standardization, privacy, and the integration of large language models. To support ongoing research, we provide a continuously updated online repository of collaborative perception datasets and related literature: https://github.com/frankwnb/Collaborative-Perception-Datasets-for-Autonomous-Driving.

cs.CV↗

arXiv2025

Multi-Party Supervised Fine-tuning of Language Models for Multi-Party Dialogue Generation

Large Language Models (LLM) are usually fine-tuned to participate in dyadic or two-party dialogues, which can not adapt well to multi-party dialogues (MPD), which hinders their applications in such scenarios including multi-personal meetings, discussions and daily communication. Previous LLM-based researches mainly focus on the multi-agent framework, while their base LLMs are still pairwisely fine-tuned. In this work, we design a multi-party fine-tuning framework (MuPaS) for LLMs on the multi-party dialogue datasets, and prove such a straightforward framework can let the LLM align with the multi-party conversation style efficiently and effectively. We also design two training strategies which can convert MuPaS into the MPD simulator. Substantial experiments show that MuPaS can achieve state-of-the-art multi-party response, higher accuracy of the-next-speaker prediction, higher human and automatic evaluated utterance qualities, and can even generate reasonably with out-of-distribution scene, topic and role descriptions. The MuPaS framework bridges the LLM training with more complicated multi-party applications, such as conversation generation, virtual rehearsal or meta-universe.

cs.CL↗

arXiv2025

Reflect-then-Plan: Offline Model-Based Planning through a Doubly Bayesian Lens

Offline reinforcement learning (RL) is crucial when online exploration is costly or unsafe but often struggles with high epistemic uncertainty due to limited data. Existing methods rely on fixed conservative policies, restricting adaptivity and generalization. To address this, we propose Reflect-then-Plan (RefPlan), a novel doubly Bayesian offline model-based (MB) planning approach. RefPlan unifies uncertainty modeling and MB planning by recasting planning as Bayesian posterior estimation. At deployment, it updates a belief over environment dynamics using real-time observations, incorporating uncertainty into MB planning via marginalization. Empirical results on standard benchmarks show that RefPlan significantly improves the performance of conservative offline RL policies. In particular, RefPlan maintains robust performance under high epistemic uncertainty and limited data, while demonstrating resilience to changing environment dynamics, improving the flexibility, generalizability, and robustness of offline-learned policies.

cs.AI↗

arXiv2025

Observation of giant nonlinear Hall conductivity in Bernal bilayer graphene

In a system of two-dimensional electrons, a combination of broken symmetry, interactions, and nontrivial topology can conspire to give rise to a nonlinear transport regime, where electric current density scales as the square of electric field. This regime has become a venue for exciting discoveries such as the nonlinear Hall effect and diode-like nonreciprocal transport. However, interpretation of experimental data is challenging in the nonlinear regime as DC transport is described by a rank-3 conductivity tensor with 6 free parameters. Here, we resolve this challenge by analytically solving for the nonlinear potential distribution across the disk sample for an arbitrary linear and nonlinear conductivity tensors. This allows us to unambiguously extract all components of the nonlinear tensor from experimental measurement. Using this novel tool, we identify giant nonlinear Hall effect in Bernal bilayer graphene. Our methodology provides the first systematic framework for interpreting nonlinear transport and uncovers a new route towards understanding quasi-2D materials.

cond-mat.mes-hall↗

arXiv2025

DenseLoRA: Dense Low-Rank Adaptation of Large Language Models

Low-rank adaptation (LoRA) has been developed as an efficient approach for adapting large language models (LLMs) by fine-tuning two low-rank matrices, thereby reducing the number of trainable parameters. However, prior research indicates that many of the weights in these matrices are redundant, leading to inefficiencies in parameter utilization. To address this limitation, we introduce Dense Low-Rank Adaptation (DenseLoRA), a novel approach that enhances parameter efficiency while achieving superior performance compared to LoRA. DenseLoRA builds upon the concept of representation fine-tuning, incorporating a single Encoder-Decoder to refine and compress hidden representations across all adaptation layers before applying adaptation. Instead of relying on two redundant low-rank matrices as in LoRA, DenseLoRA adapts LLMs through a dense low-rank matrix, improving parameter utilization and adaptation efficiency. We evaluate DenseLoRA on various benchmarks, showing that it achieves 83.8% accuracy with only 0.01% of trainable parameters, compared to LoRA's 80.8% accuracy with 0.70% of trainable parameters on LLaMA3-8B. Additionally, we conduct extensive experiments to systematically assess the impact of DenseLoRA's components on overall model performance. Code is available at https://github.com/mulin-ahu/DenseLoRA.

cs.CL↗

arXiv2025

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting

Bilevel optimization has shown its utility across various machine learning settings, yet most algorithms in practice require second-order information, making it challenging to scale them up. Only recently, a paradigm of first-order algorithms has emerged in the theoretical literature, capable of effectively addressing bilevel optimization problems. Nevertheless, the practical efficiency of this paradigm remains unverified, particularly in the context of large language models (LLMs). This paper introduces the first scalable instantiation of this paradigm called ScaleBiO, focusing on bilevel optimization for large-scale LLM data reweighting. By combining with a recently proposed memory-efficient training technique called LISA, our novel algorithm allows the paradigm to scale to $\sim$30B-sized LLMs on $8\times$H100 GPUs, marking the first successful application of bilevel optimization under practical scenarios for large-sized LLMs. Empirically, extensive experiments on data reweighting verify the effectiveness of ScaleBiO for different-scaled models, including Llama-3-8B, Gemma-2-9B, Qwen-2-7B, and Qwen-2.5-32B, where bilevel optimization succeeds in instruction-following and math reasoning tasks, outperforming several popular baselines, including uniform sampling, influence-aware data filtering, and reference-model-based sampling methods. Theoretically, ScaleBiO ensures the optimality of the learned data weights, along with a convergence guarantee matching the conventional first-order bilevel optimization paradigm on smooth and strongly convex objectives.

cs.LG↗

arXiv2025

Discontinuous hybrid neural networks for the one-dimensional partial differential equations

A feedforward neural network, including hidden layers, motivated by nonlinear functions (such as Tanh, ReLU, and Sigmoid functions), exhibits uniform approximation properties in Sobolev space, and discontinuous neural networks can reduce computational complexity. In this work, we present a discontinuous hybrid neural network method for solving the partial differential equations, construct a new hybrid loss functional that incorporates the variational of the approximation equation, interface jump stencil and boundary constraints. The RMSprop algorithm and discontinuous Galerkin method are employed to update the nonlinear parameters and linear parameters in neural networks, respectively. This approach guarantees the convergence of the loss functional and provides an approximate solution with high accuracy.

math.NA↗

arXiv2025

Beam single spin asymmetry $A_{LU}^{\sin ϕ_R}$ of the dihadron production in SIDIS process

We study the longitudinal beam single-spin asymmetry $A_{LU}^{\sin ϕ_R}$ of dihadron production in semi-inclusive deep inelastic scattering process with a polarized electron beam scattering off an unpolarized proton target. The asymmetry arises from the convolutions of twist-3 PDF $e(x)$ and twist-2 DiFF $H_1^\sphericalangle$ as well as twist-2 PDF $f_1(x)$ and twist-3 DiFF $\widetilde{G}^{\sphericalangle}$. Using the spectator model calculations for the twist-3 PDF $e(x)$, the DiFFs $D_1 , H_1^\sphericalangle$, and $\widetilde{G}^{\sphericalangle}$, we estimate the BSA $A^{\sin ϕ_R}_{LU}$ at the kinematical configuration of CLAS and CLAS12. We find good agreement with $z$- and $M_h$-dependencies data, though $x$- and $Q^2$- dependencies show discrepancies. We include DGLAP evolution of $e(x)$ and provide predictions for COMPASS, EIC, and EicC. The negligible contribution from $f_1(x) \otimes \widetilde{G}^{\sphericalangle}$ supports the Wandzura-Wilczek approximation, while our results highlight the importance of QCD evolution in twist-3 PDF analyses.

hep-ph↗

arXiv2025

Probing orbital magnetism of a kagome metal CsV3Sb5 by a tuning fork resonator

The recently discovered kagome metal CsV$_3$Sb$_5$ exhibits a complex phase diagram that encompasses frustrated magnetism, topological charge density wave (CDW), and superconductivity. One CDW state that breaks time-reversal symmetry was proposed in this compound, while the exact nature of the putative magnetic state remains elusive. To examine the thermodynamic state of CsV$_3$Sb$_5$ and assess the character of the associated magnetism, we conducted tuning fork resonator measurements of magnetotropic susceptibility over a broad range of angles, magnetic fields, and temperature. We found a cascade of phase transition in the CDW phase. Of particular interest is a highly anisotropic magnetic structure that arises below about 30~K, with a magnetic moment along the $c$-axis that has an extremely small magnitude. This magnetic state demonstrates extremely slow dynamics and small saturate field, all suggest that electronic phase below 30~K breaks time reversal symmetry and has an unconventional origin.

cond-mat.mtrl-sci↗

arXiv2025

Lab-AI: Using Retrieval Augmentation to Enhance Language Models for Personalized Lab Test Interpretation in Clinical Medicine

Accurate interpretation of lab results is crucial in clinical medicine, yet most patient portals use universal normal ranges, ignoring conditional factors like age and gender. This study introduces Lab-AI, an interactive system that offers personalized normal ranges using retrieval-augmented generation (RAG) from credible health sources. Lab-AI has two modules: factor retrieval and normal range retrieval. We tested these on 122 lab tests: 40 with conditional factors and 82 without. For tests with factors, normal ranges depend on patient-specific information. Our results show GPT-4-turbo with RAG achieved a 0.948 F1 score for factor retrieval and 0.995 accuracy for normal range retrieval. GPT-4-turbo with RAG outperformed the best non-RAG system by 33.5% in factor retrieval and showed 132% and 100% improvements in question-level and lab-level performance, respectively, for normal range retrieval. These findings highlight Lab-AI's potential to enhance patient understanding of lab results.

cs.CL↗

arXiv2025

Infinitely many solutions for a biharmonic-Kirchhoff system on locally finite graphs

The study on the partial differential equations (systems) in the graph setting is a hot topic in recent years because of their applications to image processing and data clustering. Our motivation is to develop some existence results for biharmonic-Kirchhoff systems and biharmonic systems in the Euclidean setting, which are the continuous models, to the corresponding systems in the locally finite graph setting, which are the discrete models. We mainly focus on the existence of infinitely many solutions for a biharmonic-Kirchhoff system on a locally finite graph. The method is variational and the main tool is the symmetric mountain pass theorem. We obtain that the system has infinitely many solutions when the nonlinear term admits the super-$4$ linear growth, and we also present the corresponding results to the biharmonic system. We also find that the results in the locally finite graph setting are better than that in the Euclidean setting, which caused by the better embedding theorem in the locally finite graph.

math.AP↗

arXiv2025

Non-Reversible Langevin Algorithms for Constrained Sampling

We consider the constrained sampling problem where the goal is to sample from a target distribution on a constrained domain. We propose skew-reflected non-reversible Langevin dynamics (SRNLD), a continuous-time stochastic differential equation with skew-reflected boundary. We obtain non-asymptotic convergence rate of SRNLD to the target distribution in both total variation and 1-Wasserstein distances. By breaking reversibility, we show that the convergence is faster than the special case of the reversible dynamics. Based on the discretization of SRNLD, we propose skew-reflected non-reversible Langevin Monte Carlo (SRNLMC), and obtain non-asymptotic discretization error from SRNLD, and convergence guarantees to the target distribution in 1-Wasserstein distance. We show better performance guarantees than the projected Langevin Monte Carlo in the literature that is based on the reversible dynamics. Numerical experiments are provided for both synthetic and real datasets to show efficiency of the proposed algorithms.

cs.LG↗

arXiv2025

Large Language Model Can Be a Foundation for Hidden Rationale-Based Retrieval

Despite the recent advancement in Retrieval-Augmented Generation (RAG) systems, most retrieval methodologies are often developed for factual retrieval, which assumes query and positive documents are semantically similar. In this paper, we instead propose and study a more challenging type of retrieval task, called hidden rationale retrieval, in which query and document are not similar but can be inferred by reasoning chains, logic relationships, or empirical experiences. To address such problems, an instruction-tuned Large language model (LLM) with a cross-encoder architecture could be a reasonable choice. To further strengthen pioneering LLM-based retrievers, we design a special instruction that transforms the retrieval task into a generative task by prompting LLM to answer a binary-choice question. The model can be fine-tuned with direct preference optimization (DPO). The framework is also optimized for computational efficiency with no performance degradation. We name this retrieval framework by RaHoRe and verify its zero-shot and fine-tuned performance superiority on Emotional Support Conversation (ESC), compared with previous retrieval works. Our study suggests the potential to employ LLM as a foundation for a wider scope of retrieval tasks. Our codes, models, and datasets are available on https://github.com/flyfree5/LaHoRe.

cs.IR↗

arXiv2025

Signaling Human Intentions to Service Robots: Understanding the Use of Social Cues during In-Person Conversations

As social service robots become commonplace, it is essential for them to effectively interpret human signals, such as verbal, gesture, and eye gaze, when people need to focus on their primary tasks to minimize interruptions and distractions. Toward such a socially acceptable Human-Robot Interaction, we conducted a study ($N=24$) in an AR-simulated context of a coffee chat. Participants elicited social cues to signal intentions to an anthropomorphic, zoomorphic, grounded technical, or aerial technical robot waiter when they were speakers or listeners. Our findings reveal common patterns of social cues over intentions, the effects of robot morphology on social cue position and conversational role on social cue complexity, and users' rationale in choosing social cues. We offer insights into understanding social cues concerning perceptions of robots, cognitive load, and social context. Additionally, we discuss design considerations on approaching, social cue recognition, and response strategies for future service robots.

cs.HC↗