Search arXiv⌕ Search

arXiv subjects

Le Zhang

Publications and source records attributed to Le Zhang.

At least 37 records · Page 2Linked to original sources

EgoCITE: Context-Augmented Indexing and Time-Aware Retrieval for Long-Horizon Egocentric Memory

Long-horizon egocentric memory transforms continuous first-person video and audio into a searchable record of past experiences. We demonstrate two bottlenecks in existing systems: indices built from context-poor captions are unreliable for agentic search, while retrieval ignores a question's temporal intent. To address both bottlenecks, we introduce EgoCITE (Egocentric Context-augmented Indexing and Time-aware Evidence retrieval), a long-horizon agentic memory framework for egocentric QA. EgoCITE comprises three components. EgoScheme uses local multimodal context to turn fragmentary video captions and speech transcripts into self-contained atomic memory indices. EgoIndex organizes complementary action, activity, utterance, and conversation representations into searchable multi-view memory indices at multiple granularities. EgoRetrv combines semantic search with question-conditioned temporal relevance scoring and curation of retrieved evidence. We evaluate EgoCITE on EgoLifeQA, EgoMem, and EgoR1-Bench in terms of answer accuracy and target-event retrieval alignment. EgoCITE improves accuracy over agentic memory baselines by at least 4.4--14.2% while achieving 36$\times$ lower cost than long-context LLM agents.

cs.CV↗

LLM-Based Hierarchical Coordinated Control with Continuation-Aware Policy Learning

Coordinating multiple interacting units in complex engineering systems is challenging when system interactions are difficult to model, operational information is heterogeneous, and low-level actions must satisfy strict constraints. We propose an LLM-based hierarchical framework in which the LLM coordinates interacting units based on heterogeneous operational context, while task-specific controllers or optimizers generate executable and constraint-aware actions. We further introduce Continuation-Aware GRPO to capture the consequences of coordination decisions over subsequent control intervals. Rather than judging a decision only by its immediate outcome, the method also evaluates how the system evolves afterward under the current policy. We validate the framework on multi-ramp traffic control and virtual power plant (VPP) energy management, using simplified system models for training and more realistic simulators for evaluation. Across both tasks, the proposed method consistently outperforms direct task-specific control and optimization, end-to-end reinforcement learning, rule-based and RL-based hierarchical coordination, and prompting-only LLM coordinators, demonstrating the value of heterogeneous-context reasoning, hierarchical execution, and continuation-aware policy learning.

cs.AI↗

Improved Cosmological Constraints from Morphology-Based Marked Correlation Functions

The cosmic web contains morphology-dependent information that is not fully captured by standard two-point statistics. We construct morphology-based marked correlation functions (MCFs) by assigning marks to halos according to the cosmic-web morphology identified with the \textsc{Nexus} algorithm. Using the \textsc{Kun} simulation suite, which spans 129 $w_0w_a$CDM cosmologies, we build Gaussian-process emulators for the MCFs as functions of cosmological parameters and tracer bias. We then apply the emulators to mock halo catalogues from the independent \textsc{Jiutian} simulation and perform a joint likelihood analysis to quantify the resulting cosmological constraints. We consider two marker choices: a discrete morphology marker and a continuous morphology strength marker. The continuous marker improves the Figure of Merit (FoM) by a factor of $\sim 8.6$ relative to the standard 2PCF and reduces the $1σ$ uncertainty on $σ_8$ by a factor of $\sim 5$. The discrete marker gives a more modest FoM improvement of $\sim 17\%$. We further test the impact of tracer selection by varying the halo mass threshold by a factor of $\sim 4.5$. Even for the lowest mass threshold, the continuous marker remains unbiased and achieves a FoM about $\sim 3.4$ times higher than that of the 2PCF alone. These results show that morphology-based MCFs, combined with simulation-based emulation, provide a useful framework for extracting additional cosmological information from large-scale structure surveys.

astro-ph.CO↗

Grounding Large Language Models as Generalizable Policies in Network Control

Designing generalizable control policies that operate reliably under changing conditions is essential for robust network services in modern digital infrastructure. Yet network control remains dominated by specialized policies built from handcrafted rules or deep learning models, which struggle to generalize under real-world dynamics. Large language models (LLMs) offer a promising alternative because of their broad pretrained knowledge and emergent generalization abilities, but their practical adoption in network control is hindered by non-textual observations, constrained action spaces, complex optimization knowledge, and strict real-time requirements. Therefore, we introduce Trailblazer, a systematic framework that combines domain alignment to adapt LLMs for network control with adaptive policy collaboration to reduce inference overhead. Simulations across two heterogeneous network control tasks, adaptive bitrate streaming and cluster job scheduling, show that Trailblazer improves performance over conventional policies by 6.5%-36.6% and 3.5%-41.3%, respectively. Moreover, in a large-scale online A/B test of congestion control on Douyin, Trailblazer outperforms a highly optimized industrial policy, corresponding to a projected reduction of approximately 3,145 hours of platform-wide video stall time per day. Further analysis reveals that effective LLM-based control can be achieved by properly aligning compact LLMs and only invoking them for complex conditions, rather than model scaling or extensive invocation. Together, our results establish an LLM-driven paradigm for designing generalizable network policies and offer practical insights into grounding foundation models for real-world network control.

cs.LG↗

Decoding Phenotypes: A Framework for Fusing Genomic Language Models and Neuroimaging

Neuroimaging and genetic testing are two important clinical references for nervous system diseases, offering complementary diagnostic information. However, integrating genomic and neuroimaging data for precise disease diagnosis is challenging due to cross-modality heterogeneity. Existing imaging-genetics approaches mainly encode genetic information as hard-coded labels, which lose the local sequence context around disease-associated variants. To address this limitation, we propose GeneFuse, a multimodal learning framework that aligns genetic representations from pre-trained Genomic Language Models (GLMs) with features extracted from images. GeneFuse integrates two components: (1) Genotype-Conditioned Feature Modulation (GCFM), a FiLM-inspired module that uses genomic embeddings to modulate image feature maps; and (2) Uncertainty-aware Genomic Residual Fusion (U-GRF), a fusion strategy that uses imaging-derived predictive uncertainty to gate the contribution of genotypic features. We evaluate GeneFuse on early cognitive decline identification (NC vs. MCI) and dementia screening (NC vs. AD). In the APOE-centered setting, GeneFuse achieves AUROCs of 0.77 and 0.83, outperforming existing imaging-genetics fusion methods. These results indicate that GLM-derived genomic embeddings provide additional information to imaging.

cs.AI↗

OASIS: Occlusion-aware Single-image Hand Avatar Reconstruction via 3D Gaussian Splatting

Single-image 3D hand avatar reconstruction is fundamentally ill-posed and particularly challenging due to limited visual evidence under severe self-occlusion and the complex pose-dependent deformation of highly articulated hands. Existing methods predominantly rely on implicit NeRF-style representations, whose volumetric fitting is computationally expensive and often struggles to preserve fine-grained hand details. In this work, we present OASIS, a tailored 3D Gaussian Splatting framework for single-image hand avatar reconstruction. To faithfully encode sparse image-specific appearance cues in single-view reconstruction, we construct geometry-aligned visual evidence tokens by explicitly aligning input image observations with 3D hand geometry and context-adaptively tokenizing the resulting visual evidence. Since severe self-occlusion makes the reliability of image evidence inherently visibility-dependent, we introduce a visibility-conditioned point-image attention to reliably transfer visual evidence to geometric tokens, yielding occlusion-aware Gaussian features for faithful and robust reconstruction. To further capture non-rigid deformation of articulated hands, we introduce a Feature-on-Mesh representation to enable Gaussian deformation to be guided by local surface stretching. Under this framework, we adopt a one-shot adaptation scheme that learns a shared hand prior from multi-identity training data and then fits it to a target image for target-specific reconstruction. Extensive experiments show that OASIS outperforms existing baselines in both visual fidelity and efficiency across challenging poses and in-the-wild scenarios, and further demonstrates strong versatility in downstream applications such as text-to-avatar generation and texture editing.

cs.CV↗

KuaiLive-M3: A Multi-Modal, Multi-Domain, and Multi-Feedback Dataset for Live Streaming Recommendation

Existing public live streaming datasets suffer from three major limitations: they provide limited access to temporally evolving multimodal live content, overlook users' cross-domain interactions between short videos and live streams, and contain only implicit behavioral signals without explicit feedback that captures users' perceived content quality and satisfaction. These limitations prevent existing benchmarks from faithfully reflecting real-world live streaming scenarios and hinder comprehensive research on live streaming recommendation. To address these limitations, we introduce KuaiLive-M3, a multi-modal, multi-domain, and multi-feedback dataset for live streaming recommendation, collected from Kuaishou, a leading live streaming and short video platform in China. KuaiLive-M3 covers 21,938 users and contains 35 million live streaming interactions and 111 million short video interactions, with fine-grained timestamps and diverse user behaviors. It further provides approximately 88 million timestamped segment-level multi-modal embeddings that capture the temporal evolution of live streaming content, as well as 25,403 questionnaire-based feedback records that bridge implicit user behaviors and explicit user preferences. Based on these unique signals, we establish benchmarks for cross-domain recommendation, live stream highlight prediction, and questionnaire-enhanced recommendation. Extensive experiments with representative baselines demonstrate that KuaiLive-M3 provides a challenging and realistic benchmark for future live streaming recommendation research. The results further highlight the importance of modeling temporally evolving content, transferring user preferences across domains, and bridging the gap between implicit behaviors and explicit user feedback. The dataset and benchmark code are publicly available at https://imgkkk574.github.io/KuaiLive-M3/.

cs.IR↗

Rarity-Aware Discrete Diffusion with Spatially Consistent Decoding for Photo-Realistic Image Super-Resolution

Continuous diffusion models have become the dominant paradigm for photo-realistic image Super-Resolution (SR), but they typically formulate reconstruction as continuous signal-level denoising and incorporate semantic priors through external conditioning modules. This makes it less direct to exploit the unified token-based scaling paradigm of modern multimodal models. Autoregressive models provide a more native semantic representation by modeling images as discrete visual tokens, yet their causal decoding is inefficient for high-resolution reconstruction. Discrete diffusion offers a promising middle ground by enabling non-causal, parallel prediction over visual tokens. However, directly adapting discrete diffusion to SR remains non-trivial due to two task-specific challenges: (1) the long-tailed distribution of visual tokens, which under-represents rare but perceptually critical textures; and (2) spatially inconsistent parallel decoding, which may introduce isolated artifacts. To address these issues, we propose DiMOO-SR, a rarity-aware multimodal discrete diffusion framework for photo-realistic image SR. During training, Inverse Frequency Sampling (IFS) prioritizes under-represented but information-rich tokens. During inference, Spatial Consistency Ranking (SCR) refines token confidence using local neighborhood agreement to improve structural coherence. Extensive experiments on widely used real-world SR benchmarks demonstrate that DiMOO-SR achieves competitive perceptual quality with only a few parallel decoding steps, highlighting the potential of discrete diffusion for generative image super-resolution. The code will be released upon publication.

cs.CV↗

MedDiT4SR: Tri-Stream Joint Adaptation of Pre-Trained Diffusion Transformers for Medical Image Super-Resolution

Medical image super-resolution (MedSR) requires recovering fine anatomical structures from degraded observations while avoiding unsupported details introduced by generative priors. Large-scale pre-trained multimodal diffusion transformers provide strong visual priors, but their adaptation to MedSR remains non-trivial. In conventional ControlNet-style adaptation, the low-resolution (LR) image is processed as an external condition and injected into the denoising stream through one-way connections. Consequently, LR anatomical evidence cannot be jointly updated with the evolving denoising and semantic representations. We propose MedDiT4SR, a tri-stream adaptation framework that integrates the LR, noisy latent, and text representations into the same multimodal diffusion-transformer blocks. To complement global token interaction, we introduce a Super-Resolution Adapter (SR Adapter) that aggregates scale-dependent local tokens and suppresses interpolation-induced redundancy. We further propose a Semantic Alignment Refiner (SA Refiner) that calibrates local LR responses using prompt-conditioned semantic information. Experiments under both in-domain and within-modality cross-dataset settings demonstrate the effectiveness of adapting large-scale pre-trained DiT models to medical image super-resolution across diverse imaging domains.

eess.IV↗

Layer-engineered quantum anomalous Hall effect in twisted rhombohedral graphene

Realizing programmable topological states in quantum anomalous Hall (QAH) insulators requires the ability to design and dynamically tune their topological invariant, the Chern number C. Here, we report a designer QAH platform based on twisted rhombohedral graphene family, in which C becomes a programmable and electrically tunable degree of freedom. By engineering the layer configuration in twisted monolayer-rhombohedral N-layer graphene, denoted as (1+N)L, we realize QAH states with C=N at moire filling v=1, where the layer number N=3,4,5 directly sets the Chern number. Beyond such static layer programming, we demonstrate in-situ electrical control. In a twisted monolayer-trilayer device, the sign of C (chirality) can be switched by electrostatic doping or displacement field. Most strikingly, in twisted Bernal bilayer-rhombohedral tetralayer graphene denoted as (2+4)L, we drive a displacement-field-induced topological phase transition between two distinct QAH states with C=3 and C=4 in a single device. Our work establishes a layer-engineered and electrically tunable platform that transitions topological quantum matter from discovery to design, opening the way toward on-demand engineering of correlated topological states and reconfigurable topological electronics.

cond-mat.mes-hall↗

Foreground Characterization and Mitigation in the Observations of the CD/EoR with the SKA

The Square Kilometre Array (SKA), with its unprecedented sensitivity, frequency coverage, and large collecting area, is poised to revolutionize our understanding of the Cosmic Dawn (CD) and Epoch of Reionization (EoR) epochs marking the formation of the first luminous sources and the subsequent reionization of the intergalactic medium (IGM). However, detecting the faint redshifted 21-cm signal from neutral hydrogen remains one of the foremost challenges in observational cosmology, as it is buried beneath bright foregrounds from Galactic synchrotron radiation, free-free emission, and extragalactic point sources that are 4-5 orders of magnitude stronger than the cosmological signal. In this chapter, we highlight the key components and characteristics of these foregrounds and review ongoing efforts to model, characterize, and mitigate them. We emphasize how the SKA-Low AA* configuration, through its optimized array design, wide field of view, and improved calibration accuracy, enhances our capacity to suppress foreground contamination and recover the cosmological signal. The SKA Observatory Foreground Challenge plays a pivotal role in this effort by bringing together the global EoR/CD community to develop, compare, and validate foreground removal pipelines using realistic simulated datasets. Building on the experience of existing pathfinders such as LOFAR, MWA, and HERA, these collaborative initiatives are helping refine statistical and machine learning-based approaches for signal recovery. Together, these advancements are laying the groundwork for the SKA to probe the thermal and ionization history of the early Universe with unprecedented precision.

astro-ph.CO↗

MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis

Self-supervised learning (SSL) and diffusion models have respectively advanced representation learning and generative modeling for high-dimensional 3D visual data, yet they are often developed as separate paradigms. Their unification remains challenging under multi-source heterogeneity, as anatomical content must be preserved for analysis while acquisition-related style varies across centers and affects synthesis. In this paper, we propose MeDUET, a 3D Medical image Disentangled UnifiEd PreTraining framework in the variational autoencoder latent space. MeDUET formulates unified pretraining as an empirical factor identifiability problem, aiming to learn domain-invariant content factors for anatomy and domain-specific style factors for appearance. To improve factor separation, MeDUET first uses token demixing with a standard adversarial domain regularizer to establish basic content-style specialization, and further introduces Mixed Factor Token Distillation and Swap-invariance Quadruplet Contrast to reduce mixed-region factor leakage and organize factor spaces with factor-wise invariance and discriminability. With these learned factors, MeDUET transfers effectively to both synthesis and analysis, yielding higher fidelity, faster convergence, and better controllability for synthesis, while achieving competitive or superior domain generalization and label efficiency on diverse datasets, tasks, and modalities. Overall, MeDUET shows that multi-source heterogeneity can serve as useful supervision, with disentanglement providing an effective interface for unifying 3D medical image synthesis and analysis. Our code is available at https://github.com/JK-Liu7/MeDUET.

eess.IV↗

A Comprehensive Survey on World Models for Embodied AI

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support perception, prediction, and decision making. This survey presents a unified framework for world models in embodied AI. Specifically, we formalize the problem setting and learning objectives, and propose a three-axis taxonomy encompassing: (1) Functionality, Decision-Coupled vs. General-Purpose; (2) Temporal Modeling, Sequential Simulation and Inference vs. Global Difference Prediction; (3) Spatial Representation, Global Latent Vector, Token Feature Sequence, Spatial Latent Grid, and Decomposed Rendering Representation. We systematize data resources and metrics across robotics, autonomous driving, and general video settings, covering pixel prediction quality, state-level understanding, and task performance. Furthermore, we offer a quantitative comparison of state-of-the-art models and distill key open challenges, including the scarcity of unified datasets and the need for evaluation metrics that assess physical consistency over pixel fidelity, the trade-off between model performance and the computational efficiency required for real-time control, and the core modeling difficulty of achieving long-horizon temporal consistency while mitigating error accumulation. Finally, we maintain a curated bibliography at https://github.com/Li-Zn-H/AwesomeWorldModels.

cs.CV↗

A Non-Negativity Iterative Approach to Image Deconvolution for SKA

We introduce a novel algorithm for image deconvolution applicable to interferometric radio observations, based on the assumption of non-negative source fluxes. The method enables rapid and efficient image reconstruction in an iterative manner, without requiring prior knowledge or training. Its computational cost scales linearly with the number of pixels: for example, a $512\times 512$ image can be processed in about 1-2 seconds on a standard laptop. We validate the algorithm using both point sources and an extended galaxy image, incorporating a realistic SKA-Low PSF with incomplete $uv$-coverage, though tests are conducted in noise-free simulations. Comparison with the CLEAN method demonstrates that our approach yields a good reconstruction, showing particular promise for the SKA and VLBI observations with sparse $uv$-coverage.

astro-ph.IM↗

Deep learning with hybrid frequency differencing and principal component analysis for 21-cm foreground and beam mitigation

Twenty-one-centimeter intensity mapping is a powerful probe of the large-scale distribution of neutral hydrogen (HI) and cosmological observables such as baryon acoustic oscillations. A major challenge is contamination from bright foregrounds and frequency-dependent beam effects, which can lead to signal loss in traditional methods such as principal component analysis (PCA). We develop a hybrid approach that trains a U-shaped convolutional neural network (UNet) on two input channels derived from frequency differencing (FD) and PCA cleaning, enabling it to exploit their complementary behavior across different scales. This two-channel strategy achieves improved performance, maintaining the cross-correlation power spectrum close to unity on large scales under a cosine beam and improving by 5\%-8\% relative to either FD- or PCA-based UNet alone. We further show that the method can robustly recover the HI signal even when the beam model is imperfect and differs between training and testing, with the large-scale cross-correlation remaining close to unity within the $1σ$ level. These results demonstrate that the proposed approach provides a robust framework for HI signal reconstruction under realistic observational conditions.

astro-ph.CO↗

Heavy fermion phase diagram in magic-angle twisted trilayer graphene

The interplay between localized magnetic moments and itinerant electrons gives rise to exotic quantum states in condensed matter systems. Here, we demonstrate an electrically tunable heavy fermion phase diagram in magic-angle twisted trilayer graphene, achieved by controlling the Kondo hybridization between localized flat-band electrons and itinerant Dirac electrons via a displacement field. Our results reveal a continuous quantum phase transition from an antiferromagnetic semimetal to a paramagnetic heavy fermion metal. At quantum critical point, we observe effective mass divergence and Fermi surface reconstruction. This highly tunable platform offers unprecedented control over heavy fermion physics, establishing moire heterostructures as a versatile arena for exploring correlated quantum phases-including potential unconventional superconductivity-in two-dimensional limit.

cond-mat.mes-hall↗

HiMatch-AD: DINOv3-driven Hierarchical Matching for Training-free Medical Anomaly Detection

Anomaly detection is essential for medical image analysis, where pathological regions often appear as rare deviations from normal anatomical structures. While training-based methods have achieved promising performance, they require task-specific optimization and extensive normal data, which limits scalability across modalities and institutions. Training-free approaches offer greater flexibility by leveraging pretrained visual representations, yet existing methods typically rely on simple nearest-neighbor retrieval and naive aggregation strategies, which may fail to capture hierarchical semantics and ignore the reliability of multiple anomaly responses. In this work, we propose HiMatch-AD, a DINOv3-driven hierarchical matching framework for training-free medical anomaly detection. Our method first retrieves semantically relevant normal references via dual-branch matching that jointly considers global CLS-token similarity and patch-level representations. Hierarchical anomaly maps are then generated across multiple transformer stages by comparing clustered normal features with query representations. To robustly aggregate anomaly responses, we introduce a unified uncertainty-based fusion mechanism that adaptively weights maps according to their reliability. The entire framework operates without any task-specific training. Extensive experiments on the BMAD benchmark, including brain MRI, liver CT, and retinal OCT datasets, demonstrate that HiMatch-AD consistently outperforms both training-based and DINO-based state-of-the-art methods, which highlights the effectiveness of multi-level matching and uncertainty-aware fusion for scalable medical anomaly detection.

cs.CV↗

Unlocking LLM Code Correction with Iterative Feedback Loops

Large Language Models have shown remarkable capabilities in code generation. However, most existing evaluations focus only on single-attempt accuracy and overlook the iterative refinement process that is central to real-world programming. This study presents a systematic investigation of LLMs' ability to rectify their own code through execution feedback. Using real-world programming problems across four models and two major programming languages, this study evaluates performance using iterative refinement framework where LLMs receive compiler error messages and testcase feedback after each attempt. This study introduces metrics to evaluate code failures, analyze rectification patterns, and compare the effectiveness of reasoning and non-reasoning models, offering actionable insights into both the understanding and practical application of feedback loops in LLM-driven code generation systems. Results show that reasoning models consistently improve over iterations, substantially outperforming non-reasoning models in leveraging feedback, while syntactic and runtime errors are far more tractable than logical or algorithmic failures.

cs.SE↗