Search arXiv⌕ Search

arXiv subjects

Ming Lu

Publications and source records attributed to Ming Lu.

At least 55 records · Page 3Linked to original sources

Dual canonical bases of quantum groups and $\imath$quantum groups II: geometry

The $\imath$quantum groups admit two realizations: one via the $\imath$Hall algebras and the other via the quantum Grothendieck rings of quiver varieties, as developed by the first author and Wang. Based on these two realizations, we establish the dual canonical bases for $\imath$quantum groups of type ADE in two distinct ways, using perverse sheaves and Hall algebras respectively. In this paper, we prove that these two dual canonical bases coincide, thereby proving their invariance under braid group actions, and that their structural constants are integral and positive. Furthermore, we establish the positivity of the coefficients of the transition matrix from the Hall basis (and PBW basis) to the dual canonical basis.

math.QA↗

MC-LLaVA: Multi-Concept Personalized Vision-Language Model

Current vision-language models (VLMs) show exceptional abilities across diverse tasks, such as visual question answering. To enhance user experience, recent studies have investigated VLM personalization to understand user-provided concepts. However, they mainly focus on single concepts, neglecting the existence and interplay of multiple concepts, which limits real-world applicability. This paper proposes MC-LLaVA, a multi-concept personalization paradigm. Specifically, MC-LLaVA employs a multi-concept instruction tuning strategy, effectively integrating multiple concepts in a single training step. To reduce the training costs, we propose a personalized textual prompt that uses visual token information to initialize concept tokens. Additionally, we introduce a personalized visual prompt during inference, aggregating location maps for enhanced recognition and grounding capabilities. To further push the performance upper bound, we incorporate an optional auxiliary loss, better enhancing the proposed personalized prompts. To decorate the VLM personalization research, we contribute a high-quality dataset. We carefully collect images with multiple characters and objects from movies and manually create question-answer samples for multi-concept scenarios, featuring superior diversity. Comprehensive experiments demonstrate that MC-LLaVA achieves impressive multi-concept personalized responses, paving the way for VLMs to become better user assistants. The code and dataset will be released at \href{https://github.com/arctanxarc/MC-LLaVA}{https://github.com/arctanxarc/MC-LLaVA}.

cs.CV↗

M2A: Multimodal Memory Agent with Dual-Layer Hybrid Memory for Long-Term Personalized Interactions

This work addresses the challenge of personalized question answering in long-term human-machine interactions: when conversational history spans weeks or months and exceeds the context window, existing personalization mechanisms struggle to continuously absorb and leverage users' incremental concepts, aliases, and preferences. Current personalized multimodal models are predominantly static-concepts are fixed at initialization and cannot evolve during interactions. We propose M2A, an agentic dual-layer hybrid memory system that maintains personalized multimodal information through online updates. The system employs two collaborative agents: ChatAgent manages user interactions and autonomously decides when to query or update memory, while MemoryManager breaks down memory requests from ChatAgent into detailed operations on the dual-layer memory bank, which couples a RawMessageStore (immutable conversation log) with a SemanticMemoryStore (high-level observations), providing memories at different granularities. In addition, we develop a reusable data synthesis pipeline that injects concept-grounded sessions from Yo'LLaVA and MC-LLaVA into LoCoMo long conversations while preserving temporal coherence. Experiments show that M2A significantly outperforms baselines, demonstrating that transforming personalization from one-shot configuration to a co-evolving memory mechanism provides a viable path for high-quality individualized responses in long-term multimodal interactions. The code is available at https://github.com/Little-Fridge/M2A.

cs.AI↗

AD-MIR: Bridging the Gap from Perception to Persuasion in Advertising Video Understanding via Structured Reasoning

Multimodal understanding of advertising videos is essential for interpreting the intricate relationship between visual storytelling and abstract persuasion strategies. However, despite excelling at general search, existing agents often struggle to bridge the cognitive gap between pixel-level perception and high-level marketing logic. To address this challenge, we introduce AD-MIR, a framework designed to decode advertising intent via a two-stage architecture. First, in the Structure-Aware Memory Construction phase, the system converts raw video into a structured database by integrating semantic retrieval with exact keyword matching. This approach prioritizes fine-grained brand details (e.g., logos, on-screen text) while dynamically filtering out irrelevant background noise to isolate key protagonists. Second, the Structured Reasoning Agent mimics a marketing expert through an iterative inquiry loop, decomposing the narrative to deduce implicit persuasion tactics. Crucially, it employs an evidence-based self-correction mechanism that rigorously validates these insights against specific video frames, automatically backtracking when visual support is lacking. Evaluation on the AdsQA benchmark demonstrates that AD-MIR achieves state-of-the-art performance, surpassing the strongest general-purpose agent, DVD, by 1.8% in strict and 9.5% in relaxed accuracy. These results underscore that effective advertising understanding demands explicitly grounding abstract marketing strategies in pixel-level evidence. The code is available at https://github.com/Little-Fridge/AD-MIR.

cs.CV↗

Reinforced Rate Control for Neural Video Compression via Inter-Frame Rate-Distortion Awareness

Neural video compression (NVC) has demonstrated superior compression efficiency, yet effective rate control remains a significant challenge due to complex temporal dependencies. Existing rate control schemes typically leverage frame content to capture distortion interactions, overlooking inter-frame rate dependencies arising from shifts in per-frame coding parameters. This often leads to suboptimal bitrate allocation and cascading parameter decisions. To address this, we propose a reinforcement-learning (RL)-based rate control framework that formulates the task as a frame-by-frame sequential decision process. At each frame, an RL agent observes a spatiotemporal state and selects coding parameters to optimize a long-term reward that reflects rate-distortion (R-D) performance and bitrate adherence. Unlike prior methods, our approach jointly determines bitrate allocation and coding parameters in a single step, independent of group of pictures (GOP) structure. Extensive experiments across diverse NVC architectures show that our method reduces the average relative bitrate error to 1.20% and achieves up to 13.45% bitrate savings at typical GOP sizes, outperforming existing approaches. In addition, our framework demonstrates improved robustness to content variation and bandwidth fluctuations with lower coding overhead, making it highly suitable for practical deployment.

eess.IV↗

RoboArmGS: High-Quality Robotic Arm Splatting via Bézier Curve Refinement

Constructing photorealistic and controllable robotic arm digital assets from real observations is fundamental to robotic applications. Current approaches naively bind static 3D Gaussians according to URDF links, forcing them to follow an URDF-rigged motion passively. However, the idealized URDF-rigged motion cannot accurately model the actual motion captured in real-world observations, leading to severe rendering artifacts in 3D Gaussians. To address these challenges, we propose RoboArmGS, a novel hybrid representation that refines the URDF-rigged motion with learnable Bézier curves, enabling more accurate real-world motion modeling. To be more specific, we present a learnable Bézier Curve motion refiner that corrects per-joint residuals to address mismatches between real-world motion and URDF-rigged motion. RoboArmGS enables the learning of more accurate real-world motion while achieving a coherent binding of 3D Gaussians across arm parts. To support future research, we contribute a carefully collected dataset named RoboArm4D, which comprises several widely used robotic arms for evaluating the quality of building high-quality digital assets. We evaluate our approach on RoboArm4D, and RoboArmGS achieves state-of-the-art performance in real-world motion modeling and rendering quality. The code and dataset will be released.

cs.RO↗

Design and fabrication of guiding patterns for topography-based searching of 2D devices for scanning tunneling microscopy measurements

We report the design and fabrication of guiding patterns for topography-based searching of two-dimensional (2D) devices for scanning tunneling microscopy (STM) measurements. Sub-micron geometric coordinate markers were etched into SiO2/Si wafers, serving as both substrates for 2D device integration and guiding maps for sample navigation. Here, we used a monolayer graphene/h-BN device with an active area of smaller than 20 um x 20 um as a model system and demonstrated that the device could be reliably located in STM solely through topographic imaging of the guiding patterns and in situ stage calibration, without reliance on optical viewports or capacitive sensing. Atomically resolved topographic imaging and tunneling spectroscopy were also obtained. Our proposed navigation strategy is fully compatible with standard device fabrication procedures and requires no hardware modification to existing STM setups. As such, it offers a practical alternative for locating miniaturized devices in STM, shedding light on studying emerging quantum phenomena in 2D systems.

cond-mat.str-el↗

Double Hall-Littlewood symmetric polynomials

We establish a ring isomorphism between the derived Hall algebra of the Jordan quiver and the ring of double symmetric functions (i.e., the ring of symmetric polynomials in two sets of countably many variables, invariant under the respective actions of their symmetric groups) with a parameter $t$. This isomorphism maps the derived Hall basis (the natural basis of the derived Hall algebra) to a class of double Hall-Littlewood (HL) symmetric functions, which are formulated via raising and lowering operators. These double HL functions are parameterized by bipartitions; they reduce to the classical HL functions when one of the partitions is empty, and specialize to Schur Laurent symmetric functions at $t = 0$. We also derive the Pieri rules for these double HL functions. Additionally, we obtain several natural generating functions for the derived Hall algebra as well as their transition relations, which can be transferred to the ring of double symmetric functions via the established ring isomorphism.

math.QA↗

Theory of Correlated Hofstadter Spectrum in Magic-Angle Graphene

The magnetic-field-induced correlated Chern insulator (CCI) states in magic-angle twisted bilayer graphene (MATBG) have been intensively studied in experiments, but a simple and clear understanding of their origin is still lacking. Here, we propose a unified theoretical framework for the CCI states in MATBG that successfully explains most experimental observations. The key insight of our theory is that, due to the very narrow bandwidth of MATBG, correlation-enhanced valley and spin Zeeman terms are critical for shaping the intricate Hofstadter spectrum, resulting in an interwoven, flavor-resolved (spin and valley) Hofstadter spectrum that can well describe the observed CCI states. Crucially, due to the Zeeman effect, the crossings between these flavor-polarized Hofstadter spectra are magnetic-field-dependent, causing certain CCI states to emerge only above a critical field. This is the main mechanism underlying the critical field phenomenon of the CCI states observed in experiments. Our theory provides a clear and unified physical picture for the correlated Hofstadter spectrum in MATBG.

cond-mat.mes-hall↗

Three-dimensional quantum anomalous Hall effect in Weyl semimetals

The quantum anomalous Hall effect (QAHE) is a quantum phenomenon in which a two-dimensional system exhibits a quantized Hall resistance $h/e^2$ in the absence of magnetic field, where $h$ is the Planck constant and $e$ is the electron charge. In this work, we extend this novel phase to three dimensions and thus propose a three-dimensional QAHE exhibiting richer and more versatile transport behaviors. We first confirm this three-dimensional QAHE through the quantized Chern number, then establish its bulk-boundary correspondence, and finally reaffirm it via the distinctive transport properties. Remarkably, we find that the three-dimensional QAHE hosts two chiral surface states along one spatial direction while a pair of chiral hinge states along another direction, and the location of the hinge states depends sensitively on the Fermi energy. These two types of boundary states are further connected through a perpendicular chiral surface states, whose chirality is also Fermi energy dependent. Consequently, depending on the transport direction, its Hall resistance can quantize to $0$, $h/e^2$, or $\pm h/e^2$ when the Fermi energy is tuned across the charge neutral point. This three-dimensional QAHE not only fill the gap in the Hall effect family but also holds significant potentials in device applications such as in-memory computing.

cond-mat.mes-hall↗

ResTok: Learning Hierarchical Residuals in 1D Visual Tokenizers for Autoregressive Image Generation

Existing 1D visual tokenizers for autoregressive (AR) generation largely follow the design principles of language modeling, as they are built directly upon transformers whose priors originate in language, yielding single-hierarchy latent tokens and treating visual data as flat sequential token streams. However, this language-like formulation overlooks key properties of vision, particularly the hierarchical and residual network designs that have long been essential for convergence and efficiency in visual models. To bring "vision" back to vision, we propose the Residual Tokenizer (ResTok), a 1D visual tokenizer that builds hierarchical residuals for both image tokens and latent tokens. The hierarchical representations obtained through progressively merging enable cross-level feature fusion at each layer, substantially enhancing representational capacity. Meanwhile, the semantic residuals between hierarchies prevent information overlap, yielding more concentrated latent distributions that are easier for AR modeling. Cross-level bindings consequently emerge without any explicit constraints. To accelerate the generation process, we further introduce a hierarchical AR generator that substantially reduces sampling steps by predicting an entire level of latent tokens at once rather than generating them strictly token-by-token. Extensive experiments demonstrate that restoring hierarchical residual priors in visual tokenization significantly improves AR image generation, achieving a gFID of 2.34 on ImageNet-256 with only 9 sampling steps. Code is available at https://github.com/Kwai-Kolors/ResTok.

cs.CV↗

ParkGaussian: Surround-view 3D Gaussian Splatting for Autonomous Parking

Parking is a critical task for autonomous driving systems (ADS), with unique challenges in crowded parking slots and GPS-denied environments. However, existing works focus on 2D parking slot perception, mapping, and localization, 3D reconstruction remains underexplored, which is crucial for capturing complex spatial geometry in parking scenarios. Naively improving the visual quality of reconstructed parking scenes does not directly benefit autonomous parking, as the key entry point for parking is the slots perception module. To address these limitations, we curate the first benchmark named ParkRecon3D, specifically designed for parking scene reconstruction. It includes sensor data from four surround-view fisheye cameras with calibrated extrinsics and dense parking slot annotations. We then propose ParkGaussian, the first framework that integrates 3D Gaussian Splatting (3DGS) for parking scene reconstruction. To further improve the alignment between reconstruction and downstream parking slot detection, we introduce a slot-aware reconstruction strategy that leverages existing parking perception methods to enhance the synthesis quality of slot regions. Experiments on ParkRecon3D demonstrate that ParkGaussian achieves state-of-the-art reconstruction quality and better preserves perception consistency for downstream tasks. The code and dataset will be released at: https://github.com/wm-research/ParkGaussian

cs.CV↗

YODA: Yet Another One-step Diffusion-based Video Compressor

While one-step diffusion models have recently excelled in perceptual image compression, their application to video remains limited. Prior efforts typically rely on pretrained 2D autoencoders that generate per-frame latent representations independently, thereby neglecting temporal dependencies. We present YODA--Yet Another One-step Diffusion-based Video Compressor--which embeds multiscale features from temporal references for both latent generation and latent coding to better exploit spatial-temporal correlations for more compact representation, and employs a linear Diffusion Transformer (DiT) for efficient one-step denoising. YODA achieves state-of-the-art perceptual performance, consistently outperforming traditional and deep-learning baselines on LPIPS, DISTS, FID, and KID. Source code will be publicly available at https://github.com/NJUVISION/YODA.

eess.IV↗

iQuantum groups and iHopf algebras II: dual canonical bases

Building on the iHopf algebra realization of quasi-split universal iquantum groups developed in a prequel, we construct the dual canonical basis for a universal iquantum group of arbitrary finite type, which are further shown to be preserved by the ibraid group action; this recovers the results of Lu-Pan in ADE type obtained earlier in a geometric approach. Moreover, we identify the dual canonical basis for the Drinfeld double quantum group of arbitrary finite type, which is realized via iHopf algebra on the double Borel, with Berenstein-Greenstein's double canonical basis, settling several of their conjectures.

math.QA↗

Quantum symmetric pairs via Hall algebras

A quantum symmetric pair consists of a quantum group $\widetilde{\mathbf{U}}$ and its coideal subalgebra $\widetilde{\mathbf{U}}^\imath$. The Hall algebra constructions of $\widetilde{\mathbf{U}}$ and $\widetilde{\mathbf{U}}^\imath$ are given by Bridgeland and Lu--Wang, respectively. In this paper, we construct a Hall algebra framework for the coideal subalgebra structure of $\widetilde{\mathbf{U}}^\imath$ in $\widetilde{\mathbf{U}}$, and for the quantum symmetric pair $(\widetilde{\mathbf{U}},\widetilde{\mathbf{U}}^\imath)$. As an application, we prove that the natural embedding $\imath:\widetilde{\mathbf{U}}^\imath\to \widetilde{\mathbf{U}}$, and the coproduct $Δ:\widetilde{\mathbf{U}}^\imath\to \widetilde{\mathbf{U}}^\imath\otimes \widetilde{\mathbf{U}}$ preserve the integral forms of $\widetilde{\mathbf{U}}^\imath$ and $\widetilde{\mathbf{U}}$, which are used to construct the dual canonical bases.

math.QA↗

In-plane anomalous features in the 3D quantum Hall regime

Studies of the 3D quantum Hall effect (QHE) have primarily emphasized transport features that mimic the well-established 2D QHE. In this work, we show that qualitatively new features arise when an in-plane magnetic field is applied to a 3D Weyl semimetal in the quantum Hall regime. An unexpected Hall quantum oscillation, distinct from the Weyl-orbit oscillation, coexists with the QHE, along with an unquantized two-terminal magnetoresistance. Moreover, unconventional antichiral transmission enables a peculiar disorder-robust negative longitudinal resistance. Quantization tunable by the lead configuration is further found in this transport geometry. A unique type of nonlocal quantum backscattering channels underlies these phenomena. Our work demonstrates a breakdown of the topological characterization of transport even with 3D Chern numbers and reveals hidden 3D QHE transport properties. It opens a new class of transport measurements and phenomena.

cond-mat.mes-hall↗

UniEdit-I: Training-free Image Editing for Unified VLM via Iterative Understanding, Editing and Verifying

While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally decoupled and open loop performing static, pre-defined transformations without dynamic feedback between semantic interpretation and visual generation. A central limitation stems from the representation gap: understanding typically leverages high-level, language aligned encoders, whereas generation relies on low level, pixel-space autoencoders, resulting in misaligned feature spaces. To bridge this gap, Recent advances such as Representation Autoencoders and BLIP3-o advocate performing diffusion-based modeling directly in high level features from pretrained semantic encoders. We find editing in the semantic latent space modifies conceptual representations rather than pixels, ensuring intermediates that are both semantically coherent and visually plausible. Building on this insight, We propose UniEdit-I, the first training-free, closed-loop image editing framework that operates entirely within the semantic latent space of a unified VLM by introducing an Understanding-Editing-Verifying (UEV) loop, By transforming the VLM from a posthoc evaluator into an in-process conductor, UniEdit-I establishes the first semantics-driven, self-correcting closed-loop image editing pipeline. Evaluated on GEdit-Bench, UniEdit-I achieves state of the art performance without any fine tuning or architectural modifications, and even surpasses several largescale pretrained editors.

cs.CV↗

ChainV: Atomic Visual Hints Make Multimodal Reasoning Shorter and Better

Recent advances in multimodal reasoning models have demonstrated impressive capabilities across text and vision. However, even leading models exhibit redundant self-reflection when generating lengthy reasoning chains. While training-free CoT compression methods have emerged in the LLMs domain, they rely on static visual references and thus provide limited gains for multimodal reasoning. Therefore, we propose ChainV, a framework that dynamically integrates visual hints into the reasoning process, thereby making multimodal reasoning shorter and better. Specifically, ChainV first performs a coarse visual patch selection based on the previous reasoning step, then refines it by identifying the most representative atomic visual hint according to the averaged attention intensity. Additionally, ChainV introduces a consistency-based evaluation mechanism to assess the reliability of the chosen hint, guiding the model to adaptively adjust its level of self-reflection. Eventually, the pixel coordinates of the selected visual hint and its reliability are incorporated into thinking with a Bernoulli stochastic process. Experiments indicate that our method significantly improves reasoning accuracy and efficiency, especially on math-intensive benchmarks where visual hints are crucial for multi-step symbolic reasoning. For example, ChainV achieves $2.3\%$ improvement on the MathVista within MIMO-VL-RL, while reducing inference latency by $51.4\%$ and shortening output token length by $24.5\%$.

cs.CV↗