arXiv subjects

Ming Yang

Publications and source records attributed to Ming Yang.

At least 163 records · Page 9Linked to original sources

arXiv2025

Flow-Aware Navigation of Magnetic Micro-Robots in Complex Fluids via PINN-Based Prediction

While magnetic micro-robots have demonstrated significant potential across various applications, including drug delivery and microsurgery, the open issue of precise navigation and control in complex fluid environments is crucial for in vivo implementation. This paper introduces a novel flow-aware navigation and control strategy for magnetic micro-robots that explicitly accounts for the impact of fluid flow on their movement. First, the proposed method employs a Physics-Informed U-Net (PI-UNet) to refine the numerically predicted fluid velocity using local observations. Then, the predicted velocity is incorporated in a flow-aware A* path planning algorithm, ensuring efficient navigation while mitigating flow-induced disturbances. Finally, a control scheme is developed to compensate for the predicted fluid velocity, thereby optimizing the micro-robot's performance. A series of simulation studies and real-world experiments are conducted to validate the efficacy of the proposed approach. This method enhances both planning accuracy and control precision, expanding the potential applications of magnetic micro-robots in fluid-affected environments typical of many medical scenarios.

cs.RO↗

arXiv2025

SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator Trajectories

While MLLMs have demonstrated adequate image understanding capabilities, they still struggle with pixel-level comprehension, limiting their practical applications. Current evaluation tasks like VQA and visual grounding remain too coarse to assess fine-grained pixel comprehension accurately. Though segmentation is foundational for pixel-level understanding, existing methods often require MLLMs to generate implicit tokens, decoded through external pixel decoders. This approach disrupts the MLLM's text output space, potentially compromising language capabilities and reducing flexibility and extensibility, while failing to reflect the model's intrinsic pixel-level understanding. Thus, we introduce the Human-Like Mask Annotation Task (HLMAT), a new paradigm where MLLMs mimic human annotators using interactive segmentation tools. Modeling segmentation as a multi-step Markov Decision Process, HLMAT enables MLLMs to iteratively generate text-based click points, achieving high-quality masks without architectural changes or implicit tokens. Through this setup, we develop SegAgent, a model fine-tuned on human-like annotation trajectories, which achieves performance comparable to state-of-the-art (SOTA) methods and supports additional tasks like mask refinement and annotation filtering. HLMAT provides a protocol for assessing fine-grained pixel understanding in MLLMs and introduces a vision-centric, multi-step decision-making task that facilitates exploration of MLLMs' visual reasoning abilities. Our adaptations of policy improvement method StaR and PRM-guided tree search further enhance model robustness in complex segmentation tasks, laying a foundation for future advancements in fine-grained visual perception and multi-step decision-making for MLLMs.

cs.CV↗

arXiv2025

Towards High Precision Mass Measurements of Two Sub-Neptunes in the K2-266 Planetary System Through Transit Timing

Sub-Neptunes have been found to be one of the most common types of exoplanets, yet their physical parameters and properties are poorly determined and in need of further investigation. In order to improve the mass measurement and parameter determination of two sub-Neptunes, K2-266 d and K2-266 e, we present new transit observations obtained with CHaracterising ExOPlanets Satellite (CHEOPS) and Transiting Exoplanet Survey Satellite (TESS), increasing the baseline of transit data from a few epochs to 165 epochs for K2-266 d, and to 121 epochs for K2-266 e. Through a two-stage fitting process, it is found that the masses of K2-266 d and K2-266 e are 6.01$\pm$0.43 $M_\oplus$ and 7.70$\pm$0.58 $M_\oplus$, respectively. With these updated values and one order of magnitude better precision, we confirm the planets to belong to the population of planets that has been determined to be volatile-rich. Finally, we present the results of dynamical simulations, showing that the system is stable, the orbits are not chaotic, and that these two planets are close to but not in 4:3 mean motion resonance.

astro-ph.EP↗

arXiv2025

Controllable and Continuous Quantum Phase Transitions in Intrinsic Magnetic Topological Insulator

The intrinsic magnetic topological material MnBi2Te4 has demonstrated great potential to investigate the interplay between topology and magnetism, which opens up new avenues for manipulating non-trivial electronic states and designing quantum devices. However, challenges and controversies remain due to its inevitable n-type antisite defects, hindering the experimental realization of intrinsic magnetic topological phenomena and rendering the precise control of topological phase transitions (TPTs) unachievable. Here, we study a candidate material family, Mn(1-x)GexBi2Te4, in which the heavy n-type doping features are strongly suppressed when the Ge content reaches 0.46, and multiple topological phases are well maintained with the surface Dirac point located near the Fermi level. Based on angle-resolved photoemission spectroscopy, transport measurements, and first-principles calculations, we reveal two magnetism-induced TPTs: the first is antiferromagnetic-ordering-induced transition from strong topological insulator to a magnetic topological insulator as revealed by gap opening of topological surface states; the second is external-magnetic-field-dependent transition from magnetic topological insulator to a Weyl semimetal with the gap reclosed. Our work paves the way for the realization of intrinsic magnetic topological states in MnBi2Te4 family and provides an ideal platform for achieving controllable and continuous TPTs towards future spintronic applications.

cond-mat.mtrl-sci↗

arXiv2025

Embodied Escaping: End-to-End Reinforcement Learning for Robot Navigation in Narrow Environment

Autonomous navigation is a fundamental task for robot vacuum cleaners in indoor environments. Since their core function is to clean entire areas, robots inevitably encounter dead zones in cluttered and narrow scenarios. Existing planning methods often fail to escape due to complex environmental constraints, high-dimensional search spaces, and high difficulty maneuvers. To address these challenges, this paper proposes an embodied escaping model that leverages reinforcement learning-based policy with an efficient action mask for dead zone escaping. To alleviate the issue of the sparse reward in training, we introduce a hybrid training policy that improves learning efficiency. In handling redundant and ineffective action options, we design a novel action representation to reshape the discrete action space with a uniform turning radius. Furthermore, we develop an action mask strategy to select valid action quickly, balancing precision and efficiency. In real-world experiments, our robot is equipped with a Lidar, IMU, and two-wheel encoders. Extensive quantitative and qualitative experiments across varying difficulty levels demonstrate that our robot can consistently escape from challenging dead zones. Moreover, our approach significantly outperforms compared path planning and reinforcement learning methods in terms of success rate and collision avoidance.

cs.RO↗

arXiv2025

RL-OGM-Parking: Lidar OGM-Based Hybrid Reinforcement Learning Planner for Autonomous Parking

Autonomous parking has become a critical application in automatic driving research and development. Parking operations often suffer from limited space and complex environments, requiring accurate perception and precise maneuvering. Traditional rule-based parking algorithms struggle to adapt to diverse and unpredictable conditions, while learning-based algorithms lack consistent and stable performance in various scenarios. Therefore, a hybrid approach is necessary that combines the stability of rule-based methods and the generalizability of learning-based methods. Recently, reinforcement learning (RL) based policy has shown robust capability in planning tasks. However, the simulation-to-reality (sim-to-real) transfer gap seriously blocks the real-world deployment. To address these problems, we employ a hybrid policy, consisting of a rule-based Reeds-Shepp (RS) planner and a learning-based reinforcement learning (RL) planner. A real-time LiDAR-based Occupancy Grid Map (OGM) representation is adopted to bridge the sim-to-real gap, leading the hybrid policy can be applied to real-world systems seamlessly. We conducted extensive experiments both in the simulation environment and real-world scenarios, and the result demonstrates that the proposed method outperforms pure rule-based and learning-based methods. The real-world experiment further validates the feasibility and efficiency of the proposed method.

cs.RO↗

arXiv2025

SHE-Net: Syntax-Hierarchy-Enhanced Text-Video Retrieval

The user base of short video apps has experienced unprecedented growth in recent years, resulting in a significant demand for video content analysis. In particular, text-video retrieval, which aims to find the top matching videos given text descriptions from a vast video corpus, is an essential function, the primary challenge of which is to bridge the modality gap. Nevertheless, most existing approaches treat texts merely as discrete tokens and neglect their syntax structures. Moreover, the abundant spatial and temporal clues in videos are often underutilized due to the lack of interaction with text. To address these issues, we argue that using texts as guidance to focus on relevant temporal frames and spatial regions within videos is beneficial. In this paper, we propose a novel Syntax-Hierarchy-Enhanced text-video retrieval method (SHE-Net) that exploits the inherent semantic and syntax hierarchy of texts to bridge the modality gap from two perspectives. First, to facilitate a more fine-grained integration of visual content, we employ the text syntax hierarchy, which reveals the grammatical structure of text descriptions, to guide the visual representations. Second, to further enhance the multi-modal interaction and alignment, we also utilize the syntax hierarchy to guide the similarity calculation. We evaluated our method on four public text-video retrieval datasets of MSR-VTT, MSVD, DiDeMo, and ActivityNet. The experimental results and ablation studies confirm the advantages of our proposed method.

cs.CV↗

arXiv2025

A Weight Adaptation Trigger Mechanism in Decomposition-based Evolutionary Multi-Objective Optimisation

Decomposition-based multi-objective evolutionary algorithms (MOEAs) are widely used for solving multi-objective optimisation problems. However, their effectiveness depends on the consistency between the problems Pareto front shape and the weight distribution. Decomposition-based MOEAs, with uniformly distributed weights (in a simplex), perform well on problems with a regular (simplex-like) Pareto front, but not on those with an irregular Pareto front. Previous studies have focused on adapting the weights to approximate the irregular Pareto front during the evolutionary process. However, these adaptations can actually harm the performance on the regular Pareto front via changing the weights during the search process that are eventually the best fit for the Pareto front. In this paper, we propose an algorithm called the weight adaptation trigger mechanism for decomposition-based MOEAs (ATM-MOEA/D) to tackle this issue. ATM-MOEA/D uses an archive to gradually approximate the shape of the Pareto front during the search. When the algorithm detects evolution stagnation (meaning the population no longer improves significantly), it compares the distribution of the population with that of the archive to distinguish between regular and irregular Pareto fronts. Only when an irregular Pareto front is identified, the weights are adapted. Our experimental results show that the proposed algorithm not only performs generally better than seven state-of-the-art weight-adapting methods on irregular Pareto fronts but also is able to achieve the same results as fixed-weight methods like MOEA/D on regular Pareto fronts.

cs.NE↗

arXiv2025

Depth-aware Fusion Method based on Image and 4D Radar Spectrum for 3D Object Detection

Safety and reliability are crucial for the public acceptance of autonomous driving. To ensure accurate and reliable environmental perception, intelligent vehicles must exhibit accuracy and robustness in various environments. Millimeter-wave radar, known for its high penetration capability, can operate effectively in adverse weather conditions such as rain, snow, and fog. Traditional 3D millimeter-wave radars can only provide range, Doppler, and azimuth information for objects. Although the recent emergence of 4D millimeter-wave radars has added elevation resolution, the radar point clouds remain sparse due to Constant False Alarm Rate (CFAR) operations. In contrast, cameras offer rich semantic details but are sensitive to lighting and weather conditions. Hence, this paper leverages these two highly complementary and cost-effective sensors, 4D millimeter-wave radar and camera. By integrating 4D radar spectra with depth-aware camera images and employing attention mechanisms, we fuse texture-rich images with depth-rich radar data in the Bird's Eye View (BEV) perspective, enhancing 3D object detection. Additionally, we propose using GAN-based networks to generate depth images from radar spectra in the absence of depth sensors, further improving detection accuracy.

cs.CV↗

arXiv2025

Superconductivity above 30 K due to the introduction of oxygen in CaFeAsF

Exploring new unconventional superconductors is of great value for both fundamental research and practical applications. It is a long-term challenge to develop and study more hole-doped superconductors in 1111 system of iron-based superconductors. Here we report the discovery of superconductivity with a critical transition temperature up to 30.7 K in the compound CaFeAsF by a post-annealing treatment in air atmosphere. The superconducting behaviors are verified in both the single-crystalline and polycrystalline samples by the resistance and magnetization measurements. The analysis by combining the depth-resolved time-of-flight secondary ion mass spectrometry (TOF-SIMS) and X-ray photoelectron spectroscopy (XPS) measurements shows that the introduction of oxygen elements and the consequent changing in Fe valence by the annealing treatment may lead to the hole-type doping, which is the origin for the occurrence of superconductivity. Our results pave the way for further in-depth investigations on the hole-doped 1111 system in iron-based superconductors.

cond-mat.supr-con↗

arXiv2025

Small polarons mediated near-room-temperature metal-insulator transition in vanadium dioxide and their hopping dynamics

Researchers pursuing advanced photoelectric devices have discovered near room-temperature metal-insulator transitions (MIT) in non-volatile VO2. Despite theoretical investigations suggesting that polaron dynamics mediate the MIT, direct experimental evidence remains scarce. In this study, we present direct evidence of the polaron state in insulating VO2 through high-resolution spectroscopic ellipsometry measurements and first-principles calculations. We illustrate the complementary role of polaron dynamics in facilitating Peierls and Mott transitions, thereby contributing to the MIT processes. Furthermore, our observations and characterizations of conventional metallic and correlated plasmons in the respective phases of the VO2 film offer valuable insights into their electron structures. This investigation enhances comprehension of the MIT mechanism in correlated systems and underscores the roles of polarons, lattice distortions, and electron correlations in facilitating phase transition processes in strongly-correlated systems. Additionally, the detailed detection of small polarons and plasmons serves as inspiration for the development of new device functionalities.

physics.app-ph↗

arXiv2025

BMIP: Bi-directional Modality Interaction Prompt Learning for VLM

Vision-language models (VLMs) have exhibited remarkable generalization capabilities, and prompt learning for VLMs has attracted great attention for the ability to adapt pre-trained VLMs to specific downstream tasks. However, existing studies mainly focus on single-modal prompts or uni-directional modality interaction, overlooking the powerful alignment effects resulting from the interaction between the vision and language modalities. To this end, we propose a novel prompt learning method called $\underline{\textbf{B}}i-directional \underline{\textbf{M}}odality \underline{\textbf{I}}nteraction \underline{\textbf{P}}rompt (BMIP)$, which dynamically weights bi-modal information through learning the information of the attention layer, enhancing trainability and inter-modal consistency compared to simple information aggregation methods. To evaluate the effectiveness of prompt learning methods, we propose a more realistic evaluation paradigm called open-world generalization complementing the widely adopted cross-dataset transfer and domain generalization tasks. Comprehensive experiments on various datasets reveal that BMIP not only outperforms current state-of-the-art methods across all three evaluation paradigms but is also flexible enough to be combined with other prompt-based methods for consistent performance enhancement.

cs.LG↗

arXiv2025

Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay

Nowadays transformer-based Large Language Models (LLM) for code generation tasks usually apply sampling and filtering pipelines. Due to the sparse reward problem in code generation tasks caused by one-token incorrectness, transformer-based models will sample redundant programs till they find a correct one, leading to low efficiency. To overcome the challenge, we incorporate Experience Replay (ER) in the fine-tuning phase, where codes and programs produced are stored and will be replayed to give the LLM agent a chance to learn from past experiences. Based on the spirit of ER, we introduce a novel approach called BTP pipeline which consists of three phases: beam search sampling, testing phase, and prioritized experience replay phase. The approach makes use of failed programs collected by code models and replays programs with high Possibility and Pass-rate Prioritized value (P2Value) from the replay buffer to improve efficiency. P2Value comprehensively considers the possibility of transformers' output and pass rate and can make use of the redundant resources caused by the problem that most programs collected by LLMs fail to pass any tests. We empirically apply our approach in several LLMs, demonstrating that it enhances their performance in code generation tasks and surpasses existing baselines.

cs.LG↗

arXiv2025

Cross-View Geo-Localization with Street-View and VHR Satellite Imagery in Decentrality Settings

Cross-View Geo-Localization tackles the challenge of image geo-localization in GNSS-denied environments, including disaster response scenarios, urban canyons, and dense forests, by matching street-view query images with geo-tagged aerial-view reference images. However, current research often relies on benchmarks and methods that assume center-aligned settings or account for only limited decentrality, which we define as the offset of the query image relative to the reference image center. Such assumptions fail to reflect real-world scenarios, where reference databases are typically pre-established without the possibility of ensuring perfect alignment for each query image. Moreover, decentrality is a critical factor warranting deeper investigation, as larger decentrality can substantially improve localization efficiency but comes at the cost of declines in localization accuracy. To address this limitation, we introduce DReSS (Decentrality Related Street-view and Satellite-view dataset), a novel dataset designed to evaluate cross-view geo-localization with a large geographic scope and diverse landscapes, emphasizing the decentrality issue. Meanwhile, we propose AuxGeo (Auxiliary Enhanced Geo-Localization) to further study the decentrality issue, which leverages a multi-metric optimization strategy with two novel modules: the Bird's-eye view Intermediary Module (BIM) and the Position Constraint Module (PCM). These modules improve the localization accuracy despite the decentrality problem. Extensive experiments demonstrate that AuxGeo outperforms previous methods on our proposed DReSS dataset, mitigating the issue of large decentrality, and also achieves state-of-the-art performance on existing public datasets such as CVUSA, CVACT, and VIGOR.

cs.CV↗

arXiv2024

Referencing Where to Focus: Improving VisualGrounding with Referential Query

Visual Grounding aims to localize the referring object in an image given a natural language expression. Recent advancements in DETR-based visual grounding methods have attracted considerable attention, as they directly predict the coordinates of the target object without relying on additional efforts, such as pre-generated proposal candidates or pre-defined anchor boxes. However, existing research primarily focuses on designing stronger multi-modal decoder, which typically generates learnable queries by random initialization or by using linguistic embeddings. This vanilla query generation approach inevitably increases the learning difficulty for the model, as it does not involve any target-related information at the beginning of decoding. Furthermore, they only use the deepest image feature during the query learning process, overlooking the importance of features from other levels. To address these issues, we propose a novel approach, called RefFormer. It consists of the query adaption module that can be seamlessly integrated into CLIP and generate the referential query to provide the prior context for decoder, along with a task-specific decoder. By incorporating the referential query into the decoder, we can effectively mitigate the learning difficulty of the decoder, and accurately concentrate on the target object. Additionally, our proposed query adaption module can also act as an adapter, preserving the rich knowledge within CLIP without the need to tune the parameters of the backbone network. Extensive experiments demonstrate the effectiveness and efficiency of our proposed method, outperforming state-of-the-art approaches on five visual grounding benchmarks.

cs.CV↗

arXiv2024

Cross-View Image Set Geo-Localization

Cross-view geo-localization (CVGL) has been widely applied in fields such as robotic navigation and augmented reality. Existing approaches primarily use single images or fixed-view image sequences as queries, which limits perspective diversity. In contrast, when humans determine their location visually, they typically move around to gather multiple perspectives. This behavior suggests that integrating diverse visual cues can improve geo-localization reliability. Therefore, we propose a novel task: Cross-View Image Set Geo-Localization (Set-CVGL), which gathers multiple images with diverse perspectives as a query set for localization. To support this task, we introduce SetVL-480K, a benchmark comprising 480,000 ground images captured worldwide and their corresponding satellite images, with each satellite image corresponds to an average of 40 ground images from varied perspectives and locations. Furthermore, we propose FlexGeo, a flexible method designed for Set-CVGL that can also adapt to single-image and image-sequence inputs. FlexGeo includes two key modules: the Similarity-guided Feature Fuser (SFF), which adaptively fuses image features without prior content dependency, and the Individual-level Attributes Learner (IAL), leveraging geo-attributes of each image for comprehensive scene perception. FlexGeo consistently outperforms existing methods on SetVL-480K and two public datasets, SeqGeo and KITTI-CVL, achieving a localization accuracy improvement of over 22% on SetVL-480K.

cs.CV↗

arXiv2024

LokiTalk: Learning Fine-Grained and Generalizable Correspondences to Enhance NeRF-based Talking Head Synthesis

Despite significant progress in talking head synthesis since the introduction of Neural Radiance Fields (NeRF), visual artifacts and high training costs persist as major obstacles to large-scale commercial adoption. We propose that identifying and establishing fine-grained and generalizable correspondences between driving signals and generated results can simultaneously resolve both problems. Here we present LokiTalk, a novel framework designed to enhance NeRF-based talking heads with lifelike facial dynamics and improved training efficiency. To achieve fine-grained correspondences, we introduce Region-Specific Deformation Fields, which decompose the overall portrait motion into lip movements, eye blinking, head pose, and torso movements. By hierarchically modeling the driving signals and their associated regions through two cascaded deformation fields, we significantly improve dynamic accuracy and minimize synthetic artifacts. Furthermore, we propose ID-Aware Knowledge Transfer, a plug-and-play module that learns generalizable dynamic and static correspondences from multi-identity videos, while simultaneously extracting ID-specific dynamic and static features to refine the depiction of individual characters. Comprehensive evaluations demonstrate that LokiTalk delivers superior high-fidelity results and training efficiency compared to previous methods. The code will be released upon acceptance.

cs.CV↗

arXiv2024

Searching for Galactic Red Supergiants with Gaia RVS Spectra

Red supergiants (RSGs) are essential to understanding the evolution and the contribution to the interstellar medium of massive stars. However, the number of identified RSGs within the Milky Way is still limited mainly due to the difficulty of measuring stellar extinction and distance. The release of approximately one million RVS spectra in Gaia DR3 presents new opportunity for identifying Galactic RSGs, because the equivalent width of the calcium triplet lines (EW(CaT)) in the spectra is an excellent indicator of stellar surface gravity. This work uses the RVS spectra with signal-to-noise ratio (SNR) greater than 100 to search for the Galactic RSGs. The dwarf stars and red giants are removed and the RSG candidates are selected by the location in the EW(CaT) vs. BP-RP diagram. The early-type RSG candidates (K0-M2) are then identified by BP-RP > 1.584 and EW(CaT) > 1.1 nm. To identify late-type RSG candidates (after M2), the criteria of the average equivalent widths of TiO in the XP spectra (EW(TiO)) > 10 nm, the color index K-W3 < 0.5 and the period-amplitude sequence from Gaia DR3 LPV catalog are further applied to reduce the contamination of late-type red giants and asymptotic giant branch stars. This method yields 30 early-type (K0-M2) and 6196 late-type (after M2) RSG candidates, which is a significant increase to the present Galactic RSG sample. The application of this approach to the spectra with SNR > 50 results in 48 early-type and 11,491 late-type RSG candidates. This preliminary analysis paves the way for more extensive research with Gaia DR4 when larger spectral datasets are expected to significantly enhance our understanding of Galactic RSG populations.

astro-ph.SR↗