Search arXiv⌕ Search

arXiv subjects

Bin Li

Publications and source records attributed to Bin Li.

At least 271 records · Page 15Linked to original sources

UMIT: Unifying Medical Imaging Tasks via Vision-Language Models

With the rapid advancement of deep learning, particularly in the field of medical image analysis, an increasing number of Vision-Language Models (VLMs) are being widely applied to solve complex health and biomedical challenges. However, existing research has primarily focused on specific tasks or single modalities, which limits their applicability and generalization across diverse medical scenarios. To address this challenge, we propose UMIT, a unified multi-modal, multi-task VLM designed specifically for medical imaging tasks. UMIT is able to solve various tasks, including visual question answering, disease detection, and medical report generation. In addition, it is applicable to multiple imaging modalities (e.g., X-ray, CT and PET), covering a wide range of applications from basic diagnostics to complex lesion analysis. Moreover, UMIT supports both English and Chinese, expanding its applicability globally and ensuring accessibility to healthcare services in different linguistic contexts. To enhance the model's adaptability and task-handling capability, we design a unique two-stage training strategy and fine-tune UMIT with designed instruction templates. Through extensive empirical evaluation, UMIT outperforms previous methods in five tasks across multiple datasets. The performance of UMIT indicates that it can significantly enhance diagnostic accuracy and workflow efficiency, thus providing effective solutions for medical imaging applications.

cs.CV↗

DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modeling

Accurate and efficient modeling of agent interactions is essential for trajectory generation, the core of autonomous driving systems. Existing methods, scene-centric, agent-centric, and query-centric frameworks, each present distinct advantages and drawbacks, creating an impossible triangle among accuracy, computational time, and memory efficiency. To break this limitation, we propose Directional Rotary Position Embedding (DRoPE), a novel adaptation of Rotary Position Embedding (RoPE), originally developed in natural language processing. Unlike traditional relative position embedding (RPE), which introduces significant space complexity, RoPE efficiently encodes relative positions without explicitly increasing complexity but faces inherent limitations in handling angular information due to periodicity. DRoPE overcomes this limitation by introducing a uniform identity scalar into RoPE's 2D rotary transformation, aligning rotation angles with realistic agent headings to naturally encode relative angular information. We theoretically analyze DRoPE's correctness and efficiency, demonstrating its capability to simultaneously optimize trajectory generation accuracy, time complexity, and space complexity. Empirical evaluations compared with various state-of-the-art trajectory generation models, confirm DRoPE's good performance and significantly reduced space complexity, indicating both theoretical soundness and practical effectiveness. The video documentation is available at https://drope-traj.github.io/.

cs.RO↗

Towards Practical Real-Time Neural Video Compression

We introduce a practical real-time neural video codec (NVC) designed to deliver high compression ratio, low latency and broad versatility. In practice, the coding speed of NVCs depends on 1) computational costs, and 2) non-computational operational costs, such as memory I/O and the number of function calls. While most efficient NVCs prioritize reducing computational cost, we identify operational cost as the primary bottleneck to achieving higher coding speed. Leveraging this insight, we introduce a set of efficiency-driven design improvements focused on minimizing operational costs. Specifically, we employ implicit temporal modeling to eliminate complex explicit motion modules, and use single low-resolution latent representations rather than progressive downsampling. These innovations significantly accelerate NVC without sacrificing compression quality. Additionally, we implement model integerization for consistent cross-device coding and a module-bank-based rate control scheme to improve practical adaptability. Experiments show our proposed DCVC-RT achieves an impressive average encoding/decoding speed at 125.2/112.8 fps (frames per second) for 1080p video, while saving an average of 21% in bitrate compared to H.266/VTM. The code is available at https://github.com/microsoft/DCVC.

eess.IV↗

Minute-cadence observations on Galactic plane with Wide Field Survey Telescope (WFST): Overview, methodology and early results

As the time-domain survey telescope of the highest survey power in the northern hemisphere currently, Wide Field Survey Telescope (WFST) is scheduled to hourly/daily/semi-weekly scan northern sky up to ~23 mag in four optical (ugri) bands. Unlike the observation cadences in the forthcoming regular survey missions, WFST performed "staring" observations toward Galactic plane in a cadence of $\approx$1 minute for a total on-source time of about 13 hours, during the commissioning and pilot observation phases. Such an observation cadence is well applied in producing densely sampling light curves and hunting for stars exhibiting fast stellar variabilities. Here we introduce the primary methodologies in detecting variability, periodicity, and stellar flares among a half million sources from the minute-cadence observations, and present the WFST g-/r-band light curves generated from periodic variable stars and flaring stars. Benefit from high photometric precisions and deep detection limits of WFST, the observations have captured several rare variable stars, such as a variable hot white dwarf (WD) and an ellipsoidal WD binary candidate. By surveying the almost unexplored parameter spaces for variables, WFST will lead to new opportunities in discovering unique variable stars in the northern sky.

astro-ph.SR↗

Boundedness and stability of a 2-D parabolic-elliptic system arising in biological transport networks

This paper is concerned with the Dirichlet initial-boundary value problem of a 2-D parabolic-elliptic system proposed to model the formation of biological transport networks. Even if global weak solutions for this system are known to exist, how to improve the regularity of weak solutions is a challenging problem due to the peculiar cubic nonlinearity and the possible elliptic singularity of the system. Global-in-time existence of classical solutions has recently been established showing that finite time singularities cannot emerge in this problem. However, whether or not singularities in infinite time can be precluded was still pending. In this work, we show that classical solutions of the initial-boundary value problem are uniformly bounded in time as long as $γ\geq1$ and $κ$ is suitably large, closing this gap in the literature. Moreover, uniqueness of classical solutions is also achieved based on the uniform-in-time bounds. Furthermore, it is shown that the corresponding stationary problem possesses a unique classical stationary solution which is semi-trivial, and that is globally exponentially stable, that is, all solutions of the time dependent problem converge exponentially fast to the semi-trivial steady state for $κ$ large enough.

math.AP↗

Content and Salient Semantics Collaboration for Cloth-Changing Person Re-Identification

Cloth-changing person re-identification aims at recognizing the same person with clothing changes across non-overlapping cameras. Advanced methods either resort to identity-related auxiliary modalities (e.g., sketches, silhouettes, and keypoints) or clothing labels to mitigate the impact of clothes. However, relying on unpractical and inflexible auxiliary modalities or annotations limits their real-world applicability. In this paper, we promote cloth-changing person re-identification by leveraging abundant semantics present within pedestrian images, without the need for any auxiliaries. Specifically, we first propose a unified Semantics Mining and Refinement (SMR) module to extract robust identity-related content and salient semantics, mitigating interference from clothing appearances effectively. We further propose the Content and Salient Semantics Collaboration (CSSC) framework to collaborate and leverage various semantics, facilitating cross-parallel semantic interaction and refinement. Our proposed method achieves state-of-the-art performance on three cloth-changing benchmarks, demonstrating its superiority over advanced competitors. The code is available at https://github.com/QizaoWang/CSSC-CCReID.

cs.CV↗

Hierarchical Locality Sensitive Hashing for Structured Data: A Survey

Data similarity (or distance) computation is a fundamental research topic which fosters a variety of similarity-based machine learning and data mining applications. In big data analytics, it is impractical to compute the exact similarity of data instances due to high computational cost. To this end, the Locality Sensitive Hashing (LSH) technique has been proposed to provide accurate estimators for various similarity measures between sets or vectors in an efficient manner without the learning process. Structured data (e.g., sequences, trees and graphs), which are composed of elements and relations between the elements, are commonly seen in the real world, but the traditional LSH algorithms cannot preserve the structure information represented as relations between elements. In order to conquer the issue, researchers have been devoted to the family of the hierarchical LSH algorithms. In this paper, we explore the present progress of the research into hierarchical LSH from the following perspectives: 1) Data structures, where we review various hierarchical LSH algorithms for three typical data structures and uncover their inherent connections; 2) Applications, where we review the hierarchical LSH algorithms in multiple application scenarios; 3) Challenges, where we discuss some potential challenges as future directions.

cs.DS↗

Magnetic phases and electron-phonon coupling in La$_3$Ni$_2$O$_7$ under pressure

Motivated by recent reports of pressure-induced superconductivity in bilayer nickelate La$_3$Ni$_2$O$_7$, we present a comprehensive investigation into the structural, electronic, magnetic, and phonon properties of this compound across a pressure range of 0 to 29.5 GPa. DFT+U calculations reveal that the A-type antiferromagnetic ground state of La$_3$Ni$_2$O$_7$ persists throughout the studied pressure range. Electronic structure analysis shows that the Ni-$d_{xy}$ and Ni-$d_{z^2}$ orbitals dominate near the Fermi level in both the $Fmmm$ and $Amam$ phases of La$_3$Ni$_2$O$_7$. Phonon dispersion calculations for the $Fmmm$ phase reveal no imaginary modes from 12 to 29.5 GPa, confirming its dynamical stability in this pressure range. The vibrational frequencies of O atoms are substantially higher than those of Ni and La atoms, primarily due to the lower mass of oxygen. At 29.5 GPa, the electron-phonon coupling constant $λ$ for the $Fmmm$ phase is calculated to be 0.13. This small value suggests that conventional electron-phonon coupling is insufficient to explain the reported superconductivity in La$_3$Ni$_2$O$_7$, indicating a potentially unconventional mechanism. The study offers nuanced, actionable insights that can strategically inform and direct subsequent experimental investigations into the design and optimization of nickel-based superconducting materials.

cond-mat.supr-con↗

Prediction of high-temperature ambient-pressure superconductivity in hexagonal boron-rich clathrates

Inspired by recent predictions of superconductivity in B-C framework clathrates, we employ density functional theory to explore potential superconductors among hexagonal hydride-substituted compounds with compositions XB$_8$C, XB$_7$C$_2$, XB$_6$C$_3$, XB$_3$C$_6$, XB$_2$C$_7$, and XBC$_8$. Our high-throughput calculations on 96 compounds reveal several dynamically stable candidates exhibiting superconductivity at ambient pressure. Analysis of electronic structures and electron-phonon coupling demonstrates that CaB$_8$C, SrB$_8$C, and BaB$_8$C possess superconducting transition temperatures ($T_c$) exceeding 50 K, with CaB$_8$C exhibiting the highest predicted $T_c$ of 77.1 K among all stable compounds studied. These findings expand the family of B-C clathrate superconductors and provide valuable insights for experimental efforts aimed at discovering novel superconducting materials.

cond-mat.supr-con↗

Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs

While LLMs have demonstrated remarkable potential in time series forecasting, their practical deployment remains constrained by excessive computational demands and memory footprints. Existing LLM-based approaches typically suffer from three critical limitations: Inefficient parameter utilization in handling numerical time series patterns; Modality misalignment between continuous temporal signals and discrete text embeddings; and Inflexibility for real-time expert knowledge integration. We present SMETimes, the first systematic investigation of sub-3B parameter SLMs for efficient and accurate time series forecasting. Our approach centers on three key innovations: A statistically-enhanced prompting mechanism that bridges numerical time series with textual semantics through descriptive statistical features; A adaptive fusion embedding architecture that aligns temporal patterns with language model token spaces through learnable parameters; And a dynamic mixture-of-experts framework enabled by SLMs' computational efficiency, adaptively combining base predictions with domain-specific models. Extensive evaluations across seven benchmark datasets demonstrate that our 3B-parameter SLM achieves state-of-the-art performance on five primary datasets while maintaining 3.8x faster training and 5.2x lower memory consumption compared to 7B-parameter LLM baselines. Notably, the proposed model exhibits better learning capabilities, achieving 12.3% lower MSE than conventional LLM. Ablation studies validate that our statistical prompting and cross-modal fusion modules respectively contribute 15.7% and 18.2% error reduction in long-horizon forecasting tasks. By redefining the efficiency-accuracy trade-off landscape, this work establishes SLMs as viable alternatives to resource-intensive LLMs for practical time series forecasting. Code and models are available at https://github.com/xiyan1234567/SMETimes.

cs.CL↗

VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Models

Faces synthesized by diffusion models (DMs) with high-quality and controllable attributes pose a significant challenge for Deepfake detection. Most state-of-the-art detectors only yield a binary decision, incapable of forgery localization, attribution of forgery methods, and providing analysis on the cause of forgeries. In this work, we integrate Multimodal Large Language Models (MLLMs) within DM-based face forensics, and propose a fine-grained analysis triad framework called VLForgery, that can 1) predict falsified facial images; 2) locate the falsified face regions subjected to partial synthesis; and 3) attribute the synthesis with specific generators. To achieve the above goals, we introduce VLF (Visual Language Forensics), a novel and diverse synthesis face dataset designed to facilitate rich interactions between Visual and Language modalities in MLLMs. Additionally, we propose an extrinsic knowledge-guided description method, termed EkCot, which leverages knowledge from the image generation pipeline to enable MLLMs to quickly capture image content. Furthermore, we introduce a low-level vision comparison pipeline designed to identify differential features between real and fake that MLLMs can inherently understand. These features are then incorporated into EkCot, enhancing its ability to analyze forgeries in a structured manner, following the sequence of detection, localization, and attribution. Extensive experiments demonstrate that VLForgery outperforms other state-of-the-art forensic approaches in detection accuracy, with additional potential for falsified region localization and attribution analysis.

cs.CV↗

Energy-Aware Task Offloading for Rotatable STAR-RIS-Enhanced Mobile Edge Computing Systems

Simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) can expand the coverage of mobile edge computing (MEC) services by reflecting and transmitting signals simultaneously, enabling full-space coverage. The orientation of the STAR-RIS plays a crucial role in optimizing the gain of received and transmitted signals, and a rotatable STAR-RIS offers potential enhancement for MEC systems. This paper investigates a rotatable STAR-RIS-assisted MEC system, operated under three protocols, namely energy splitting, mode switching, and time switching. The goal is to minimize energy consumption for multiple moving user devices through the joint optimization of STAR-RIS configurations, orientation, computation resource allocation, transmission power, and task offloading strategies. Considering the mobility of user devices, we model the original optimization problem as a sequential decision-making process across multiple time slots. The high-dimensional, highly coupled, and nonlinear nature makes it a challenging non-convex decision-making problem for traditional optimization algorithms. Therefore, a deep reinforcement learning (DRL) approach is employed, specifically utilizing soft actor-critic algorithm to train the DRL model. Simulation results demonstrate that the proposed algorithm outperforms the benchmarks in both convergence speed and energy efficiency, while reducing energy consumption by up to 52.7\% compared to the fixed STAR-RIS scheme. Among three operating protocols, the energy splitting yields the best performance.

cs.ET↗

Delay-Aware Digital Twin Synchronization in Mobile Edge Networks with Semantic Communications

The synchronization of digital twins (DT) serves as the cornerstone for effective operation of the DT framework. However, the limitations of channel capacity can greatly affect the data transmission efficiency of wireless communication. Unlike traditional communication methods, semantic communication transmits the intended meanings of physical objects instead of raw data, effectively saving bandwidth resource and reducing DT synchronization latency. Hence, we are committed to integrating semantic communication into the DT synchronization framework within the mobile edge computing system, aiming to enhance the DT synchronization efficiency of user devices (UDs). Our goal is to minimize the average DT synchronization latency of all UDs by jointly optimizing the synchronization strategy, transmission power of UDs, and computational resource allocation for both UDs and base station. The formulated problem involves sequential decision-making across multiple coherent time slots. Furthermore, the mobility of UDs introduces uncertainties into the decision-making process. To solve this challenging optimization problem efficiently, we propose a soft actor-critic-based deep reinforcement learning algorithm to optimize synchronization strategy and resource allocation. Numerical results demonstrate that our proposed algorithm can reduce synchronization latency by up to 13.2\% and improve synchronization efficiency compared to other benchmark schemes.

cs.ET↗

Pressure-driven superconductivity in the topological insulator GeBi4Te7

The van der Waals, pseudo-binary chalcogenides (ACh)m(Pn2Ch3)n (A = Ge, Mn, Pb, etc.; Pn = Sb or Bi; Ch = Te, Se) have recently been reported to host a vast landscape of topological phases of matter, including the quantum anomalous Hall state and topological axion state with quantized magnetoelectric effect. A subgroup in this series, like MnSb4Te7 and GeSb4Te7, can be driven to a superconducting state by applying a physical pressure, making them viable candidates to realize so-called topological superconductivity. However, the role of magnetic fluctuations in this pressure-induced superconductivity remains unclear. Here, we report the pressure-induced multiple superconducting phases in the nonmagnetic GeBi4Te7, accompanied by corresponding structural transitions evidenced from the high-pressure Raman scattering. In comparison with other members in this family, we find the superconducting transition temperature of the nonmagnetic subgroup is significantly higher than their magnetic homologues, possibly hinting at the detrimental role played by the magnetic fluctuations in the superconductivity formation, at least in this pseudo-binary chalcogenide family.

cond-mat.supr-con↗

Symmetrical bipolar electrobending deformation in acceptor-doped piezoceramics

Since 2022, large apparent strains (>1%) with highly asymmetrical strain-electric field (S-E) curves have been reported in various thin piezoceramic materials, attributed to a bidirectional electric-field-induced bending (electrobending) deformation, which consistently produces convex bending along the negative electric field direction. In this study, we report a novel unidirectional electrobending behavior in acceptor-doped K0.5Na0.5NbO3 ceramics, where convex bending always occurs along the pre-poling direction regardless of the direction of the applied electric field. This unique deformation is related to the reorientation of the defect dipoles in one surface layer during the pre-poling process, resulting in an asymmetrical distribution of defect dipoles in the two surface layers. The synergistic interaction between ferroelectric domains and defect dipoles in the surface layers induces this unidirectional electrobending, as evidenced by a butterfly-like symmetrical bipolar S-E curve with a giant apparent strain of 3.2%. These findings provide new insights into defect engineering strategies for developing advanced piezoelectric materials with large electroinduced displacements.

cond-mat.mtrl-sci↗

Range and Bird's Eye View Fused Cross-Modal Visual Place Recognition

Image-to-point cloud cross-modal Visual Place Recognition (VPR) is a challenging task where the query is an RGB image, and the database samples are LiDAR point clouds. Compared to single-modal VPR, this approach benefits from the widespread availability of RGB cameras and the robustness of point clouds in providing accurate spatial geometry and distance information. However, current methods rely on intermediate modalities that capture either the vertical or horizontal field of view, limiting their ability to fully exploit the complementary information from both sensors. In this work, we propose an innovative initial retrieval + re-rank method that effectively combines information from range (or RGB) images and Bird's Eye View (BEV) images. Our approach relies solely on a computationally efficient global descriptor similarity search process to achieve re-ranking. Additionally, we introduce a novel similarity label supervision technique to maximize the utility of limited training data. Specifically, we employ points average distance to approximate appearance similarity and incorporate an adaptive margin, based on similarity differences, into the vanilla triplet loss. Experimental results on the KITTI dataset demonstrate that our method significantly outperforms state-of-the-art approaches.

cs.CV↗

Accurate and Scalable Graph Neural Networks via Message Invariance

Message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. For a sampled mini-batch of target nodes, the message passing process is divided into two parts: message passing between nodes within the batch (MP-IB) and message passing from nodes outside the batch to those within it (MP-OB). However, MP-OB recursively relies on higher-order out-of-batch neighbors, leading to an exponentially growing computational cost with respect to the number of layers. Due to the neighbor explosion, the whole message passing stores most nodes and edges on the GPU such that many GNNs are infeasible to large-scale graphs. To address this challenge, we propose an accurate and fast mini-batch approach for large graph transductive learning, namely topological compensation (TOP), which obtains the outputs of the whole message passing solely through MP-IB, without the costly MP-OB. The major pillar of TOP is a novel concept of message invariance, which defines message-invariant transformations to convert costly MP-OB into fast MP-IB. This ensures that the modified MP-IB has the same output as the whole message passing. Experiments demonstrate that TOP is significantly faster than existing mini-batch methods by order of magnitude on vast graphs (millions of nodes and billions of edges) with limited accuracy degradation.

cs.LG↗

Accurate Pose Estimation for Flight Platforms based on Divergent Multi-Aperture Imaging System

Vision-based pose estimation plays a crucial role in the autonomous navigation of flight platforms. However, the field of view and spatial resolution of the camera limit pose estimation accuracy. This paper designs a divergent multi-aperture imaging system (DMAIS), equivalent to a single imaging system to achieve simultaneous observation of a large field of view and high spatial resolution. The DMAIS overcomes traditional observation limitations, allowing accurate pose estimation for the flight platform. {Before conducting pose estimation, the DMAIS must be calibrated. To this end we propose a calibration method for DMAIS based on the 3D calibration field.} The calibration process determines the imaging parameters of the DMAIS, which allows us to model DMAIS as a generalized camera. Subsequently, a new algorithm for accurately determining the pose of flight platform is introduced. We transform the absolute pose estimation problem into a nonlinear minimization problem. New optimality conditions are established for solving this problem based on Lagrange multipliers. Finally, real calibration experiments show the effectiveness and accuracy of the proposed method. Results from real flight experiments validate the system's ability to achieve centimeter-level positioning accuracy and arc-minute-level orientation accuracy.

cs.CV↗