arXiv subjects

Tong Liu

Publications and source records attributed to Tong Liu.

At least 127 records · Page 7Linked to original sources

arXiv2025

A Generative Re-ranking Model for List-level Multi-objective Optimization at Taobao

E-commerce recommendation systems aim to generate ordered lists of items for customers, optimizing multiple business objectives, such as clicks, conversions and Gross Merchandise Volume (GMV). Traditional multi-objective optimization methods like formulas or Learning-to-rank (LTR) models take effect at item-level, neglecting dynamic user intent and contextual item interactions. List-level multi-objective optimization in the re-ranking stage can overcome this limitation, but most current re-ranking models focus more on accuracy improvement with context. In addition, re-ranking is faced with the challenges of time complexity and diversity. In light of this, we propose a novel end-to-end generative re-ranking model named Sequential Ordered Regression Transformer-Generator (SORT-Gen) for the less-studied list-level multi-objective optimization problem. Specifically, SORT-Gen is divided into two parts: 1)Sequential Ordered Regression Transformer innovatively uses Transformer and ordered regression to accurately estimate multi-objective values for variable-length sub-lists. 2)Mask-Driven Fast Generation Algorithm combines multi-objective candidate queues, efficient item selection and diversity mechanism into model inference, providing a fast online list generation method. Comprehensive online experiments demonstrate that SORT-Gen brings +4.13% CLCK and +8.10% GMV for Baiyibutie, a notable Mini-app of Taobao. Currently, SORT-Gen has been successfully deployed in multiple scenarios of Taobao App, serving for a vast number of users.

cs.IR↗

arXiv2025

Quantum synchronization in one-dimensional topological systems

The phenomenon of synchronization, where entities exhibit stable oscillations with aligned frequencies and phases, has been detected in diverse areas of natural science. It plays a crucial role in achieving frequency locking in multiple applications such as microwave communication and signal processing. The study of synchronization in quantum systems has gained significant interest, particularly in developing robust methods for synchronizing distant objects. Here, we demonstrate that synchronization between the boundary sites of one-dimensional generalized Aubry-André-Harper models can be induced through applying dissipation on the central sites. Two types of synchronization, stemming from the topological edge states, are characterized by the off-diagonal or diagonal correlations between the boundary sites. We analyze the relaxation rate to realize the synchronization and its acceleration with bulk dissipation. Remarkably, the synchronous oscillations maintain steady amplitude and frequency in the thermodynamic limit. Moreover, we show that the synchronization is robust against the perturbations in the Hamiltonian and initial states, highlighting its potential for practical implementation in quantum networks.

quant-ph↗

arXiv2025

Design and Experimental Test of Datatic Approximate Optimal Filter in Nonlinear Dynamic Systems

Filtering is crucial in engineering fields, providing vital state estimation for control systems. However, the nonlinear nature of complex systems and the presence of non-Gaussian noises pose significant challenges to the performance of conventional filtering methods in terms of estimation accuracy and computational efficiency. In this work, we present a data-driven closed-loop filter, termed datatic approximate optimal filter (DAOF), specifically designed for nonlinear systems under non-Gaussian conditions. We first formulate a Markovian filtering problem (MFP), which inherently shares a connection with reinforcement learning (RL) as it aims to compute the optimal state estimate by minimizing the accumulated error. To solve MFP, we propose DAOF, which primarily incorporates a trained RL policy and features two distinct structural designs: DAOF-v1 and DAOF-v2. Designed for systems with explicit models, DAOF-v1 combines prediction and update phases, with the RL policy generating the update value. Meanwhile, DAOF-v2 bypasses system modeling by directly outputting the state estimate. Then, we utilize an actor-critic algorithm to learn the parameterized policy for DAOF. Experimental results on a 2-degree-of-freedom (2-DOF) vehicle system, equipped with explicit system models, demonstrate the superior accuracy and computational efficiency of DAOF-v1 compared to existing nonlinear filters. Moreover, DAOF-v2 showcases its unique ability to perform filtering without requiring explicit system modeling, as validated by a 14-DOF vehicle system.

eess.SY↗

arXiv2025

Searching for pulsars in Globular Clusters with the Fast Fold Algorithm and a new pulsar discovered in M13

We employed the Fast Folding Algorithm (FFA) on L-Band Globular Cluster (GC) observations taken with Five-hundred-meter Aperture Spherical radio Telescope (FAST) to search for new pulsars, especially those with a long rotational period. We conducted a search across 16 GCs that collectively host 93 known pulsars, as well as 14 GCs that do not contain any known pulsars. The majority of these known pulsars were successfully re-detected in our survey. The few non-detections could be attributed to the high accelerations of these pulsars. Additionally, we have discovered a new binary millisecond pulsar, namely M13I (or PSR J1641+3627I) in GC M13 (or NGC 6205), and obtained its phase-coherent timing solution using observations spanning 6 years. M13I has a spin period of 6.37 ms, and an orbital period of 18.23 days. The eccentricity of the binary orbit is 0.064, with a companion mass range of approximately 0.45 to 1.37 M$_{\odot}$. The orbital properties of M13I are remarkably different from those of the other known pulsars in M13, indicating that this pulsar has undergone a different evolutionary path compared to the rest.

astro-ph.HE↗

arXiv2025

Taming the Titans: A Survey of Efficient LLM Inference Serving

Large Language Models (LLMs) for Generative AI have achieved remarkable progress, evolving into sophisticated and versatile tools widely adopted across various domains and applications. However, the substantial memory overhead caused by their vast number of parameters, combined with the high computational demands of the attention mechanism, poses significant challenges in achieving low latency and high throughput for LLM inference services. Recent advancements, driven by groundbreaking research, have significantly accelerated progress in this field. This paper provides a comprehensive survey of these methods, covering fundamental instance-level approaches, in-depth cluster-level strategies, emerging scenario directions, and other miscellaneous but important areas. At the instance level, we review model placement, request scheduling, decoding length prediction, storage management, and the disaggregation paradigm. At the cluster level, we explore GPU cluster deployment, multi-instance load balancing, and cloud service solutions. For emerging scenarios, we organize the discussion around specific tasks, modules, and auxiliary methods. To ensure a holistic overview, we also highlight several niche yet critical areas. Finally, we outline potential research directions to further advance the field of LLM inference serving.

cs.CL↗

arXiv2025

Kimi-Audio Technical Report

We present Kimi-Audio, an open-source audio foundation model that excels in audio understanding, generation, and conversation. We detail the practices in building Kimi-Audio, including model architecture, data curation, training recipe, inference deployment, and evaluation. Specifically, we leverage a 12.5Hz audio tokenizer, design a novel LLM-based architecture with continuous features as input and discrete tokens as output, and develop a chunk-wise streaming detokenizer based on flow matching. We curate a pre-training dataset that consists of more than 13 million hours of audio data covering a wide range of modalities including speech, sound, and music, and build a pipeline to construct high-quality and diverse post-training data. Initialized from a pre-trained LLM, Kimi-Audio is continual pre-trained on both audio and text data with several carefully designed tasks, and then fine-tuned to support a diverse of audio-related tasks. Extensive evaluation shows that Kimi-Audio achieves state-of-the-art performance on a range of audio benchmarks including speech recognition, audio understanding, audio question answering, and speech conversation. We release the codes, model checkpoints, as well as the evaluation toolkits in https://github.com/MoonshotAI/Kimi-Audio.

eess.AS↗

arXiv2025

A Neutron Capture Explanation for the 10 MeV Emission Line Seen in GRB 221009A

The brightest ever gamma-ray burst (GRB) 221009A displays a significant emission line component around 10 MeV. As the GRB central engine is neutron-rich, we propose that the emission line could be originally due to the 2.223 MeV gamma-rays following neutron capture with protons. The measured line profile can be adequately fitted with a neutron capture model that involves thermal broadening and a bulk Doppler shift. The spectral modeling reveals a Doppler factor varying from 5.1 to 2.1 for the neutron-rich component, along with a temperature increase from 300 keV to about 900 keV, during the time interval of 280--360 s since the trigger, with about $10^{-2}$ $M_\odot$ deuteriums produced in the process. We argue that the neutron capture can take place in the outer shell of a structure jet. Disk winds could be another possible site.

astro-ph.HE↗

arXiv2025

Large Language Models for Traffic and Transportation Research: Methodologies, State of the Art, and Future Opportunities

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and adapting LLMs for various traffic and transportation applications. However, despite these significant advancements, a systematic review and synthesis of the existing studies remain lacking. To address this gap, this paper provides a comprehensive review of the methodologies and applications of LLMs in traffic and transportation, highlighting their ability to process unstructured textual data to advance transportation research. We explore key applications, including autonomous driving, travel behavior prediction, and general transportation-related queries, alongside methodologies such as zero- or few-shot learning, prompt engineering, and fine-tuning. Our analysis identifies critical research gaps. From the methodological perspective, many research gaps can be addressed by integrating LLMs with existing tools and refining LLM architectures. From the application perspective, we identify numerous opportunities for LLMs to tackle a variety of traffic and transportation challenges, building upon existing research. By synthesizing these findings, this review not only clarifies the current state of LLM adoption and adaptation in traffic and transportation but also proposes future research directions, paving the way for smarter and more sustainable transportation systems.

cs.CE↗

arXiv2025

Constraints on violation of Lorentz symmetry with clock-comparison redshift experiments

Lorentz symmetry is a cornerstone of both the General relativity and Standard Model and its experimental verification deepens our understanding of nature. This paper focuses on the investigation of Lorentz violations with the context of clock comparison experiments in the framework of Standard Model Extension (SME). Considering matter-gravity coupling sector, we provide a generic frame to study the sensitivities of Lorentz-violating coefficients for three distinct types of clock redshift tests, including the traditional gravitational redshift test, null-redshift test I and null-redshift test II. Each of these tests is sensitivity to different combinations of Lorentz-violating coefficients. By using the current clock comparison results, we estimate the limits of SME coefficients at level of parts in $10^{4}$ down to parts in $10^{7}$. Better sensitivity may be achieved in the clock comparisons by using the state-of-the-art optical clocks. Additionally considering relativistic factors in null-redshift I, the frequency comparison result of E2 and E3 transitions of Yb$^{+}$ can set the limit $c^{e}_{00}=(7.4\pm9.3)\times10^{-9}$ in the electron sector. Our analysis demonstrates that clock-comparison redshift experiments may contribute to explore the vast parameters space on searching for the Lorentz violation.

gr-qc↗

arXiv2025

Thermodynamics of the Hubbard Model on the Bethe Lattice

We investigate the thermodynamic properties of the Hubbard model on the Bethe lattice with a coordination number of 3 using the thermal canonical tree tensor network method. Our findings reveal two distinct thermodynamic phases: a low-temperature antiferromagnetic phase, where spin SU(2) symmetry is broken, and a high-temperature paramagnetic phase. A key feature of the system is the separation of energy scales for charge and spin excitations, which is reflected in the temperature dependence of thermodynamic quantities and the disparity between spin and charge gaps extracted from their respective susceptibilities. At the critical point, both spin and charge susceptibilities exhibit singularities, suggesting that charge excitations are not fully decoupled from their spin counterparts. Additionally, the double occupancy number exhibits a non-monotonic temperature dependence, indicative of an entropy-driven Pomeranchuk effect. These results demonstrate that the loopless Bethe lattice effectively captures the essential physics of the Hubbard model while providing a computationally efficient framework for studying strongly correlated electronic systems.

cond-mat.str-el↗

arXiv2025

AVD2: Accident Video Diffusion for Accident Video Description

Traffic accidents present complex challenges for autonomous driving, often featuring unpredictable scenarios that hinder accurate system interpretation and responses. Nonetheless, prevailing methodologies fall short in elucidating the causes of accidents and proposing preventive measures due to the paucity of training data specific to accident scenarios. In this work, we introduce AVD2 (Accident Video Diffusion for Accident Video Description), a novel framework that enhances accident scene understanding by generating accident videos that aligned with detailed natural language descriptions and reasoning, resulting in the contributed EMM-AU (Enhanced Multi-Modal Accident Video Understanding) dataset. Empirical results reveal that the integration of the EMM-AU dataset establishes state-of-the-art performance across both automated metrics and human evaluations, markedly advancing the domains of accident analysis and prevention. Project resources are available at https://an-answer-tree.github.io

cs.CV↗

arXiv2025

Demystifying RCE Vulnerabilities in LLM-Integrated Apps

LLMs show promise in transforming software development, with a growing interest in integrating them into more intelligent apps. Frameworks like LangChain aid LLM-integrated app development, offering code execution utility/APIs for custom actions. However, these capabilities theoretically introduce Remote Code Execution (RCE) vulnerabilities, enabling remote code execution through prompt injections. No prior research systematically investigates these frameworks' RCE vulnerabilities or their impact on applications and exploitation consequences. Therefore, there is a huge research gap in this field. In this study, we propose LLMSmith to detect, validate and exploit the RCE vulnerabilities in LLM-integrated frameworks and apps. To achieve this goal, we develop two novel techniques, including 1) a lightweight static analysis to examine LLM integration mechanisms, and construct call chains to identify RCE vulnerabilities in frameworks; 2) a systematical prompt-based exploitation method to verify and exploit the found vulnerabilities in LLM-integrated apps. This technique involves various strategies to control LLM outputs, trigger RCE vulnerabilities and launch subsequent attacks. Our research has uncovered a total of 20 vulnerabilities in 11 LLM-integrated frameworks, comprising 19 RCE vulnerabilities and 1 arbitrary file read/write vulnerability. Of these, 17 have been confirmed by the framework developers, with 11 vulnerabilities being assigned CVE IDs. For the 51 apps potentially affected by RCE, we successfully executed attacks on 17 apps, 16 of which are vulnerable to RCE and 1 to SQL injection. Furthermore, we conduct a comprehensive analysis of these vulnerabilities and construct practical attacks to demonstrate the hazards in reality. Last, we propose several mitigation measures for both framework and app developers to counteract such attacks.

cs.CR↗

arXiv2025

Preliminary Sensitivity Study for a Gravitational Redshift Measurement with China's Lunar Exploration Project

General relativity (GR) is a highly successful theory that describes gravity as a geometric phenomenon. The gravitational redshift, a classic test of GR, can potentially be violated in alternative gravity theories, and experimental tests on this effect are crucial for our understanding of gravity. In this paper, considering the space-ground clock comparisons with free-space links, we discuss a high-precision Doppler cancellation-based measurement model for testing gravitational redshift. This model can effectively reduce various sources of error and noise, reducing the influences of the first-order Doppler effect, atmospheric delay, Shapiro delay, etc. China's Lunar Exploration Project (CLEP) is proposed to equip the deep-space H maser with a daily stability of $2\times10^{-15}$, which provides an approach for testing gravitational redshift. Based on the simulation, we analyze the space-ground clock comparison experiments of the CLEP experiment, and simulation analysis demonstrates that under ideal condition of high-precision measurement of the onboard H-maser frequency offset and drift, the CLEP experiment may reach the uncertainty of $3.7\times10^{-6}$ after a measurement session of 60 days. Our results demonstrate that if the issue of frequency offset and drift is solved, CLEP missions have a potential of testing the gravitational redshift with high accuracy. This manuscript has been accepted for publication in Classical and Quantum Gravity. DOI 10.1088/1361-6382/ad4ae2

gr-qc↗

arXiv2025

Memory Helps, but Confabulation Misleads: Understanding Streaming Events in Videos with MLLMs

Multimodal large language models (MLLMs) have demonstrated strong performance in understanding videos holistically, yet their ability to process streaming videos-videos are treated as a sequence of visual events-remains underexplored. Intuitively, leveraging past events as memory can enrich contextual and temporal understanding of the current event. In this paper, we show that leveraging memories as contexts helps MLLMs better understand video events. However, because such memories rely on predictions of preceding events, they may contain misinformation, leading to confabulation and degraded performance. To address this, we propose a confabulation-aware memory modification method that mitigates confabulated memory for memory-enhanced event understanding.

cs.CV↗

arXiv2025

PerfSeer: An Efficient and Accurate Deep Learning Models Performance Predictor

Predicting the performance of deep learning (DL) models, such as execution time and resource utilization, is crucial for Neural Architecture Search (NAS), DL cluster schedulers, and other technologies that advance deep learning. The representation of a model is the foundation for its performance prediction. However, existing methods cannot comprehensively represent diverse model configurations, resulting in unsatisfactory accuracy. To address this, we represent a model as a graph that includes the topology, along with the node, edge, and global features, all of which are crucial for effectively capturing the performance of the model. Based on this representation, we propose PerfSeer, a novel predictor that uses a Graph Neural Network (GNN)-based performance prediction model, SeerNet. SeerNet fully leverages the topology and various features, while incorporating optimizations such as Synergistic Max-Mean aggregation (SynMM) and Global-Node Perspective Boost (GNPB) to capture the critical performance information more effectively, enabling it to predict the performance of models accurately. Furthermore, SeerNet can be extended to SeerNet-Multi by using Project Conflicting Gradients (PCGrad), enabling efficient simultaneous prediction of multiple performance metrics without significantly affecting accuracy. We constructed a dataset containing performance metrics for 53k+ model configurations, including execution time, memory usage, and Streaming Multiprocessor (SM) utilization during both training and inference. The evaluation results show that PerfSeer outperforms nn-Meter, Brp-NAS, and DIPPM.

cs.PF↗

arXiv2025

Graph Neural Networks for Travel Distance Estimation and Route Recommendation Under Probabilistic Hazards

Estimating the shortest travel time and providing route recommendation between different locations in a city or region can quantitatively measure the conditions of the transportation network during or after extreme events. One common approach is to use Dijkstra's Algorithm, which produces the shortest path as well as the shortest distance. However, this option is computationally expensive when applied to large-scale networks. This paper proposes a novel fast framework based on graph neural networks (GNNs) which approximate the single-source shortest distance between pairs of locations, and predict the single-source shortest path subsequently. We conduct multiple experiments on synthetic graphs of different size to demonstrate the feasibility and computational efficiency of the proposed model. In real-world case studies, we also applied the proposed method of flood risk analysis of coastal urban areas to calculate delays in evacuation to public shelters during hurricanes. The results indicate the accuracy and computational efficiency of the GNN model, and its potential for effective implementation in emergency planning and management.

cs.LG↗

arXiv2025

Multi-Class Traffic Assignment using Multi-View Heterogeneous Graph Attention Networks

Solving traffic assignment problem for large networks is computationally challenging when conventional optimization-based methods are used. In our research, we develop an innovative surrogate model for a traffic assignment when multi-class vehicles are involved. We do so by employing heterogeneous graph neural networks which use a multiple-view graph attention mechanism tailored to different vehicle classes, along with additional links connecting origin-destination pairs. We also integrate the node-based flow conservation law into the loss function. As a result, our model adheres to flow conservation while delivering highly accurate predictions for link flows and utilization ratios. Through numerical experiments conducted on urban transportation networks, we demonstrate that our model surpasses traditional neural network approaches in convergence speed and predictive accuracy in both user equilibrium and system optimal versions of traffic assignment.

cs.LG↗

arXiv2025

Polarization Profiles of Globular Cluster Pulsars from FAST I. 25 Profiles from Previously Known Pulsars

Pulsar polarization profiles are critical for understanding their magnetospheric structures and radiation mechanisms. We present polarization profile measurements for 25 pulsars in globular clusters (GCs) from the observation of the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The diversity of polarization profiles shows complex magnetic structure and emission pattern of pulsars. Among these, the polarization profiles of 15 pulsars were firstly measured. M53A present a 57\% linear polarization ratio, being highest among these 25 GC pulsars. M15H present a 42\% circular polarization ratio, which is the highest among these 25 pulsars. The average ratios of circular and absolute circular polarization of these GC pulsars are -1\% and 10\% respectively, lower than normal pulsars measured with Parkes (\citealt{Oswald2023}), which are 5\% and 32\%, respectively. The Rotation Measure (RM) values of each pulsar were measured, giving the range of pulsar(s) from M3, M5, M15, M71, M53, NGC6517, NGC6539, NGC6760 being 8(1) to 16(1) rad $m^{-2}$, -1(2) to -4(6) rad $m^{-2}$, -70(2) to -76(1) rad $m^{-2}$, -480(14) rad $m^{-2}$ (M71A only), -2(1) rad $m^{-2}$ (M53A only), 187(1) to 212(2) rad $m^{-2}$, 109(1) rad $m^{-2}$ (NGC6539A only), and 102(1) to 129(4) rad $m^{-2}$. The GCs closer to the Galactic plane (GP) tend to have larger RM. This is consistent with previous study (\citealt{Hutschenreuter2022}).

astro-ph.HE↗