Search arXiv⌕ Search

arXiv subjects

Qian Li

Publications and source records attributed to Qian Li.

At least 109 records · Page 6Linked to original sources

Practice on Long Behavior Sequence Modeling in Tencent Advertising

Long-sequence modeling has become an indispensable frontier in recommendation systems for capturing users' long-term preferences. However, user behaviors within advertising domains are inherently sparse, posing a significant barrier to constructing long behavioral sequences using data from a single advertising domain alone. This motivates us to collect users' behaviors not only across diverse advertising scenarios, but also beyond the boundaries of the advertising domain into content domains-thereby constructing unified commercial behavior trajectories. This cross-domain or cross-scenario integration gives rise to the following challenges: (1) feature taxonomy gaps between distinct scenarios and domains, (2) inter-field interference arising from irrelevant feature field pairs, and (3) target-wise interference in temporal and semantic patterns when optimizing for different advertising targets. To address these challenges, we propose several practical approaches within the two-stage framework for long-sequence modeling. In the first (search) stage, we design a hierarchical hard search method for handling complex feature taxonomy hierarchies, alongside a decoupled embedding-based soft search to alleviate conflicts between attention mechanisms and feature representation. In the second (sequence modeling) stage, we introduce: (a) Decoupled Side Information Temporal Interest Networks (TIN) to mitigate inter-field conflicts; (b) Target-Decoupled Positional Encoding and Target-Decoupled SASRec to address target-wise interference; and (c) Stacked TIN to model high-order behavioral correlations. Deployed in production on Tencent's large-scale advertising platforms, our innovations delivered significant performance gains: an overall 4.22% GMV lift in WeChat Channels and an overall 1.96% GMV increase in WeChat Moments.

cs.IR↗

Every Keystroke You Make: A Tech-Law Measurement and Analysis of Event Listeners for Wiretapping

The privacy community has a long track record of investigating emerging types of web tracking techniques. Recent work has focused on compliance of web trackers with new privacy laws such as Europe's GDPR and California's CCPA. Despite the growing body of research documenting widespread lack of compliance with new privacy laws, there is a lack of robust enforcement. Different from prior work, we conduct a tech-law analysis to map decades-old U.S. laws about interception of electronic communications--so-called wiretapping--to web tracking. Bridging the tech-law gap for older wiretapping laws is important and timely because, in cases where legal harm to privacy is proven, they can provide statutory private right of action, are at the forefront of recent privacy enforcement, and could ultimately lead to a meaningful change in the web tracking landscape. In this paper, we focus on a particularly invasive tracking technique: the use of JavaScript event listeners by third-party trackers for real-time keystroke interception on websites. We use an instrumented web browser to crawl a sample of the top-million websites to investigate the use of event listeners that aligns with the criteria for wiretapping, according to U.S. wiretapping law at the federal level and in California. We find evidence that 38.52% websites installed third-party event listeners to intercept keystrokes, and that at least 3.18% websites transmitted intercepted information to a third-party server, which aligns with the criteria for wiretapping. We further find evidence that the intercepted information such as email addresses typed into form fields are used for unsolicited email marketing. Beyond our work that maps the intersection between technical measurement and U.S. wiretapping law, additional future legal research is required to determine when the wiretapping observed in our paper passes the threshold for illegality.

cs.CR↗

Novel constants based on the generalization of Von Neumann-Jordan constant

We introduce a new geometric constant based on a generalization of the parallelogram law, and study its properties as well as some relationships with other well-known geometric constants. A sufficient condition for normal structure is presented. Next, we introduce a constant and calculate its value in a specific space. Furthermore, we introduce another new constant and investigate some of its basic properties.

math.FA↗

BCRNet: Enhancing Landmark Detection in Laparoscopic Liver Surgery via Bezier Curve Refinement

Laparoscopic liver surgery, while minimally invasive, poses significant challenges in accurately identifying critical anatomical structures. Augmented reality (AR) systems, integrating MRI/CT with laparoscopic images based on 2D-3D registration, offer a promising solution for enhancing surgical navigation. A vital aspect of the registration progress is the precise detection of curvilinear anatomical landmarks in laparoscopic images. In this paper, we propose BCRNet (Bezier Curve Refinement Net), a novel framework that significantly enhances landmark detection in laparoscopic liver surgery primarily via the Bezier curve refinement strategy. The framework starts with a Multi-modal Feature Extraction (MFE) module designed to robustly capture semantic features. Then we propose Adaptive Curve Proposal Initialization (ACPI) to generate pixel-aligned Bezier curves and confidence scores for reliable initial proposals. Additionally, we design the Hierarchical Curve Refinement (HCR) mechanism to enhance these proposals iteratively through a multi-stage process, capturing fine-grained contextual details from multi-scale pixel-level features for precise Bezier curve adjustment. Extensive evaluations on the L3D and P2ILF datasets demonstrate that BCRNet outperforms state-of-the-art methods, achieving significant performance improvements. Code will be available.

cs.CV↗

Prediction Inconsistency Helps Achieve Generalizable Detection of Adversarial Examples

Adversarial detection protects models from adversarial attacks by refusing suspicious test samples. However, current detection methods often suffer from weak generalization: their effectiveness tends to degrade significantly when applied to adversarially trained models rather than naturally trained ones, and they generally struggle to achieve consistent effectiveness across both white-box and black-box attack settings. In this work, we observe that an auxiliary model, differing from the primary model in training strategy or model architecture, tends to assign low confidence to the primary model's predictions on adversarial examples (AEs), while preserving high confidence on normal examples (NEs). Based on this discovery, we propose Prediction Inconsistency Detector (PID), a lightweight and generalizable detection framework to distinguish AEs from NEs by capturing the prediction inconsistency between the primal and auxiliary models. PID is compatible with both naturally and adversarially trained primal models and outperforms four detection methods across 3 white-box, 3 black-box, and 1 mixed adversarial attacks. Specifically, PID achieves average AUC scores of 99.29\% and 99.30\% on CIFAR-10 when the primal model is naturally and adversarially trained, respectively, and 98.31% and 96.81% on ImageNet under the same conditions, outperforming existing SOTAs by 4.70%$\sim$25.46%.

cs.CR↗

UAV-Enabled Joint Sensing, Communication, Powering and Backhaul Transmission in Maritime Monitoring Networks

This paper addresses the challenge of energy-constrained maritime monitoring networks by proposing an unmanned aerial vehicle (UAV)-enabled integrated sensing, communication, powering and backhaul transmission scheme with a tailored time-division duplex frame structure. Within each time slot, the UAV sequentially implements sensing, wireless charging and uplink receiving with buoys, and lastly forwards part of collected data to the central ship via backhaul links. Considering the tight coupling among these functions, we jointly optimize time allocation, UAV trajectory, UAV-buoy association, and power scheduling to maximize the performance of data collection, with the practical consideration of sea clutter effects during UAV sensing. A novel optimization framework combining alternating optimization, quadratic transform and augmented first-order Taylor approximation is developed, which demonstrates good convergence behavior and robustness. Simulation results show that under sensing quality-of-service constraint, buoys are able to achieve an average data rate over 22bps/Hz using around 2mW harvested power per active time slot, validating the scheme's effectiveness for open-sea monitoring. Additionally, it is found that under the influence of sea clutters, the optimal UAV trajectory always keeps a certain distance with buoys to strike a balance between sensing and other multi-functional transmissions.

eess.SP↗

Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning

Parameter-Efficient Fine-Tuning (PEFT) methods achieve performance comparable to Full Fine-Tuning (FFT) while requiring significantly fewer computing resources, making it the go-to choice for researchers. We find that although PEFT can achieve competitive results on some benchmarks, its performance falls short of FFT in complex tasks, such as reasoning and instruction-based fine-tuning. In this paper, we compare the characteristics of PEFT and FFT in terms of representational capacity and robustness based on optimization theory. We theoretically demonstrate that PEFT is a strict subset of FFT. By providing theoretical upper bounds for PEFT, we show that the limited parameter space constrains the model's representational ability, making it more susceptible to perturbations. Experiments on 15 datasets encompassing classification, generation, reasoning, instruction fine-tuning tasks and 11 adversarial test sets validate our theories. We hope that these results spark further research beyond the realms of well established PEFT. The source code is in the anonymous Github repository\footnote{https://github.com/misonsky/PEFTEval}.

cs.LG↗

FedGraM: Defending Against Untargeted Attacks in Federated Learning via Embedding Gram Matrix

Federated Learning (FL) enables geographically distributed clients to collaboratively train machine learning models by sharing only their local models, ensuring data privacy. However, FL is vulnerable to untargeted attacks that aim to degrade the global model's performance on the underlying data distribution. Existing defense mechanisms attempt to improve FL's resilience against such attacks, but their effectiveness is limited in practical FL environments due to data heterogeneity. On the contrary, we aim to detect and remove the attacks to mitigate their impact. Generalization contribution plays a crucial role in distinguishing untargeted attacks. Our observations indicate that, with limited data, the divergence between embeddings representing different classes provides a better measure of generalization than direct accuracy. In light of this, we propose a novel robust aggregation method, FedGraM, designed to defend against untargeted attacks in FL. The server maintains an auxiliary dataset containing one sample per class to support aggregation. This dataset is fed to the local models to extract embeddings. Then, the server calculates the norm of the Gram Matrix of the embeddings for each local model. The norm serves as an indicator of each model's inter-class separation capability in the embedding space. FedGraM identifies and removes potentially malicious models by filtering out those with the largest norms, then averages the remaining local models to form the global model. We conduct extensive experiments to evaluate the performance of FedGraM. Our empirical results show that with limited data samples used to construct the auxiliary dataset, FedGraM achieves exceptional performance, outperforming state-of-the-art defense methods.

cs.LG↗

Right Time to Learn:Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation

Knowledge distillation (KD) is a powerful strategy for training deep neural networks (DNNs). Although it was originally proposed to train a more compact "student" model from a large "teacher" model, many recent efforts have focused on adapting it to promote generalization of the model itself, such as online KD and self KD. Here, we propose an accessible and compatible strategy named Spaced KD to improve the effectiveness of both online KD and self KD, in which the student model distills knowledge from a teacher model trained with a space interval ahead. This strategy is inspired by a prominent theory named spacing effect in biological learning and memory, positing that appropriate intervals between learning trials can significantly enhance learning performance. With both theoretical and empirical analyses, we demonstrate that the benefits of the proposed Spaced KD stem from convergence to a flatter loss landscape during stochastic gradient descent (SGD). We perform extensive experiments to validate the effectiveness of Spaced KD in improving the learning performance of DNNs (e.g., the performance gain is up to 2.31% and 3.34% on Tiny-ImageNet over online KD and self KD, respectively). Our codes have been released on github https://github.com/SunGL001/Spaced-KD.

cs.LG↗

Advancing Antiferromagnetic Nitrides via Metal Alloy Nitridation

Nitride materials, valued for their structural stability and exceptional physical properties, have garnered significant interest in both fundamental research and technological applications. The fabrication of high-quality nitride thin films is essential for advancing their use in microelectronics and spintronics. Yet, achieving single-crystal nitride thin films with excellent structural integrity remains a challenge. Here, we introduce a straightforward yet innovative metallic alloy nitridation technique for the synthesis of stable single-crystal nitride thin films. By subjecting metal alloy thin films to a controlled nitridation process, nitrogen atoms integrate into the lattice, driving structural transformations while preserving high epitaxial quality. Combining nanoscale magnetic imaging with a diamond nitrogen-vacancy (NV) probe, X-ray magnetic linear dichroism, and comprehensive transport measurements, we confirm that the nitridated films exhibit a robust antiferromagnetic character with a zero net magnetic moment. This work not only provides a refined and reproducible strategy for the fabrication of nitride thin films but also lays a robust foundation for exploring their burgeoning device applications.

cond-mat.mtrl-sci↗

T-T: Table Transformer for Tagging-based Aspect Sentiment Triplet Extraction

Aspect sentiment triplet extraction (ASTE) aims to extract triplets composed of aspect terms, opinion terms, and sentiment polarities from given sentences. The table tagging method is a popular approach to addressing this task, which encodes a sentence into a 2-dimensional table, allowing for the tagging of relations between any two words. Previous efforts have focused on designing various downstream relation learning modules to better capture interactions between tokens in the table, revealing that a stronger capability to capture relations can lead to greater improvements in the model. Motivated by this, we attempt to directly utilize transformer layers as downstream relation learning modules. Due to the powerful semantic modeling capability of transformers, it is foreseeable that this will lead to excellent improvement. However, owing to the quadratic relation between the length of the table and the length of the input sentence sequence, using transformers directly faces two challenges: overly long table sequences and unfair local attention interaction. To address these challenges, we propose a novel Table-Transformer (T-T) for the tagging-based ASTE method. Specifically, we introduce a stripe attention mechanism with a loop-shift strategy to tackle these challenges. The former modifies the global attention mechanism to only attend to a 2-dimensional local attention window, while the latter facilitates interaction between different attention windows. Extensive and comprehensive experiments demonstrate that the T-T, as a downstream relation learning module, achieves state-of-the-art performance with lower computational costs.

cs.CL↗

Identifying discreditable firms in a large-scale ownership network

Violations of laws and regulations about food safety, production safety, quality standard and environmental protection, or negative consequences from loan, guarantee and pledge contracts, may result in operating and credit risks of firms. The above illegal or trust-breaking activities are collectively called discreditable activities, and firms with discreditable activities are named as discreditable firms. Identification of discreditable firms is of great significance for investment attraction, bank lending, equity investment, supplier selection, job seeking, and so on. In this paper, we collect registration records of about 113 million Chinese firms and construct an ownership network with about 6 million nodes, where each node is a firm who has invested at least one firm or has been invested by at least one firm. Analysis of publicly available records of discreditable activities show strong network effect, namely the probability of a firm to be discreditable is remarkably higher than the average probability given the fact that one of its investors or investees is discreditable. In comparison, for the risk of being a discreditable firm, an investee has higher impact than an investor in average. The impact of a firm on surrounding firms decays along with the increasing topological distance, analogous to the well-known "three degrees of separation" phenomenon. The uncovered correlation of discreditable activities can be considered as a representative example of network effect, in addition to the propagation of diseases, opinions and human behaviors. Lastly, we show that the utilization of the network effect largely improves the accuracy of the algorithm to identify discreditable firms.

cs.CY↗

Flexible Perovskite/Silicon Monolithic Tandem Solar Cells Approaching 30% Efficiency

Thanks to their excellent properties of low cost, lightweight, portability, and conformity, flexible perovskite-based tandem solar cells show great potentials for energy harvesting applications, with flexible perovskite/c-silicon tandem solar cells particularly promising for achieving high efficiency. However, performance of flexible perovskite/c-silicon monolithic tandem solar cells still greatly lags, due to challenges in simultaneously achieving both efficient photocarrier transport and reliable mitigation of residual stress. Here, we reveal the critical role of perovskite phase homogeneity, for achieving high-efficient and mechanical-stable flexible perovskite/c-silicon heterojunction monolithic tandem solar cells (PSTs) with textured surface. Through ensuring high phase homogeneity, which promotes charge transfer across all facets of the pyramid on the textured substrates and releases the residual stress at the perovskite/c-silicon interface, we demonstrate flexible PSTs with a bending curvature of 0.44 cm-1, and a certified power conversion efficiency of 29.88% (1.04 cm2 aperture area), surpassing all other types of flexible perovskite-based photovoltaic devices. Our results can lead to broad applications and commercialization of flexible perovskite/c-silicon tandem photovoltaics.

cond-mat.mtrl-sci↗

Free-DyGS: Camera-Pose-Free Scene Reconstruction for Dynamic Surgical Videos with Gaussian Splatting

High-fidelity reconstruction of surgical scene is a fundamentally crucial task to support many applications, such as intra-operative navigation and surgical education. However, most existing methods assume the ideal surgical scenarios - either focus on dynamic reconstruction with deforming tissue yet assuming a given fixed camera pose, or allow endoscope movement yet reconstructing the static scenes. In this paper, we target at a more realistic yet challenging setup - free-pose reconstruction with a moving camera for highly dynamic surgical scenes. Meanwhile, we take the first step to introduce Gaussian Splitting (GS) technique to tackle this challenging setting and propose a novel GS-based framework for fast reconstruction, termed \textit{Free-DyGS}. Concretely, our model embraces a novel scene initialization in which a pre-trained Sparse Gaussian Regressor (SGR) can efficiently parameterize the initial attributes. For each subsequent frame, we propose to jointly optimize the deformation model and 6D camera poses in a frame-by-frame manner, easing training given the limited deformation differences between consecutive frames. A Scene Expansion scheme is followed to expand the GS model for the unseen regions introduced by the moving camera. Moreover, the framework is equipped with a novel Retrospective Deformation Recapitulation (RDR) strategy to preserve the entire-clip deformations throughout the frame-by-frame training scheme. The efficacy of the proposed Free-DyGS is substantiated through extensive experiments on two datasets: StereoMIS and Hamlyn datasets. The experimental outcomes underscore that Free-DyGS surpasses other advanced methods in both rendering accuracy and efficiency. Code will be available.

cs.CV↗

Broad-temperature-range ultrafast terahertz excitation of collective dynamics in polar skyrmions

Ultrafast coherent control of electric dipoles using strong terahertz (THz) pulses provides a means to discover hidden phases of materials and potentially leads to applications in high-speed electro-optic devices. The effectiveness of this means, albeit demonstrated in architype (incipient) ferroelectric systems such as SrTiO3, hinges on a spectral overlapping between their soft phonon modes within the excitation bandwidth of THz pulses. Generally this can only induce an appreciable coupling close to the phase transition temperatures, where the lattice phonons substantially soften. Because of their emergent subterahertz collective dynamics, a fundamentally distinct and effective THz coupling mechanism can be envisaged in topological polar structures recently discovered in PbTiO3/SrTiO3 superlattices. Here, we show that polar skyrmions can be coherently driven into a hidden phase with transient macroscopic polarization, as probed based on THz field-induced second harmonic generation and optical Kerr effects. Such an ultrafast THz-driven phase transition is found to sustain across a broad temperature range of 4-470 K, in accordance with the equilibrium stability field of the skyrmions. Supplemented by dynamical phase-field simulations, we identify the spatial symmetries and relaxation behaviors of the excited collective modes, thereby revealing their correlation with the emergence of the polar phases. Our results unveil the exotic dynamical properties of topological polar structures, which could be technologically exploited given their remarkable flexibility in structure design and tunability under external fields.

cond-mat.mtrl-sci↗

A single-phase epitaxially grown ferroelectric perovskite nitride

The integration of ferroelectrics with semiconductors is crucial for developing functional devices, such as field-effect transistors, tunnel junctions, and nonvolatile memories. However, the synthesis of high-quality single-crystalline ferroelectric nitride perovskites has been limited, hindering a comprehensive understanding of their switching dynamics and potential applications. Here we report the synthesis and characterizations of epitaxial single-phase ferroelectric cerium tantalum nitride (CeTaN3) on both oxides and semiconductors. The polar symmetry of CeTaN3 was confirmed by observing the atomic displacement of central ions relative to the center of the TaN6 octahedra, as well as through optical second harmonic generation. We observed switchable ferroelectric domains in CeTaN3 films using piezo-response force microscopy, complemented by the characterization of square-like polarization-electric field hysteresis loops. The remanent polarization of CeTaN3 reaches approximately 20 uC/cm2 at room temperature, consistent with theoretical calculations. This work establishes a vital link between ferroelectric nitride perovskites and their practical applications, paving the way for next-generation information and energy-storage devices with enhanced performance, scalability, and manufacturability.

cond-mat.mtrl-sci↗

Reconfigurable Holographic Surface-aided Distributed MIMO Radar Systems

Distributed phased Multiple-Input Multiple-Output (phased-MIMO) radar systems have attracted wide attention in target detection and tracking. However, the phase-shifting circuits in phased subarrays contribute to high power consumption and hardware cost. To address this issue, an energy-efficient and cost-efficient metamaterial antenna array, i.e., reconfigurable holographic surface (RHS), has been developed. In this letter, we propose RHS-aided distributed MIMO radar systems to achieve more accurate multi-target detection under equivalent power consumption and hardware cost as that of distributed phased-MIMO radar systems. Different from phased arrays, the RHS achieves beam steering by regulating the radiation amplitude of its elements, and thus conventional beamforming schemes designed for phased arrays are no longer applicable. Aiming to maximize detection accuracy, we design an amplitude-controlled beamforming scheme for multiple RHS transceiver subarrays. The simulations validate the superiority of the proposed scheme over the distributed phased-MIMO radar scheme and reveal the optimal allocation of spatial diversity and coherent processing gain that leads to the best system performance when hardware resources are fixed.

eess.SP↗

Giant Rashba splitting in PtTe/PtTe$_2$ heterostructure

Achieving a large spin splitting is highly desirable for spintronic devices, which often requires breaking of the inversion symmetry. However, many atomically thin films are centrosymmetric, making them unsuitable for spintronic applications. Here, we report a strategy to achieve inversion symmetry breaking from a centrosymmetric transition metal dichalcogenide (TMDC) bilayer PtTe$_2$, leading to a giant Rashba spin splitting. Specifically, the thermal annealing turns one layer of PtTe$_2$ sample into a transition metal monochalcogenide (TMMC) PtTe through Te extraction, thus forming PtTe/PtTe$_2$ heterostructure with inversion symmetry breaking. In the naturally-formed PtTe/PtTe$_2$ heterostructure, we observe a giant Rashba spin splitting with Rashba coefficient of $α_{R}$ = 1.8 eV$\cdot$$Å$, as revealed by spin- and angle-resolved photoemission spectroscopy measurements. Our work demonstrates a convenient and effective pathway for achieving pronounced Rashba splitting in centrosymmetric TMDC thin films by creating TMMC/TMDC heterostructure, thereby extending their potential applications to spintronics.

cond-mat.mtrl-sci↗