arXiv subjects

Fei Sun

Publications and source records attributed to Fei Sun.

At least 73 records · Page 4Linked to original sources

arXiv2025

LLM4MEA: Data-free Model Extraction Attacks on Sequential Recommenders via Large Language Models

Recent studies have demonstrated the vulnerability of sequential recommender systems to Model Extraction Attacks (MEAs). MEAs collect responses from recommender systems to replicate their functionality, enabling unauthorized deployments and posing critical privacy and security risks. Black-box attacks in prior MEAs are ineffective at exposing recommender system vulnerabilities due to random sampling in data selection, which leads to misaligned synthetic and real-world distributions. To overcome this limitation, we propose LLM4MEA, a novel model extraction method that leverages Large Language Models (LLMs) as human-like rankers to generate data. It generates data through interactions between the LLM ranker and target recommender system. In each interaction, the LLM ranker analyzes historical interactions to understand user behavior, and selects items from recommendations with consistent preferences to extend the interaction history, which serves as training data for MEA. Extensive experiments demonstrate that LLM4MEA significantly outperforms existing approaches in data quality and attack performance, reducing the divergence between synthetic and real-world data by up to 64.98% and improving MEA performance by 44.82% on average. From a defensive perspective, we propose a simple yet effective defense strategy and identify key hyperparameters of recommender systems that can mitigate the risk of MEAs.

cs.IR↗

arXiv2025

The Mirage of Model Editing: Revisiting Evaluation in the Wild

Despite near-perfect results reported in the literature, the effectiveness of model editing in real-world applications remains unclear. To bridge this gap, we introduce QAEdit, a new benchmark aligned with widely used question answering (QA) datasets, and WILD, a task-agnostic evaluation framework designed to better reflect real-world usage of model editing. Our single editing experiments show that current editing methods perform substantially worse than previously reported (38.5% vs. 96.8%). We demonstrate that it stems from issues in the synthetic evaluation practices of prior work. Among them, the most severe is the use of teacher forcing during testing, which leaks both content and length of the ground truth, leading to overestimated performance. Furthermore, we simulate practical deployment by sequential editing, revealing that current approaches fail drastically with only 1000 edits. This work calls for a shift in model editing research toward rigorous evaluation and the development of robust, scalable methods that can reliably update knowledge in LLMs for real-world use.

cs.CL↗

arXiv2025

Thermal superscatterer: amplification of thermal scattering signatures for arbitrarily shaped thermal materials

The concept of superscattering is extended to the thermal field through the design of a thermal superscatterer based on transformation thermodynamics. A small thermal scatterer of arbitrary shape and conductivity is encapsulated with an engineered negative-conductivity shell, creating a composite that mimics the scattering signature of a significantly larger scatterer. The amplified signature can match either a conformal larger scatterer (preserving conductivity) or a geometry-transformed one (modified conductivity). The implementation employs a positive-conductivity shell integrated with active thermal metasurfaces, demonstrated through three representative examples: super-insulating thermal scattering, super-conducting thermal scattering, and equivalent thermally transparent effects. Experimental validation shows the fabricated superscatterer amplifies the thermal scattering signature of a small insulated circular region by nine times, effectively mimicking the scattering signature of a circular region with ninefold radius. This approach enables thermal signature manipulation beyond physical size constraints, with potential applications in thermal superabsorbers/supersources, thermal camouflage, and energy management.

physics.app-ph↗

arXiv2025

Implementation of ultra-broadband optical null media via space-folding

Optical null medium (ONM) has garnered significant attention in electromagnetic wave manipulation. However, existing ONM implementations suffer from either narrow operational bandwidths or low efficiency. Here, we demonstrate an ultra-broadband ONM design that simultaneously addresses both challenges - achieving broad bandwidth while preserving perfect impedance matching with air for near-unity transmittance. The proposed space-folding ONM is realized by introducing precisely engineered folds into a metal channel array, creating an effective dispersion-free medium that enables independent phase control in each channel. The design incorporates optimized boundary layers implemented through gradually tapered folding structures, achieving perfect impedance matching with the surrounding medium. Beam bending effect and broadband beam focusing effect are experimentally verified using the proposed space-folding ONM. Due to its simple material requirements, broadband characteristics, and high transmittance, the proposed space-folding ONM shows potential for applications in electromagnetic camouflage, beam steering devices and ultra-compact microwave components.

physics.optics↗

arXiv2025

Broadband source-surrounded cloak for on-chip antenna radiation pattern protection

As the frequency range of electromagnetic wave communication continues to expand and the integration of integrated circuits increases, electromagnetic waves emitted by on-chip antennas are prone to scattering from electronic components, which limits further improvements in integration and the protection of radiation patterns. Cloaks can be used to reduce electromagnetic scattering; however, they cannot achieve both broadband and omnidirectional effectiveness simultaneously. Moreover, their operating modes are typically designed for scenarios where the source is located outside the cloak, making it difficult to address this problem. In this work, we propose a dispersionless air-impedance-matched metamaterial over the 2-8 GHz bandwidth that achieves an adjustable effective refractive index ranging from 1.1 to 1.5, with transmittance maintained above 93%. Based on this metamaterial, we introduce a broadband source-surrounded cloak that can guide electromagnetic waves from a broadband source surrounded by the cloak in any propagation direction to bypass obstacles and reproduce the original wavefronts outside the cloak. Thereby protecting the radiation pattern from distortion due to scattering caused by obstacles. Our work demonstrates significant potential for enhancing the integration density of integrated circuits and improving the operational stability of communication systems.

physics.optics↗

arXiv2025

Robust Recommender System: A Survey and Future Directions

With the rapid growth of information, recommender systems have become integral for providing personalized suggestions and overcoming information overload. However, their practical deployment often encounters ``dirty'' data, where noise or malicious information can lead to abnormal recommendations. Research on improving recommender systems' robustness against such dirty data has thus gained significant attention. This survey provides a comprehensive review of recent work on recommender systems' robustness. We first present a taxonomy to organize current techniques for withstanding malicious attacks and natural noise. We then explore state-of-the-art methods in each category, including fraudster detection, adversarial training, certifiable robust training for defending against malicious attacks, and regularization, purification, self-supervised learning for defending against malicious attacks. Additionally, we summarize evaluation metrics and commonly used datasets for assessing robustness. We discuss robustness across varying recommendation scenarios and its interplay with other properties like accuracy, interpretability, privacy, and fairness. Finally, we delve into open issues and future research directions in this emerging field. Our goal is to provide readers with a comprehensive understanding of robust recommender systems and to identify key pathways for future research and development. To facilitate ongoing exploration, we maintain a continuously updated GitHub repository with related research: https://github.com/Kaike-Zhang/Robust-Recommender-System.

cs.IR↗

arXiv2025

High-precise determination of critical exponents in holographic QCD

The precise determination of critical exponents is crucial for understanding the properties of strongly interacting matter under extreme conditions. These exponents are fundamentally linked to the system's behavior near the critical end point (CEP), making precise localization of the CEP essential. However, precisely identifying the CEP within the framework of AdS/CFT correspondence presents considerable challenges. In this study, we explore critical phenomena and critical exponents within a holographic QCD model. We achieve high-precision calculations of the CEP's position and dynamically analyze the behavior of the critical exponent as it approaches the CEP using limiting methods. Our results indicate that linear fitting is only appropriate in regions very close to the CEP. Furthermore, we find that although the values of the critical exponents vary when approaching the CEP from different directions, they ultimately converge to a single fixed value, revealing a universal behavior among these exponents. Our research underscores the importance of precisely determining the CEP, selecting the fitting region, and considering the direction of the approach when predicting critical exponents. These findings establish a vital benchmark for identifying critical phenomena and their associated exponents.

hep-ph↗

arXiv2025

LoRec: Large Language Model for Robust Sequential Recommendation against Poisoning Attacks

Sequential recommender systems stand out for their ability to capture users' dynamic interests and the patterns of item-to-item transitions. However, the inherent openness of sequential recommender systems renders them vulnerable to poisoning attacks, where fraudulent users are injected into the training data to manipulate learned patterns. Traditional defense strategies predominantly depend on predefined assumptions or rules extracted from specific known attacks, limiting their generalizability to unknown attack types. To solve the above problems, considering the rich open-world knowledge encapsulated in Large Language Models (LLMs), our research initially focuses on the capabilities of LLMs in the detection of unknown fraudulent activities within recommender systems, a strategy we denote as LLM4Dec. Empirical evaluations demonstrate the substantial capability of LLMs in identifying unknown fraudsters, leveraging their expansive, open-world knowledge. Building upon this, we propose the integration of LLMs into defense strategies to extend their effectiveness beyond the confines of known attacks. We propose LoRec, an advanced framework that employs LLM-Enhanced Calibration to strengthen the robustness of sequential recommender systems against poisoning attacks. LoRec integrates an LLM-enhanced CalibraTor (LCT) that refines the training process of sequential recommender systems with knowledge derived from LLMs, applying a user-wise reweighting to diminish the impact of fraudsters injected by attacks. By incorporating LLMs' open-world knowledge, the LCT effectively converts the limited, specific priors or rules into a more general pattern of fraudsters, offering improved defenses against poisoning attacks. Our comprehensive experiments validate that LoRec, as a general framework, significantly strengthens the robustness of sequential recommender systems.

cs.IR↗

arXiv2025

Reversibly Strain Engineering and Electric-Field Control of Crystal Symmetry in Multiferroic Oxides

Multiferroic oxides, such as BiFeO3, have garnered significant attention due to their coupled ferroelectric, magnetic, and elastic properties, offering exciting opportunities for multifunctional device applications. Controlling phase transitions in these materials is critical for tuning their physical properties and achieving desired functionalities. While numerous studies have focused on ferroelectric-ferroelectric transitions at rhombohedral-tetragonal morphotropic phase boundaries, far less attention has been given to the ferroelectric-antiferroelectric phase boundaries. Such systems hold promise for discovering novel physical phenomena, such as reversible phase transitions, enhanced piezoelectricity, and magnetoelectric coupling. In this work, we report a reversible antiferroelectric-to-ferroelectric phase transition in La doped BiFeO3 thin films. By modulating the residual strain via film thickness, an antiferroelectric orthorhombic phase is stabilized within a ferroelectric rhombohedral phase matrix. Under an external electric field, the phase transitions reversibly between these two states. This discovery not only enriches the understanding of orthorhombic-rhombohedral morphotropic phase boundaries but also provides a potential pathway for developing magnetoelectric devices with enhanced functionality.

cond-mat.mtrl-sci↗

arXiv2025

Personalized Denoising Implicit Feedback for Robust Recommender System

While implicit feedback is foundational to modern recommender systems, factors such as human error, uncertainty, and ambiguity in user behavior inevitably introduce significant noise into this feedback, adversely affecting the accuracy and robustness of recommendations. To address this issue, existing methods typically aim to reduce the training weight of noisy feedback or discard it entirely, based on the observation that noisy interactions often exhibit higher losses in the overall loss distribution. However, we identify two key issues: (1) there is a significant overlap between normal and noisy interactions in the overall loss distribution, and (2) this overlap becomes even more pronounced when transitioning from pointwise loss functions (e.g., BCE loss) to pairwise loss functions (e.g., BPR loss). This overlap leads traditional methods to misclassify noisy interactions as normal, and vice versa. To tackle these challenges, we further investigate the loss overlap and find that for a given user, there is a clear distinction between normal and noisy interactions in the user's personal loss distribution. Based on this insight, we propose a resampling strategy to Denoise using the user's Personal Loss distribution, named PLD, which reduces the probability of noisy interactions being optimized. Specifically, during each optimization iteration, we create a candidate item pool for each user and resample the items from this pool based on the user's personal loss distribution, prioritizing normal interactions. Additionally, we conduct a theoretical analysis to validate PLD's effectiveness and suggest ways to further enhance its performance. Extensive experiments conducted on three datasets with varying noise ratios demonstrate PLD's efficacy and robustness.

cs.IR↗

arXiv2024

The 1st Workshop on Human-Centered Recommender Systems

Recommender systems are quintessential applications of human-computer interaction. Widely utilized in daily life, they offer significant convenience but also present numerous challenges, such as the information cocoon effect, privacy concerns, fairness issues, and more. Consequently, this workshop aims to provide a platform for researchers to explore the development of Human-Centered Recommender Systems~(HCRS). HCRS refers to the creation of recommender systems that prioritize human needs, values, and capabilities at the core of their design and operation. In this workshop, topics will include, but are not limited to, robustness, privacy, transparency, fairness, diversity, accountability, ethical considerations, and user-friendly design. We hope to engage in discussions on how to implement and enhance these properties in recommender systems. Additionally, participants will explore diverse evaluation methods, including innovative metrics that capture user satisfaction and trust. This workshop seeks to foster a collaborative environment for researchers to share insights and advance the field toward more ethical, user-centric, and socially responsible recommender systems.

cs.IR↗

arXiv2024

Fact-Level Confidence Calibration and Self-Correction

Confidence calibration in LLMs, i.e., aligning their self-assessed confidence with the actual accuracy of their responses, enabling them to self-evaluate the correctness of their outputs. However, current calibration methods for LLMs typically estimate two scalars to represent overall response confidence and correctness, which is inadequate for long-form generation where the response includes multiple atomic facts and may be partially confident and correct. These methods also overlook the relevance of each fact to the query. To address these challenges, we propose a Fact-Level Calibration framework that operates at a finer granularity, calibrating confidence to relevance-weighted correctness at the fact level. Furthermore, comprehensive analysis under the framework inspired the development of Confidence-Guided Fact-level Self-Correction ($\textbf{ConFix}$), which uses high-confidence facts within a response as additional knowledge to improve low-confidence ones. Extensive experiments across four datasets and six models demonstrate that ConFix effectively mitigates hallucinations without requiring external knowledge sources such as retrieval systems.

cs.CL↗

arXiv2024

Game-theoretic LLM: Agent Workflow for Negotiation Games

This paper investigates the rationality of large language models (LLMs) in strategic decision-making contexts, specifically within the framework of game theory. We evaluate several state-of-the-art LLMs across a spectrum of complete-information and incomplete-information games. Our findings reveal that LLMs frequently deviate from rational strategies, particularly as the complexity of the game increases with larger payoff matrices or deeper sequential trees. To address these limitations, we design multiple game-theoretic workflows that guide the reasoning and decision-making processes of LLMs. These workflows aim to enhance the models' ability to compute Nash Equilibria and make rational choices, even under conditions of uncertainty and incomplete information. Experimental results demonstrate that the adoption of these workflows significantly improves the rationality and robustness of LLMs in game-theoretic tasks. Specifically, with the workflow, LLMs exhibit marked improvements in identifying optimal strategies, achieving near-optimal allocations in negotiation scenarios, and reducing susceptibility to exploitation during negotiations. Furthermore, we explore the meta-strategic considerations of whether it is rational for agents to adopt such workflows, recognizing that the decision to use or forgo the workflow constitutes a game-theoretic issue in itself. Our research contributes to a deeper understanding of LLMs' decision-making capabilities in strategic contexts and provides insights into enhancing their rationality through structured workflows. The findings have implications for the development of more robust and strategically sound AI agents capable of navigating complex interactive environments. Code and data supporting this study are available at \url{https://github.com/Wenyueh/game_theory}.

cs.AI↗

arXiv2024

Ultra-broadband acoustic absorber based on periodic acoustic rigid-metaporous composite array

To address the increasingly serious issue of noise pollution, we propose an ultra-broadband and wide-angle acoustic absorber based on a periodic acoustic rigid-metaporous composite array. Numerical simulation results verify the broadband good acoustic absorption performance of the proposed absorber, which can achieve an average absorption coefficient of approximately 90.9% within the frequency band from 500 to 4000 Hz with incident angles ranging from -75 to +75 degrees, thus compensating for the shortcomings of traditional acoustic absorbers that are not as effective at low frequencies. This work will provide a new approach for ultra-broadband and wide-angle acoustic wave absorption and noise suppression.

cs.CE↗

arXiv2024

Understanding and Improving Adversarial Collaborative Filtering for Robust Recommendation

Adversarial Collaborative Filtering (ACF), which typically applies adversarial perturbations at user and item embeddings through adversarial training, is widely recognized as an effective strategy for enhancing the robustness of Collaborative Filtering (CF) recommender systems against poisoning attacks. Besides, numerous studies have empirically shown that ACF can also improve recommendation performance compared to traditional CF. Despite these empirical successes, the theoretical understanding of ACF's effectiveness in terms of both performance and robustness remains unclear. To bridge this gap, in this paper, we first theoretically show that ACF can achieve a lower recommendation error compared to traditional CF with the same training epochs in both clean and poisoned data contexts. Furthermore, by establishing bounds for reductions in recommendation error during ACF's optimization process, we find that applying personalized magnitudes of perturbation for different users based on their embedding scales can further improve ACF's effectiveness. Building on these theoretical understandings, we propose Personalized Magnitude Adversarial Collaborative Filtering (PamaCF). Extensive experiments demonstrate that PamaCF effectively defends against various types of poisoning attacks while significantly enhancing recommendation performance.

cs.IR↗

arXiv2024

Pruning Foundation Models for High Accuracy without Retraining

Despite the superior performance, it is challenging to deploy foundation models or large language models (LLMs) due to their massive parameters and computations. While pruning is a promising technique to reduce model size and accelerate the inference, the traditional pruning techniques can hardly be applied for LLMs as they need to finetune the model on the full dataset with multiple epochs consuming massive data and hardware resources. To deal with this problem, post-training pruning methods are proposed to prune LLMs in one-shot without retraining. However, their accuracy after pruning may suffer from certain performance degradation due to the lack of retraining with massive data. To address this issue, in this paper, we first formulate the post-training problem for layer-wise LLM compression to simultaneously prune multiple weights in LLMs. Next, we provide an optimal solution for this problem and design our post-training pruning algorithm for both unstructured and semi-structured sparsity. Our extensive experiments demonstrate the superior performance of the proposed methods in comparison to SOTA baselines across various LLM families including transformer-based LLMs and Mamba-based LLMs. Code link: https://github.com/piuzha/APT

cs.LG↗

arXiv2024

MITA: Bridging the Gap between Model and Data for Test-time Adaptation

Test-Time Adaptation (TTA) has emerged as a promising paradigm for enhancing the generalizability of models. However, existing mainstream TTA methods, predominantly operating at batch level, often exhibit suboptimal performance in complex real-world scenarios, particularly when confronting outliers or mixed distributions. This phenomenon stems from a pronounced over-reliance on statistical patterns over the distinct characteristics of individual instances, resulting in a divergence between the distribution captured by the model and data characteristics. To address this challenge, we propose Meet-In-The-Middle based Test-Time Adaptation ($\textbf{MITA}$), which introduces energy-based optimization to encourage mutual adaptation of the model and data from opposing directions, thereby meeting in the middle. MITA pioneers a significant departure from traditional approaches that focus solely on aligning the model to the data, facilitating a more effective bridging of the gap between model's distribution and data characteristics. Comprehensive experiments with MITA across three distinct scenarios (Outlier, Mixture, and Pure) demonstrate its superior performance over SOTA methods, highlighting its potential to significantly enhance generalizability in practical applications.

cs.LG↗

arXiv2024

Understanding the Collapse of LLMs in Model Editing

Despite significant progress in model editing methods, their application in real-world scenarios remains challenging as they often cause large language models (LLMs) to collapse. Among them, ROME is particularly concerning, as it could disrupt LLMs with only a single edit. In this paper, we study the root causes of such collapse. Through extensive analysis, we identify two primary factors that contribute to the collapse: i) inconsistent handling of prefixed and unprefixed keys in the parameter update equation may result in very small denominators, causing excessively large parameter updates; ii) the subject of collapse cases is usually the first token, whose unprefixed key distribution significantly differs from the prefixed key distribution in autoregressive transformers, causing the aforementioned issue to materialize. To validate our findings, we propose a simple yet effective approach: uniformly using prefixed keys during editing phase and adding prefixes during testing phase to ensure the consistency between training and testing. The experimental results show that the proposed solution can prevent model collapse while maintaining the effectiveness of the edits.

cs.CL↗