Search arXivSearch

arXiv subjects

Zhu

Publications and source records attributed to Zhu.

13 recordsLinked to original sources

When Should Neural Data Inform Welfare? A Critical Framework for Policy Uses of Neuroeconomics

Neuroeconomics promises to ground welfare analysis in neural and computational evidence about how people value outcomes, learn from experience and exercise self-control. At the same time, policy and commercial actors increasingly invoke neural data to justify paternalistic regulation, "brain-based" interventions and new welfare measures. This paper asks under what conditions neural data can legitimately inform welfare judgements for policy rather than merely describing behaviour. I develop a non-empirical, model-based framework that links three levels: neural signals, computational decision models and normative welfare criteria. Within an actor-critic reinforcement-learning model, I formalise the inference path from neural activity to latent values and prediction errors and then to welfare claims. I show that neural evidence constrains welfare judgements only when the neural-computational mapping is well validated, the decision model identifies "true" interests versus context-dependent mistakes, and the welfare criterion is explicitly specified and defended. Applying the framework to addiction, neuromarketing and environmental policy, I derive a Neuroeconomic Welfare Inference Checklist for regulators and for designers of NeuroAI systems. The analysis treats brains and artificial agents as value-learning systems while showing that internal reward signals, whether biological or artificial, are computational quantities and cannot be treated as welfare measures without an explicit normative model.

cs.LG

Behavior of quantum coherence in the ultrastrong and deep strong coupling regimes of light-matter system

The ultrastrong and deep strong coupling regimes exhibit a variety of intriguing physical phenomena. In this work, we utilize the Hopfield model of a two-mode bosonic system, with each mode interacts with a heat reservoir, to research the behavior of quantum coherence. Our results indicate that a coupled oscillator system can exhibit significant quantum coherence in the ultrastrong and deep strong coupling regimes. In the ground state, the photon-mode and the matter-mode coherences are equal. The larger coherences that encompass the photon mode, the matter mode, and the overall system are achieved at lower optical frequencies and with increased coupling strengths. Notably, the the beam-splitter and phase rotation terms alone does not generate coherences for either total coherence or subsystem coherences; instead, the generation of quantum coherences originates from the one-mode and two-mode squeezing terms. When heat environments are present, the total coherence can be enhanced by the the beam-splitter and phase rotation terms, while it has no effect on subsystem coherences. Moreover, when the one-mode and two-mode squeezing terms and the the beam-splitter and phase rotation terms are considered together, the total coherence increases with stronger coupling. We also observe that lower frequencies maximize total coherence in the deep strong coupling regime. These results demonstrate that the ultrastrong and deep strong coupling regimes give rise to novel characteristics of quantum coherence. This work provides valuable insights into the quantum coherence properties, particularly in the ultrastrong and deep strong coupling regimes between light and matter and may have potential applications in quantum information processing.

quant-ph

Intelligent Interaction Strategies for Context-Aware Cognitive Augmentation

Human cognition is constrained by processing limitations, leading to cognitive overload and inefficiencies in knowledge synthesis and decision-making. Large Language Models (LLMs) present an opportunity for cognitive augmentation, but their current reactive nature limits their real-world applicability. This position paper explores the potential of context-aware cognitive augmentation, where LLMs dynamically adapt to users' cognitive states and task environments to provide appropriate support. Through a think-aloud study in an exhibition setting, we examine how individuals interact with multi-modal information and identify key cognitive challenges in structuring, retrieving, and applying knowledge. Our findings highlight the need for AI-driven cognitive support systems that integrate real-time contextual awareness, personalized reasoning assistance, and socially adaptive interactions. We propose a framework for AI augmentation that seamlessly transitions between real-time cognitive support and post-experience knowledge organization, contributing to the design of more effective human-centered AI systems.

cs.HC

Aligned Multi Objective Optimization

To date, the multi-objective optimization literature has mainly focused on conflicting objectives, studying the Pareto front, or requiring users to balance tradeoffs. Yet, in machine learning practice, there are many scenarios where such conflict does not take place. Recent findings from multi-task learning, reinforcement learning, and LLMs training show that diverse related tasks can enhance performance across objectives simultaneously. Despite this evidence, such phenomenon has not been examined from an optimization perspective. This leads to a lack of generic gradient-based methods that can scale to scenarios with a large number of related objectives. To address this gap, we introduce the Aligned Multi-Objective Optimization framework, propose new algorithms for this setting, and provide theoretical guarantees of their superior performance compared to naive approaches.

cs.LG

Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

Modern AI agents, driven by advances in large foundation models, promise to enhance our productivity and transform our lives by augmenting our knowledge and capabilities. To achieve this vision, AI agents must effectively plan, perform multi-step reasoning and actions, respond to novel observations, and recover from errors, to successfully complete complex tasks across a wide range of scenarios. In this work, we introduce Magentic-One, a high-performing open-source agentic system for solving such tasks. Magentic-One uses a multi-agent architecture where a lead agent, the Orchestrator, plans, tracks progress, and re-plans to recover from errors. Throughout task execution, the Orchestrator directs other specialized agents to perform tasks as needed, such as operating a web browser, navigating local files, or writing and executing Python code. We show that Magentic-One achieves statistically competitive performance to the state-of-the-art on three diverse and challenging agentic benchmarks: GAIA, AssistantBench, and WebArena. Magentic-One achieves these results without modification to core agent capabilities or to how they collaborate, demonstrating progress towards generalist agentic systems. Moreover, Magentic-One's modular design allows agents to be added or removed from the team without additional prompt tuning or training, easing development and making it extensible to future scenarios. We provide an open-source implementation of Magentic-One, and we include AutoGenBench, a standalone tool for agentic evaluation. AutoGenBench provides built-in controls for repetition and isolation to run agentic benchmarks in a rigorous and contained manner -- which is important when agents' actions have side-effects. Magentic-One, AutoGenBench and detailed empirical performance evaluations of Magentic-One, including ablations and error analysis are available at https://aka.ms/magentic-one

cs.AI

Reinforcement Learning for LLM Post-Training: A Survey

Large language models (LLMs) trained via pretraining and supervised fine-tuning (SFT) can still produce harmful and misaligned outputs, or struggle in domains like math and coding. Reinforcement learning (RL)-based post-training methods, including Reinforcement Learning from Human Feedback (RLHF) methods like Direct Preference Optimization (DPO) and Reinforcement Learning with Verifiable Rewards (RLVR) approaches like PPO and GRPO, have made remarkable gains to alleviate these issues. Yet, no existing work offers a technically detailed comparison of the various methods driving this progress. In order to fill this gap, we present a timely survey that connects foundational components with latest advancements. We derive a single policy gradient framework that unifies pretraining, SFT, RLHF, and RLVR as special cases while also organizing the more recent techniques therein. The main contributions of our survey are as follows: (1) a self-contained introduction to MLE, RLHF, and RLVR foundations and the unified policy gradient framework; (2) detailed technical analysis of PPO- and GRPO-based methods alongside offline and iterative DPO approaches, decomposed along prompt sampling, response sampling, and gradient coefficient axes; (3) standardized notation enabling direct cross-method comparison; and (4) comprehensive comparison of implementation details and empirical results of each method in the appendix. We aim to serve as a technically grounded reference for researchers and practitioners working on LLM post-training.

cs.CL

A Novel Design of Capacitive Plasmonic Near Field Transducer

A near field transducer (NFT) is a key photonics component in heat assisted magnetic recording (HAMR) for the localized heating of the magnetic medium. In this work, we present a novel NFT design through capacitive coupling. In our design, tapered metal bars separated by thin dielectric materials with gap distance G are used to create the plasmonic resonance and focus the electromagnetic field. The design is motivated by the intention to improve thermal stability, which can be achieved through segmentation using thermally stable dielectric material between the plasmonic metal bars. Using COMSOL Multiphysics software, the performance of this capacitive-coupled NFT is systematically modeled. It is shown that the electromagnetic field could gradually be focused through the tapering towards the air bearing surface (ABS). In addition, the focusing effect could be enhanced with a smaller NFT peg size at the resonant wavelength. The material selection for the NFT tip material will be discussed to further address the thermal stability of the device. In conclusion, this capacitive-coupled NFT with dielectric separation gaps and tapering yields an enhanced |E| field intensity at the tip with the potential for an enhanced material thermal stability. Such a design can also exhibit applications in other energy delivery systems as well as plasmonic waveguides and sensors.

physics.optics

Ultralow thermal conductance across the [FePt/h-BN/FePt] interface

Heat transfer in nanocomposite materials has attracted great interest for various applications. Multilayer structures provide an important platform to study interfacial thermal transport and to engineer materials with ultralow thermal conductivity. Here we report on the fabrication and thermal characterization of [h-BN/$L1_0$-FePt]xN multilayers, where hexagonal boron nitride (h-BN) nanosheets (2.5 nm thick) and $L1_0$-FePt layers (6.5 nm thick) alternate periodically. Differential three-omega($3\omega$) measurements reveal an ultralow effective thermal conductivity of $ 0.60 \pm 0.05 W \cdot m^{-1}K^{-1}$ across the multilayer films, and a low thermal boundary conductance (TBC) of $ 67.9 \pm 6.6 MW \cdot m^{-2}K^{-1}$ for the [FePt/h-BN(2.5nm)/FePt] interface at room temperature. We attribute the ultralow thermal conductivity to the weak van der Waals bonding at h-BN/FePt interfaces, which dominates the thermal resistance of the multilayer structure. These findings provide insights into the thermal transport in 2D-material/metal multilayer nanostructures and suggest the [h-BN/FePt] superlattice as a promising material for nanoscale thermal barrier coating. Furthermore, the obtained TBC lays the foundation for analyzing heat transfer in FePt-(h-BN) nanogranular films, a promising magnetic recording media which can potentially provide high thermal gradient for heat-assisted magnetic recording (HAMR). This work advances the understanding of thermal transport in 2D-material/metal nanocomposites and demonstrates interface engineering as an effective approach to achieve materials with ultralow thermal conductivity.

physics.app-ph

Comparison of h-BN and graphene layers as grain boundary materials for granular FePt-$\text{L}1_0$ thin films

Granular $\text{L}1_0$-FePt thin films with small columnar grains are essential for heat-assisted magnetic recording media. While hexagonal boron nitride(h-BN) has proven effective for promoting columnar FePt grains, we explored multilayer graphene as an alternative grain boundary material leveraging its structural similarity to h-BN. The FePt granular thin films with carbon-based grain boundary materials(GBMs) were deposited by cosputtering on Si/SiO2 substrates with substrate bias at 650{\deg}C. The RF bias and high temperature facilitated formation of interlinked graphene nanoribbons wrapping around FePt grains, yielding 7.5 nm diameter, 8 nm height grains with an order parameter of 0.78 and a perpendicular coercivity of 40 kOe. However, the formation of graphene nanoribbons could not effectively promote columnar structures, likely due to co-existing amorphous carbon in grain boundaries. Optimizing deposition to improve graphene grain boundary quality is necessary to realize this 2D material's potential for achieving desirable microstructures for HAMR media.

cond-mat.mtrl-sci

Bias sputtering of granular $\text{L1}_0$-FePt films with hexagonal boron nitride grain boundaries

In this paper, we present an experimental study of $\text{L1}_0$-FePt granular films with crystalline/amorphous boron nitride (BN) grain boundary materials for heat assisted magnetic recording (HAMR). It is found that an adequate RF substrate bias yields the formation of hexagonal boron nitride (h-BN) nanosheets in grain boundaries, facilitating the columnar growth of FePt grains during sputtering at high temperatures. The h-BN monolayers conform to the side surfaces of columnar FePt grains, completely encircling individual FePt grains. The resulting core-shell FePt/h-BN nanostructures appear to be highly promising for HAMR application. The high thermal stability of h-BN grain boundaries allows the deposition temperature to be as high as 800oC such that high order parameters of FePt $\text{L1}_0$ phase have been obtained. For the fabricated FePt/h-BN thin film, excellent granular microstructure with FePt grains of 6.5nm in diameter and 11.5nm in height has been achieved along with good magnetic hysteresis properties.

cond-mat.mtrl-sci

Understanding the growth of high-aspect-ratio grains in granular L10-FePt thin-film magnetic media

A systematic investigation has been performed to optimize the microstructure of $\mathrm{L1_0-FePt-SiO_x}$ granular thin film as recording media for heat-assisted magnetic recording. The FePt-BN nucleation layer, which is stable even at $700^\circ \text{C}$, is used to control the grain sizes and microstructure during high-temperature processing. The study finds that films of high-aspect-ratio FePt grains with well-formed silicon oxide (SiOx) grain boundaries require the grading of the deposition temperature during film growth as well as the grading of the silicon oxide concentration. Well-isolated columnar grains of $\mathrm{L1_0-FePt}$ with an average height greater than 11 nm and diameters less than 7 nm have been achieved. Transmission electron microscopy (TEM) analysis of the microstructures of samples produced under a variety of non-optimal conditions is presented to show how the microstructure of the films depends on each of the sputtering parameters.

cond-mat.mtrl-sci

Sieve-SDP: a simple facial reduction algorithm to preprocess semidefinite programs

We introduce Sieve-SDP, a simple facial reduction algorithm to preprocess semidefinite programs (SDPs). Sieve-SDP inspects the constraints of the problem to detect lack of strict feasibility, deletes redundant rows and columns, and reduces the size of the variable matrix. It often detects infeasibility. It does not rely on any optimization solver: the only subroutine it needs is Cholesky factorization, hence it can be implemented in a few lines of code in machine precision. We present extensive computational results on several problem collections from the literature, with many SDPs coming from polynomial optimization.

math.OC

Ribbonlength of folded ribbon unknots in the plane

We study Kauffman's model of folded ribbon knots: knots made of a thin strip of paper folded flat in the plane. The ribbonlength is the length to width ratio of such a ribbon, and it turns out that the way the ribbon is folded influences the ribbonlength. We give an upper bound of $n\cot(\pi/n)$ for the ribbonlength of $n$-stick unknots. We prove that the minimum ribbonlength for a 3-stick unknot with the same type of fold at each vertex is $3\sqrt{3}$, and such a minimizer is an equilateral triangle. We end the paper with a discussion of projection stick number and ribbonlength.

math.GT