arXiv subjects

Yajun Wang

Publications and source records attributed to Yajun Wang.

At least 37 records · Page 2Linked to original sources

arXiv2024

Efficient Joint Precoding Design for Wideband Intelligent Reflecting Surface-Assisted Cell-Free Network

In this paper, we propose an efficient joint precoding design method to maximize the weighted sum-rate in wideband intelligent reflecting surface (IRS)-assisted cell-free networks by jointly optimizing the active beamforming of base stations and the passive beamforming of IRS. Due to employing wideband transmissions, the frequency selectivity of IRSs has to been taken into account, whose response usually follows a Lorentzian-like profile. To address the high-dimensional non-convex optimization problem, we employ a fractional programming approach to decouple the non-convex problem into subproblems for alternating optimization between active and passive beamforming. The active beamforming subproblem is addressed using the consensus alternating direction method of multipliers (CADMM) algorithm, while the passive beamforming subproblem is tackled using the accelerated projection gradient (APG) method and Flecher-Reeves conjugate gradient method (FRCG). Simulation results demonstrate that our proposed approach achieves significant improvements in weighted sum-rate under various performance metrics compared to primal-dual subgradient (PDS) with ideal reflection matrix. This study provides valuable insights for computational complexity reduction and network capacity enhancement.

eess.SP↗

arXiv2024

A semi-implicit stochastic multiscale method for radiative heat transfer problem

In this paper, we propose and analyze a new semi-implicit stochastic multiscale method for the radiative heat transfer problem with additive noise fluctuation in composite materials. In the proposed method, the strong nonlinearity term induced by heat radiation is first approximated, by a semi-implicit predictor-corrected numerical scheme, for each fixed time step, resulting in a spatially random multiscale heat transfer equation. Then, the infinite-dimensional stochastic processes are modeled and truncated using a complete orthogonal system, facilitating the reduction of the model's dimensionality in the random space. The resulting low-rank random multiscale heat transfer equation is approximated and computed by using efficient spatial basis functions based multiscale method. The main advantage of the proposed method is that it separates the computational difficulty caused by the spatial multiscale properties, the high-dimensional randomness and the strong nonlinearity of the solution, so they can be overcome separately using different strategies. The convergence analysis is carried out, and the optimal rate of convergence is also obtained for the proposed semi-implicit stochastic multiscale method. Numerical experiments on several test problems for composite materials with various microstructures are also presented to gauge the efficiency and accuracy of the proposed semi-implicit stochastic multiscale method.

math.NA↗

arXiv2024

Localized subspace iteration methods for elliptic multiscale problems

This paper proposes localized subspace iteration (LSI) methods to construct generalized finite element basis functions for elliptic problems with multiscale coefficients. The key components of the proposed method consist of the localization of the original differential operator and the subspace iteration of the corresponding local spectral problems, where the localization is conducted by enforcing the local homogeneous Dirichlet condition and the partition of the unity functions. From a novel perspective, some multiscale methods can be regarded as one iteration step under approximating the eigenspace of the corresponding local spectral problems. Vice versa, new multiscale methods can be designed through subspaces of spectral problem algorithms. Then, we propose the efficient localized standard subspace iteration (LSSI) method and the localized Krylov subspace iteration (LKSI) method based on the standard subspace and Krylov subspace, respectively. Convergence analysis is carried out for the proposed method. Various numerical examples demonstrate the effectiveness of our methods. In addition, the proposed methods show significant superiority in treating long-channel cases over other well-known multiscale methods.

math.NA↗

arXiv2024

Regularized coupling multiscale method for thermomechanical coupled problems

The coupling effects in multiphysics processes are often neglected in designing multiscale methods. The coupling may be described by a non-positive definite operator, which in turn brings significant challenges in multiscale simulations. In the paper, we develop a regularized coupling multiscale method based on the generalized multiscale finite element method (GMsFEM) to solve coupled thermomechanical problems, and it is referred to as the coupling generalized multiscale finite element method (CGMsFEM). The method consists of defining the coupling multiscale basis functions through local regularized coupling spectral problems in each coarse-grid block, which can be implemented by a novel design of two relaxation parameters. Compared to the standard GMsFEM, the proposed method can not only accurately capture the multiscale coupling correlation effects of multiphysics problems but also greatly improve computational efficiency with fewer multiscale basis functions. In addition, the convergence analysis is also established, and the optimal error estimates are derived, where the upper bound of errors is independent of the magnitude of the relaxation coefficient. Several numerical examples for periodic, random microstructure, and random material coefficients are presented to validate the theoretical analysis. The numerical results show that the CGMsFEM shows better robustness and efficiency than uncoupled GMsFEM.

math.NA↗

arXiv2023

Improving Native Ads CTR Prediction by Large Scale Event Embedding and Recurrent Networks

Click through rate (CTR) prediction is very important for Native advertisement but also hard as there is no direct query intent. In this paper we propose a large-scale event embedding scheme to encode the each user browsing event by training a Siamese network with weak supervision on the users' consecutive events. The CTR prediction problem is modeled as a supervised recurrent neural network, which naturally model the user history as a sequence of events. Our proposed recurrent models utilizing pretrained event embedding vectors and an attention layer to model the user history. Our experiments demonstrate that our model significantly outperforms the baseline and some variants.

cs.LG↗

arXiv2022

NGAME: Negative Mining-aware Mini-batching for Extreme Classification

Extreme Classification (XC) seeks to tag data points with the most relevant subset of labels from an extremely large label set. Performing deep XC with dense, learnt representations for data points and labels has attracted much attention due to its superiority over earlier XC methods that used sparse, hand-crafted features. Negative mining techniques have emerged as a critical component of all deep XC methods that allow them to scale to millions of labels. However, despite recent advances, training deep XC models with large encoder architectures such as transformers remains challenging. This paper identifies that memory overheads of popular negative mining techniques often force mini-batch sizes to remain small and slow training down. In response, this paper introduces NGAME, a light-weight mini-batch creation technique that offers provably accurate in-batch negative samples. This allows training with larger mini-batches offering significantly faster convergence and higher accuracies than existing negative sampling techniques. NGAME was found to be up to 16% more accurate than state-of-the-art methods on a wide array of benchmark datasets for extreme classification, as well as 3% more accurate at retrieving search engine queries in response to a user webpage visit to show personalized ads. In live A/B tests on a popular search engine, NGAME yielded up to 23% gains in click-through-rates.

cs.LG↗

arXiv2022

Deterministic and universal quantum squeezing gate in virtue of teleportation-like protocol

Squeezing transformation as an essential component, gives rise to the possibility to perform various tasks of quantum information processing. However, the reported squeezing gate with best performance so far is a conditional realization at the expense of low success probability, while the performance of the deterministic ones is currently circumscribed by the limited squeezing degree of the non-classical ancilla. To address this issue, we develop and demonstrate a new scheme of deterministic and universal quantum squeezing gate with the property of non-local operation attributed to the teleportation-like protocol. We demonstrate high fidelity squeezing operation, even when the level of target squeezing being up to 10 dB, where a squeezed state with non-classical noise reduction of 6.5 dB is directly observed. Moreover, we perform a high-fidelity complex operation including a Fourier transformation and a phase squeezing gate, exploring the potential of implementing the complex task of quantum information processing with the presented functional unit. Our method can be applied to distributed quantum processor, the creation of exotic non-classical states, and quantum error correction.

quant-ph↗

arXiv2021

An Adaptive-Importance-Sampling-Enhanced Bayesian Approach for Topology Estimation in an Unbalanced Power Distribution System

The reliable operation of a power distribution system relies on a good prior knowledge of its topology and its system state. Although crucial, due to the lack of direct monitoring devices on the switch statuses, the topology information is often unavailable or outdated for the distribution system operators for real-time applications. Apart from the limited observability of the power distribution system, other challenges are the nonlinearity of the model, the complicated, unbalanced structure of the distribution system, and the scale of the system. To overcome the above challenges, this paper proposes a Bayesian-inference framework that allows us to simultaneously estimate the topology and the state of a three-phase, unbalanced power distribution system. Specifically, by using the very limited number of measurements available that are associated with the forecast load data, we efficiently recover the full Bayesian posterior distributions of the system topology under both normal and outage operation conditions. This is performed through an adaptive importance sampling procedure that greatly alleviates the computational burden of the traditional Monte-Carlo (MC)-sampling-based approach while maintaining a good estimation accuracy. The simulations conducted on the IEEE 123-bus test system and an unbalanced 1282-bus system reveal the excellent performances of the proposed method.

eess.SY↗

arXiv2021

Multi-Interest-Aware User Modeling for Large-Scale Sequential Recommendations

Precise user modeling is critical for online personalized recommendation services. Generally, users' interests are diverse and are not limited to a single aspect, which is particularly evident when their behaviors are observed for a longer time. For example, a user may demonstrate interests in cats/dogs, dancing and food \& delights when browsing short videos on Tik Tok; the same user may show interests in real estate and women's wear in her web browsing behaviors. Traditional models tend to encode a user's behaviors into a single embedding vector, which do not have enough capacity to effectively capture her diverse interests. This paper proposes a Sequential User Matrix (SUM) to accurately and efficiently capture users' diverse interests. SUM models user behavior with a multi-channel network, with each channel representing a different aspect of the user's interests. User states in different channels are updated by an \emph{erase-and-add} paradigm with interest- and instance-level attention. We further propose a local proximity debuff component and a highway connection component to make the model more robust and accurate. SUM can be maintained and updated incrementally, making it feasible to be deployed for large-scale online serving. We conduct extensive experiments on two datasets. Results demonstrate that SUM consistently outperforms state-of-the-art baselines.

cs.IR↗

arXiv2021

Hybrid Encoder: Towards Efficient and Precise Native AdsRecommendation via Hybrid Transformer Encoding Networks

Transformer encoding networks have been proved to be a powerful tool of understanding natural languages. They are playing a critical role in native ads service, which facilitates the recommendation of appropriate ads based on user's web browsing history. For the sake of efficient recommendation, conventional methods would generate user and advertisement embeddings independently with a siamese transformer encoder, such that approximate nearest neighbour search (ANN) can be leveraged. Given that the underlying semantic about user and ad can be complicated, such independently generated embeddings are prone to information loss, which leads to inferior recommendation quality. Although another encoding strategy, the cross encoder, can be much more accurate, it will lead to huge running cost and become infeasible for realtime services, like native ads recommendation. In this work, we propose hybrid encoder, which makes efficient and precise native ads recommendation through two consecutive steps: retrieval and ranking. In the retrieval step, user and ad are encoded with a siamese component, which enables relevant candidates to be retrieved via ANN search. In the ranking step, it further represents each ad with disentangled embeddings and each user with ad-related embeddings, which contributes to the fine-grained selection of high-quality ads from the candidate set. Both steps are light-weighted, thanks to the pre-computed and cached intermedia results. To optimize the hybrid encoder's performance in this two-stage workflow, a progressive training pipeline is developed, which builds up the model's capability in the retrieval and ranking task step-by-step. The hybrid encoder's effectiveness is experimentally verified: with very little additional cost, it outperforms the siamese encoder significantly and achieves comparable recommendation quality as the cross encoder.

cs.IR↗

arXiv2020

Identification and online updating of dynamic models for demand response of an industrial air separation unit

Demand-response operation of air separation units requires frequent changes in production rate(s), and scheduling calculations must explicitly consider process dynamics to ensure feasibility of the solutions. To this end, scale-bridging models (SBMs) approximate the scheduling-relevant dynamics of a process and its controller in a low-order representation. In contrast to previous works that have employed nonlinear SBMs, this paper proposes linear SBMs, developed using time-series analysis, to facilitate online scheduling computations. Using a year-long industrial dataset, we find that compact linear SBMs are suitable approximations over typical scheduling horizons, but that their accuracies are unpredictable over time. We introduce a strategy for online updating of the SBMs, based on Kalman filtering schemes for online parameter estimation. The approach greatly improves the accuracy of SBM predictions and will enable the use of linear SBM-based demand-response scheduling in the future.

math.OC↗

arXiv2020

Resource reduction for simultaneous generation of two types of continuous variable nonclassical states

We demonstrate experimentally the simultaneous generation and detection of two types of continuous variable nonclassical states from one type-0 phase-matching optical parametric amplification (OPA) and subsequent two ring filter cavities (RFCs). The output field of the OPA includes the baseband ω0 and sideband modes ω0+/-nωf subjects to the cavity resonance condition, which are separated by two cascaded RFCs. The first RFC resonates with half the pump wavelength ω0 and the transmitted baseband component is a squeezed state. The reflected fields of the first RFC, including the sideband modes ω0+/-ωf, are separated by the second RFC, construct Einstein-Podolsky-Rosen entangled state. All freedoms, including the filter cavities for sideband separation and relative phases for the measurements of these sidebands, are actively stabilized. The noise variance of squeezed states is 10.2 dB below the shot noise limit (SNL), the correlation variances of both quadrature amplitude-sum and quadrature phase-difference for the entanglement state are 10.0 dB below the corresponding SNL.

quant-ph↗

arXiv2020

A PAPR Reduction Method Based on Artificial Bee Colony Algorithm for OFDM Signals

One of the major drawbacks of orthogonal frequency division multiplexing (OFDM) signals is the high peak to average power ratio (PAPR) of the transmitted signal. Many PAPR reduction techniques have been proposed in the literature, among which, partial transmit sequence (PTS) technique has been taken considerable investigation.However, PTS technique requires an exhaustive search over all combinations of allowed phase factors, whose complexity increases exponentially with the number of sub-blocks. In this paper, a newly suboptimal method based on modified artificial bee colony (ABC-PTS) algorithm is proposed to search the better combination of phase factors. The ABC-PTS algorithm can significantly reduce the computational complexity for larger PTS subblocks and offers lower PAPR at the same time. Simulation results show that the ABC-PTS algorithm is an efficient method to achieve significant PAPR reduction.

eess.SP↗

arXiv2020

Genetic Algorithm Based Nearly Optimal Peak Reduction Tone Set Selection for Adaptive Amplitude Clipping PAPR Reduction

In tone reservation (TR) based OFDM systems, the peak to average power ratio (PAPR) reduction performance mainly depends on the selection of the peak reduction tone (PRT) set and the optimal target clipping level. Finding the optimal PRT set requires an exhaustive search of all combinations of possible PRT sets, which is a nondeterministic polynomial-time (NP-hard) problem, and this search is infeasible for the number of tones used in practical systems. The existing selection methods, such as the consecutive PRT set, equally spaced PRT set and random PRT set, perform poorly compared to the optimal PRT set or incur high computational complexity. In this paper, an efficient scheme based on genetic algorithm (GA) with lower computational complexity is proposed for searching a nearly optimal PRT set. While TR-based clipping is simple and attractive for practical implementation, determining the optimal target clipping level is difficult. To overcome this problem, we propose an adaptive clipping control algorithm.Simulation results show that our proposed algorithms efficiently obtain a nearly optimal PRT set and good PAPR reductions.

eess.SP↗

arXiv2020

PAPR Reduction Method Based on Parametric Minimum Cross Entropy for OFDM Signals

The partial transmit sequence (PTS) technique has received much attention in reducing the high peak to average power ratio (PAPR) of orthogonal frequency division multiplexing (OFDM) signals. However, the PTS technique requires an exhaustive search of all combinations of the allowed phase factors, and the search complexity increases exponentially with the number of sub-blocks. In this paper, a novel method based on parametric minimum cross entropy (PMCE) is proposed to search the optimal combination of phase factors. The PMCE algorithm not only reduces the PAPR significantly, but also decreases the computational complexity. The simulation results show that it achieves more or less the same PAPR reduction as that of exhaustive search.

eess.SP↗

arXiv2020

Real-Time Monitoring of Area Angles with Synchrophasor Measurements

This paper develops a comprehensive framework of Area Angle Monitoring (AAM) to monitor the stress of bulk power transfer across an area of a power transmission system in real-time. Area angle is calculated from synchrophasor measurements to provide alert to system operators if the area angle exceeds pre-defined thresholds. This paper proposes general methods to identify these warning and emergency thresholds, and tests a mitigation strategy to relieve the area stress when the area angle exceeds the threshold. In order to handle the limited coverage of synchrophasor measurements, this paper proposes methods to estimate phase angles for boundary buses without synchrophasor measurements, which extends the application of AAM. AAM is verified for a power transmission area in the Western Electricity Coordinating Council system with both simulated data and synchrophasor measurements recorded from real events. A utility deployment to test the framework for monitoring area angle with live-stream and recorded synchrophasor data is described.

math.DS↗

arXiv2020

DymSLAM:4D Dynamic Scene Reconstruction Based on Geometrical Motion Segmentation

Most SLAM algorithms are based on the assumption that the scene is static. However, in practice, most scenes are dynamic which usually contains moving objects, these methods are not suitable. In this paper, we introduce DymSLAM, a dynamic stereo visual SLAM system being capable of reconstructing a 4D (3D + time) dynamic scene with rigid moving objects. The only input of DymSLAM is stereo video, and its output includes a dense map of the static environment, 3D model of the moving objects and the trajectories of the camera and the moving objects. We at first detect and match the interesting points between successive frames by using traditional SLAM methods. Then the interesting points belonging to different motion models (including ego-motion and motion models of rigid moving objects) are segmented by a multi-model fitting approach. Based on the interesting points belonging to the ego-motion, we are able to estimate the trajectory of the camera and reconstruct the static background. The interesting points belonging to the motion models of rigid moving objects are then used to estimate their relative motion models to the camera and reconstruct the 3D models of the objects. We then transform the relative motion to the trajectories of the moving objects in the global reference frame. Finally, we then fuse the 3D models of the moving objects into the 3D map of the environment by considering their motion trajectories to obtain a 4D (3D+time) sequence. DymSLAM obtains information about the dynamic objects instead of ignoring them and is suitable for unknown rigid objects. Hence, the proposed system allows the robot to be employed for high-level tasks, such as obstacle avoidance for dynamic objects. We conducted experiments in a real-world environment where both the camera and the objects were moving in a wide range.

cs.CV↗

arXiv2017

Oscillation energy based sensitivity analysis and control for multi-mode oscillation systems

This paper describes a novel approach to analyze and control systems with multi-mode oscillation problems. Traditional single dominant mode analysis fails to provide effective control actions when several modes have similar low damping ratios. This work addresses this problem by considering all modes in the formulation of the system kinetic oscillation energy. The integral of energy over time defines the total action as a measure of dynamic performance, and its sensitivity allows comparing the performance of different actuators/locations in the system to select the most effective one to damp the oscillation energy. Time domain simulations in the IEEE 9-bus system and IEEE 39-bus system verify the findings obtained by the oscillation energy based analysis. Applications of the proposed method in control and system planning are discussed.

eess.SY↗