arXiv subjects

Jun Zhang

Publications and source records attributed to Jun Zhang.

At least 721 records · Page 40Linked to original sources

arXiv2022

PARAGEN : A Parallel Generation Toolkit

PARAGEN is a PyTorch-based NLP toolkit for further development on parallel generation. PARAGEN provides thirteen types of customizable plugins, helping users to experiment quickly with novel ideas across model architectures, optimization, and learning strategies. We implement various features, such as unlimited data loading and automatic model selection, to enhance its industrial usage. ParaGen is now deployed to support various research and industry applications at ByteDance. PARAGEN is available at https://github.com/bytedance/ParaGen.

cs.CL↗

arXiv2022

DReS-FL: Dropout-Resilient Secure Federated Learning for Non-IID Clients via Secret Data Sharing

Federated learning (FL) strives to enable collaborative training of machine learning models without centrally collecting clients' private data. Different from centralized training, the local datasets across clients in FL are non-independent and identically distributed (non-IID). In addition, the data-owning clients may drop out of the training process arbitrarily. These characteristics will significantly degrade the training performance. This paper proposes a Dropout-Resilient Secure Federated Learning (DReS-FL) framework based on Lagrange coded computing (LCC) to tackle both the non-IID and dropout problems. The key idea is to utilize Lagrange coding to secretly share the private datasets among clients so that each client receives an encoded version of the global dataset, and the local gradient computation over this dataset is unbiased. To correctly decode the gradient at the server, the gradient function has to be a polynomial in a finite field, and thus we construct polynomial integer neural networks (PINNs) to enable our framework. Theoretical analysis shows that DReS-FL is resilient to client dropouts and provides privacy protection for the local datasets. Furthermore, we experimentally demonstrate that DReS-FL consistently leads to significant performance gains over baseline methods.

cs.LG↗

arXiv2022

Parity-doublet bands in the odd-\bm{$A$} isotones \element{237}U and \element{239}Pu by a particle-number-conserving method based on the cranked shell model

Based on the reflection-asymmetric Nilsson potential, the parity-doublet rotational bands in odd-$A$ isotones \element{237}U and \element{239}Pu have been investigated by using the particle-number-conserving (PNC) method in the framework of the cranked shell model (CSM). The experimental kinematic moments of inertia (MOIs) and angular momentum alignments are reproduced very well by the PNC-CSM calculations. The significant differences of rotational properties between \element{237}U and \element{239}Pu are explained with the contribution of nucleons occupying proton octupole-correlation pairs of $π^{2} i_{13/2}f_{7/2}$. The upbendings of moments of inertia of the parity-doublet bands in \element{237}U are due to the interference terms of alignments of protons occupying $πf_{7/2}$ (${1/2}$) and the high-$j$ intruder $πi_{13/2}$ $(1/2, 3/2)$ orbitals. The splittings between the simplex partner bands of the parity-doublet bands in both \element{237}U and \element{239}Pu result from the contribution of alignment of neutron occupying the $νd_{5/2}$ ($1/2$) orbital.

nucl-th↗

arXiv2022

SoccerNet 2022 Challenges Results

The SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team. In 2022, the challenges were composed of 6 vision-based tasks: (1) action spotting, focusing on retrieving action timestamps in long untrimmed videos, (2) replay grounding, focusing on retrieving the live moment of an action shown in a replay, (3) pitch localization, focusing on detecting line and goal part elements, (4) camera calibration, dedicated to retrieving the intrinsic and extrinsic camera parameters, (5) player re-identification, focusing on retrieving the same players across multiple views, and (6) multiple object tracking, focusing on tracking players and the ball through unedited video streams. Compared to last year's challenges, tasks (1-2) had their evaluation metrics redefined to consider tighter temporal accuracies, and tasks (3-6) were novel, including their underlying data and annotations. More information on the tasks, challenges and leaderboards are available on https://www.soccer-net.org. Baselines and development kits are available on https://github.com/SoccerNet.

cs.CV↗

arXiv2022

Stellar Chromospheric Activity Database of Solar-like Stars Based on the LAMOST Low-Resolution Spectroscopic Survey

$\require{mediawiki-texvc}$A stellar chromospheric activity database of solar-like stars is constructed based on the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) Low-Resolution Spectroscopic Survey (LRS). The database contains spectral bandpass fluxes and indexes of Ca II H&K lines derived from 1,330,654 high-quality LRS spectra of solar-like stars. We measure the mean fluxes at line cores of the Ca II H&K lines using a 1 $Å$ rectangular bandpass as well as a 1.09 $Å$ full width at half maximum (FWHM) triangular bandpass, and the mean fluxes of two 20 $Å$ pseudo-continuum bands on the two sides of the lines. Three activity indexes, $S_{\rm rec}$ based on the 1 $Å$ rectangular bandpass, and $S_{\rm tri}$ and $S_L$ based on the 1.09 $Å$ FWHM triangular bandpass, are evaluated from the measured fluxes to quantitatively indicate the chromospheric activity level. The uncertainties of all the obtained parameters are estimated. We also produce spectrum diagrams of Ca II H&K lines for all the spectra in the database. The entity of the database is composed of a catalog of spectral sample and activity parameters, and a library of spectrum diagrams. Statistics reveal that the solar-like stars with high level of chromospheric activity ($S_{\rm rec}>0.6$) tend to appear in the parameter range of $T_{\rm eff}\text{ (effective temperature)}<5500\,{\rm K}$, $4.3<\log\,g\text{ (surface gravity)}<4.6$, and $-0.2<[{\rm Fe/H}]\text{ (metallicity)}<0.3$. This database with more than one million high-quality LAMOST LRS spectra of Ca II H&K lines and basal chromospheric activity parameters can be further used for investigating activity characteristics of solar-like stars and solar-stellar connection.

astro-ph.SR↗

arXiv2022

Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval

Cross-modal retrieval between videos and texts has gained increasing research interest due to the rapid emergence of videos on the web. Generally, a video contains rich instance and event information and the query text only describes a part of the information. Thus, a video can correspond to multiple different text descriptions and queries. We call this phenomenon the ``Video-Text Correspondence Ambiguity'' problem. Current techniques mostly concentrate on mining local or multi-level alignment between contents of a video and text (\textit{e.g.}, object to entity and action to verb). It is difficult for these methods to alleviate the video-text correspondence ambiguity by describing a video using only one single feature, which is required to be matched with multiple different text features at the same time. To address this problem, we propose a Text-Adaptive Multiple Visual Prototype Matching model, which automatically captures multiple prototypes to describe a video by adaptive aggregation of video token features. Given a query text, the similarity is determined by the most similar prototype to find correspondence in the video, which is termed text-adaptive matching. To learn diverse prototypes for representing the rich information in videos, we propose a variance loss to encourage different prototypes to attend to different contents of the video. Our method outperforms state-of-the-art methods on four public video retrieval datasets.

cs.CV↗

arXiv2022

Overtwisting and Coiling Highly Enhances Strain Generation of Twisted String Actuators

Twisted string actuators (TSAs) have exhibited great promise in robotic applications by generating high translational force with low input torque. To further facilitate their robotic applications, it is strongly desirable but challenging to enhance their consistent strain generation while maintaining compliance. Existing studies predominantly considered overtwisting and coiling after the regular twisting stage to be undesirable non-uniform and unpredictable knots, entanglements, and coils formed to create an unstable and failure-prone structure. Overtwisting would work well for TSAs when uniform coils can be consistently formed. In this study, we realize uniform and consistent coil formation in overtwisted TSAs, which greatly increases their strain. Furthermore, we investigate methods for enabling uniform coil formation upon overtwisting the strings in a TSA and present a procedure to systematically "train" the strings. To the authors' best knowledge, this is the first study to experimentally investigate overtwisting for TSAs with different stiffnesses and realize consistent uniform coil formation. Ultra-high molecular-weight polyethylene (UHMWPE) strings form the stiff TSAs whereas compliant TSAs are realized with stretchable and conductive supercoiled polymer (SCP) strings. The strain, force, velocity, and torque of each overtwisted TSA was studied. Overtwisting and coiling resulted in approximately 70% strain in stiff TSAs and approximately 60% strain in compliant TSAs. This is more than twice the strain achieved through regular twisting. Lastly, the overtwisted TSA was successfully demonstrated in a robotic bicep.

cs.RO↗

arXiv2022

Anthropomorphic Twisted String-Actuated Soft Robotic Gripper with Tendon-Based Stiffening

Realizing high-performance soft robotic grippers is challenging because of the inherent limitations of the soft actuators and artificial muscles that drive them, including low force output, small actuation range, and poor compactness. Despite advances in this area, realizing compact soft grippers with high dexterity and force output is still challenging. This paper explores twisted string actuators (TSAs) to drive a soft robotic gripper. TSAs have been used in numerous robotic applications, but their inclusion in soft robots has been limited. The proposed design of the gripper was inspired by the human hand. Tunable stiffness was implemented in the fingers with antagonistic TSAs. The fingers' bending angles, actuation speed, blocked force output, and stiffness tuning were experimentally characterized. The gripper achieved a score of 6 on the Kapandji test and recreated 31 of the 33 grasps of the Feix GRASP taxonomy. It exhibited a maximum grasping force of 72 N, which was almost 13 times its own weight. A comparison study revealed that the proposed gripper exhibited equivalent or superior performance compared to other similar soft grippers.

cs.RO↗

arXiv2022

Data-Driven Deep Learning Based Hybrid Beamforming for Aerial Massive MIMO-OFDM Systems with Implicit CSI

In an aerial hybrid massive multiple-input multiple-output (MIMO) and orthogonal frequency division multiplexing (OFDM) system, how to design a spectral-efficient broadband multi-user hybrid beamforming with a limited pilot and feedback overhead is challenging. To this end, by modeling the key transmission modules as an end-to-end (E2E) neural network, this paper proposes a data-driven deep learning (DL)-based unified hybrid beamforming framework for both the time division duplex (TDD) and frequency division duplex (FDD) systems with implicit channel state information (CSI). For TDD systems, the proposed DL-based approach jointly models the uplink pilot combining and downlink hybrid beamforming modules as an E2E neural network. While for FDD systems, we jointly model the downlink pilot transmission, uplink CSI feedback, and downlink hybrid beamforming modules as an E2E neural network. Different from conventional approaches separately processing different modules, the proposed solution simultaneously optimizes all modules with the sum rate as the optimization object. Therefore, by perceiving the inherent property of air-to-ground massive MIMO-OFDM channel samples, the DL-based E2E neural network can establish the mapping function from the channel to the beamformer, so that the explicit channel reconstruction can be avoided with reduced pilot and feedback overhead. Besides, practical low-resolution phase shifters (PSs) introduce the quantization constraint, leading to the intractable gradient backpropagation when training the neural network. To mitigate the performance loss caused by the phase quantization error, we adopt the transfer learning strategy to further fine-tune the E2E neural network based on a pre-trained network that assumes the ideal infinite-resolution PSs. Numerical results show that our DL-based schemes have considerable advantages over state-of-the-art schemes.

eess.SP↗

arXiv2022

Stochastic Coded Federated Learning with Convergence and Privacy Guarantees

Federated learning (FL) has attracted much attention as a privacy-preserving distributed machine learning framework, where many clients collaboratively train a machine learning model by exchanging model updates with a parameter server instead of sharing their raw data. Nevertheless, FL training suffers from slow convergence and unstable performance due to stragglers caused by the heterogeneous computational resources of clients and fluctuating communication rates. This paper proposes a coded FL framework to mitigate the straggler issue, namely stochastic coded federated learning (SCFL). In this framework, each client generates a privacy-preserving coded dataset by adding additive noise to the random linear combination of its local data. The server collects the coded datasets from all the clients to construct a composite dataset, which helps to compensate for the straggling effect. In the training process, the server as well as clients perform mini-batch stochastic gradient descent (SGD), and the server adds a make-up term in model aggregation to obtain unbiased gradient estimates. We characterize the privacy guarantee by the mutual information differential privacy (MI-DP) and analyze the convergence performance in federated learning. Besides, we demonstrate a privacy-performance tradeoff of the proposed SCFL method by analyzing the influence of the privacy constraint on the convergence rate. Finally, numerical experiments corroborate our analysis and show the benefits of SCFL in achieving fast convergence while preserving data privacy.

cs.LG↗

arXiv2022

Instability of spherically-symmetric black holes in Quadratic Gravity

We investigate the linear stability of the two known branches of spherically-symmetric black holes in Quadratic Gravity. We extend previous work on the long-wavelength (Gregory-Laflamme) instability of the Schwarzschild branch to a corresponding long-wavelength instability in the non-Schwarzschild branch. In both cases, the instability sets in below a critical horizon radius at which the two black-hole branches intersect. This suggests that classical perturbations enforce a lower bound on the horizon radius of spherically-symmetric black holes in Quadratic Gravity.

gr-qc↗

arXiv2022

Augmented Deep Unfolding for Downlink Beamforming in Multi-cell Massive MIMO With Limited Feedback

In limited feedback multi-user multiple-input multiple-output (MU-MIMO) cellular networks, users send quantized information about the channel conditions to the associated base station (BS) for downlink beamforming. However, channel quantization and beamforming have been treated as two separate tasks conventionally, which makes it difficult to achieve global system optimality. In this paper, we propose an augmented deep unfolding (ADU) approach that jointly optimizes the beamforming scheme at the BSs and the channel quantization scheme at the users. In particular, the classic WMMSE beamformer is unrolled and a deep neural network (DNN) is leveraged to pre-process its input to enhance the performance. The variational information bottleneck technique is adopted to further improve the performance when the feedback capacity is strictly restricted. Simulation results demonstrate that the proposed ADU method outperforms all the benchmark schemes in terms of the system average rate.

eess.SP↗

arXiv2022

Experimental demonstration of genuine tripartite nonlocality under strict locality conditions

Nonlocality captures one of the counterintuitive features of nature that defies classical intuition. Recent investigations reveal that our physical world's nonlocality is at least tripartite; i.e., genuinely tripartite nonlocal correlations in nature cannot be reproduced by any causal theory involving bipartite nonclassical resources and unlimited shared randomness. Here, by allowing the fair sampling assumption and postselection, we experimentally demonstrate such genuine tripartite nonlocality in a network under strict locality constraints that are ensured by spacelike separating all relevant events and employing fast quantum random number generators and high-speed polarization measurements. In particular, for a photonic quantum triangular network we observe a locality-loophole-free violation of the Bell-type inequality by 7.57 standard deviations for a postselected tripartite Greenberger-Horne-Zeilinger state of fidelity $(93.13 \pm 0.24)\%$, which convincingly disproves the possibility of simulating genuine tripartite nonlocality by bipartite nonlocal resources with globally shared randomness.

quant-ph↗

arXiv2022

On Deep Holes of Elliptic Curve Codes

We give a method to construct deep holes for elliptic curve codes. For long elliptic curve codes, we conjecture that our construction is complete in the sense that it gives all deep holes. Some evidence and heuristics on the completeness are provided via the connection with problems and results in finite geometry.

cs.IT↗

arXiv2022

Halo Properties and Mass Functions of Groups/Clusters from the DESI Legacy Imaging Surveys DR9

Based on a large group/cluster catalog recently constructed from the DESI Legacy Imaging Surveys DR9 using an extended halo-based group finder, we measure and model the group-galaxy weak lensing signals for groups/clusters in a few redshift bins within redshift range $0.1 \leqslant z<0.6$. Here, the background shear signals are obtained based on the DECaLS survey shape catalog derived with the \textsc{Fourier\_Quad} method. We divide the lens samples into 5 equispaced redshift bins and 7 mass bins, which allow us to probe the redshift and mass dependence of the lensing signals and hence the resulting halo properties. In addition to these sample selections, we have also checked the signals around different group centers, e.g., brightest central galaxy (BCG), luminosity weighted center and number weighted center. We use a lensing model that includes off-centering to describe the lensing signals we measure for all mass and redshift bins. The results demonstrate that our model predictions for the halo masses, bias and concentrations are stable and self-consistent among different samples for different group centers. Taking advantage of the very large and complete sample of groups/clusters, as well as the reliable estimation of their halo masses, we provide measurements of the cumulative halo mass functions up to redshift $z=0.6$, with a mass precision at $0.03\sim0.09$ dex.

astro-ph.CO↗

arXiv2022

Ferroelectricity driven by magnetism in quasi-one-dimensional Ba9Fe3Se15

The spin-induced ferroelectricity in quasi-1D spin chain system is little known, which could be fundamentally different from those in three-dimensional (3D) system. Here, we report the ferroelectricity driven by a tilted screw spin order and its exotic dynamic in the spin-chain compound Ba9Fe3Se15. It is found that the spin-induced polarization has already occurred and exhibits magnetoelectric coupling behavior far above the long-range spin order (LRSO) at TN = 14 K. The polarized entities grow and their dynamic responses slow down gradually with decreasing temperature and permeate the whole lattice to form 3D ferroelectricity at TN. Our results reveal that the short-range spin orders (SRSOs) in the decoupled chains play a key role for the exotic dynamic in this dimension reduced system. Ba9Fe3Se15 is the only example so far which exhibits electric polarization above LRSO temperature because of the formation of SRSOs.

cond-mat.str-el↗

arXiv2022

Unusual slow energy relaxation induced by mobile discrete breathers in one-dimensional lattices with next-nearest-neighbor coupling

We study the energy relaxation process in one-dimensional (1D) lattices with next-nearest-neighbor (NNN) couplings. This relaxation is produced by adding damping (absorbing conditions) to the boundary (free-end) of the lattice. Compared to the 1D lattices with on-site potentials, the properties of discrete breathers (DBs) that are spatially localized intrinsic modes are quite unusual with the NNN couplings included, i.e., these DBs are mobile, and thus they can interact with both the phonons and the boundaries of the lattice. For the interparticle interactions of harmonic and Fermi-Pasta-Ulam-Tsingou-$β$ (FPUT-$β$) types, we find two crossovers of relaxation in general, i.e., a first crossover from the stretched-exponential to the regular exponential relaxation occurring in a short timescale, and a further crossover from the exponential to the power-law relaxation taking place in a long timescale. The first and second relaxations are universal, but the final power-law relaxation is strongly influenced by the properties of DBs, e.g. the scattering processes of DBs with phonons and boundaries in the FPUT-$β$ type systems make the power-law decay relatively faster than that in the counterparts of the harmonic type systems under the same coupling. Our results present new information and insights for understanding the slow energy relaxation in cooling the lattices.

nlin.CD↗

arXiv2022

Hiding Your Signals: A Security Analysis of PPG-based Biometric Authentication

Recently, physiological signal-based biometric systems have received wide attention. Unlike traditional biometric features, physiological signals can not be easily compromised (usually unobservable to human eyes). Photoplethysmography (PPG) signal is easy to measure, making it more attractive than many other physiological signals for biometric authentication. However, with the advent of remote PPG (rPPG), unobservability has been challenged when the attacker can remotely steal the rPPG signals by monitoring the victim's face, subsequently posing a threat to PPG-based biometrics. In PPG-based biometric authentication, current attack approaches mandate the victim's PPG signal, making rPPG-based attacks neglected. In this paper, we firstly analyze the security of PPG-based biometrics, including user authentication and communication protocols. We evaluate the signal waveforms, heart rate and inter-pulse-interval information extracted by five rPPG methods, including four traditional optical computing methods (CHROM, POS, LGI, PCA) and one deep learning method (CL_rPPG). We conducted experiments on five datasets (PURE, UBFC_rPPG, UBFC_Phys, LGI_PPGI, and COHFACE) to collect a comprehensive set of results. Our empirical studies show that rPPG poses a serious threat to the authentication system. The success rate of the rPPG signal spoofing attack in the user authentication system reached 0.35. The bit hit rate is 0.6 in inter-pulse-interval-based security protocols. Further, we propose an active defence strategy to hide the physiological signals of the face to resist the attack. It reduces the success rate of rPPG spoofing attacks in user authentication to 0.05. The bit hit rate was reduced to 0.5, which is at the level of a random guess. Our strategy effectively prevents the exposure of PPG signals to protect users' sensitive physiological data.

cs.CR↗