Search arXiv⌕ Search

arXiv subjects

Jian Chen

Publications and source records attributed to Jian Chen.

At least 289 records · Page 16Linked to original sources

Pareto-Frontier-aware Neural Architecture Generation for Diverse Budgets

Designing feasible and effective architectures under diverse computation budgets incurred by different applications/devices is essential for deploying deep models in practice. Existing methods often perform an independent architecture search for each target budget, which is very inefficient yet unnecessary. Moreover, the repeated independent search manner would inevitably ignore the common knowledge among different search processes and hamper the search performance. To address these issues, we seek to train a general architecture generator that automatically produces effective architectures for an arbitrary budget merely via model inference. To this end, we propose a Pareto-Frontier-aware Neural Architecture Generator (NAG) which takes an arbitrary budget as input and produces the Pareto optimal architecture for the target budget. We train NAG by learning the Pareto frontier (i.e., the set of Pareto optimal architectures) over model performance and computational cost (e.g., latency). Extensive experiments on three platforms (i.e., mobile, CPU, and GPU) show the superiority of the proposed method over existing NAS methods.

cs.LG↗

Calibration of manganin pressure gauge for diamond-anvil cells

Pressure calibration for most diamond-anvil cell (DAC) experiments is mainly based on the ruby scale, which is key to implement this powerful tool for high-pressure study. However, the ruby scale can often hardly be used for programmably-controlled DAC devices, especially the piezoelectric-driving cells, where a continuous pressure calibration is required. In this work, we present an effective pressure gauge for DACs made of manganin metal, based on the four-probe resistivity measurements. Pressure dependence of its resistivity is well established and shows excellent linear relations in the 0 - 30 GPa pressure range with a slope of 23.4 (9) GPa for the first-cycle compression, in contrast to that of multiple-cycle compression and decompression having a nearly identical slope of 33.7 (4) GPa likely due to the strain effect. In addition, such-established manganin scale can be used for continuously monitoring the cell pressure of piezoelectric-driving DACs, and the reliability of this method is also verified by the fixed-point method with a Bi pressure standard. Realization of continuous pressure calibration for programmably-controlled DACs would offer many opportunities for study of dynamics, kinetics, and critical behaviors of pressure-induced phase transitions.

physics.app-ph↗

Towards Accurate and Compact Architectures via Neural Architecture Transformer

Designing effective architectures is one of the key factors behind the success of deep neural networks. Existing deep architectures are either manually designed or automatically searched by some Neural Architecture Search (NAS) methods. However, even a well-designed/searched architecture may still contain many nonsignificant or redundant modules/operations. Thus, it is necessary to optimize the operations inside an architecture to improve the performance without introducing extra computational cost. To this end, we have proposed a Neural Architecture Transformer (NAT) method which casts the optimization problem into a Markov Decision Process (MDP) and seeks to replace the redundant operations with more efficient operations, such as skip or null connection. Note that NAT only considers a small number of possible transitions and thus comes with a limited search/transition space. As a result, such a small search space may hamper the performance of architecture optimization. To address this issue, we propose a Neural Architecture Transformer++ (NAT++) method which further enlarges the set of candidate transitions to improve the performance of architecture optimization. Specifically, we present a two-level transition rule to obtain valid transitions, i.e., allowing operations to have more efficient types (e.g., convolution->separable convolution) or smaller kernel sizes (e.g., 5x5->3x3). Note that different operations may have different valid transitions. We further propose a Binary-Masked Softmax (BMSoftmax) layer to omit the possible invalid transitions. Extensive experiments on several benchmark datasets show that the transformed architecture significantly outperforms both its original counterpart and the architectures optimized by existing methods.

cs.CV↗

$L^2$ extension of $\bar\partial$-closed forms on weakly pseudoconvex Kähler manifolds

Combining V. Koziarz's observation about the regularity of some modified section related to the initial extension with J. McNeal--D. Varolin's regularity argument, we generalize two theorems of McNeal--Varolin for the $L^2$ extension of $\bar\partial$-closed high-degree forms on a Stein manifold to the weakly pseudoconvex Kähler case under mixed positivity conditions.

math.CV↗

Experimental demonstration of cylindrical vector spatiotemporal optical vortex

We experimentally generate cylindrically polarized wavepackets with transverse orbital angular momentum, demonstrating the coexistence of spatiotemporal optical vortex with spatial polarization singularity. The results in this paper extend the study of spatiotemporal wavepackets to a broader scope, paving the way for its applications in various areas such as light-matter interaction, optical tweezers, spatiotemporal spin-orbit angular momentum coupling, etc.

physics.optics↗

VIS30K: A Collection of Figures and Tables from IEEE Visualization Conference Publications

We present the VIS30K dataset, a collection of 29,689 images that represents 30 years of figures and tables from each track of the IEEE Visualization conference series (Vis, SciVis, InfoVis, VAST). VIS30K's comprehensive coverage of the scientific literature in visualization not only reflects the progress of the field but also enables researchers to study the evolution of the state-of-the-art and to find relevant work based on graphical content. We describe the dataset and our semi-automatic collection process, which couples convolutional neural networks (CNN) with curation. Extracting figures and tables semi-automatically allows us to verify that no images are overlooked or extracted erroneously. To improve quality further, we engaged in a peer-search process for high-quality figures from early IEEE Visualization papers. With the resulting data, we also contribute VISImageNavigator (VIN, visimagenavigator.github.io), a web-based tool that facilitates searching and exploring VIS30K by author names, paper keywords, title and abstract, and years.

cs.CV↗

Covert Communication in Intelligent Reflecting Surface-Assisted NOMA Systems: Design, Analysis, and Optimization

In this paper, we investigate covert communication in an intelligent reflecting surface (IRS)-assisted non-orthogonal multiple access (NOMA) system, where a legitimate transmitter (Alice) applies NOMA for downlink and uplink transmissions with a covert user (Bob) and a public user (Roy) aided by an IRS. Specifically, we propose new IRS-assisted downlink and uplink NOMA schemes to hide the existence of Bob's covert transmission from a warden (Willie), which cost-effectively exploit the phase-shift uncertainty of the IRS and the non-orthogonal signal transmission of Roy as the cover medium without requiring additional uncertainty sources. Assuming the worst-case covert communication scenario where Willie can optimally adjust the detection threshold for his detector, we derive an analytical expression for the minimum average detection error probability of Willie achieved by each of the proposed schemes. To further enhance the covert communication performance, we propose to maximize the covert rates of Bob by jointly optimizing the transmit power and the IRS reflect beamforming, subject to given requirements on the covertness against Willie and the quality-of-service (QoS) at Roy. Simulation results demonstrate the covertness advantage of the proposed schemes and confirm the accuracy of the derived analytical results. Interestingly, it is found that covert communication is impossible without using IRS or NOMA for the considered setup while the proposed schemes can always guarantee positive covert rates.

cs.IT↗

Mid-infrared single photon detector with superconductor Mo$_{80}$Si$_{20}$ nanowire

A mid-infrared single photon detector (MIR-SNSPD) was reported based on 30 nm-wide superconductor molybdenum silicide nanowires in this work. Saturated quantum efficiencies (QEs) were achieved at the wavelength ranging from 1.55 to 5.07 micrometer in experiments. At the same time, the intrinsic dark count rate (DCR) was below 100 cps. Thus, this device produced a noise equivalent power (NEP) of 4.5 * 10-19 W/sqrt(Hz). The results provide the foundation of developing 10 micrometer-SNSPD for the applications of infrared astronomy observation.

physics.app-ph↗

Defense-guided Transferable Adversarial Attacks

Though deep neural networks perform challenging tasks excellently, they are susceptible to adversarial examples, which mislead classifiers by applying human-imperceptible perturbations on clean inputs. Under the query-free black-box scenario, adversarial examples are hard to transfer to unknown models, and several methods have been proposed with the low transferability. To settle such issue, we design a max-min framework inspired by input transformations, which are benificial to both the adversarial attack and defense. Explicitly, we decrease loss values with inputs' affline transformations as a defense in the minimum procedure, and then increase loss values with the momentum iterative algorithm as an attack in the maximum procedure. To further promote transferability, we determine transformed values with the max-min theory. Extensive experiments on Imagenet demonstrate that our defense-guided transferable attacks achieve impressive increase on transferability. Experimentally, we show that our ASR of adversarial attack reaches to 58.38% on average, which outperforms the state-of-the-art method by 12.1% on the normally trained models and by 11.13% on the adversarially trained models. Additionally, we provide elucidative insights on the improvement of transferability, and our method is expected to be a benchmark for assessing the robustness of deep models.

cs.LG↗

Secure Two-Way Communications via Intelligent Reflecting Surfaces

In this letter, we propose to exploit an intelligent reflecting surface (IRS) to secure multiuser two-way communications. Specifically, two end users simultaneously transmit their signals, where the signal of one user is exploited as information jamming to disrupt the reception of the other user's signal at an eavesdropper. A simple user scheduling scheme is developed to improve the secrecy rate. Analytical results in terms of a lower bound on the average secrecy rate and its scaling laws are derived to evaluate the secrecy performance and obtain valuable design insights. Simulation results are provided to confirm the accuracy of the theoretical analysis and validate the secrecy improvement of the proposed scheme over other baseline schemes.

cs.IT↗

Secure Non-Orthogonal Multiple Access: An Interference Engineering Perspective

Non-orthogonal multiple access (NOMA) is an efficient approach that can improve spectrum utilization and support massive connectivity for next-generation wireless networks. However, over a wireless channel, the superimposed NOMA signals are highly susceptible to eavesdropping, potentially leading to severe leakage of confidential information. In this article, we unleash the potential of network interference and exploit it constructively to enhance physical-layer security in NOMA networks. Particularly, three different types of network interference, including artificial noise, specifically-designed jamming signals, and inter-user interference, are well engineered to intentionally reduce information leakage while mitigating the effect on signal reception quality of legitimate users, thereby significantly enhancing the transmission security of NOMA. Furthermore, we propose interference engineering strategies for more advanced full-duplex NOMA, intelligent reflecting surface NOMA, cognitive radio NOMA, and multi-cell NOMA networks, and discuss several open research problems and challenges, which could inspire innovative interference engineering designs for secure NOMA communications.

cs.IT↗

Double Forward Propagation for Memorized Batch Normalization

Batch Normalization (BN) has been a standard component in designing deep neural networks (DNNs). Although the standard BN can significantly accelerate the training of DNNs and improve the generalization performance, it has several underlying limitations which may hamper the performance in both training and inference. In the training stage, BN relies on estimating the mean and variance of data using a single minibatch. Consequently, BN can be unstable when the batch size is very small or the data is poorly sampled. In the inference stage, BN often uses the so called moving mean and moving variance instead of batch statistics, i.e., the training and inference rules in BN are not consistent. Regarding these issues, we propose a memorized batch normalization (MBN), which considers multiple recent batches to obtain more accurate and robust statistics. Note that after the SGD update for each batch, the model parameters will change, and the features will change accordingly, leading to the Distribution Shift before and after the update for the considered batch. To alleviate this issue, we present a simple Double-Forward scheme in MBN which can further improve the performance. Compared to related methods, the proposed MBN exhibits consistent behaviors in both training and inference. Empirical results show that the MBN based models trained with the Double-Forward scheme greatly reduce the sensitivity of data and significantly improve the generalization performance.

cs.LG↗

Conditional Automated Channel Pruning for Deep Neural Networks

Model compression aims to reduce the redundancy of deep networks to obtain compact models. Recently, channel pruning has become one of the predominant compression methods to deploy deep models on resource-constrained devices. Most channel pruning methods often use a fixed compression rate for all the layers of the model, which, however, may not be optimal. To address this issue, given a target compression rate for the whole model, one can search for the optimal compression rate for each layer. Nevertheless, these methods perform channel pruning for a specific target compression rate. When we consider multiple compression rates, they have to repeat the channel pruning process multiple times, which is very inefficient yet unnecessary. To address this issue, we propose a Conditional Automated Channel Pruning(CACP) method to obtain the compressed models with different compression rates through single channel pruning process. To this end, we develop a conditional model that takes an arbitrary compression rate as input and outputs the corresponding compressed model. In the experiments, the resultant models with different compression rates consistently outperform the models compressed by existing methods with a channel pruning process for each target compression rate.

cs.CV↗

Grasp Proposal Networks: An End-to-End Solution for Visual Learning of Robotic Grasps

Learning robotic grasps from visual observations is a promising yet challenging task. Recent research shows its great potential by preparing and learning from large-scale synthetic datasets. For the popular, 6 degree-of-freedom (6-DOF) grasp setting of parallel-jaw gripper, most of existing methods take the strategy of heuristically sampling grasp candidates and then evaluating them using learned scoring functions. This strategy is limited in terms of the conflict between sampling efficiency and coverage of optimal grasps. To this end, we propose in this work a novel, end-to-end \emph{Grasp Proposal Network (GPNet)}, to predict a diverse set of 6-DOF grasps for an unseen object observed from a single and unknown camera view. GPNet builds on a key design of grasp proposal module that defines \emph{anchors of grasp centers} at discrete but regular 3D grid corners, which is flexible to support either more precise or more diverse grasp predictions. To test GPNet, we contribute a synthetic dataset of 6-DOF object grasps; evaluation is conducted using rule-based criteria, simulation test, and real test. Comparative results show the advantage of our methods over existing ones. Notably, GPNet gains better simulation results via the specified coverage, which helps achieve a ready translation in real test. We will make our dataset publicly available.

cs.CV↗

Privacy-Preserving Dynamic Average Consensus via State Decomposition: Case Study on Multi-Robot Formation Control

Dynamic average consensus is a decentralized control/estimation framework where a group of agents cooperatively track the average of local time-varying reference signals. In this paper, we develop a novel state decomposition-based privacy preservation scheme to protect the privacy of agents when sharing information with neighboring agents. Specifically, we first show that an external eavesdropper can successfully wiretap the reference signals of all agents in a conventional dynamic average consensus algorithm. To protect privacy against the eavesdropper, a state decomposition scheme is developed where the original state of each agent is decomposed into two sub-states: one succeeds the role of the original state in inter-node interactions, while the other sub-state only communicates with the first one and is invisible to other neighboring agents. Rigorous analyses are performed to show that 1) the proposed privacy scheme preserves the convergence of the average consensus; and 2) the privacy of the agents is protected such that an eavesdropper cannot discover the private reference signals with any guaranteed accuracy. The developed privacy-preserving dynamic average consensus framework is then applied to the formation control of multiple non-holonomic mobile robots, in which the efficacy of the scheme is demonstrated. Numerical simulation is provided to illustrate the effectiveness of the proposed approach.

eess.SY↗

Exemplar-based Layout Fine-tuning for Node-link Diagrams

We design and evaluate a novel layout fine-tuning technique for node-link diagrams that facilitates exemplar-based adjustment of a group of substructures in batching mode. The key idea is to transfer user modifications on a local substructure to other substructures in the whole graph that are topologically similar to the exemplar. We first precompute a canonical representation for each substructure with node embedding techniques and then use it for on-the-fly substructure retrieval. We design and develop a light-weight interactive system to enable intuitive adjustment, modification transfer, and visual graph exploration. We also report some results of quantitative comparisons, three case studies, and a within-participant user study.

cs.GR↗

Robust and Secure Communications in Intelligent Reflecting Surface Assisted NOMA networks

This letter investigates secure transmission in an intelligent reflecting surface (IRS) assisted non-orthogonal multiple access (NOMA) network. Consider a practical eavesdropping scenario with imperfect channel state information of the eavesdropper, we propose a robust beamforming scheme using artificial noise to guarantee secure NOMA transmission with the IRS. A joint transmit beamforming and IRS phase shift optimization problem is formulated to minimize the transmit power. Since the problem is non-convex and challenging to resolve, we develop an effective alternative optimization (AO) algorithm to obtain stationary point solutions. Simulation results validate the security advantage of the robust beamforming scheme and the effectiveness of the AO algorithm.

cs.IT↗