arXiv subjects

Peng Zhang

Publications and source records attributed to Peng Zhang.

At least 397 records · Page 22Linked to original sources

arXiv2024

A Dynamic Droplet Breakup Model for Eulerian-Lagrangian Simulation of Liquid-fueled Detonation

This study proposes a dynamic model to reflect the physical image of the droplet breakup process in two-phase detonation flows. This breakup model is implemented in a two-phase detonation solver developed based on an open-source computational fluid dynamic platform, OpenFOAM, and compared with three prevalent models (TAB, PilchErdman, and ReitzKH-RT model) under different droplet diameters in one- and two-dimensional detonation problems. The simulating results show that the present breakup model well predicts experimentally determined detonation parameters such as detonation velocities and post-wave temperature. In addition, the present model has the advantage of being free of the KH breakup time parameter, which is needed by the ReitzKH-RT model to fit the experimental data. The one-dimensional detonation simulations indicate that different breakup models have a slight impact on the detonation wave velocity because the droplet breakup process does not significantly affect the total heat release as long as it is sufficiently fast to sustain the detonation. However, the two-dimensional detonation simulations show that both the breakup model and the droplet initial diameter significantly affect the detonation cell size due to the different droplet distributions predicted by different models. The breakup length, which is the distance from the shock wave to the location at which sufficiently small child droplets appear, affects the chemical reaction zone thickness, which in turn affects the detonation cell size. A longer breakup length will result in a larger detonation cell size.

physics.flu-dyn↗

arXiv2024

Timing and Spectral Analysis of HMXB 4U 1700-37 Observed with Insight-HXMT

We report timing and spectral studies of the high mass X-ray binary 4U 1700-37 using Insight-HXMT observations carried out in 2020 during its out-of-eclipse state. We found significant variations in flux on a time-scale of kilo-seconds, while the hardness (count rate ratio between 10-30 keV and 2-10 keV) remains relatively stable. No evident pulsations were found over a frequency range of $10^{-3}$-2000 Hz. During the spectral analysis, for the first time we took the configuration of different Insight-HXMT detectors' orientations into account, which allows us obtaining reliable results even if a stable contamination exists in the field-of-view. We found that the spectrum could be well described by some phenomenological models that commonly used in accreting pulsars (e.g., a power law with a high energy cutoff) in the energy range of 2-100 keV. We found hints of cyclotron absorption features around ~ 16 keV or/and ~ 50 keV.

astro-ph.HE↗

arXiv2024

MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answering

In today's fast-paced industry, professionals face the challenge of summarizing a large number of documents and extracting vital information from them on a daily basis. These metrics are frequently hidden away in tables and/or their nested hyperlinks. To address this challenge, the approach of Table Question Answering (QA) has been developed to extract the relevant information. However, traditional Table QA training tasks that provide a table and an answer(s) from a gold cell coordinate(s) for a question may not always ensure extracting the accurate answer(s). Recent advancements in Large Language Models (LLMs) have opened up new possibilities for extracting information from tabular data using prompts. In this paper, we introduce the Multi-hop Few-shot Open Rich Table QA (MFORT-QA) approach, which consists of two major steps. The first step involves Few-Shot Learning (FSL), where relevant tables and associated contexts of hyperlinks are retrieved based on a given question. The retrieved content is then used to construct few-shot prompts as inputs to an LLM, such as ChatGPT. To tackle the challenge of answering complex questions, the second step leverages Chain-of-thought (CoT) prompting to decompose the complex question into a sequential chain of questions and reasoning thoughts in a multi-hop manner. Retrieval-Augmented Generation (RAG) enhances this process by retrieving relevant tables and contexts of hyperlinks that are relevant to the resulting reasoning thoughts and questions. These additional contexts are then used to supplement the prompt used in the first step, resulting in more accurate answers from an LLM. Empirical results from OTT-QA demonstrate that our abstractive QA approach significantly improves the accuracy of extractive Table QA methods.

cs.CL↗

arXiv2024

InternLM2 Technical Report

The evolution of Large Language Models (LLMs) like ChatGPT and GPT-4 has sparked discussions on the advent of Artificial General Intelligence (AGI). However, replicating such advancements in open-source models has been challenging. This paper introduces InternLM2, an open-source LLM that outperforms its predecessors in comprehensive evaluations across 6 dimensions and 30 benchmarks, long-context modeling, and open-ended subjective evaluations through innovative pre-training and optimization techniques. The pre-training process of InternLM2 is meticulously detailed, highlighting the preparation of diverse data types including text, code, and long-context data. InternLM2 efficiently captures long-term dependencies, initially trained on 4k tokens before advancing to 32k tokens in pre-training and fine-tuning stages, exhibiting remarkable performance on the 200k ``Needle-in-a-Haystack" test. InternLM2 is further aligned using Supervised Fine-Tuning (SFT) and a novel Conditional Online Reinforcement Learning from Human Feedback (COOL RLHF) strategy that addresses conflicting human preferences and reward hacking. By releasing InternLM2 models in different training stages and model sizes, we provide the community with insights into the model's evolution.

cs.CL↗

arXiv2024

Discovery of superconductivity in technetium-borides at moderate pressures

Advances in theoretical calculations boosted the searches for high temperature superconductors, such as sulfur hydrides and rare-earth polyhydrides. However, the required extremely high pressures for stabilizing these superconductors handicapped further implementations. Based upon thorough structural searches, we identified series of unprecedented superconducting technetium-borides at moderate pressures, including TcB (P6$_3$/mmc) with superconducting transition temperature $T_{\text{c}}$ = 20.2 K at ambient pressure and TcB$_2$ (P6/mmm) with $T_{\text{c}}$ = 23.1 K at 20 GPa. Superconductivity in these technetium-borides mainly originates from the coupling between the low frequency vibrations of technetium-atoms and the dominant technetium-4d electrons at the Fermi level. Our works therefore present a fresh group in the family of superconducting borides, whose diversified crystal structures suggest rich possibilities in discovery of other superconducting transition-metal-borides.

cond-mat.supr-con↗

arXiv2024

Scalable Neural Dynamic Equivalence for Power Systems

Traditional grid analytics are model-based, relying strongly on accurate models of power systems, especially the dynamic models of generators, controllers, loads and other dynamic components. However, acquiring thorough power system models can be impractical in real operation due to inaccessible system parameters and privacy of consumers, which necessitate data-driven dynamic equivalencing of unknown subsystems. Learning reliable dynamic equivalent models for the external systems from SCADA and PMU data, however, is a long-standing intractable problem in power system analysis due to complicated nonlinearity and unforeseeable dynamic modes of power systems. This paper advances a practical application of neural dynamic equivalence (NeuDyE) called Driving Port NeuDyE (DP-NeuDyE), which exploits physics-informed machine learning and neural-ordinary-differential-equations (ODE-NET) to discover a dynamic equivalence of external power grids while preserving its dynamic behaviors after disturbances. The new contributions are threefold: A NeuDyE formulation to enable a continuous-time, data-driven dynamic equivalence of power systems, saving the effort and expense of acquiring inaccessible system; An introduction of a Physics-Informed NeuDyE learning (PI-NeuDyE) to actively control the closed-loop accuracy of NeuDyE; and A DP-NeuDyE to reduce the number of inputs required for the training. We conduct extensive case studies on the NPCC system to validate the generalizability and accuracy of both PI-NeuDyE and DP-NeuDyE, which span a multitude of scenarios, differing in the time required for fault clearance, the specific fault locations, and the limitations of data. Test results have demonstrated the scalability and practicality of NeuDyE, showing its potential to be used in ISO and utility control centers for online transient stability analysis and for planning purposes.

eess.SY↗

arXiv2024

Batch-oriented Element-wise Approximate Activation for Privacy-Preserving Neural Networks

Privacy-Preserving Neural Networks (PPNN) are advanced to perform inference without breaching user privacy, which can serve as an essential tool for medical diagnosis to simultaneously achieve big data utility and privacy protection. As one of the key techniques to enable PPNN, Fully Homomorphic Encryption (FHE) is facing a great challenge that homomorphic operations cannot be easily adapted for non-linear activation calculations. In this paper, batch-oriented element-wise data packing and approximate activation are proposed, which train linear low-degree polynomials to approximate the non-linear activation function - ReLU. Compared with other approximate activation methods, the proposed fine-grained, trainable approximation scheme can effectively reduce the accuracy loss caused by approximation errors. Meanwhile, due to element-wise data packing, a large batch of images can be packed and inferred concurrently, leading to a much higher utility ratio of ciphertext slots. Therefore, although the total inference time increases sharply, the amortized time for each image actually decreases, especially when the batch size increases. Furthermore, knowledge distillation is adopted in the training process to further enhance the inference accuracy. Experiment results show that when ciphertext inference is performed on 4096 input images, compared with the current most efficient channel-wise method, the inference accuracy is improved by 1.65%, and the amortized inference time is reduced by 99.5%.

cs.CR↗

arXiv2024

Spontaneous gap opening and potential excitonic states in an ideal Dirac semimetal Ta$_2$Pd$_3$Te$_5$

The opening of an energy gap in the electronic structure generally indicates the presence of interactions. In materials with low carrier density and short screening length, long-range Coulomb interaction favors the spontaneous formation of electron-hole pairs, so-called excitons, opening an excitonic gap at the Fermi level. Excitonic materials host unique phenomenons associated with pair excitations. However, there is still no generally recognized single-crystal material with excitonic order, which is, therefore, awaited in condensed matter physics. Here, we show that excitonic states may exist in the quasi-one-dimensional material Ta$_2$Pd$_3$Te$_5$, which has an almost ideal Dirac-like band structure, with Dirac point located exactly at Fermi level. We find that an energy gap appears at 350 K, and it grows with decreasing temperature. The spontaneous gap opening is absent in a similar material Ta$_2$Ni$_3$Te$_5$. Intriguingly, the gap is destroyed by the potassium deposition on the crystal, likely due to extra-doped carriers. Furthermore, we observe a pair of in-gap flat bands, which is an analog of the impurity states in a superconducting gap. All these observations can be properly explained by an excitonic order, providing Ta$_2$Pd$_3$Te$_5$ as a new and promising candidate realizing excitonic states.

cond-mat.mtrl-sci↗

arXiv2024

Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentation

Existing interactive point cloud segmentation approaches primarily focus on the object segmentation, which aim to determine which points belong to the object of interest guided by user interactions. This paper concentrates on an unexplored yet meaningful task, i.e., interactive point cloud semantic segmentation, which assigns high-quality semantic labels to all points in a scene with user corrective clicks. Concretely, we presents the first interactive framework for point cloud semantic segmentation, named InterPCSeg, which seamlessly integrates with off-the-shelf semantic segmentation networks without offline re-training, enabling it to run in an on-the-fly manner. To achieve online refinement, we treat user interactions as sparse training examples during the test-time. To address the instability caused by the sparse supervision, we design a stabilization energy to regulate the test-time training process. For objective and reproducible evaluation, we develop an interaction simulation scheme tailored for the interactive point cloud semantic segmentation task. We evaluate our framework on the S3DIS and ScanNet datasets with off-the-shelf segmentation networks, incorporating interactions from both the proposed interaction simulator and real users. Quantitative and qualitative experimental results demonstrate the efficacy of our framework in refining the semantic segmentation results with user interactions. The source code will be publicly available.

cs.CV↗

arXiv2024

Application of Deep Learning Methods for Distinguishing Gamma-Ray Bursts from Fermi/GBM TTE Data

To investigate GRBs in depth, it is crucial to develop an effective method for identifying GRBs accurately. Current criteria, e.g., onboard blind search, ground blind search, and target search, are limited by manually set thresholds and perhaps miss GRBs, especially for sub-threshold events. We propose a novel approach that utilizes convolutional neural networks (CNNs) to distinguish GRBs and non-GRBs directly. We structured three CNN models, plain-CNN, ResNet, and ResNet-CBAM, and endeavored to exercise fusing strategy models. Count maps of NaI detectors onboard Fermi/GBM were employed as the input samples of datasets and models were implemented to evaluate their performance on different time scale data. The ResNet-CBAM model trained on 64 ms dataset achieves high accuracy overall, which includes residual and attention mechanism modules. The visualization methods of Grad-CAM and t-SNE explicitly displayed that the optimal model focuses on the key features of GRBs precisely. The model was applied to analyze one-year data, accurately identifying approximately 98% of GRBs listed in the Fermi burst catalog, 8 out of 9 sub-threshold GRBs, and 5 GRBs triggered by other satellites, which demonstrated the deep learning methods could effectively distinguish GRBs from observational data. Besides, thousands of unknown candidates were retrieved and compared with the bursts of SGR J1935+2154 for instance, which exemplified the potential scientific value of these candidates indeed. Detailed studies on integrating our model into real-time analysis pipelines thus may improve their accuracy of inspection, and provide valuable guidance for rapid follow-up observations of multi-band telescopes.

astro-ph.HE↗

arXiv2024

Detecting Neutrinos from Supernova Bursts in PandaX-4T

Neutrinos from core-collapse supernovae are essential for the understanding of neutrino physics and stellar evolution. The dual-phase xenon dark matter detectors can provide a way to track explosions of galactic supernovae by detecting neutrinos through coherent elastic neutrino-nucleus scatterings. In this study, a variation of progenitor masses as well as explosion models are assumed to predict the neutrino fluxes and spectra, which result in the number of expected neutrino events ranging from 6.6 to 13.7 at a distance of 10 kpc over a 10-second duration with negligible backgrounds at PandaX-4T. Two specialized triggering alarms for monitoring supernova burst neutrinos are built. The efficiency of detecting supernova explosions at various distances in the Milky Way is estimated. These alarms will be implemented in the real-time supernova monitoring system at PandaX-4T in the near future, providing the astronomical communities with supernova early warnings.

hep-ex↗

arXiv2024

MuseChat: A Conversational Music Recommendation System for Videos

Music recommendation for videos attracts growing interest in multi-modal research. However, existing systems focus primarily on content compatibility, often ignoring the users' preferences. Their inability to interact with users for further refinements or to provide explanations leads to a less satisfying experience. We address these issues with MuseChat, a first-of-its-kind dialogue-based recommendation system that personalizes music suggestions for videos. Our system consists of two key functionalities with associated modules: recommendation and reasoning. The recommendation module takes a video along with optional information including previous suggested music and user's preference as inputs and retrieves an appropriate music matching the context. The reasoning module, equipped with the power of Large Language Model (Vicuna-7B) and extended to multi-modal inputs, is able to provide reasonable explanation for the recommended music. To evaluate the effectiveness of MuseChat, we build a large-scale dataset, conversational music recommendation for videos, that simulates a two-turn interaction between a user and a recommender based on accurate music track information. Experiment results show that MuseChat achieves significant improvements over existing video-based music retrieval methods as well as offers strong interpretability and interactability.

cs.LG↗

arXiv2024

Learning Expressive And Generalizable Motion Features For Face Forgery Detection

Previous face forgery detection methods mainly focus on appearance features, which may be easily attacked by sophisticated manipulation. Considering the majority of current face manipulation methods generate fake faces based on a single frame, which do not take frame consistency and coordination into consideration, artifacts on frame sequences are more effective for face forgery detection. However, current sequence-based face forgery detection methods use general video classification networks directly, which discard the special and discriminative motion information for face manipulation detection. To this end, we propose an effective sequence-based forgery detection framework based on an existing video classification method. To make the motion features more expressive for manipulation detection, we propose an alternative motion consistency block instead of the original motion features module. To make the learned features more generalizable, we propose an auxiliary anomaly detection block. With these two specially designed improvements, we make a general video classification network achieve promising results on three popular face forgery datasets.

cs.CV↗

arXiv2024

On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models

Big models have achieved revolutionary breakthroughs in the field of AI, but they might also pose potential concerns. Addressing such concerns, alignment technologies were introduced to make these models conform to human preferences and values. Despite considerable advancements in the past year, various challenges lie in establishing the optimal alignment strategy, such as data cost and scalable oversight, and how to align remains an open question. In this survey paper, we comprehensively investigate value alignment approaches. We first unpack the historical context of alignment tracing back to the 1920s (where it comes from), then delve into the mathematical essence of alignment (what it is), shedding light on the inherent challenges. Following this foundation, we provide a detailed examination of existing alignment methods, which fall into three categories: Reinforcement Learning, Supervised Fine-Tuning, and In-context Learning, and demonstrate their intrinsic connections, strengths, and limitations, helping readers better understand this research area. In addition, two emerging topics, personal alignment, and multimodal alignment, are also discussed as novel frontiers in this field. Looking forward, we discuss potential alignment paradigms and how they could handle remaining challenges, prospecting where future alignment will go.

cs.AI↗

arXiv2024

Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning

Large Language Models (LLMs) have made unprecedented breakthroughs, yet their increasing integration into everyday life might raise societal risks due to generated unethical content. Despite extensive study on specific issues like bias, the intrinsic values of LLMs remain largely unexplored from a moral philosophy perspective. This work delves into ethical values utilizing Moral Foundation Theory. Moving beyond conventional discriminative evaluations with poor reliability, we propose DeNEVIL, a novel prompt generation algorithm tailored to dynamically exploit LLMs' value vulnerabilities and elicit the violation of ethics in a generative manner, revealing their underlying value inclinations. On such a basis, we construct MoralPrompt, a high-quality dataset comprising 2,397 prompts covering 500+ value principles, and then benchmark the intrinsic values across a spectrum of LLMs. We discovered that most models are essentially misaligned, necessitating further ethical value alignment. In response, we develop VILMO, an in-context alignment method that substantially enhances the value compliance of LLM outputs by learning to generate appropriate value instructions, outperforming existing competitors. Our methods are suitable for black-box and open-source models, offering a promising initial step in studying the ethical values of LLMs.

cs.CL↗

arXiv2024

DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction

Audio-visual saliency prediction can draw support from diverse modality complements, but further performance enhancement is still challenged by customized architectures as well as task-specific loss functions. In recent studies, denoising diffusion models have shown more promising in unifying task frameworks owing to their inherent ability of generalization. Following this motivation, a novel Diffusion architecture for generalized audio-visual Saliency prediction (DiffSal) is proposed in this work, which formulates the prediction problem as a conditional generative task of the saliency map by utilizing input audio and video as the conditions. Based on the spatio-temporal audio-visual features, an extra network Saliency-UNet is designed to perform multi-modal attention modulation for progressive refinement of the ground-truth saliency map from the noisy map. Extensive experiments demonstrate that the proposed DiffSal can achieve excellent performance across six challenging audio-visual benchmarks, with an average relative improvement of 6.3\% over the previous state-of-the-art results by six metrics.

cs.CV↗

arXiv2024

Two Ultracold Atoms in a Quasi-Two-Dimensional Box Confinement

We investigate the scattering and two-body bound states of two ultracold atoms in a quasi-two-dimensional (quasi-2D) confinement, with the confinement potential being an infinite square well (box potential) in the transverse ($z$-) direction, and the motion of the atoms in the $x$-$y$ plane being free. Specifically, we calculate the effective 2D scattering length and 2D effective range of the low-energy scattering, as well as the energy and the transverse-excited-mode probability of the bound states. Comparing these results with those obtained under a harmonic transverse confinement potential, we find that in most of the cases the 2D effective range for the box confinement is approximately 0.28 of the one for the harmonic confinement. Moreover, the transverse-excited-mode probability of the bound states for the box confinement is also much lower than the one for the harmonic confinement. These results suggest that the transverse excitation in the box confinement is notably weaker than the one in a harmonic confinement. Therefore, achieving quasi-2D ultracold gases well-described by pure-2D effective models, particularly those with 2D contact interaction, is more feasible through box confinement. Our results are helpful for the quantum simulation of 2D many-body physics with ultracold atoms, e.g., the suppression of 2D effective range may lead to an enhancement of quantum anomaly in two-dimensional Fermi Gases. Additionally, our calculation method is applicable to the two-body problems of ultracold atoms in other types of quasi-2D confinements.

cond-mat.quant-gas↗

arXiv2024

VN Network: Embedding Newly Emerging Entities with Virtual Neighbors

Embedding entities and relations into continuous vector spaces has attracted a surge of interest in recent years. Most embedding methods assume that all test entities are available during training, which makes it time-consuming to retrain embeddings for newly emerging entities. To address this issue, recent works apply the graph neural network on the existing neighbors of the unseen entities. In this paper, we propose a novel framework, namely Virtual Neighbor (VN) network, to address three key challenges. Firstly, to reduce the neighbor sparsity problem, we introduce the concept of the virtual neighbors inferred by rules. And we assign soft labels to these neighbors by solving a rule-constrained problem, rather than simply regarding them as unquestionably true. Secondly, many existing methods only use one-hop or two-hop neighbors for aggregation and ignore the distant information that may be helpful. Instead, we identify both logic and symmetric path rules to capture complex patterns. Finally, instead of one-time injection of rules, we employ an iterative learning scheme between the embedding method and virtual neighbor prediction to capture the interactions within. Experimental results on two knowledge graph completion tasks demonstrate that our VN network significantly outperforms state-of-the-art baselines. Furthermore, results on Subject/Object-R show that our proposed VN network is highly robust to the neighbor sparsity problem.

cs.LG↗