arXiv subjects

Ming Yang

Publications and source records attributed to Ming Yang.

At least 181 records · Page 10Linked to original sources

arXiv2024

A New Approach to Identifying Red Supergiant Stars in Metal-poor Galaxies: A Case Study of NGC 6822

A complete sample of red supergiant stars (RSGs) is important for studying their properties. Identifying RSGs in extragalatic field first requires removing the Galactic foreground dwarfs. The color-color diagram (CCD) method, specifically using $r-z/z-H$ and $J-H/H-K$, has proven successful in several studies. However, in metal-poor galaxies, faint RSGs will mix into the dwarf branch in the CCD and would be removed, leading to an incomplete RSG sample. This work attempts to improve the CCD method in combination with the Gaia astrometric measurement to remove foreground contamination in order to construct a complete RSG sample in metal-poor galaxies. The empirical regions of RSGs in both CCDs are defined and modified by fitting the locations of RSGs in galaxies with a range of metallicity. The metal-poor galaxy NGC 6822 is taken as a case study for its low metallicity ([Fe/H] $\approx$ -1.0) and moderate distance (about 500 kpc). In the complete sample, we identify 1,184 RSG, 1,559 oxygen-rich AGB (O-AGBs), 1,075 carbon-rich AGB (C-AGBs), and 140 extreme AGB (x-AGBs) candidates, with a contamination rate of approximately 20.5%, 9.7%, 6.8%, and 5.0%, respectively. We also present a pure sample, containing only the sources away from the dwarf branch, which includes 843 RSG, 1,519 O-AGB, 1,059 C-AGB, and 140 x-AGB candidates, with a contamination rate of approximately 6.5%, 8.8%, 6.1%, and 5.0%, respectively. About 600 and 450 RSG candidates are newly identified in the complete and pure sample, respectively, compared to the previous RSG sample in NGC 6822.

astro-ph.GA↗

arXiv2024

GraphicsDreamer: Image to 3D Generation with Physical Consistency

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is still significantly lags in industrial application. This gap exists because 3D modeling demands high-quality assets with sharp geometry, exquisite topology, and physically based rendering (PBR), among other criteria. To narrow the disparity between generated results and artists' expectations, we introduce GraphicsDreamer, a method for creating highly usable 3D meshes from single images. To better capture the geometry and material details, we integrate the PBR lighting equation into our cross-domain diffusion model, concurrently predicting multi-view color, normal, depth images, and PBR materials. In the geometry fusion stage, we continue to enforce the PBR constraints, ensuring that the generated 3D objects possess reliable texture details, supporting realistic relighting. Furthermore, our method incorporates topology optimization and fast UV unwrapping capabilities, allowing the 3D products to be seamlessly imported into graphics engines. Extensive experiments demonstrate that our model can produce high quality 3D assets in a reasonable time cost compared to previous methods.

cs.GR↗

arXiv2024

Mass Acquisition of Dirac Fermions in Bi4I4 by Spontaneous Symmetry Breaking

Massive Dirac fermions, which are essential for realizing novel topological phenomena, are expected to be generated from massless Dirac fermions by breaking the related symmetry, such as time-reversal symmetry (TRS) in topological insulators or crystal symmetry in topological crystalline insulators. Here, we report scanning tunneling microscopy and angle-resolved photoemission spectroscopy studies of α-Bi4I4, which reveals the realization of massive Dirac fermions in the (100) surface states without breaking the TRS. Combined with first-principle calculations, our experimental results indicate that the spontaneous symmetry breaking engenders two nondegenerate edges states at the opposite sides of monolayer Bi4I4 after the structural phase transition, imparting mass to the Dirac fermions after taking the interlayer coupling into account. Our results not only demonstrate the formation of the massive Dirac fermions by spontaneous symmetry breaking, but also imply the potential for the engineering of Dirac fermions for device applications.

cond-mat.mtrl-sci↗

arXiv2024

STDHL: Spatio-Temporal Dynamic Hypergraph Learning for Wind Power Forecasting

Leveraging spatio-temporal correlations among wind farms can significantly enhance the accuracy of ultra-short-term wind power forecasting. However, the complex and dynamic nature of these correlations presents significant modeling challenges. To address this, we propose a spatio-temporal dynamic hypergraph learning (STDHL) model. This model uses a hypergraph structure to represent spatial features among wind farms. Unlike traditional graph structures, which only capture pair-wise node features, hypergraphs create hyperedges connecting multiple nodes, enabling the representation and transmission of higher-order spatial features. The STDHL model incorporates a novel dynamic hypergraph convolutional layer to model dynamic spatial correlations and a grouped temporal convolutional layer for channel-independent temporal modeling. The model uses spatio-temporal encoders to extract features from multi-source covariates, which are mapped to quantile results through a forecast decoder. Experimental results using the GEFCom dataset show that the STDHL model outperforms existing state-of-the-art methods. Furthermore, an in-depth analysis highlights the critical role of spatio-temporal covariates in improving ultra-short-term forecasting accuracy.

cs.LG↗

arXiv2024

Animate-X: Universal Character Image Animation with Enhanced Motion Representation

Character image animation, which generates high-quality videos from a reference image and target pose sequence, has seen significant progress in recent years. However, most existing methods only apply to human figures, which usually do not generalize well on anthropomorphic characters commonly used in industries like gaming and entertainment. Our in-depth analysis suggests to attribute this limitation to their insufficient modeling of motion, which is unable to comprehend the movement pattern of the driving video, thus imposing a pose sequence rigidly onto the target character. To this end, this paper proposes Animate-X, a universal animation framework based on LDM for various character types (collectively named X), including anthropomorphic characters. To enhance motion representation, we introduce the Pose Indicator, which captures comprehensive motion pattern from the driving video through both implicit and explicit manner. The former leverages CLIP visual features of a driving video to extract its gist of motion, like the overall movement pattern and temporal relations among motions, while the latter strengthens the generalization of LDM by simulating possible inputs in advance that may arise during inference. Moreover, we introduce a new Animated Anthropomorphic Benchmark (A^2Bench) to evaluate the performance of Animate-X on universal and widely applicable animation images. Extensive experiments demonstrate the superiority and effectiveness of Animate-X compared to state-of-the-art methods.

cs.CV↗

arXiv2024

MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation

The image-to-video (I2V) generation is conditioned on the static image, which has been enhanced recently by the motion intensity as an additional control signal. These motion-aware models are appealing to generate diverse motion patterns, yet there lacks a reliable motion estimator for training such models on large-scale video set in the wild. Traditional metrics, e.g., SSIM or optical flow, are hard to generalize to arbitrary videos, while, it is very tough for human annotators to label the abstract motion intensity neither. Furthermore, the motion intensity shall reveal both local object motion and global camera movement, which has not been studied before. This paper addresses the challenge with a new motion estimator, capable of measuring the decoupled motion intensities of objects and cameras in video. We leverage the contrastive learning on randomly paired videos and distinguish the video with greater motion intensity. Such a paradigm is friendly for annotation and easy to scale up to achieve stable performance on motion estimation. We then present a new I2V model, named MotionStone, developed with the decoupled motion estimator. Experimental results demonstrate the stability of the proposed motion estimator and the state-of-the-art performance of MotionStone on I2V generation. These advantages warrant the decoupled motion estimator to serve as a general plug-in enhancer for both data processing and video generation training.

cs.CV↗

arXiv2024

Mimir: Improving Video Diffusion Models for Precise Text Understanding

Text serves as the key control signal in video generation due to its narrative nature. To render text descriptions into video clips, current video diffusion models borrow features from text encoders yet struggle with limited text comprehension. The recent success of large language models (LLMs) showcases the power of decoder-only transformers, which offers three clear benefits for text-to-video (T2V) generation, namely, precise text understanding resulting from the superior scalability, imagination beyond the input text enabled by next token prediction, and flexibility to prioritize user interests through instruction tuning. Nevertheless, the feature distribution gap emerging from the two different text modeling paradigms hinders the direct use of LLMs in established T2V models. This work addresses this challenge with Mimir, an end-to-end training framework featuring a carefully tailored token fuser to harmonize the outputs from text encoders and LLMs. Such a design allows the T2V model to fully leverage learned video priors while capitalizing on the text-related capability of LLMs. Extensive quantitative and qualitative results demonstrate the effectiveness of Mimir in generating high-quality videos with excellent text comprehension, especially when processing short captions and managing shifting motions. Project page: https://lucaria-academy.github.io/Mimir/

cs.CV↗

arXiv2024

Cross-Modal Visual Relocalization in Prior LiDAR Maps Utilizing Intensity Textures

Cross-modal localization has drawn increasing attention in recent years, while the visual relocalization in prior LiDAR maps is less studied. Related methods usually suffer from inconsistency between the 2D texture and 3D geometry, neglecting the intensity features in the LiDAR point cloud. In this paper, we propose a cross-modal visual relocalization system in prior LiDAR maps utilizing intensity textures, which consists of three main modules: map projection, coarse retrieval, and fine relocalization. In the map projection module, we construct the database of intensity channel map images leveraging the dense characteristic of panoramic projection. The coarse retrieval module retrieves the top-K most similar map images to the query image from the database, and retains the top-K' results by covisibility clustering. The fine relocalization module applies a two-stage 2D-3D association and a covisibility inlier selection method to obtain robust correspondences for 6DoF pose estimation. The experimental results on our self-collected datasets demonstrate the effectiveness in both place recognition and pose estimation tasks.

cs.CV↗

arXiv2024

Panther: Illuminate the Sight of Multimodal LLMs with Instruction-Guided Visual Prompts

Multimodal large language models (MLLMs) are closing the gap to human visual perception capability rapidly, while, still lag behind on attending to subtle images details or locating small objects precisely, etc. Common schemes to tackle these issues include deploying multiple vision encoders or operating on original high-resolution images. Few studies have concentrated on taking the textual instruction into improving visual representation, resulting in losing focus in some vision-centric tasks, a phenomenon we herein termed as Amblyopia. In this work, we introduce Panther, a MLLM that closely adheres to user instruction and locates targets of interests precisely, with the finesse of a black panther. Specifically, Panther comprises three integral components: Panther-VE, Panther-Bridge, and Panther-Decoder. Panther-VE integrates user instruction information at the early stages of the vision encoder, thereby extracting the most relevant and useful visual representations. The Panther-Bridge module, equipped with powerful filtering capabilities, significantly reduces redundant visual information, leading to a substantial savings in training costs. The Panther-Decoder is versatile and can be employed with any decoder-only architecture of LLMs without discrimination. Experimental results, particularly on vision-centric benchmarks, have demonstrated the effectiveness of Panther.

cs.CV↗

arXiv2024

Try-On-Adapter: A Simple and Flexible Try-On Paradigm

Image-based virtual try-on, widely used in online shopping, aims to generate images of a naturally dressed person conditioned on certain garments, providing significant research and commercial potential. A key challenge of try-on is to generate realistic images of the model wearing the garments while preserving the details of the garments. Previous methods focus on masking certain parts of the original model's standing image, and then inpainting on masked areas to generate realistic images of the model wearing corresponding reference garments, which treat the try-on task as an inpainting task. However, such implements require the user to provide a complete, high-quality standing image, which is user-unfriendly in practical applications. In this paper, we propose Try-On-Adapter (TOA), an outpainting paradigm that differs from the existing inpainting paradigm. Our TOA can preserve the given face and garment, naturally imagine the rest parts of the image, and provide flexible control ability with various conditions, e.g., garment properties and human pose. In the experiments, TOA shows excellent performance on the virtual try-on task even given relatively low-quality face and garment images in qualitative comparisons. Additionally, TOA achieves the state-of-the-art performance of FID scores 5.56 and 7.23 for paired and unpaired on the VITON-HD dataset in quantitative comparisons.

cs.CV↗

arXiv2024

HomoMatcher: Dense Feature Matching Results with Semi-Dense Efficiency by Homography Estimation

Feature matching between image pairs is a fundamental problem in computer vision that drives many applications, such as SLAM. Recently, semi-dense matching approaches have achieved substantial performance enhancements and established a widely-accepted coarse-to-fine paradigm. However, the majority of existing methods focus on improving coarse feature representation rather than the fine-matching module. Prior fine-matching techniques, which rely on point-to-patch matching probability expectation or direct regression, often lack precision and do not guarantee the continuity of feature points across sequential images. To address this limitation, this paper concentrates on enhancing the fine-matching module in the semi-dense matching framework. We employ a lightweight and efficient homography estimation network to generate the perspective mapping between patches obtained from coarse matching. This patch-to-patch approach achieves the overall alignment of two patches, resulting in a higher sub-pixel accuracy by incorporating additional constraints. By leveraging the homography estimation between patches, we can achieve a dense matching result with low computational cost. Extensive experiments demonstrate that our method achieves higher accuracy compared to previous semi-dense matchers. Meanwhile, our dense matching results exhibit similar end-point-error accuracy compared to previous dense matchers while maintaining semi-dense efficiency.

cs.CV↗

arXiv2024

Anchor-free Clustering based on Anchor Graph Factorization

Anchor-based methods are a pivotal approach in handling clustering of large-scale data. However, these methods typically entail two distinct stages: selecting anchor points and constructing an anchor graph. This bifurcation, along with the initialization of anchor points, significantly influences the overall performance of the algorithm. To mitigate these issues, we introduce a novel method termed Anchor-free Clustering based on Anchor Graph Factorization (AFCAGF). AFCAGF innovates in learning the anchor graph, requiring only the computation of pairwise distances between samples. This process, achievable through straightforward optimization, circumvents the necessity for explicit selection of anchor points. More concretely, our approach enhances the Fuzzy k-means clustering algorithm (FKM), introducing a new manifold learning technique that obviates the need for initializing cluster centers. Additionally, we evolve the concept of the membership matrix between cluster centers and samples in FKM into an anchor graph encompassing multiple anchor points and samples. Employing Non-negative Matrix Factorization (NMF) on this anchor graph allows for the direct derivation of cluster labels, thereby eliminating the requirement for further post-processing steps. To solve the method proposed, we implement an alternating optimization algorithm that ensures convergence. Empirical evaluations on various real-world datasets underscore the superior efficacy of our algorithm compared to traditional approaches.

cs.LG↗

arXiv2024

Multi-head Sequence Tagging Model for Grammatical Error Correction

To solve the Grammatical Error Correction (GEC) problem , a mapping between a source sequence and a target one is needed, where the two differ only on few spans. For this reason, the attention has been shifted to the non-autoregressive or sequence tagging models. In which, the GEC has been simplified from Seq2Seq to labeling the input tokens with edit commands chosen from a large edit space. Due to this large number of classes and the limitation of the available datasets, the current sequence tagging approaches still have some issues handling a broad range of grammatical errors just by being laser-focused on one single task. To this end, we simplified the GEC further by dividing it into seven related subtasks: Insertion, Deletion, Merge, Substitution, Transformation, Detection, and Correction, with Correction being our primary focus. A distinct classification head is dedicated to each of these subtasks. the novel multi-head and multi-task learning model is proposed to effectively utilize training data and harness the information from related task training signals. To mitigate the limited number of available training samples, a new denoising autoencoder is used to generate a new synthetic dataset to be used for pretraining. Additionally, a new character-level transformation is proposed to enhance the sequence-to-edit function and improve the model's vocabulary coverage. Our single/ensemble model achieves an F0.5 of 74.4/77.0, and 68.6/69.1 on BEA-19 (test) and CoNLL-14 (test) respectively. Moreover, evaluated on JFLEG test set, the GLEU scores are 61.6 and 61.7 for the single and ensemble models, respectively. It mostly outperforms recently published state-of-the-art results by a considerable margin.

cs.CL↗

arXiv2024

The Star Formation History of Nearby Galaxies: A Machine Learning Approach

Reproducing color-magnitude diagrams (CMDs) of star-resolved galaxies is one of the most precise methods for measuring the star formation history (SFH) of nearby galaxies back to the earliest time. The upcoming big data era poses challenges to the traditional numerical technique in its capacity to deal with vast amounts of data, which motivates us to explore the feasibility of employing machine learning networks in this field. In this study, we refine the synthetic CMD method with a state-of-the-art theoretical stellar evolution model to simulate the properties of stellar populations, incorporate the convolutional neural network (CNN) in the fitting process to enhance the efficiency, and innovate the initial stellar mass estimation to improve the flexibility. The fine-tuned deep learning network, named \texttt{SFHNet}, has been tested with synthetic data and further validated with photometric data collected from the Hubble Space Telescope (\textit{HST}). The derived SFHs are largely in accordance with those reported in the literature. Furthermore, the network provides detailed insights into the distribution of stellar density, initial stellar mass, and star formation rate (SFR) over the age-metallicity map. The application of the deep learning network not only measures the SFH accurately but also enhances the synthetic CMD method's efficiency and flexibility, thereby facilitating a more comprehensive and in-depth understanding of nearby galaxies.

astro-ph.GA↗

arXiv2024

Exciton dissociation in two-dimensional transition metal dichalcogenides: Excited states and substrate effects

Exciton dissociation plays a crucial role in the performance of optoelectronic devices based on two-dimensional (2D) transition metal dichalcogenides (TMDs). In this work, we investigate the effect of an in-plane electric field on the exciton resonance states in MX$_2$ (M = Mo, W; X = S, Se) monolayers and few-layers using the complex coordinate rotation method and the Lagrange-Laguerre polynomial expansion of the wave function. The exciton properties are well described within the Mott-Wannier model incorporating the nonlocal Keldysh potential. Our calculations reveal that an electric field effectively dissociates excitons, with excited states being more easily dissociated than the ground state. The critical field for exciton dissociation is found to be smaller in WX$_2$ monolayers compared to MoX$_2$ monolayers due to the smaller exciton reduced mass. Furthermore, the presence of a dielectric substrate and an increase in the number of MX$_2$ layers enhance the exciton susceptibility to the electric field, lowering the critical field for dissociation. The dependence of exciton properties on the number of MX$_2$ layers can be well described by power functions. These findings provide valuable insights for the design and optimization of high-performance optoelectronic devices based on 2D TMDs.

cond-mat.mtrl-sci↗

arXiv2024

Existence of limit of multivariable function

This article provides several theorems regarding the existence of limit for multivariable function, among which Theorem 1 and Theorem 3 relax the requirement for sequence of Heine's definition of limit. These results address the question of which paths need to be considered to determine the existence of limit for multivariable function.

math.GM↗

arXiv2024

HOTVCOM: Generating Buzzworthy Comments for Videos

In the era of social media video platforms, popular ``hot-comments'' play a crucial role in attracting user impressions of short-form videos, making them vital for marketing and branding purpose. However, existing research predominantly focuses on generating descriptive comments or ``danmaku'' in English, offering immediate reactions to specific video moments. Addressing this gap, our study introduces \textsc{HotVCom}, the largest Chinese video hot-comment dataset, comprising 94k diverse videos and 137 million comments. We also present the \texttt{ComHeat} framework, which synergistically integrates visual, auditory, and textual data to generate influential hot-comments on the Chinese video dataset. Empirical evaluations highlight the effectiveness of our framework, demonstrating its excellence on both the newly constructed and existing datasets.

cs.CV↗

arXiv2024

Mass-loss Rate of Highly Evolved Stars in the Magellanic Clouds

Asymptotic giant branch stars (AGBs) and red supergiant stars (RSGs) exhibit significant mass loss phenomena and are considered important sources of interstellar dust. In this work, we employed an uniform method of spectral energy distribution fitting to analyze a large, and hence statistically significant, sample of approximately 40,000 RSGs and AGBs in the Magellanic Clouds (MCs), providing a new catalog of evolved stars that includes stellar parameters and dust properties. Our results reveal that the total dust-production rate (DPR) of the Large Magellanic Cloud is approximately $9.69\times10^{-6}\,\rm{M_{\odot }\, yr^{-1}}$, while it is around $1.75\times10^{-6}\,\rm{M_{\odot }\,yr^{-1}}$ for the Small Magellanic Cloud, with a few stars significantly contributing to the total DPR. No significant differences were observed in the contributions to DPR from carbon-rich and oxygen-rich (O-rich) evolved stars in the MCs. We explored the relations between stellar parameters (luminosity, infrared color, period, amplitude) and mass-loss rate (MLR) for evolved stars. A prominent turning point at $\log{(L/L_{\odot})} \approx 4.4$ appears in the luminosity-MLR diagram of RSGs, potentially related to the mass-loss mechanism of RSGs. The luminosity-MLR relation of AGBs is highly scattered. The DPR of AGBs shows a clear change with pulsation period and amplitude, with DPR exhibiting a drastic increase at pulsation periods of approximately 300 days and I-band amplitudes greater than 0.5 mag. Metallicity has some impact on the DPR of O-rich stars, with lower metallicity seeming to result in lower mean DPR and a higher proportion of optically thin stars.

astro-ph.SR↗