Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining

Yongqian Peng; Zhouran Zhang; Longhui Zhang; Fengyuan Zhao; Yahao Li; Yicong Ye; Shuxin Bai

Home/Archive/arXiv

arXiv · 2506.12516

Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining

Yongqian Peng·Zhouran Zhang·Longhui Zhang·Fengyuan Zhao·Yahao Li·Yicong Ye·Shuxin Bai

View original source ↗Read source document ↗Export metadata ↓

Abstract

Machine learning has revolutionized materials design, yet predicting complex properties like alloy ductility remains challenging due to the influence of processing conditions and microstructural features that resist quantification through traditional reductionist approaches. Here, we present an innovative information fusion architecture that integrates domain-specific texts from materials science literature with quantitative physical descriptors to overcome these limitations. Our framework employs MatSciBERT for advanced textual comprehension and incorporates contrastive learning to automatically extract implicit knowledge regarding processing parameters and microstructural characteristics. Through rigorous ablation studies and comparative experiments, the model demonstrates superior performance, achieving coefficient of determination (R2) values of 0.849 and 0.680 on titanium alloy validation set and refractory multi-principal-element alloy test set. This systematic approach provides a holistic framework for property prediction in complex material systems where quantitative descriptors are incomplete and establishes a foundation for knowledge-guided materials design and informatics-driven materials discovery.

Explore related subjects

cond-mat.mtrl-sci cs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Yongqian Peng, Zhouran Zhang, Longhui Zhang, Fengyuan Zhao, Yahao Li, Yicong Ye, Shuxin Bai. 2025-06-14. Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining. https://arxiv.org/abs/2506.12516

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Symmetry-induced magnetic fullerene

Defect-free, charge-neutral, pure-carbon materials are generally viewed as intrinsically non-magnetic. Here we challenge this view by establishing a fundamental principle of symmetry-induced magnetism in pure-carbon fullerene systems through molecular orbital theory. We show that high-order symmetry of fullerene molecules or their crystalline lattices induces degenerate energy levels and hence, quantised magnetic moments at half filling. This mechanism holds for all high-order symmetries. It suggests a plausible intrinsic origin for the previously debated magnetic fullerene. Additionally, recent experimental advances in the synthesis of monolayer fullerene networks provide a feasible platform to implement our prediction on the deep link between symmetry and magnetism in these systems. Our results create new, broad frontiers of quantum magnetism by introducing molecular or crystalline symmetries in any lattice.

cond-mat.mtrl-sci↗

arXiv2026

Tritium for Nanoscale Hydrogen Analysis by Atom Probe Tomography

Accurate nanoscale detection of hydrogen is essential for understanding hydrogen-related phenomena in materials, yet conventional tracing with deuterium is often complicated by residual background hydrogen. This study evaluates tritium as a highly resolvable isotopic marker for nanoscale hydrogen analysis in metals using atom probe tomography. Titanium was selected for its ability to incorporate hydrogen isotopes, providing a suitable platform for tritium detection. Time of flight secondary ion mass spectrometry and electron backscatter diffraction were performed prior to tritium charging to characterize the initial composition and microstructure. Atom probe tomography in laser mode before and after tritium charging, at three post-charging time intervals, enables tracking of tritium incorporation over time. Thermal desorption analysis confirmed the presence of tritium and complemented the secondary ion mass spectrometry measurements, highlighting the role of the surface oxide layer in modulating tritium release. While tritium, deuterium, and protium differ in their diffusion and trapping behavior, the distinct mass signal associated with tritium provides a practical advantage for resolving hydrogen at very low concentrations. This work serves as a fundamental benchmarking study for leveraging tritium and atom probe tomography as a combined tool for understanding hydrogen in materials, relevant for interpreting local processes such as hydrogen embrittlement.

cond-mat.mtrl-sci↗

arXiv2026

Interfacial melting as a thermodynamic indicator of solid-state synthesizability

Computational materials discovery commonly ranks candidate materials by their thermodynamic stability on the formation energy convex hull, yet many predicted-stable phases resist synthesis. We propose that solid-state synthesizability through interfacial-melt-mediated routes requires an additional thermodynamic condition: the interfacial melt at the target composition must itself remain locally stable against spinodal decomposition. We examine this in the classical Fe--B system, where thermodynamically stable FeB$_4$ has been reported under high-pressure synthesis but not in low-pressure synthesis attempts. Using melt--quench molecular dynamics driven by a fine-tuned machine-learning interatomic potential, we find that, at ambient pressure, the B-rich interfacial melt near the FeB$_4$ composition develops a concave free-energy landscape, signaling a demixing instability that is corroborated by the concentration--concentration structure factor and correlated with low-energy icosahedral and pentagonal-pyramidal boron motifs. In contrast to FeB$_4$, metastable Fe$_3$B and Fe$_{23}$B$_6$ remain synthesizable because their corresponding melts are stable. Applied pressure introduces a convex $PV$ contribution that strongly suppresses this instability, reducing the curvature at the FeB$_4$ composition to within the uncertainty of our fit at 1800~K, consistent with the experimental synthesis boundary. Comparison with CrB$_4$ further shows that weaker melt instability correlates with easier experimental synthesis. Interfacial-melt stability, which atomistic simulations can assess via the low-$k$ concentration--concentration structure factor, is thus proposed as a practical thermodynamic screening descriptor of synthesizability for AI-assisted materials discovery.

cond-mat.mtrl-sci↗