Search arXiv⌕ Search

arXiv subjects

Jan Pavšek

Publications and source records attributed to Jan Pavšek.

3 recordsLinked to original sources

A systematic comparison of hard- and soft-constrained physics-informed molecular machine learning with the Clapeyron equation

In molecular machine learning (ML), significant progress has been made on integrating fundamental thermodynamic relations into ML models. Such physics-informed approaches can be categorized as hard-constrained, where the thermodynamic relations are embedded in the model architecture, and soft-constrained, where relations are included in the training loss. While both approaches have been applied to various property prediction tasks, a systematic comparison on experimental data is lacking. We herein compare hard- and soft-constrained approaches on a numerically challenging case study: the prediction of vapor pressure, saturated liquid and vapor molar volumes, and enthalpy of vaporization as functions of temperature for single-species vapor-liquid equilibrium, related by the exact Clapeyron equation. Furthermore, soft-constrained approaches in molecular ML typically balance data and physics losses with a fixed weighting factor, requiring careful tuning. To overcome this, we investigate the augmented Lagrangian method (ALM), well established in constrained optimization. We find that for the soft-constrained approach, using the ALM improves prediction performance in terms of constraint satisfaction by factor 2 and reduces training epochs compared to using a fixed penalty by 30%. Hence, in the soft-constrained approach, the use of the ALM is always recommended. The hard-constrained approach, which entails additional architectural design choices, can reach on par accuracy with the soft-constrained approach, at even higher thermodynamic consistency, reaching 12 orders of magnitude closer approximation of the Clapeyron equation. Overall, the hard-constrained approach is most promising when thermodynamic consistency is critical, yet requires tailoring the ML model architecture to the respective thermodynamic relation.

physics.chem-ph↗

Clapeyron Neural Networks for Single-Species Vapor-Liquid Equilibria

Machine learning (ML) approaches have shown promising results for predicting molecular properties relevant for chemical process design. However, they are often limited by scarce experimental property data and lack thermodynamic consistency. As such, thermodynamics-informed ML, i.e., incorporating thermodynamic relations into the loss function as regularization term for training, has been proposed. We herein transfer the concept of thermodynamics-informed graph neural networks (GNNs) from the Gibbs-Duhem to the Clapeyron equation, predicting several pure component properties in a multi-task manner, namely: vapor pressure, liquid molar volume, vapor molar volume and enthalpy of vaporization. We find improved prediction accuracy of the Clapeyron-GNN compared to the single-task learning setting, and improved approximation of the Clapeyron equation compared to the purely data-driven multi-task learning setting. In fact, we observe the largest improvement in prediction accuracy for the properties with the lowest availability of data, making our model promising for practical application in data scarce scenarios of chemical engineering practice.

physics.chem-ph↗

DeepEOSNet: Capturing the dependency on thermodynamic state in property prediction tasks

We propose a machine learning (ML) architecture to better capture the dependency of thermodynamic properties on the independent states. When predicting state-dependent thermodynamic properties, ML models need to account for both molecular structure and the thermodynamic state, described by independent variables, typically temperature, pressure, and composition. Modern molecular ML models typically include state information by adding it to molecular fingerprint vectors or by embedding explicit (semi-empirical) thermodynamic relations. Here, we propose to rather split the information processing on the molecular structure and the dependency on states into two separate network channels: a graph neural network and a multilayer perceptron, whose output is combined by a dot product. We refer to our approach as DeepEOSNet, as this idea is based on the DeepONet architecture [Lu et al. (2021), Nat. Mach. Intell.]: instead of operators, we learn state dependencies, with the possibility to predict equation of states (EOS). We investigate the predictive performance of DeepEOSNet by means of three case studies, which include the prediction of vapor pressure as a function of temperature, and mixture molar volume as a function of composition, temperature, and pressure. Our results show superior performance of DeepEOSNet for predicting vapor pressure and comparable performance for predicting mixture molar volume compared to state-of-research graph-based thermodynamic prediction models from our earlier works. In fact, we see large potential of DeepEOSNet in cases where data is sparse in the state domain and the output function is structurally similar across different molecules. The concept of DeepEOSNet can easily be transferred to other ML architectures in molecular context, and thus provides a viable option for property prediction.

physics.chem-ph↗