Attention-Based Functional-Group Coarse-Graining: A Deep Learning Framework for Molecular Prediction and Design

Abstract

Machine learning (ML) offers considerable promise for the design of new molecules and materials. In real-world applications, the design problem is often domain-specific, and suffers from insufficient data, particularly labeled data, for ML training. In this study, we report a data-efficient, deep-learning framework for molecular discovery that integrates a coarse-grained functional-group representation with a self-attention mechanism to capture intricate chemical interactions. Our approach exploits group-contribution theory to create a graph-based intermediate representation of molecules, serving as a low-dimensional embedding that substantially reduces the data demands typically required for training. By leveraging the self-attention mechanism to learn subtle chemical context, our method consistently outperforms conventional methods in predicting multiple thermophysical properties. In a case study focused on adhesive polymer monomers, we train on a limited dataset comprising just 6,000 unlabeled and 600 labeled monomers. The resulting chemistry prediction model achieves over 92% accuracy in forecasting properties directly from SMILES strings, exceeding the performance of current state-of-the-art techniques. Furthermore, the latent molecular embedding is invertible, allowing the design pipeline to incorporate a decoder that can automatically generate new monomers from the learned chemical subspace. We illustrate this functionality by targeting high and low glass transition temperatures ($T_g$), successfully identifying novel candidates whose $T_g$ extends beyond the range observed in the training data. The ease with which our coarse-grained, attention-based framework navigates both chemical diversity and data scarcity offers a compelling route to accelerate and broaden the search for functional materials.