Introducing AlloyBERT: a transformer encoder-based model for predicting alloy properties from textual inputs. Leveraging RoBERTa and self-attention mechanisms, it achieves superior performance, surpassing shallow models.
Primary LanguagePythonMIT LicenseMIT