/ddraig-transformer

Learning about attenion models

Primary LanguagePython

Ddraig Transformer into ddraig Summarizar

Overview

DDraig Transformer is an implementation of a Transformer model for translating English into Welsh, inspired by the "Attention is All You Need" paper. The model is trained using the OPUS Books dataset, and the implementation utilizes the Hugging Face Transformers library.

Dataset: https://huggingface.co/datasets/opus_books