/Sign2GPT

[ICLR2024] Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

Primary LanguagePythonApache License 2.0Apache-2.0

Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

Implementation of Sign2GPT.

[27/09/2024] Added embedding layers

[20/08/2024] Added pretraining head component

[20/08/2024] Added pretraining loss function

[19/07/2024] Added missing transformer encoder modules.

[02/06/2024] Added spatial model architecture setup.

[25/05/2024] Added sign encoder model architecture setup.

[07/04/2024] Created Repo for the paper titled "Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation", Work in progress.