/Sign2GPT

[ICLR2024] Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

Primary LanguagePythonApache License 2.0Apache-2.0

Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

Implementation of Sign2GPT.

[19/07/2024] Added missing transformer encoder modules.

[02/06/2024] Added spatial model architecture setup.

[25/05/2024] Added sign encoder model architecture setup.

[07/04/2024] Created Repo for the paper titled "Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation", Work in progress with the aim to start releasing code once I have completed the release for Learnt Contrastive Concept Embeddings for Sign Recognition (See repo for latest updates)