/Awesome-SLP

A curated list of awesome work on Sign Language Production

Awesome-SLP

A list of awesome work on Sign Language Production (SLP), the automatic translation from Spoken Language sentences to Sign Language Sequences. It contains an extensive literature review of the field of deep-learning based SLP, with all relevant publications.

I am gathering these papers as literature for my PhD, and thought others may be interested. If you have any updates, please feel free to contribute or email me at b.saunders@surrey.ac.uk.

These are ordered by year, and I try to find the appropriate conference for each.

2022

Changing the Representation: Examining Language Representation for Neural Sign Language Production. Walsh, Saunders, Bowden SLTAT 22 - https://openresearch.surrey.ac.uk/esploro/outputs/conferencePaper/Changing-the-Representation-Examining-Language-Representation/99652965902346

Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation. Suo, Zheng, Wang, Zhang, Yang. https://arxiv.org/pdf/2207.03714.pdf

Towards Automated Sign Language Production: A Pipeline for Creating Inclusive Virtual Humans. Bernhard, Nunnari, Unger et al. PETRA 22 - https://dl.acm.org/doi/abs/10.1145/3529190.3529202

Cartoonized Anonymization of Sign Language Videos. Tze, Filntisis, Roussos, Maragos. IVMSP 22 - https://ieeexplore.ieee.org/abstract/document/9816293

Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production. Saunders, Camgoz, Bowden. CVPR 22 - https://arxiv.org/pdf/2203.15354.pdf

Modeling Intensification for Sign Language Generation: A Computational Approach. Inan, Zhong, Hassan, Quandt, Alikhani. ArXiv - https://arxiv.org/pdf/2203.09679.pdf

Including Facial Expressions in Contextual Embeddings for Sign Language Generation. Viegas, Inan, Quandt, Alikhani. ArXiv - https://arxiv.org/pdf/2202.05383.pdf

2021

Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production. Saunders, Camgoz, Bowden. ArXiv - https://arxiv.org/pdf/2112.05277.pdf

GAN Based Indian Sign Language Synthesis. Krishna, Ukey, Babu. ICVGIP'21 - https://dl.acm.org/doi/pdf/10.1145/3490035.3490301

Non-Autoregressive Sign Language Production with Gaussian Space. Hwang, Kim, Park. BMVC 2021 - https://www.bmvc2021-virtualconference.com/assets/papers/1102.pdf

Towards Fast and High-Quality Sign Language Production. Huang, Pan, Zhao, Tian. ACM 2021 - https://www.semanticscholar.org/paper/Towards-Fast-and-High-Quality-Sign-Language-Huang-Pan/481f18278fc707dd7cf8254da1e68b96f6913326?utm_source=alert_email&utm_content=AuthorCitation&utm_campaign=AlertEmails_DAILY&utm_term=AuthorCitation&email_index=0-0-0&utm_medium=2754082

Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives. Saunders, Camgoz, Bowden. ICCV21 - https://arxiv.org/abs/2107.11317

ANONYSIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation. Saunders, Camgoz, Bowden. FG2021 - https://arxiv.org/abs/2107.10685

Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks. Saunders, Camgoz, Bowden. IJCV2021 - https://link.springer.com/content/pdf/10.1007/s11263-021-01457-9.pdf

Pose-Guided Sign Language Video GAN with Dynamic Lambda. Kissel, Kümmel, Ritter, Hildebrand. ArXiv - https://arxiv.org/abs/2105.02742

2020

Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video. Saunders, Camgoz, Bowden. ArXiv - https://arxiv.org/abs/2011.09846

Machine Translation from Spoken Language to Sign Language using Pre-trained Language Model as Encoder. Miyazaki, Morita, Sano. LREC2020 - https://www.aclweb.org/anthology/2020.signlang-1.23.pdf

Adversarial Training for Multi-Channel Sign Language Production. Saunders, Camgoz, Bowden. BMVC20 - https://www.bmvc2020-conference.com/assets/papers/0223.pdf

SignSynth : Data-Driven Sign Language Video Generation. Stoll, Hadfield, Bowden. ACV Workshop 20 - https://epubs.surrey.ac.uk/858501/

Can Everybody Sign Now ? Exploring Sign Language Video Generation from 2D Poses. Ventura, Duarta, Giro-i-Nieto. SLRTP Workshop 20. -https://slrtp.com/papers/extended_abstracts/SLRTP.EA.14.018.paper.pdf

Progressive Transformers for End-to-End Sign Language Production. Saunders, Camgoz, Bowden. ECCV20 - http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123560664.pdf

Skeleton-based Chinese Sign Language Recognition and Generation for Bidirectional Communication between Deaf and Hearing People. Xiao, Qin, Yin. Neural Networks 20 - https://www.sciencedirect.com/science/article/abs/pii/S089360802030040X

Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks. Stoll, Camgoz, Hadfield, Bowden. IJCV2020 - https://link.springer.com/article/10.1007/s11263-019-01281-2

Neural Sign Language Synthesis: Words Are Our Glosses. Zelinka, Kanis. WACV20 - https://openaccess.thecvf.com/content_WACV_2020/papers/Zelinka_Neural_Sign_Language_Synthesis_Words_Are_Our_Glosses_WACV_2020_paper.pdf

2019

Deep Gesture Video Generation With Learning on Regions of Interest. Cui, Cao, Pan, Zhang, Wang. IEEE Transactions on Multimedia - https://ieeexplore.ieee.org/document/8936484/media#media

NN-Based Czech Sign Language Synthesis. Zelinka, Kanis, Salajka. SPECOM19 - https://link.springer.com/chapter/10.1007/978-3-030-26061-3_57

Cross-modal Neural Sign Language Translation. Duarte. ACM International Conference on Multimedia - https://imatge.upc.edu/web/sites/default/files/pub/cDuarteb.pdf

2018

Sign Language Production using Neural Machine Translation and Generative Adversarial Networks. Stoll, Camgoz, Hadfield, Bowden. BMVC18 - http://bmvc2018.org/contents/papers/0906.pdf

Overviews

Sign Language Production: A Review. Rastgoo, Kiani, Escalera, Sabokrou. ArXiv - https://arxiv.org/abs/2103.15910

Machine Translation from Text to Sign Language: A Systematic Review. Navroz Kaur Kahlon1 Williamjeet Singh. Universal Access in the Information Society - https://link.springer.com/content/pdf/10.1007/s10209-021-00823-1.pdf