[Feature] SignWriting Textual Description
AmitMY opened this issue Β· 5 comments
Problem
Understanding how to perform SignWriting exactly can be a little difficult to non-linguists.
Description
In addition to illustration (#114), we can include textual description of SignWriting.
In a zero-shot setting, we can describe where every symbol is placed, and it's name, and ask ChatGPT to describe it
Given the signs:
π π€π€£ρ²‘π£³π£©ρ©§π€π£»
π π€π€§ρ«π£»π€ρ’π£΄π£Όρ‘π€π€ρπ€π£¦ ρπ£’π€
I would like to send them to ChatGPT as an image + as a rough textual description (hand 5 fingers, alternating arrows, and positions), and get "wave an open hand back and forth" or something similar
Repository to get this done https://github.com/sign-language-processing/signwriting-description
Hi, I saw the commit 794c64c it is uing the api /api/signwriting-description. But in cloud function no route is there for signwriting-description? Is there something that you will commit later on?
We are using this implementation - https://github.com/sign-language-processing/signwriting-description
Just deployed using python on a GCP instance, and routed in the project definition:
Lines 95 to 96 in 91f1806
On sign.mt are you using GPT or naive for signwriting description?