Create a model to detect hand-drawn "SOS"

Question

Create a model to detect hand-drawn "SOS"

krook opened this issue 5 years ago · 9 comments

Is your feature request related to a problem? Please describe.
We assume that the person in need will have a kit with the printed symbols available. We should improve the system to demonstrate how a person could hand-recreate the symbols, and in turn, make the recognition more sensitive to those symbols.

Answer 1 · 2019-10-18T12:34:42.000Z

Very timely: https://www.cnn.com/2019/10/17/world/missing-australian-woman-sos-rescued-trnd/

Answer 2 · 2021-04-23T22:02:26.000Z

I can work on this

Answer 3 · 2021-04-26T13:56:43.000Z

Thanks @anushkrishnav

Answer 4 · 2021-12-19T06:33:41.000Z

Is this issue resolved, as I can see it open and unassigned? My proposal for the resolving it is: If we already have the models for our symbols from the kit ready, and a hand-written SoS is not one of them, it could be a good idea to instead use a pretrained model for handwritten letter recognition and integrate it with our present models.

Answer 5 · 2021-12-21T14:06:21.000Z

Hi @sarrah-basta. This hasn't been worked on yet. Please feel free to take a shot. Thank you! And I agree, if we can reuse a model that would be ideal. Maybe the Model Asset Exchange has something to build upon.

Answer 6 · 2022-01-04T19:23:35.000Z

Hi, @krook hope you are doing well!
As the issue is opened and unassigned, I can work on this. I would propose to simply determine the alphabets written on the ground, as it could be possible that someone in need might write some other information as well, like for reference "INJURED" or something else.
And based on the determined text, we can classify it.
For this, we can use a pre-trained model, and as mentioned by you Model Asset Exchange seems a good choice, we can also take help from mediapie for detecting if the human is present their or not, and in what state.

Answer 7 · 2022-01-05T10:48:00.000Z

@krook @bhavyagoel yes as both of you'll have mentioned, we can use Optical character Recognition from Model Asset Exchange to detect the text. It can be further classified using either manually or using a classification model such as Naive Bayes classifier or the like. And adding the Face Detection Model from MediaPipe as mentioned would also be a huge plus.

Answer 8 · 2022-01-06T14:31:02.000Z

Thanks for your interest everyone. So since @sarrah-basta replied first to the latest request, why don't you take the first pass at it? If you need any feedback or review of the proposed approach, then you can tag @bhavyagoel and I. Sound like a plan?

Answer 9 · 2022-01-06T15:36:16.000Z

Yep sure, I'll start by finalising the models among ones we were proposing and try looking at our codebase to understand how it can be integrated. Thanks

Thanks for your interest everyone. So since @sarrah-basta replied first to the latest request, why don't you take the first pass at it? If you need any feedback or review of the proposed approach, then you can tag @bhavyagoel and I. Sound like a plan?