pharmapsychotic/clip-interrogator

Feature suggestion : Add "finetuned" face detection

nigelianburton opened this issue · 2 comments

Hey pharma, I realize this was made mostly for SD, and found it that way - but I'm now also using it to organize my lifetime of photos! I had been using free version of a commercial app, https://excire.com though that has a miniscule vocabulary and is less accurate. The ability to override LabelTable is very useful, otherwise I'd have an exceptionally well indexed collection, but with 30 tags per photo :)

It would be cool if there was some minimal "fine tuning" overlay because I wish it could tag faces of my family. I realize that face detection is very ten-years-ago - but would guess that faces can be quickly trained nowadays? Understand it's probably not high on your todo list, and I'll try myself. Though lmk you have any suggestions on approach :)

really clever use of multiple engines, thanks for sharing it for us,

Cheers, Nigel.

Glad it's useful to you!

For the faces, a dedicated facial recognition model is probably what you really want. You might be able to crop to face and calculate CLIP image features for each family member then for each photo in the library crop to face, calculate image features, and dot product with the known people to find the one that matches best.

Glad it's useful to you!

For the faces, a dedicated facial recognition model is probably what you really want. You might be able to crop to face and calculate CLIP image features for each family member then for each photo in the library crop to face, calculate image features, and dot product with the known people to find the one that matches best.

I am also looking for such a model, can you recommend one?
Cheers.