How do I input an open-vocabulary text

Question

How do I input an open-vocabulary text

123lcy123 opened this issue 7 months ago · 3 comments

Hello, thank you for developing a good work, i am really interested in it. But I want to know how do I input an open-vocabulary text description like the example you gave?

Answer 1 · 2024-06-08T11:36:22.000Z

Thank you for your interest in our work. We have not yet released the single detection testing code and plan to do so around early next month with the latest version of the paper. We will inform you in due course.

Best,
Zhening

Answer 2 · 2024-06-10T02:31:52.000Z

Thank you for your response and the update. I look forward to seeing the single detection testing code and the latest version of the paper.

Answer 3 · 2024-08-13T01:15:29.000Z

We have just released a newer version of the code, which showcases how this is done under

zero_shot_single_voc.py.

If you look into this code, you will see how the results in the teaser images are detected. Essentially, we designed a CLIP ranking and filtering system to effectively reduce false positive detections for single-vocabulary open-world inference.
Best,
Zhening