OpenGVLab/Instruct2Act

How to run

nbbb24 opened this issue · 5 comments

nbbb24 commented

Hi, thanks for your work

What if I just want to get the result after using SAM and Openclip, without performing any robot actions

Which files should i modify and run

Thanks!

Hi, thanks for your interest in our work!

If you just want to get the results after CLIP + SAM, you can check the functions SAM(), CLIPRetrieval(objs, query) in the line. And the modify the main function do not execute the actions HERE.

nbbb24 commented

Do i need to insert task in "visual_programm_prompt.py"?

The CLIP needs the parameter for objects query, like target object, you can insert it manually or let it done in visual_programm_prompt.py. It depends on your need.

The most simple why is just running the code, and delete the the action execution part.

nbbb24 commented

Alright, thank you so much!

Yep! Hope it helps.

I will close this issue currently. But you could re-open it whenever needed!