OpenGVLab/Instruct2Act

Can I get the success rate form of offline mode

VitaLemonTea1 opened this issue · 2 comments

VitaLemonTea1 commented

Hi，

I run the offline mode these days. Can I get the success rate form of offline mode to compare with my result.

Thanks!

SiyuanHuang95 commented

Hi,

thanks for your interest in this project.

Actually, we did not calculate the SR of offline mode. But you can calculate the SR with our provided script. For the structured tasks in VIMA, I guess the results would be similar to the online version.

SiyuanHuang95 commented

Since no further update, I will close this issue.