Calculating nDTW

[raphael-sch]

I have a question about calculating nDTW that is unclear to me:

Shouldn't "_SUCCESS_THRESHOLD" be set to 1. The binary success is determined if the agent stops within 1 panorama from the target panorama.

[VegB]

Hi, thanks for your question.
In the Touchdown task setup, it mentions that

We consider an execution correct if the agent reaches the exact goal position or one of its neighboring nodes in the environment graph.

Another implementation (VALAN) on Touchdown task can be found here.

[raphael-sch]

Thanks