lucas-ventura/CoVR

What is the search space for a query in test set??

Closed this issue · 1 comments

Hi,
I am slightly confused about the test set's search space. Given a query (Image/video and text) from the test set, what is the search space for this query? I am assuming that we are searching over all the possible target videos in the test set. I'd appreciate it if you could confirm this.
Thanks

Hi,

It depends on the dataset:

  • For WebVid-CoVR, the search space includes all target embeddings specified in ann["path2"].
  • For CIRR, the search space consists of all images in the target embedding folder, which includes the embeddings from the test set directory images.
  • For FashionIQ, the search space is defined by target_ids, which correspond to the ids from the targets split json file.

Hope this clarifies things!