yihong-chen/neural-collaborative-filtering

Test Dataloader for large dataset.

RuihongQiu opened this issue · 4 comments

RuihongQiu commented

Maybe a test dataloader for iterate the test set is more user friendly for large dataset? Just simply treat all test data as a huge batch sometimes will cause OOM error.

image

Sometimes the size could be like this.

yihong-chen commented

Couldn't agree more. A test dataloader would be better. I will add it to my todo list.

RuihongQiu commented

Hope to see the method. I try to implement it but get stuck in the calculation of HR and NDCG.