vzyrianov/lidargen

Test set of KITTI-360

kazuto1011 opened this issue · 0 comments

Thanks for the codes! I would like to implement your evaluation protocol for KITTI-360 experiments. According to your paper, the test set comprises 30,758 frames from the first two sequences.

We split the dataset into two parts, where the first two sequences (30,758 frames) are the testing set, and the rest are used for training and cross-validation.

And in this repository a dataset class parses 0000_sync and 0001_sync filenames.

if split == "train":
self.full_list = list(filter(lambda file: '0000_sync' not in file and '0001_sync' not in file, full_list))
else:
self.full_list = list(filter(lambda file: '0000_sync' in file or '0001_sync' in file, full_list))

However, since KITTI-360 did not release 0001_sync, the dataset class just parses 0000_sync (11,518 frames).
I think the number 30,758 may be from the actual serial sequences 0000_sync (11,518) and 0002_sync (19,240).
Which is correct for evaluation, 11,518 or 30,758 frames?