How to handle TypError using nonechucks

Question

How to handle TypError using nonechucks

simongeek opened this issue 6 years ago · 7 comments

Hi,

How to handle TypeError using nonechucks?

I have 162400 annotations (260 labels per one annotation) in json file. Each annotation contains filename for example aaa.jpg. I load photos based on filename from annotation json file. My image dataset contains 162000 images, so I do not have 400 photos in the collection. If the dataloader comes across the name of the annotation image and is not in the image set, it returns TypeError to me.
Do you know how to catch this error using your library? I tried SafeDataLoader and it does not work.
I also tried try except, but if I print a picture as None, I get a Class TypeNone error.
Best!

Answer 1 · 2019-03-05T11:56:37.000Z

Are you using the SafeDataloader in conjunction with the SafeDataset?

Answer 2 · 2019-03-05T11:58:58.000Z

Yes, I also tried separately and it does not work.

Answer 3 · 2019-03-05T12:02:55.000Z

Can I replace in class SimpleCustomDataset(Dataset) to SimpleCustomDataset(nc.SafeDataset)?

Answer 4 · 2019-03-05T12:27:02.000Z

You can do

custom_dataset = SimpleCustomDataset()

safe_custom_dataset = nc.SafeDataset(custom_dataset)

Answer 5 · 2019-03-05T12:30:15.000Z

when I try:

mvc_dataset = MVCDataset(json_file="labels.json",
                         root="data", transform=transform, target_transform=None)

save_mvc_dataset = nc.SafeDataset(mvc_dataset)

I got TypeError: TypeError: batch must contain tensors, numbers, dicts or lists; found <class 'NoneType'>

Answer 6 · 2019-03-06T06:03:46.000Z

Could you paste your full stack trace?

Answer 7 · 2019-05-14T07:57:53.000Z

Closing due to no response.