When loading the DC.json dataset, I encountered the 'ijson.common.IncompleteJSONError: parse error: premature EOF' error.

[hcwei13]

Thank you for your excellent work! I encountered some questions while running the training script.
When loading the DC.json dataset, I encountered the 'ijson.common.IncompleteJSONError: parse error: premature EOF' error. This is the second time I've downloaded the data, so it's unlikely to be a dataset corruption issue. How should I resolve it?

with open(cur_images_path, "rb") as f: 
        for key, value in ijson.kvitems(f, "", use_float=True):
            self.images[key] = value

  File "/home/weihongchen/miniconda3/envs/otter/lib/python3.9/site-packages/ijson/utils.py", line 55, in coros2gen
    f.send(value)
  File "/home/weihongchen/miniconda3/envs/otter/lib/python3.9/site-packages/ijson/backends/yajl2_cffi.py", line 225, in basic_parse_basecoro
    yajl_parse(handle, buffer)
  File "/home/weihongchen/miniconda3/envs/otter/lib/python3.9/site-packages/ijson/backends/yajl2_cffi.py", line 196, in yajl_parse
    raise exception(error)
ijson.common.IncompleteJSONError: parse error: premature EOF
                                       
                     (right here) ------^

Before you open an issue, please check if a similar issue already exists or has been closed before.

When you open an issue, please be sure to include the following

• A descriptive title: [xxx] XXXX
• A detailed description
• Assign an issue type tag (label):
  • dataset (mimic-it download, usage, etc.),
  • demo (online demo), doc (readme, wiki, paper, video etc.),
  • evaluation (evaluation result, performance of Otter etc.),
  • model (model configuration, components, etc.),
  • train (training configuration, process, code, etc.)

Thank you for your contributions!

[hcwei13]

@Luodian