Lightning-Universe/lightning-transformers

Couldn't run Tasks with Custom Data Files

Closed this issue ยท 0 comments

๐Ÿ› Bug

Reference docs.

Error trying to access dataset.train_file: node `dataset` is not a container and thus cannot contain `train_file`
    full_key: dataset.train_file
    object_type=dict

To Reproduce

python train.py +task=nlp/language_modeling dataset.train_file=train.csv dataset.validation_file=valid.csv

One more example:

sh-4.2$ python train.py +task=nlp/multiple_choice +dataset=nlp/multiple_choice/race dataset.train_file=train.json dataset.validation_file=valid.json
Could not override 'dataset.train_file'.
To append to your config use +dataset.train_file=train.json
Key 'train_file' is not in struct
    full_key: dataset.train_file
    object_type=dict