train_test_split in LSTM
huni1023 opened this issue · 2 comments
huni1023 commented
[https://github.com/bentrevett/pytorch-sentiment-analysis/blob/master/2_lstm.ipynb]
in those jupyter-notebook above,
i think library for code train_test_split
isn't called. (cell 7)
Should I using from sklearn.model_selection import train_test_split
?
bentrevett commented
Why do you think it is not called?
The train_data
is a HuggingFace datasets Dataset class, which has a train_test_split
method, see: https://huggingface.co/docs/datasets/package_reference/main_classes.html#datasets.Dataset.train_test_split. This is unrelated to sklearn
's train_test_split
function.
huni1023 commented
Thanks for your kind response. I will check out details again!