Question about data_loader.py

Question

Question about data_loader.py

Closed this issue 5 months ago · 3 comments

Dear author, thank you for your excellent work！
I have some questions about getitem(self, index) in data_loader.py

It seems that seq_x only contains data for one feature. And I don't quite understand this kind of handling.
Is this related to the handling of Channel Independence？
But I checked the code of PatchTST and his DataLoader is not like this.
Could you please provide a specific explanation of the data processing in getitem(self, index)，thanks a lot！！

Answer 1 · 2024-05-01T16:20:18.000Z

I'm also interested in this question.

Answer 2 · 2024-05-06T06:58:35.000Z

I think maybe I have found the answer. The Dataloader of this code is the same as GPT4TS. Someone has raised a similar question and has already received an answer, please refer to NeurIPS2023-One-Fits-All/issues/15 for details.This operation does seem to be related to channel independence

Answer 3 · 2024-05-15T06:34:02.000Z

I think maybe I have found the answer. The Dataloader of this code is the same as GPT4TS. Someone has raised a similar question and has already received an answer, please refer to NeurIPS2023-One-Fits-All/issues/15 for details.This operation does seem to be related to channel independence

Yes, your understanding is completely correct. This is the data processing method that implements the channel-independent operation, and it reduces the amount of data entering the GPU at the same time, avoiding the OOM problem caused by too much data.