thuml/Time-Series-Library

PatchTST. No self-supervised?

well0203 opened this issue · 1 comments

Hi, again, many thanks for your work.
I wanted to ask whether you plan to add self-supervised setting to PatchTST? From paper authors received best results due to this setting.

Hi, in this repo, we only focus on the deep model architecture. Thus, we do not have a plan to include the pre-training stage in our repo. But you may find some useful pre-training code here: https://github.com/thuml/SimMTM, which is based on vanilla Transformer and PatchTST.