KennethEnevoldsen/snp-transformer

debugging: check that models can overfit to an individual

Opened this issue · 1 comments

KennethEnevoldsen commented
debugging: check that models can overfit to an individual
KennethEnevoldsen commented

Adding a unique (learned) vector for each IID to all the embedding vector lead to a perfect fit (thankfully):

Screenshot 2024-02-08 at 15 03 17

It is indeed possible to overfit if we add in IID info to the data