loeweX/Greedy_InfoMax

Is any Guide , that i can use InfoNCE_Loss in my custom model ?

aceprojectx opened this issue · 3 comments

class InfoNCE_Loss(loss.Loss):

Hi @loeweX i already read the code , but how can i use it , i am not sure some parameter in this class

update :
i success mod this loss, but when train the model , when i get the loss is 1.8xxx , the acc only 27% ~ 30% , is it normal ?

Hi aceprojectx,

Thanks for your interest in the code!

I'm not sure I understand your problem. What kind of modifications are you trying to apply to the loss? When using the original implementation of the repo, it should be able to achieve the performance as stated in the paper.

@loeweX Infact i want to build a CPC model , and i need infoNCE loss .

This loss function your implement , is following by contrastive predictive coding right ? so can i directly use it in my custom cpc model ?

Thanks for your reply , and sorry for my poor English 😅

Yes, this code also implements the basic CPC model. To use it, simply use the command-line parameter --model_splits 1