No train with sensitivity for Relational model?
Closed this issue · 2 comments
Hi @avsolatorio,
I see that train with sensitivity happens only in Tabular model type? Don't we use sensitivity when training a relational model? Why is that?
Hello @echatzikyriakidis, correct; the intrinsic sensitivity training still needs to be implemented in the relational model. Unlike the non-relational case where a precise data-copying metric, i.e., DCR is well defined, it is not the case for the relational data. However, if an analogous metric is available, it can easily be implemented in the system. In the meantime, you have to set train_size < 1
so that evaluation data will be held-out to detect overfitting and execute early stopping.
HI @avsolatorio!
Great, I assumed that too which is probably why _train_with_sensitivity() doesn't exist in the case of relational. Yes, I use train_size=0.8 for relational models and train_size=1 for tabular ones.
Thanks!