georgian-io/Multimodal-Toolkit

XLNet doesn't support the "weighted_feature_sum_on_transformer_cat_and_numerical_feats" combining module

Aymen-lab opened this issue · 0 comments

Dear team, 

I am doing several experiments with the toolkit. Thank you very much for the good work. While trying XLNet with the combination module "weighted_feature_sum_on_transformer_cat_and_numerical_feats". I got the following error:

230             self.act_func = create_act(self.mlp_act)
231             self.layer_norm = nn.LayerNorm(self.text_out_dim)

--> 232 self.final_dropout = nn.Dropout(tabular_config.hidden_dropout_prob)
233 self.final_out_dim = self.text_out_dim
234
AttributeError: 'TabularConfig' object has no attribute 'hidden_dropout_prob'

I think in model initialization this configuration is missing. Please update the code.
tabular_config.hidden_dropout_prob = hf_model_config.hidden_dropout_prob