XLNet doesn't support the "weighted_feature_sum_on_transformer_cat_and_numerical_feats" combining module
Aymen-lab opened this issue · 0 comments
Aymen-lab commented
Dear team,
I am doing several experiments with the toolkit. Thank you very much for the good work. While trying XLNet with the combination module "weighted_feature_sum_on_transformer_cat_and_numerical_feats". I got the following error:
230 self.act_func = create_act(self.mlp_act)
231 self.layer_norm = nn.LayerNorm(self.text_out_dim)
--> 232 self.final_dropout = nn.Dropout(tabular_config.hidden_dropout_prob)
233 self.final_out_dim = self.text_out_dim
234
AttributeError: 'TabularConfig' object has no attribute 'hidden_dropout_prob'
I think in model initialization this configuration is missing. Please update the code.
tabular_config.hidden_dropout_prob = hf_model_config.hidden_dropout_prob