Why de-simple.py initialises ent_embs with dim s_emb_dim, but rel_embs with s+t_emb_dim?
anniezhi opened this issue · 1 comments
Hi. Thank you for the open-sourced codes.
In your paper, you mentioned that modeling relations with a static (rather than a diachronic) representation would suffice for decent performance. I perceive it as that you would embed the entities with temporal dims, and the relations with static dims. But in de-simple.py, the ent_embs are initialised with s_emb_dim, while the rel_embs are initialised with s_emb_dim + t_emb_dim. Could you please explain why so? Is there a conflict?
Thank you.
Hi @anniezhi,
Thanks for your interest and apologies for the delay in responding. There is no conflict. Please note that final embedding of an entity/relation(emb_dim
) is s_emb_dim
+ t_emb_sim
. From lines 20-23 we are initializing the static embeddings/features and for relations (as you also said) entire emb_dim
is static. Thus, it is initialized as s_emb_dim
+ t_emb_sim
. While for entities s_emb_dim
is the dimension of the static features.
I hope this helps.