kaonashi-tyc/zi2zi

About init_embedding

MenghaoGuo opened this issue · 4 comments

MenghaoGuo commented

Thanks for your code, I learn a lot, but I have a question :
why do you use random_normal_initializer to initiate embeddings ?
In my opinion, it will cause no difference between all embeddings dimension and make Interpolation unuseful.

MenghaoGuo commented

Thanks for your code, I learn a lot, but I have a question :
why do you use random_normal_initializer to initiate embeddings ?
In my opinion, it will cause no difference between different embeddings and make Interpolation unuseful.

  • 👍1
  • 🎉1
Nealcl commented

hi , have you get the answer

Nealcl commented

Thanks for your code, I learn a lot, but I have a question :
why do you use random_normal_initializer to initiate embeddings ?
In my opinion, it will cause no difference between all embeddings dimension and make Interpolation unuseful.

hi, have you get the answer?
@chongzhe

  • 👍1
Nealcl commented

@kaonashi-tyc hi, can you give us some inspiration?