which bert's feature do you use ?

Question

which bert's feature do you use ?

mayuelala opened this issue 3 years ago · 2 comments

hello,I notice that when use bert to generate feature ,there are four outputs in bert,

last_hidden_state 2.pooler_output 3. hidden_state 4.attention
which bert's feature do you use ? and could you please tell me the detail of generate language feature? use which layer?

Answer 1 · 2021-11-12T02:02:00.000Z

Hi, I have met the same problem as u, do you figure it out ?
Any reply will help!

Answer 2 · 2021-11-12T15:09:32.000Z

Please see this issue answer:
here