does the wordpiece tool the same with the bert one?

Question

RyanHuangNLP opened this issue 5 years ago · 1 comments

Can I use this script to generate the vocab.txt to train bert code

Answer 1 · 2019-10-05T01:07:53.000Z

Yes, you can use the generate_vocab.py script to generate a vocabulary file that you can use with the wordpiece tokenizer.