ImportError: cannot import name 'BERT_PRETRAINED_MODEL_ARCHIVE_MAP'

Question

ImportError: cannot import name 'BERT_PRETRAINED_MODEL_ARCHIVE_MAP'

MedSao opened this issue 4 years ago · 5 comments

First of all, I would thank you for your work.
I have read you paper about "BERT-of-Theseus", and found it very amazing and good written.
After Fine tuning BERT on the MRPC GLUE task, I tried to compress it using 'BERT-of-Theseus' technique, But unfortunately getting the following error:
"ImportError: cannot import name 'BERT_PRETRAINED_MODEL_ARCHIVE_MAP'".
I wish if you have any idea to fix this!
thank you a lot.

Answer 1 · 2020-06-27T00:58:30.000Z

Thanks for your interest in our work!

This error is caused by the API change of huggingface/transformers. Please use an earlier version like transformers==2.1.0

Please don't hesitate to ask if you have any further questions.

Answer 2 · 2020-06-27T01:16:27.000Z

I believe what makes you confused there is mainly because of the mathematical equations. I think maybe reading the code is more helpful.

Answer 3 · 2020-06-27T01:20:21.000Z

Thank you very much for you Answers. I will check the code.
All the best.

Answer 4 · 2020-11-26T07:39:48.000Z

With transformers==2.1.0, I got ImportError: cannot import name 'get_linear_schedule_with_warmup' from 'transformers' (/home/user/.pyenv/versions/env-wbGhSO8R-py3.7/lib/python3.7/site-packages/transformers/__init__.py)

Answer 5 · 2020-11-26T10:16:20.000Z

@liebkne Sorry for that. I don't actually remember which version of transformers is compatible either. Please try 2.2.0 to 2.4.0. If you find a compatible version, please report it here so I can put it into README. Thanks.