/bert-inference

An attempt to make Google BERT closer to production before Hugging Face Transformers etc.

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

A helper class for Google BERT (Devlin et al., 2018) to support online prediction and model pipelining. Check Jupyter Notebook for the demo. Before running, clone BERT repo into the root directory. Check the pull request #327 for Sst2Processor class. Place actual model files (ckpt) under models directory.

Based on this issue comment by @brightmart.