dolly-v2-12b w/Colab Pro High Ram + Premium GPU - out of RAM using
Opened this issue · 0 comments
durapensa commented
Just reporting that Colab Pro w/High Ram (24GB) & Premium GPU (Tesla V100-SXM2-16GB) crashes 'out of memory' when using databricks/dolly-v2-12b as indicated in the comment in Dolly 2.0 HuggingFace v1.1.ipynb