linwhitehat/ET-BERT

VRAM needed for finetuning

Closed this issue · 2 comments

miqsoft commented

Hey,

Since in the requirements the GPU: Tesla V100S is mentied I'm wondering if this is meant for training the model or for finetuning.
Or in other words, is it also possible to do the finetuning on a graphic card with 12GB or so.

Greetings,
Michael

zxxcjy123 commented

微调够的

zxxcjy123 commented

微调阶段batch_size32大概需要8-9G显存