graykode/ALBERT-Pytorch

Issues

• what is the corpus format in train.txt for electra pre-training ??

  #4 opened 4 years ago by marcusau
  1

• how to train on custom dataset ?

  #8 opened 3 years ago by StephennFernandes
  0

• How to select mask_alpha and mask_beta parameters values in n-grams mask by experience？

  #6 opened 4 years ago by wa008
  0

• WARNING:root:NAN or Inf found in input tensor ERROR

  #5 opened 4 years ago by youngyoung1021
  0

• Number of Transformer layers

  #3 opened 5 years ago by IwasakiYuuki
  2

• out of memory error

  #2 opened 5 years ago by csharma
  4