google-research/albert
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
PythonApache-2.0
Issues
- 2
Prediction Fails on default Colab
#259 opened by Jadiker - 0
Albert
#279 opened by Albertjabal - 0
Albet
#278 opened by Albertjabal - 0
Why do I find inconsistencies between the output of my ALBERT model converted to ONNX format and tested with ONNX Runtime, compared to the original PyTorch format model?
#277 opened by Orient12 - 2
- 0
Load in Browser Tensorflow
#276 opened by sysmaya - 1
torch.nn.modules.module.ModuleAttributeError: 'AlbertEmbeddings' object has no attribute 'bias'
#241 opened by dhs29 - 1
albert base fine-tuned on squad2.0 gets stuck in loop when predicting on new file
#243 opened by alexander-fichtl - 0
Improvement to how the `app` and `pages` files conflict is shown. Especially the last log line `"pages/" - "app/"` made it seem like you should remove the `pages` folder altogether. This was a bug in how the `''` case was displayed. After having a look at this I went further and added exactly which file caused the conflict given that `app` allows you to create `app/(home)/page.js` and such it saves some digging for what the actual conflicting file is. Similarly in `pages` both `pages/dashboard/index.js` and `pages/dashboard.js` are possible.
#270 opened by albrtkinn - 2
The results can't be reproduced
#269 opened by kavin525zhang - 7
[Problem/ Squad V2] the result is too low compare with the F1 score in paper, Is something wrong?
#230 opened by Gs-Zhang - 0
Wrong evaluate result on Squad2.0
#267 opened by YuxuanJiang1 - 0
Difference between v1 and v2 for xxlarge
#266 opened by yanaiela - 0
when training in Race , The eval_accuracy is flat , it only has three numbers which are 0.0, 0.33334, 0.66667, 1.0
#264 opened by AGuangzzz - 0
- 2
- 0
- 0
- 0
Discrepancy in tokenization results using albert's tokenizer and sentencepiece library
#249 opened by anjali-chadha - 2
Wrong pieces for control symbols after loading SentencepieceProcessor from official model
#247 opened by JanKaul - 2
fine_tune albert with run_classifier.py on GPU but the GPU-util is 0,why and how?
#211 opened by yuanjun1991 - 0
fine tune on my own English dataset
#248 opened by cxx-cindy - 1
Could you provide the training hyper paras
#235 opened by juyiming - 2
TypeError: '<' not supported between instances of 'int' and 'NoneType' while only predicting, try to fix it, but not sure is it make sense
#221 opened by alznn - 2
Error creating and exporting TFLite after fine-tuning (using run_squad_v1.py/run_squad_v2.py)
#227 opened by manojpreveen - 0
The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.
#242 opened by guotong1988 - 0
The output of the features of a given text consists of two tensor. Are they both the deep features?
#240 opened by FriedaSmith - 0
train albert on custom dataset
#239 opened by mlcom - 0
- 0
- 0
[Implementation] Sentence order prediction (SOP) label for a single-chunk-document in create_pretraining_data.py
#234 opened by joongbo - 0
albert_base可以使用多块GPU同时训练么
#233 opened by Yaaasuo - 0
ValueError: Expected input batch_size (864) to match target batch_size (32).
#232 opened by abhibha1807 - 2
- 0
Can ALBERT's parameter sharing concept be used in image-GPT paper implementation?
#229 opened by spygaurad - 0
Finetune with multiple GPU
#228 opened by ReyonRen - 1
is it support fine tuning with tf2.x?
#226 opened by ares5221 - 0
Albert-base-v2 training data
#225 opened by slvcsl - 1
why running run_squad_v2.py in prediction mode with dev-v2.0.json gets zero neg example
#220 opened by urextra - 0
tensorflow.python.framework.errors_impl.NotFoundError: Restoring from checkpoint failed.
#224 opened by YuHengKit - 0
Is it possible to load pretrained model's checkpoint and pretrain other corpus with that checkpoint?
#218 opened by sikaleo - 1
invalid load key, '\x12'
#217 opened by liu-x-p - 1
use custom vocab.txt
#214 opened by 2696120622 - 0
- 2
- 1
model isn't learning
#207 opened by raviolli - 0
Description problem of attention_mask.
#208 opened by liushaoweihua - 0
different parameter position with api doc
#206 opened by cyjj - 0
get Matthew_corr = 0 in eval on CoLA
#205 opened by cyjj - 3