brightmart/albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
Python
Issues
- 1
在预训练生成特定格式的文件(tfrecords) 时内存不足问题
#173 opened by TITONIChen - 0
Internal: Blas GEMM launch failed : a.shape=(4096, 128), b.shape=(128, 312), m=4096, n=312, k=128
#178 opened by wzhslap - 0
AttributeError: module 'tensorflow.contrib.tpu' has no attribute 'InputPipelineConfig'
#177 opened by wzhslap - 0
File path error
#176 opened by w17716383006 - 5
模型转换pytorch问题
#162 opened by dalinvip - 0
想請問模型的 license
#170 opened by emfomy - 1
在run_classifier里加载模型正确,在run_pretraining_google.py里加载模型报错:ValueError: Shape of variable bert/embeddings/LayerNorm/beta:0 ((128,)) doesn't match with shape of tensor bert/embeddings/LayerNorm/beta ([312]) from checkpoint reader.
#144 opened by yuanjun1991 - 0
有相关onnx模型转换与调用的支持嘛?
#172 opened by Gmgge - 1
albert_chinese_large 报显存错误
#149 opened by teng1996 - 1
- 0
请问DataProcessor类在哪里呢
#169 opened by sweetboxwwy - 1
数据集下载不了
#168 opened by sweetboxwwy - 1
- 1
ALBERT-small训练效果问题
#135 opened by Hanlard - 0
请问预训练模型是文本分类模型吗? 想做语言模型,预测下一个单字或词应该怎么修改?
#166 opened by JiaoPaner - 1
请问中文albert训练过程中是按字符级分割还是按词语级分割?
#165 opened by rsindper - 2
求助
#164 opened by xiaoxiao111111 - 1
'str' object has no attribute 'size'
#163 opened by wenHK - 1
打算训一个更小的预训练模型,你们预训练数据都是咋准备的啊?
#154 opened by TriLoo - 0
- 0
句向量特征提取的最佳实践
#160 opened by RingoD - 1
这个pretrain用的tensorflow版本是什么?
#150 opened by yangtianyu92 - 0
The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.
#159 opened by guotong1988 - 0
请问考虑将模型发布到 tfhub 上面吗?
#158 opened by HarborZeng - 1
加载使用albert base正常,加载albert tiny or small报错
#132 opened by sataliulan - 0
- 0
how to load albert_zh model
#156 opened by lijiekiff - 1
HTTP request sent, awaiting response... 404 Not Found; https://raw.githubusercontent.com/pengming617/text_matching/master/data/test.txt
#148 opened by king21guns - 0
- 0
albert_Tiny文本分类推理速度CPU 300+ms,GPU 7ms,请问正常么
#153 opened by faker2cumtb - 4
请问怎么转化成pb文件,输入层和输出层是什么呢
#129 opened by KatouMegumiMoe - 0
xxlarge模型微调时训不动
#152 opened by bestbzw - 2
- 0
使用transformers无法加载模型
#151 opened by Brokenwind - 2
run_classifier_clue.sh 这个脚本好像没有下载下来数据,https://storage.googleapis.com这个网址也打不开
#145 opened by starplatinum3 - 1
请问下,我想在 albert_zh 后面拼接上一个ctc loss 的输出,能实现么?
#147 opened by x19990416 - 0
- 3
ValueError: Shape of variable bert/embeddings/LayerNorm/beta:0 ((312,)) doesn't match with shape of tensor bert/embeddings/LayerNorm/beta ([128]) from checkpoint reader
#137 opened by BrightHai - 0
预训练的中文预料除了wiki还有啥
#143 opened by ann22 - 0
tpu 名称
#142 opened by chinese-wikisource - 1
训练集一万多条数据,测试集两千多条,共400多类,训练集准确率90%多,验证集70%,这正常吗
#140 opened by ann22 - 0
- 0
用run_classifier_clue.py跑分类任务,Adam优化时,梯度出现Nan
#139 opened by jcfeng - 0
Windows fatal exception: access violation
#136 opened by kezoy - 2
Albert_zh 和Google Albert的几点区别
#134 opened by jiezouguihuafu - 4
关于Factorized Embedding Parameterization的问题
#133 opened by hntee - 0
做预训练 Pre-training时关于do-eval疑问
#127 opened by WuSiQingChun - 0
直接运行Similarity.py报错,模型restore失败
#131 opened by justein - 0
tf2.0适配
#128 opened by 2012060010010 - 0
很多默认的dropout是0?
#126 opened by guotong1988