huawei-noah/Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
Python
Issues
- 0
- 1
- 0
Is the TinyBERT_General_4L_312D published on huggingface pure English LM or En-CN-Mixed LM?
#246 opened by JohnHerry - 0
运行WuKong的官方测试代码
#242 opened by sore-2001 - 4
tinybert 在mnli任务不能复现
#229 opened by iMountTai - 0
请教一下大家,4层tinybert和6层tinybert加载到显存中,占用了多大的显存
#241 opened by louiss007 - 0
- 1
CeMAT 加载预训练 ckpt 报错
#239 opened by yangb05 - 0
TernaryBERT如何实现模型size降低的
#238 opened by saggitarxm - 0
复现TinyBERT需要pre-train的wiki语料,另是否开源tinybert-cased模型
#237 opened by hppy139 - 0
How does BinaryBERT store the 1 bit weight?
#236 opened by jzhang38 - 3
TinyBERT's Google resource 404
#223 opened by xxysocute - 0
When to use DFL loss
#235 opened by WailordHe - 2
- 3
CeMAT预训练模型下载?
#221 opened by Vincent131499 - 0
TinyBERT实验到底用哪个enwiki-latest-pages-articles数据集?
#230 opened by ra225 - 0
使用nezha_base_www模型,得到的嵌入向量为nan
#227 opened by yixiu00001 - 1
wukong-为什么以ILSVRC作为验证集,模型不是在中文数据集上的训练的吗?
#215 opened by xueyongfu - 1
wmt数据下载
#226 opened by 0-KaiKai-0 - 1
CeMAT pre-trained models download
#197 opened by bityigoss - 2
- 2
- 9
请问 PanGu-Bot 什么时候能公开模型和代码呢
#186 opened by realLINorth - 0
For BinaryBERT, Is 2 epochs used to fine tune both the ternary BERT and binary BERT with data augmentation?
#219 opened by Phuoc-Hoan-Le - 0
关于filip的训练中损失降低的问题?
#217 opened by Soulscb - 1
- 1
wukong模型图文测试相似度太低
#204 opened by douzi0248 - 0
请问nezha的pytorch模型在哪里下载呢
#212 opened by zyx214 - 0
- 0
when the code of "bert2BERT" can be released?
#211 opened by leoozy - 0
询问AutoTinyBert的数据集
#209 opened by AlchemistZoro - 0
请问bert2BERT什么时候能公开代码呢?
#208 opened by iscshuai - 2
Wukong 论文table9问题
#194 opened by bixiaopeng0 - 0
tinybert linear transformation sharing
#205 opened by sh0416 - 1
Wukong token-wise 交互的模型图文相似性区别度较小?
#200 opened by zyx1213271098 - 1
TinyBERT download link broken
#202 opened by sh0416 - 1
how to import my own datasets in TinyBERT_4L_zh?
#199 opened by zoeChen119 - 0
TinyBERT for masked LM
#198 opened by danchern97 - 0
关于BinaryBERT中lsq的问题。
#196 opened by rainbowyuanyuan - 0
Resources for General Distill (TinyBERT)
#195 opened by YegorKhodak - 0
from transformer import modeling时报AttributeError: module 'cryptography.utils' has no attribute 'Enum'
#193 opened by huihuipiaomiao - 1
multilingual TinyBERT
#190 opened by YegorKhodak - 1
About tinybert ['CLS']
#191 opened by zshy1205 - 2
AutoTinyBERT models not accessible
#185 opened by AdityaKane2001 - 0
About Prediction Distill
#187 opened by Fpw19980724 - 1
- 0
Question about the pre-train dataset.
#183 opened by TLB-MISS - 0
我想蒸馏出2层的tinybert,怎么入手
#182 opened by Weries - 1
tinybert的tf代码有提供吗
#177 opened by Weries - 0
soft_cross_entropy in TinyBERT needs modification
#176 opened by sbwww