Issues

• 📋 Documentation Enhancement Suggestion

  huawei-noah/Pretrained-Language-Model#248 · Filter by author croviatrust opened on Mar 30, 2026

• When will the source code of bert2BERT be released?

  huawei-noah/Pretrained-Language-Model#247 · Filter by author vibhamasti opened on Feb 26, 2024

• Is the TinyBERT_General_4L_312D published on huggingface pure English LM or En-CN-Mixed LM?

  huawei-noah/Pretrained-Language-Model#246 · Filter by author JohnHerry opened on Jan 23, 2024

• 运行WuKong的官方测试代码

  huawei-noah/Pretrained-Language-Model#242 · Filter by author sore-2001 opened on Dec 6, 2023

• 请教一下大家，4层tinybert和6层tinybert加载到显存中，占用了多大的显存

  huawei-noah/Pretrained-Language-Model#241 · Filter by author louiss007 opened on Nov 21, 2023

• 你好，请问能否分享一下pytorch版nezha的NEZHA-Base-WWM/model.ckpt文件，谢谢

  huawei-noah/Pretrained-Language-Model#240 · Filter by author 258508 opened on Sep 5, 2023

• TernaryBERT如何实现模型size降低的

  huawei-noah/Pretrained-Language-Model#238 · Filter by author saggitarxm opened on May 16, 2023

• 复现TinyBERT需要pre-train的wiki语料，另是否开源tinybert-cased模型

  huawei-noah/Pretrained-Language-Model#237 · Filter by author hppy139 opened on May 11, 2023

• How does BinaryBERT store the 1 bit weight?

  huawei-noah/Pretrained-Language-Model#236 · Filter by author jzhang38 opened on May 8, 2023

• TinyBERT实验到底用哪个enwiki-latest-pages-articles数据集？

  huawei-noah/Pretrained-Language-Model#230 · Filter by author ra225 opened on Dec 11, 2022

• tinybert 在mnli任务不能复现

  huawei-noah/Pretrained-Language-Model#229 · Filter by author iMountTai opened on Dec 10, 2022
  4

• 使用nezha_base_www模型，得到的嵌入向量为nan

  huawei-noah/Pretrained-Language-Model#227 · Filter by author yixiu00001 opened on Dec 7, 2022

• wmt数据下载

  huawei-noah/Pretrained-Language-Model#226 · Filter by author 0-KaiKai-0 opened on Nov 29, 2022
  1

• TinyBERT's Google resource 404

  huawei-noah/Pretrained-Language-Model#223 · Filter by author xxysocute opened on Nov 15, 2022
  3

• 想问下tinybert Task-specific Distillation第一步中间层蒸馏的评价指标

  huawei-noah/Pretrained-Language-Model#222 · Filter by author wsh2836741 opened on Nov 11, 2022
  2

• CeMAT预训练模型下载?

  huawei-noah/Pretrained-Language-Model#221 · Filter by author Vincent131499 opened on Nov 2, 2022
  3

• For BinaryBERT, what is the value of config.dyna_hidden_size?

  huawei-noah/Pretrained-Language-Model#220 · Filter by author Phuoc-Hoan-Le opened on Oct 31, 2022
  3

• For BinaryBERT, Is 2 epochs used to fine tune both the ternary BERT and binary BERT with data augmentation?

  huawei-noah/Pretrained-Language-Model#219 · Filter by author Phuoc-Hoan-Le opened on Oct 31, 2022

• 关于filip的训练中损失降低的问题？

  huawei-noah/Pretrained-Language-Model#217 · Filter by author Soulscb opened on Oct 8, 2022

• wukong-为什么以ILSVRC作为验证集，模型不是在中文数据集上的训练的吗？

  huawei-noah/Pretrained-Language-Model#215 · Filter by author ghost opened on Sep 29, 2022
  1

• 请问nezha的pytorch模型在哪里下载呢

  huawei-noah/Pretrained-Language-Model#212 · Filter by author zyx214 opened on Sep 6, 2022

• when the code of "bert2BERT" can be released?

  huawei-noah/Pretrained-Language-Model#211 · Filter by author junleiz opened on Sep 4, 2022

• 关于悟空大模型

  huawei-noah/Pretrained-Language-Model#210 · Filter by author Soulscb opened on Sep 2, 2022
  1

• 询问AutoTinyBert的数据集

  huawei-noah/Pretrained-Language-Model#209 · Filter by author AlchemistZoro opened on Sep 2, 2022

• 请问bert2BERT什么时候能公开代码呢？

  huawei-noah/Pretrained-Language-Model#208 · Filter by author iscshuai opened on Aug 25, 2022