OpenBMB/BMInf

Issues

• [FEATURE] full examples with some known models from the HF in a Collab Notebook

  #63 opened 2 years ago by vackosar
  10

• 为什么实际的显存占用总比我设置的多两个G?

  #69 opened 2 years ago by Anhforth
  0

• [BUG] GPU RTX4090 report errors

  #68 opened 2 years ago by zc3r
  0

• [FEATURE] Does BMInf support multiple nodes deployment?

  #67 opened 2 years ago by sharlec
  0

• 在使用CPM ANT+上使用BMinf时报错：

  #66 opened 2 years ago by lhj-git
  0

• [FEATURE] Can the framework be combined with Faster Transformer?

  #65 opened 2 years ago by vackosar
  0

• BMInf支持 CPM-Bee/Live 模型吗?

  #64 opened 2 years ago by HaishengLiang
  1

• [BUG] TypeError: object of type 'TransformerBlockList' has no len()

  #62 opened 2 years ago by jiangliqin
  1

• [BUG]请问BMInf支持transformers的模型吗？我用BMInf包装模型推理时报错了

  #61 opened 2 years ago by L-hongbin
  1

• [BUG] 存下显存泄漏，及访问过快时候报错

  #60 opened 2 years ago by changleilei
  1

• [FEATURE]How to finetune CPM2.1？

  #58 opened 2 years ago by drxmy
  2

• Examples of CPM-1/2 啥时候出呀，还有生成模型的代码

  #59 opened 2 years ago by touwenameng
  2

• [BUG] RuntimeError: Unexpected model output: 26239

  #49 opened 3 years ago by mali19064
  0

• 是否支持cpm2 finetune repo的模型

  #24 opened 3 years ago by 2020zyc
  4

• 怎样用BMInf加速GLM推理速度

  #57 opened 2 years ago by jiangliqin
  4

• CPM2自动问答任务怎么推理

  #55 opened 2 years ago by yuxulingche
  1

• [FEATURE] Question: why does CPM1.0 need 2 GPU cards while BMInf only need 1 GPU?

  #44 opened 3 years ago by lucasjinreal
  4

• 请教CUPY/CUDA

  #51 opened 3 years ago by 2020zyc
  1

• [BUG]RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED

  #52 opened 3 years ago by cuishibin
  0

• [BUG]RuntimeError: Library cublasLt is not initialized

  #50 opened 3 years ago by hxl523
  0

• [QUESTION] Is it able to load complete model instead of INT8 model?

  #45 opened 3 years ago by skpig
  1

• 请问是否支持显存按需调用，如果支持可否给个代码演示

  #43 opened 3 years ago by thehzzz
  5

• [BUG] Error was raised when importing model in v1.0.x

  #40 opened 3 years ago by sdjksdafji
  12

• RuntimeError: CUBLAS error: CUBLAS_STATUS_NOT_INITIALIZED [BUG]

  #41 opened 3 years ago by fangd123
  4

• fill_blank报错，换成别的文本进行填空提示Unexpected model output: 26239

  #31 opened 3 years ago by bidoudhd
  3

• cpm1 or cpm2 named_parameters() is empty []

  #33 opened 3 years ago by RyanYip-Kat
  1

• [FEATURE]允许加载本地模型

  #36 opened 3 years ago by huhk-sysu
  2

• RuntimeError: CUBLAS error: CUBLAS_STATUS_EXECUTION_FAILED[BUG]

  #30 opened 3 years ago by zhangxliang
  5

• CUDA Error: no kernel image is available for execution on the device

  #29 opened 3 years ago by AdamBear
  2

• [BUG]运行generate_cpm2.py 报value error

  #20 opened 3 years ago by xiaoqiao
  3

• [MODEL] Debug Self-Trained GPT-Model

  #19 opened 3 years ago by HoratioJSY
  2

• CPM2.1模型做文本生成时的问题

  #17 opened 3 years ago by huhk-sysu
  10

• generate.py示例程序错误

  #14 opened 3 years ago by huhk-sysu
  1

• cublas error: CUBLAS_STATUS_NOT_SUPPORTED

  #13 opened 3 years ago by huhk-sysu
  4

• running examples and get error: type object 'cublasLt' has no attribute 'cublasLtHandle_t'

  #11 opened 3 years ago by qiufengyuyi
  3

• Error during installation, `No matching distribution found for cupy-cuda90<10,>=9` [BUG]

  #10 opened 3 years ago by YixuanCao
  1

• 请问CPM2.1模型所对应的vocab.txt哪里可以下载？

  #25 opened 3 years ago by chenpe32cp
  3

• QUESTION:请问如何从CPM2.1模型中提取出句向量(输入词则提取词向量)

  #26 opened 3 years ago by chenpe32cp
  2

• AttributeError: type object 'cublasLt' has no attribute 'cublasLtHandle_t'

  #23 opened 3 years ago by wac81
  3

• [BUG] eva2 = bminf.models.EVA2()

  #9 opened 3 years ago by Hansen06
  5

• 我们收集的是医疗问答数据怎么训练自己收集的数据呢？[FEATURE]

  #21 opened 3 years ago by yunfeihaha
  1

• [BUG] RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED

  #22 opened 3 years ago by mirrorange
  1

• [FEATURE]Compare to FasterTransformer

  #12 opened 3 years ago by HoratioJSY
  1