hpcaitech/ColossalAI-Examples

Issues

• connection failure

  #207 opened 2 years ago by lhj-git
  2

• cannot import name 'OPTForCausalLM'

  #206 opened 2 years ago by upwindflys
  0

• grad is none when run gpt2 with pipeline parallelism only

  #204 opened 2 years ago by lin88lin8850
  0

• Outdated OPT example

  #203 opened 2 years ago by larry-fuy
  0

• Load ColossalAI GPT model as HuggingFace/Transformers Model

  #199 opened 2 years ago by Red-Giuliano
  2

• It seems the pipeline parallel document is out of date(https://www.colossalai.org/docs/features/pipeline_parallel)

  #195 opened 2 years ago by lambda7xx
  7

• detr-debug pipelinable.py

  #197 opened 2 years ago by lsx66
  1

• there maybe some bug about the train_gpt.py(https://github.com/hpcaitech/ColossalAI-Examples/blob/main/language/gpt/train_gpt.py)

  #196 opened 2 years ago by lambda7xx
  5

• Cannot find the gradient handler example

  #171 opened 2 years ago by DarrenYing
  1

• Too large training loss

  #155 opened 2 years ago by qyc-98
  1

• ImportError running detr

  #186 opened 2 years ago by LSC527
  1

• question about import model_zoo.gpt.gpt as col_gpt

  #193 opened 2 years ago by lambda7xx
  2

• The error happened when I did multi-node distributed training

  #180 opened 2 years ago by ShangWeiKuo
  1

• RuntimeError: CUDA out of memory with cifar10 in data_parallel example

  #176 opened 2 years ago by fuhengwu2021
  1

• ImportError: cannot import name 'colo_state_dict' from 'colossalai.utils.model.colo_init_context'

  #175 opened 2 years ago by fuhengwu2021
  1

• BERT Data Preprocessing

  #172 opened 2 years ago by JizeZhangCS
  3

• 当模型gradient_checkpointing时运行feature/zero/train_v2.py出错

  #169 opened 2 years ago by wjizhong
  5

• [Compatibility] Runining OPT using PyTorch 1.12 and Gemini placement_policy = 'cuda' failed

  #166 opened 2 years ago by feifeibear
  3

• wikiextractor raise BdbQuit

  #108 opened 2 years ago by RenyunLi0116
  3

• Problem with saving model state dict

  #156 opened 2 years ago by ouyangliqi
  2

• BERT示例运行错误，ColossalAI-Examples/language/bert/sequene_parallel/

  #158 opened 2 years ago by ZXM1063694570
  2

• 运行GPT2案例出现RuntimeError: Could not find 'SLURM_PROCID'问题，是必须要装SLURM环境？

  #161 opened 2 years ago by ZXM1063694570
  1

• no kernel image

  #152 opened 2 years ago by qyc-98
  2

• Vision Transformer cifar10 bug

  #134 opened 3 years ago by gaow0007
  7

• ColossalAI cannot run the shufflenet_v2_x1_0 model as torch do

  #139 opened 3 years ago by songyuc
  5

• ZeRO without using shard_param

  #133 opened 3 years ago by powermano
  7

• ModuleNotFoundError: No module named 'colossal_layer_norm_cuda'

  #94 opened 3 years ago by 200987299
  3

• Failed to run gpt2_3d example

  #99 opened 3 years ago by FJRFrancio
  7

• 请问应该如何保存模型？

  #126 opened 3 years ago by 480284856
  2

• Possible example: text to image or image to text

  #107 opened 3 years ago by binmakeswell
  0

• [RFC] Merge train_with_engine and train_with_trainer

  #100 opened 3 years ago by FrankLeeeee
  0

• Provide relatively small model for ViT

  #98 opened 3 years ago by Gy-Lu
  0

• 'RuntimeError: CUDA error: an illegal memory access was encountered' with large batch size of GPT2-example

  #70 opened 3 years ago by Gy-Lu
  1

• Provide an Example for Inference

  #31 opened 3 years ago by FrankLeeeee
  2

• Broken Link to Doc in ViT DP example

  #30 opened 3 years ago by FrankLeeeee
  0

• Python Exception when running BERT Examples

  #46 opened 3 years ago by Wesley-Jzy
  0

• Any plan for Swin Transformer?

  #76 opened 3 years ago by bityangke
  1

• Memory leakage in BERT example

  #50 opened 3 years ago by ExtremeViscent
  1

• ZeRO 2 configuration example

  #71 opened 3 years ago by CHN-ChenYi
  1

• failed to run gpt2 zero3 example

  #69 opened 3 years ago by CHN-ChenYi
  2

• WRONG URL in GPT README

  #44 opened 3 years ago by Wesley-Jzy
  1

• Overflow in GPT examples

  #37 opened 3 years ago by feifeibear
  1

• failed to run gpt example

  #36 opened 3 years ago by feifeibear
  3

• The directory content of gpt_2 and gpt_3 are the same.

  #26 opened 3 years ago by dujiangsu
  2

• Invalid Import in GPT Example

  #25 opened 3 years ago by FrankLeeeee
  0

• Personal Dataset Preprocessing

  #24 opened 3 years ago by Lobskodax
  2

• PyTorch or TensorFlow

  #21 opened 3 years ago by Aadyant12
  2