leileilin opened this issue 3 years ago · 0 comments
你好, 按照workthrough.md中步骤执行,但是却出现了训练卡在encoder.layers.3.feed_forward.layer_norm.bias [512] encoder.layers.3.feed_forward.layer_norm.weight [512] encoder.layers.3.self_attention.attention.k_transform.bias [512] 这个阶段,无代码报错,显卡占用也没反应。
encoder.layers.3.feed_forward.layer_norm.bias [512] encoder.layers.3.feed_forward.layer_norm.weight [512] encoder.layers.3.self_attention.attention.k_transform.bias [512]