bytedance/ByteMLPerf

运行gpt2-torch-fp32 task 遇到的2个问题

longerzone opened this issue · 1 comments

问题1: general_perf/prepare_model_and_dataset.sh 脚本无法下载到正确的位置:

wget -O general_perf/download/traced_gpt2.tar https://lf-bytemlperf.17mh.cn/obj/bytemlperf-zoo/traced_gpt2.tar
tar xf general_perf/download/gpt2.tar -C general_perf/model_zoo/sota/

下载的tar 包和解压的tar 包名称不一样,需要修改为:

wget -O general_perf/download/traced_gpt2.tar -c https://lf-bytemlperf.17mh.cn/obj/bytemlperf-zoo/traced_gpt2.tar
mkdir general_perf/model_zoo/sota/traced_gpt2
tar xf general_perf/download/traced_gpt2.tar -C general_perf/model_zoo/sota/traced_gpt2/

问题2: 运行过程中遇到如下报错,程序不运行也不异常退出,麻烦确认下是什么问题?

INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:FAKE_DATA:Rebatching batch size to: 4 ...
INFO:TestAccuracy:Start to calculate accuracy...
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:28<00:00,  3.48it/s]
INFO:TestAccuracy:Batch size is 4, Accuracy: 0.0
/ByteMLPerf/byte_infer_perf/general_perf/datasets/fake_dataset/test_accuracy.py:48: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
  np.array(diffs),
运行到这里就卡死了

Problem 1 fixed: 6a63cc7