Error with `ezkl.setup()`
finlytics-hub opened this issue · 0 comments
finlytics-hub commented
Describe the bug
Unable to run ezkl.setup()
for a couple of models with a batch_size=1000 and corresponding input data. Same input data was used for ezkl.calibrate_settings()
too. This input data was used to successfully setup other similar model architectures but errored out with the attached two.
Error as below:
thread '<unnamed>' panicked at 'index out of bounds: the len is 1 but the index is 1', src/tensor/var.rs:340:63
PanicException: index out of bounds: the len is 1 but the index is 1
Expected behaviors
Setup to be successful
Steps to reproduce the bug
- Generate and calibrate settings using the attached onnx and input.json files
- Compile the attached onnx using
ezkl.compile_model()
(compiled models also attached) - Get SRS using the calibrated (and attached) settings file
- Run
ezkl.setup()
Device and Operating System
OS: Ubuntu
Version: 22.04
Processor: Intel Haswell 60 vCPUs
Memory: 256 GB
Additional Information
- python 3.10.12
- ezkl v 1.7.19
- pytorch v 2.1.0.dev20230727+cu121
- onnx v 1.13.1
input.zip
model_8.zip
model_4.zip