doe300/VC4C

Running Tensorflow model via TVM on OpenCL

Opened this issue · 6 comments

marcin-sielski commented

I am experiencing following error on Rasberry Pi while trying to run tensorflow model over TVM on OpenCL.
terminate called after throwing an instance of 'vc4c::CompilationError'
what(): Normalizer: Invalid local type for memory area: (p) i32* %tmp.3262

doe300 commented

Can you give me more details about what were you trying to do?

  • What tensorflow sources did you build?
  • What command did you run?
  • If possible, please post any log previous to that error.
marcin-sielski commented

Hi @doe300,

My apologies but I am new to the OpenCL and the whole TVM stack. I will try to explain in more details what I did.
I have compiled VC4C, VC4CL, VC4CLStdLib, TVM (full package) and installed it on Raspberry Pi together with Tensorflow and tried to follow the tutorial at:
https://opensourceforu.com/2019/06/the-capabilities-of-tensor-virtual-machine-an-open-deep-learning-compiler-stack/
The tutorial has some drawbacks but I was able to walk through most of the example:

  1. I have imported and compiled the mobilenet into relay representation for "opencl" (example uses llvm) - Step 3
  2. I have saved the compiler output - Step 4
  3. I have executed successfully most of the steps from Step 5 (tvm.cl() instead of tvm.cpu(0))
    While trying to execute the model:
# Execute the Model
module.run()
# Get the first output
out = module.get_output(0)

I get

terminate called after throwing an instance of 'vc4c::CompilationError'
  what():  Normalizer: Invalid local type for memory area: (p) i32* %tmp.326

Thank you for help.

Best Regards

Marcin Sielski

PS. I managed to execute entire example on Intel/beignet successfully.

marcin-sielski commented

Hi @doe300,

Do you have any ideas how to troubleshoot the issue?

I wonder what the message 'Invalid local type for memory area: (p) i32* %tmp.326' mean.

Thank you for help in advance.

Best Regards

Marcin Sielski

doe300 commented

The error means that the OpenCL kernel accesses memory in a way that is not yet supported by the VC4C compiler.

Without knowing the actual kernel code, there is not much that can be done here. If you compile the VC4CL host-side stack in debug mode (with the CMake variable BUILD_DEBUG set), the kernel code which fails to compile will be dumped into a file (look for lines in the standard output like "Dumping program sources to (tmp/vc4c-source-xxx.cl") which the could be used to analyze the problem.

marcin-sielski commented

@doe300
I finally managed to generate kernel code. I am not sure where too look at:

vc4cl-source-1804289383.cl.tar.gz

Thank you for help in advance.

Best Regards

Marcin Sielski

doe300 commented

Thanks for the source code.

I do not get the error reported above, but I do get some register-association errors. I will have a look into them.