regel/loudml

Running Donut generator on a hardware accelerator via onnx

Opened this issue · 0 comments

My client wants me to demonstrate LoudML running on their existing TPA hardware for fast time-series predictions/anomaly detection. In general, rather than running the generator in TF on a CPU, my pull request would entail an optional conversion of the generator to Onnx. Then proprietary code would load that onnx file to the hardware and shuffle buckets to keep up with it. I assume you would not want HW specific code cluttering up the repo - let me know if I'm mistaken. In perfect solution, if the anomaly rate reaches a threshold, a new training would commence and generate a new onnyx file which I'd automatically load on the TPA. I have to implement the demo by the end of May . Your inputs would be invaluable to me as I'm new to VAEs and LoudML.