robmarkcole/tensorflow-lite-rest-server

Performance in CLI vs Service vs Docker 2x, 4x reduction

Closed this issue · 1 comments

fgonza2 commented

I am getting <200ms while i run it in CLI. If i run it as a service it goes up to 500ms. then in docker goes up to 800ms

Running Ubuntu on a 7th Gen Intel CPU with Coral USB installed

Any ideas why?

robmarkcole commented

That is uesful to know, but your guesses are as good as mine