Profiling

[ethandmd]

We need some instrumentation to understand how our code is performing. Not only do we need profiling instrumentation but we need some metrics to care about! Some general areas I want to know about are:

• receiving video stream in streamrs and encoding it for sending to client browser
• receiving video stream in inference server and preprocessing it for model inference
• capturing video and serving it / sending it to downstream services.

Some tools of interest are:

• flamegraph-rs
• tokio-console
• also perf, of course, maybe with some Brendan Gregg inspiration?