Is EMA generally applied after every optimizer update?

[glenn-jocher]

I saw your blog post here that was super informative:
http://ruishu.io/2017/11/22/ema/

I'm trying to reproduce EMA for YOLOv3 in PyTorch and am wondering if I should apply it after every batch or every optimizer update? Thank you!
https://github.com/ultralytics/yolov3