Add annotation which will keep deployments around

[devigned]

By default, we should clean up deployments. In the case where we might want to keep them around for debugging, we should have an annotation which will enable that.