Auto scale worker instances by number of SQS messages received
mwakaba2 opened this issue · 0 comments
mwakaba2 commented
Auto scale worker ec2 instances by number of messages received from SQS per instance.
Scaling based on number of messages in the queue is not ideal because it can slam downstream components if the queue backs up. (e.g. queue backs up and ES is down --> slamming ES)
Recommended metrics to use
- number of requests received
- number of messages arriving to queue
- Autoscaling EC2 instances based on SQS