What are the reasons for companies to migrate from on-premises servers to the Cloud?
- Maintenance Overhead
- Highly Expensive
- Not very efficient
What if a company migrated to the Cloud and these problems still exist? What if the costs aren't being saved either? Is it the cloud provider's fault? No. It is a shared responsibilty. To explain it - cloud providers like AWS, Azure etc, provide you with numerous services for compute, storage, monitoring and many more, with least amount of effort on your end. This doesn't mean you can use the resources irresponsibly, it will incur additional charges and you won't benefit from the migration. So, it is a shared responsibility. Use resources responsibly, reap all the benefits.
As a DevOps Engineer, one of your responsibilities is to maintain all the created resources and ensure the deletion of stale resources
Imagine you created an EC2 instance with an attached root EBS volume, to store the data related to your application hosted on that instance. You decided to take a backup of that EBS volume by taking a snapshot, to restore it as a new volume in a different AZ when a disaster strikes. But, you need the snapshots only as long as the application exists. If you decide to shut down your application on the EC2 instance, there will be no need for the snapshot. In that scenario, the snapshots associated with the instance needs to be deleted to be financially efficient.
If you just have one or two EC2 intances to manage, this won't be a big deal, and you can easily manage creation and deletion snapshots manually. But, companies usually have a lot of resources and EC2 instances to manage in various AWS regions. So the above task is almost impossible to be done manually.
This is when Lambda functions in AWS emerge.
Lambda functions are serverless, it doesn't mean there aren't any servers. It just means that you don't have to manage the underlying servers. All you have to do is write code to perform your desired actions. For this function, you have to add a trigger i.e., for the function to be triggered when an EC2 instance is deleted. This action leads to the running of the function, which will check if any stale snapshots created from the deleted instance exist and delete.
A Lambda function is developed utilizing AWS Boto3, which is an AWS SDK, to automate the identification and deletion of stale snapshots, thus optimizing cloud expenses. Through proactive management of snapshots, the Lambda function contributes to cost optimization strategies within AWS environments.