aws-samples/hpc-cost-simulator

[FEATURE] Add EBS capacity cost to cost estimation

Opened this issue · 0 comments

Is your feature request related to a problem? Please describe.

Every host we account for has at least 1 EBS volume. We should add this to the cost calculation per job / hourly cost aggregation based on a simplified formula:

  • Get EBS (root) volume size from config.yml
  • Get volume price from the pricing API, store as part of the offline ec2 pricing JSON
  • optional: make EBS volume type configurable in config.yml

Describe the solution you'd like

Input from Cloud Economics:

Keep EBS costs separate in the results

After doing my first E2E sizing exercise with the Cloud Econ (EC) team, I think the EBS should be calculated as follows:

In JobAnalyzer.py, When processing hourly_*.csv to hourly-stats.csv:

Count the number of job minutes in that hour (When a job has 4 cores for 10 minutes) it will be counted as 10 minutes total)
Add it as a column to hourly-stats.csv called "EBS Minutes". Then when working with EC we can provide the default type and size to use for calculation.