aws-samples/aws-cudos-framework-deployment

Create dashboard with split cost allocation data for EKS

iakov-aws opened this issue · 4 comments

iakov-aws commented

Please +1 here to support this feature. Feel free to share your use cases and details in comments (or in our feedback mail)
Best,
CID team

jinman commented

We did some research here. We would like to get cluster-level, namespace-level and pod-level or label-level data for EKS deployments. We found only some commercial options are:

  1. Kubecost
  2. Cloudability
  3. doit EKS Lens

Can we have an AWS native way to get data and visualize via Quicksight?

udid-aws commented

@jinman, for EKS cost allocation, we have the Containers Cost Allocation dashboard:
Public GitHub repo: https://github.com/awslabs/containers-cost-allocation-dashboard
Public demo dashboard: https://cid.workshops.aws.dev/demo/?dashboard=containers-cost-allocation

It's based on data collection from Kubecost, so it requires that you have Kubecost deployed on your clusters (see the requirements in the repo).

Stay tuned for more features in context of this GitHub issue this year

ivan-kovnatskyi-c54f97a commented

@udid-aws thanks for building these dashboards. I briefly checked, but didn't see, can that data be used to group by pod-level labels?

udid-aws commented

@udid-aws thanks for building these dashboards. I briefly checked, but didn't see, can that data be used to group by pod-level labels?

@ivan-kovnatskyi, thank you for using the dashboards. The answer depends on whether you're using the Kubecost Containers Cost Allocation Dashboard or the SCAD Containers Cost Allocation Dashboard.

The Kubecost Containers Cost Allocation Dashboard supports grouping/filtering by pod labels (and annotations), but you first need to add them to the dataset yourself (this is to prevent the dataset from growing or changing frequently if all labels/annotations would just be collected automatically).
Please follow this for instructions how to add pod labels or annotations to the dataset.
Then, you'll need to customize the visuals in the dashboard yourself to add the pod labels/annotations as group-by fields or filters. This is because the dashboard is published for the public, and we can't tell which labels/annotations will be used by users, so we couldn't include labels/annotations as part of group-by/filters by default.
However, we do plan to include some of the K8s recommended labels, such as the ones prefixed by app.kubernetes.io, by default in the dataset and in the different dashboard's visuals as group-by/filter.

The SCAD Containers Cost Allocation Dashboard doesn't yet support pod labels, because underlying data source, SCAD (Split Cost Allocation Data) itself doesn't yet support pod labels.
I suggest you contact your AWS account team, or AWS Support, to ask if there's any plan to support pod labels in SCAD. You can refer them to me by my GitHub user's email address, and ask them to contact me in our internal channels if they need more information

  • ❤️1