microsoft/contosotraders-cloudtesting

Add AKS cost optimization demo

MarcusFelling opened this issue · 0 comments

MarcusFelling commented

Tasks

  • Parameterize AKS deployment manifest: cpu, mem, replicas
  • EnvSubst these parameters using:
    • GH action
    • AZD pipeline task
  • New AZD pipeline: matrix strategy
  • New GH workflow: matrix strategy
  • New demo script

Open Questions

  • How do we "reset" the AKS cluster once all these load tests have concluded?
  • Do we need a new load test? Or can we reuse the existing one (targeting product API)
  • New pass/fail critiera needed?
  • Decide if it makes sense to merge new pipelines with main pipelines (release criteria?)
  • Need to figure out cost/billing impact to users:
    • GH action minutes
    • AZD pipeline minutes
    • Azure billing from load test runs

Decisions

  1. These load tests for cost-optimization/right-sizing can also be performed against ACA too (and not just AKS). But given that ACA metrics are currently not ingestable into Azure Load Testing, diagnosing failures will be painful for the users.
    • For now, let's just skip ACA entirely, and focus on AKS.
    • ACA support is in on the Load testing team's backlog. Let's revisit this in the future once support is enabled.

Reference Links