Performance Regression or Improvement: test_cloudml_benchmark_criteo_10GB-runtime_sec:runtime_sec
Closed this issue · 0 comments
github-actions commented
Performance change found in the
test: test_cloudml_benchmark_criteo_10GB-runtime_sec for the metric: runtime_sec.
For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.
Test description: TFT Criteo test on 10 GB data.
Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py#LL104C7-L104C41
timestamp: Thu Sep 12 22:55:26 2024, metric_value: 2621.12
timestamp: Wed Sep 11 22:53:18 2024, metric_value: 2629.05
timestamp: Tue Sep 10 22:53:25 2024, metric_value: 2540.39
timestamp: Mon Sep 9 22:47:01 2024, metric_value: 2581.80
timestamp: Sun Sep 8 22:44:23 2024, metric_value: 2464.56
timestamp: Sat Sep 7 22:43:19 2024, metric_value: 2429.98
timestamp: Fri Sep 6 22:57:33 2024, metric_value: 2508.30
timestamp: Thu Sep 5 22:48:43 2024, metric_value: 2566.30
timestamp: Wed Sep 4 22:46:14 2024, metric_value: 2498.41
timestamp: Tue Sep 3 22:47:57 2024, metric_value: 2561.78 <---- Anomaly
timestamp: Mon Sep 2 22:38:56 2024, metric_value: 2297.89
timestamp: Sun Sep 1 22:40:19 2024, metric_value: 2255.53
timestamp: Sat Aug 31 22:41:56 2024, metric_value: 2398.85
timestamp: Fri Aug 30 22:42:54 2024, metric_value: 2449.79
timestamp: Thu Aug 29 22:44:19 2024, metric_value: 2395.76
timestamp: Wed Aug 28 22:43:39 2024, metric_value: 2338.07
timestamp: Tue Aug 27 22:43:38 2024, metric_value: 2357.34
timestamp: Mon Aug 26 22:45:44 2024, metric_value: 2371.61
timestamp: Sun Aug 25 22:40:02 2024, metric_value: 2348.55
timestamp: Sat Aug 24 22:38:27 2024, metric_value: 2360.65