Fix Metrics Deprecation Warning

[rafidka]

Overview

We are seeing this message repeatedly in our logs:

RemovedInAirflow3Warning: The basic metric validator will be deprecated in the future in favor of pattern-matching. You can try this now by setting config option metrics_use_pattern_match to True.

We need to start setting the mentioned flag to True to avoid this error. This would also require updating our internal CloudWatch Agent (the airflow.go plugin) to treat the allow/block-list as containing regex.

Acceptance Criteria

• Enable the metrics_use_pattern_match flag.
• Update our CloudWatch agent to treat the patterns in allow/block-list as regex.
• Important: Is there any potential customer impact? Probably not, but we need to verify.

Additional Info

N/A