liupeirong/MLOpsManufacturing

Cleaner variable management

liupeirong opened this issue · 1 comments

Review the variable management article and the image-classification-tensorflow sample to see if there're any additional guidelines or code that can be improved.

Glossary

Term Remark
variables here variable and parameters used in and for the CI/CD part as well for AML wrapper and business logic

Scenario or use case

There are many variables used in any Azure Machine Learning (AML) projects, including variables for Azure resources, Azure DevOps (ADO) pipelines, AML experiments and more. There are also many different ways to store them, for example, in environment variables, ADO variable templates, ADO variable groups, or supply them directly in command line. What's the best practice to manage these variables - which variables should be store where?

more details

The v-team removed some variables from the current samples because they didn't felt maintainable or helpful

The project teams developed more feasible approaches then what the common staring point MLOpsPython provided

Regarding variables to specify targeted compute environments this is related to #47

Acceptance criteria

  • Best Practice documentation around what values need to be stored in variables, where to store them, where to to the cut (maybe referencing one or several samples for demonstration of pros/cons?)

Stretch Goal

  • One sample which leverages App Configuration Service (ACS can reference KeyVault for secrets internally) in favor of AzDO Variable Groups (just an idea see #19)