databrickslabs/dbx

Named parameters not working as expected

zerodarkzone opened this issue · 0 comments

Expected Behavior

When using named parameters in the deployment file, these should be reflected in the databricks job.

ej: deployment

python_wheel_task:
  <<: *python_wheel_task
  named_parameters:
    pipeline: intermediate
    env: dev
    conf-source: file:fuse://conf
    runner: ThreadRunner

Current Behavior

With the given parameters configuration. I get this in Databricks.

image

An extra parameter called "named_parameters" is added to the task.
This is a problem for the task im running.

Steps to Reproduce (for bugs)

Deploy a python wheel task using named parameters.

Your Environment

  • dbx version used: 0.8.15
  • Databricks Runtime version: 12.2 LTS