[Core] ImportError: cannot import name 'ThreadpoolController' from 'threadpoolctl' on Databricks

[michal-mmm]

What happened + What you expected to happen

Latest release of statsforecast==1.7.7 and higher does not work with Databricks correctly.

ImportError: cannot import name 'ThreadpoolController' from 'threadpoolctl' (/databricks/python/lib/python3.10/site-packages/threadpoolctl.py)

It might be a Databricks issue (most likely) but I'm reporting it here too. Downgrading the statsforecast to 1.7.6 fixes the import:

Versions / Dependencies

Click to expand

Dependencies: statsforecast==1.7.7 and (Databricks ML Runtime 14.3 LTS or Databricks Runtime 13.3 LTS)

Reproducible example

from statsforecast import StatsForecast

Issue Severity

Low: It annoys or frustrates me.

[dgarridoa]

Upgrading threadpoolctl, for instance, to 3.5.0 solves the issue. I also had some pipelines fail in Databricks, for example, dbr 13.3 ml uses threadpoolctl==2.2.0, using that version you can replicate the error locally.