AbePabbathi/lakehouse-tacklebox

TPCDS: add error if catalog doesn't exist

Closed this issue · 1 comments

TPCDS: add error if catalog doesn't exist

This is weirdly unstable. show catalogs sometimes only returns spark_catalog. Given this is not necessary and the user needs to manually resolve anyway, this won't be implemented.

        if spark.sql(f"show catalogs like '{self.catalog_name}'").count() == 0:
            raise NameError(f"{self.catalog_name} does not exist. Please manually create the catalog.")