astronomer/astro-sdk

improve transform operator

phanikumv opened this issue · 0 comments

Please describe the feature you'd like to see
While using the transform operators there are a lot of automated queries that run to check the schema and information in snowflake. Are all of those really necessary all the time? Sometimes those are the queries that take too long to execute.
We need to disable these

https://astronomer.slack.com/archives/C02B8SPT93K/p1682378438764019

Describe the solution you'd like
A clear and concise description of what you want to happen, if possible with code examples.

Are there any alternatives to this feature?
Is there another way we could solve this problem or enable this use-case?

Additional context
Add any other context about the feature request here.

Acceptance Criteria

  • All checks and tests in the CI should pass
  • Unit tests (90% code coverage or more, once available)
  • Integration tests (if the feature relates to a new database or external service)
  • Example DAG
  • Docstrings in reStructuredText for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
  • Exception handling in case of errors
  • Logging (are we exposing useful information to the user? e.g. source and destination)
  • Improve the documentation (README, Sphinx, and any other relevant)
  • How to use Guide for the feature (example)