Dremio Plugin for Intake based on pyarrow Flight
To install the intake-dremio plugin, execute the following command
conda install -c conda-forge intake-dremio
or:
pip install intake-dremio
An Intake catalog referencing a Dremio dataset consists of the uri
pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr
), e.g.:
sources:
dremio_vds:
driver: dremio
args:
uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010
sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC