logstash-plugins/logstash-output-google_bigquery

json_schema or csv_schema on pre-made partitioned table

Opened this issue · 0 comments

Hi all,

Is it possible for projects that use pre-made partitioned tables to disable the requirement for either json or csv schema to be provided? We don't want the plugin to create any tables, we just want it to post to the ones already created. The way I am currently pushing to bigquery is by setting the date and separator to empty and using the "prefix" as table name, which doesn't sound right to me, but was the only way to make it work. Now I need to create the partitioned table in BQ, but also add the structure in logstash config as well.

If the above is not possible - can we at least get options for the table partitioning ?

Using Logstash 6.8 by the way.