ClickHouse/spark-clickhouse-connector

Writing StructType to ClickHouse

MohsenIT opened this issue · 1 comments

MohsenIT commented

I want to write a dataframe with struct type column into clickhouse. But it raises an error:
Can't convert 'StructType([StructField('addon_id', StringType(), True), StructField('app_slug', StringType(), True), StructField('token', StringType(), True), StructField('uri', StringType(), True), StructField('in_browser', BooleanType(), True), StructField('addon_position', StringType(), True)])' datatype from spark to clickhouse.

  1. Why struct type does not convert to NestedType/Tuple/Json?
  2. How can we create NestedType/Tuple/ Json Column using spark-clickhouse-connector ?
pan3793 commented

The current implementation has very limited support for complex data types.

  • 😕1