ZuInnoTe/spark-hadoopoffice-ds

How do i get a schema that's all String with "read.spark.simpleMode"

Closed this issue · 2 comments

I try to get data with "read.spark.simpleMode", but i get a "java.lang.NumberFormatException"
the schema is
root
|-- c0: string (nullable = true)
|-- c1: string (nullable = true)
|-- c2: long (nullable = true)
|-- c3: string (nullable = true)
|-- c4: string (nullable = true)
|-- c5: string (nullable = true)
|-- c6: long (nullable = true)
|-- c7: string (nullable = true)
|-- c8: string (nullable = true)
|-- c9: long (nullable = true)
|-- c10: string (nullable = true)
|-- c11: string (nullable = true)
|-- c12: string (nullable = true)
|-- c13: decimal(6,3) (nullable = true)
|-- c14: string (nullable = true)
|-- c15: string (nullable = true)
|-- c16: string (nullable = true)
|-- c17: string (nullable = true)

i want to get a schema that's all String. thanks

or how can i get data without "read.spark.simpleMode"
i use "res0.rdd.map{r => r.get(0)}.take(1)" and i get "Array(WrappedArray([PrizeType,,,A1,xxx], [PrizeTime,,,B1,xxx] ....etc"

i get it! i get some message from closed issues, and i try create a custom schema.it works!
thank your perfect program and thank you very much!