apache/seatunnel

COMMON-08", "Sql operation failed, such as (execute,addBatch,close) etc...

Opened this issue · 0 comments

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

There is an issue with querying SQL or a null value in a partition field, which did not synchronize successfully, but the program did not throw an exception

SeaTunnel Version

2.3.3

SeaTunnel Config

env{
spark.executor.memory=5g
job.mode="BATCH"
}
source{
Jdbc{
password="xxxxxx"
driver="org.postgresql.Driver"
query="select C_AGENCYNO,C_NAME,C_CODE from view_tablename"
result_table_name="t1"
parallelism=3
partition_column="C_AGENCYNO"
partition_num=3
user="xxxx"
url="jdbc:postgresql://192.168.10.34:54321/data"
}}

transform {}

sink{
Hive {
hdfs_site_path="/etc/hadoop/conf.cloudera.hdfs/hdfs-site.xml"
have_partition=false
source_table_name="t1"
metastore_url="thrift://192.168.1.23:9083"
table_name="test.tabe1"
}
}

Running Command

spark2.4.5

Error Exception

errer: BatchPartitionReader execute failed

Zeta or Flink or Spark Version

spark2.4.5

Java or Scala Version

java 8 scala 2.12

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct