DTStack/flinkStreamSQL

【2021-03-02】FlinkSteamSQL增加资源校验,增加errorLimit参数控制表失败条数

FlechazoW opened this issue · 0 comments

对rdb相关插件做资源校验,在使用前检查

  • 数据源是否可用;
  • 当前用户是否有对应权限(side需要select权限,sink需要insert权限);
  • 执行过程中表结构改变任务失败;

增加errorLimit参数,控制任务过程中,表的失败条数

CREATE TABLE DimOne
(
    id    int,
    age   bigint,
    name  varchar,
    birth timestamp,
    -- PRIMARY KEY (id, age, name),
    PRIMARY KEY (),
    -- PERIOD FOR SYSTEM_TIME
    period for system_time
) WITH (
      type = 'mysql',
      url = 'jdbc:mysql://k3:3306/tiezhu?useSSL=false',
      userName = 'root',
      password = 'xxxxx',
      tableName = 'TestOne',
      parallelism = '1',
      cache = 'LRU',
      asyncCapacity = '100',
      asyncTimeout = '1000',
      errorLimit = '10',
      cacheTTLMs = '1000'
);

当前表dim如果失败条数达到10,那么任务将失败;