delta-io/kafka-delta-ingest

Issues

• Schema Registry and Avro Format Deserialization Issues

  #199 opened a month ago by iankittomar
  0

• Writer ignores the table's "delta.dataSkippingStatsColumns" and "delta.dataSkippingNumIndexedCols"

  #189 opened 4 months ago by kpapadatos
  0

• Message consumption error: PollExceeded (Local: Maximum application poll interval (max.poll.interval.ms) exceeded)

  #191 opened 4 months ago by kpapadatos
  2

• Ingest service exited with error DeltaTable { source: Protocol { source: Generic("filed to get tombstones") } }

  #193 opened 3 months ago by kpapadatos
  0

• Write to multiple delta tables from a single topic

  #161 opened a year ago by Kikkon
  4

• Generated checkpoint files are unexpectedly large and potentially broken

  #187 opened 4 months ago by igor-lobanov-maersk
  0

• Checkpoint file creation is skipped on restart

  #184 opened 4 months ago by morgan-soulie
  0

• Build failed on `alpine` because of `rdkafka` `ssl-vendored` instead of `ssl`

  #176 opened 4 months ago by thanhminhmr
  0

• Dockerfile build failure

  #180 opened 4 months ago by giulio1979
  0

• Change transformation log error message from debug to warn level

  #59 opened 3 years ago by mosyp
  0

• Transform failed (using Azure Event Hubs & ADLS Gen 2 storage account)

  #151 opened a year ago by Jaegin
  1

• Remove direct dynamodb lock interactions

  #182 opened 4 months ago by rtyler
  0

• feature request: record metrics and export to prometheus

  #157 opened a year ago by gdubya
  1

• Docker image build can't find `deltalake-core` dependency

  #170 opened 6 months ago by beanscouts
  2

• Documentation to write data to S3

  #166 opened 7 months ago by mayanksingh2298
  7

• What is the documentation to use HMS as the catalog with delta lake on S3?

  #174 opened 7 months ago by alberttwong
  3

• error: future cannot be sent between threads safely -- dead_letters.rs and writer.rs

  #167 opened 9 months ago by clairewood
  1

• Ability to implement on GCP with cloud storage interoperability

  #41 opened 3 years ago by rajatha-ravish
  5

• Put avro support behind an optional feature flag

  #163 opened 10 months ago by rtyler
  1

• Add CONTRIBUTING.md file

  #135 opened 2 years ago by MrPowers
  1

• thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value

  #149 opened a year ago by huyhandes
  3

• Can't write to a table with `DECIMAL(38,0)` field.

  #127 opened 2 years ago by denizsurmeli
  3

• Build Error on Windows Machine: Failed to run custom build command for openssl-sys v0.9.61

  #42 opened 10 months ago by rajatha-ravish
  8

• use of deprecated method `chrono::DateTime::<Tz>::timestamp_nanos`: use `timestamp_nanos_opt()` instead

  #156 opened a year ago by gdubya
  4

• end_at_last_offsets flag is always set

  #158 opened a year ago by kyrre
  1

• Add cron-style "Trigger Once" feature

  #75 opened a year ago by xianwill
  0

• Slack link in the readme is expired

  #143 opened a year ago by lorenzoc25
  0

• No snapshot or version 0 found

  #130 opened 2 years ago by timopetmanson
  6

• Is there support to read images/videos from kafka and push to delta lake

  #148 opened a year ago by asksonu
  2

• unable to run example code: "thread 'main' panicked at 'called `Option::unwrap()` on a `None` value', src\main.rs:91:18"

  #146 opened a year ago by clairewood
  2

• Getting "unexpected argument" error for all argument IDs when running KDI

  #144 opened a year ago by clairewood
  3

• Add in logic for "Create Delta Table if not exist"

  #116 opened 3 years ago by mdrakiburrahman
  2

• Remove clap_app macro and use builder syntax

  #133 opened a year ago by rportilla-databricks
  1

• Kafka client collaboration

  #122 opened 2 years ago by crepererum
  3

• Please change address of arrow rust in DESIGN.md, currently getting error 404

  #53 opened 2 years ago by MironAtHome
  0

• Question: How to use an EC2 Instance role for accessing S3/DynamoDB?

  #111 opened 2 years ago by xenji
  1

• Fix the encoding for special cases

  #85 opened 2 years ago by mosyp
  1

• To connect with aws

  #126 opened 2 years ago by binodyadav6119
  1

• Remove some annoying debug messages

  #60 opened 2 years ago by mosyp
  1

• Provide the simplest possible install and getting started instructions

  #138 opened 2 years ago by rtyler
  0

• Possibility of adding Python bindings to this project

  #124 opened 2 years ago by MrPowers
  4

• Run latency timer on an interval (instead of on message received)

  #74 opened 2 years ago by xianwill
  0

• How to ingest the key?

  #117 opened 2 years ago by rymail
  1

• no support for gzip?

  #89 opened 3 years ago by bbigras
  2

• Kafka-connect sink connector

  #51 opened 3 years ago by raphaelauv
  4

• Keep dead_letters table/client on demand

  #93 opened 3 years ago by mosyp
  1

• Find a way to run integration tests in parallel

  #100 opened 3 years ago by mosyp
  0

• Log and send to stats handler the average message size

  #62 opened 3 years ago by mosyp
  1

• Consumer cannot reseek back to offset 0 on conflict resolution

  #67 opened 3 years ago by mosyp
  1

• Handling null partition values on write

  #52 opened 3 years ago by houqp
  0