datayoga-io/datayoga

Issues

• `relational.write`: Handle MySQL server lost errors (CR_SERVER_LOST, etc.) as ConnectionError

  #379 opened a month ago by spicy-sauce
  0

• `relational.write` - When a batch fails, insert the records one by one

  #378 opened 3 months ago by spicy-sauce
  0

• `redis.read_stream` producer sends messages one by one, should be in batches based on batch_size arg

  #377 opened 3 months ago by spicy-sauce
  0

• `relational.write` - SQL statements are executed individually instead of in bulk for MySQL

  #373 opened 4 months ago by spicy-sauce
  1

• `relational.write` - `ConnectionError` is thrown wrongly due to other DB errors

  #369 opened 5 months ago by spicy-sauce
  0

• `relational.write` - Malformed MERGE statement for Oracle and SQLServer for multiple keys

  #367 opened 8 months ago by spicy-sauce
  0

• Build connections jsonschema and use it in schemastore catalog

  #360 opened 10 months ago by spicy-sauce
  0

• Jobs should be named as *.dy.yaml

  #358 opened 10 months ago by spicy-sauce
  0

• Build job's `full_schema.json` with all the supported blocks

  #356 opened 10 months ago by spicy-sauce
  1

• kafka.auth SASL_PLAINTEXT, basic auth etc

  #353 opened a year ago by wheelly
  0

• Adapt intergration-tests to run under docker

  #352 opened a year ago by wheelly
  3

• Add AWS S3 Connector

  #351 opened a year ago by Idank96
  0

• Add comprehensive README to Dev

  #350 opened a year ago by Idank96
  0

• `relational.write` - case sensitivity issue for column matching #349

  #348 opened a year ago by spicy-sauce
  0

• `relational.write` - schema should not be required

  #343 opened a year ago by spicy-sauce
  0

• `redis.lookup` - pipeline is executed with transaction=True leads to CROSSSLOT issue

  #346 opened a year ago by spicy-sauce
  0

• `relational.write` - DB2 connector

  #341 opened a year ago by spicy-sauce
  0

• `relational.write` - delete and insert strategy for upsert in databases without native merge support

  #344 opened a year ago by spicy-sauce
  0

• `http.write` - bulk operations

  #340 opened a year ago by spicy-sauce
  0

• `http.write` block

  #337 opened a year ago by spicy-sauce
  0

• Enhanced Producer State Management for Incremental Data Retrieval

  #338 opened a year ago by spicy-sauce
  0

• prometheus should not be used directly in core, only in CLI

  #336 opened a year ago by spicy-sauce
  0

• Missing documentation for connection types

  #332 opened a year ago by spicy-sauce
  0

• `add_field` - nested fields when parent key does not exist

  #281 opened a year ago by zalmane
  1

• validate() job/step/block routine

  #327 opened a year ago by vd2org
  0

• Make able to specify `user` for redis related blocks

  #324 opened a year ago by vd2org
  0

• `redis.lookup` block

  #322 opened a year ago by vd2org
  0

• Update certify to ^2023.7.22

  #320 opened a year ago by vd2org
  0

• `from_entries`, `to_entries` and `filter_entries` custom JMESPath functions

  #318 opened a year ago by spicy-sauce
  0

• Make able `Job.transform` to use external event loop

  #316 opened a year ago by vd2org
  0

• Azure Event Hubs Reader

  #314 opened a year ago by spicy-sauce
  0

• base64.decode custom jmespath function

  #311 opened 2 years ago by vd2org
  0

• Demo environment

  #289 opened 2 years ago by vd2org
  0

• demo - enhancements

  #308 opened 2 years ago by spicy-sauce
  0

• Default properties should be derived from the block's JSON schema rather than being hardcoded within the block itself

  #307 opened 2 years ago by vd2org
  0

• Implement http receiver/producer

  #299 opened 2 years ago by vd2org
  0

• `relational.write` - Special cases for Oracle and MSSql server

  #301 opened 2 years ago by spicy-sauce
  0

• Performance issue with SQLA and MySQL 8.0.17+

  #306 opened 2 years ago by vd2org
  0

• Relational: force reset connection pool on error

  #302 opened 2 years ago by vd2org
  0

• relational.read: force reset connection on error

  #305 opened 2 years ago by vd2org
  0

• Implement batch support for the read_csv producer

  #292 opened 2 years ago by vd2org
  0

• Implement a general function generates ID

  #298 opened 2 years ago by vd2org
  0

• relational.write: fallback to process records one by one in case of error

  #287 opened 2 years ago by vd2org
  0

• Implement batch support for the std/read producer

  #296 opened 2 years ago by vd2org
  0

• Implement batch support for the relational/read producer

  #295 opened 2 years ago by vd2org
  0

• Implement batch support for the redis/read_stream producer

  #294 opened 2 years ago by vd2org
  0

• Implement batch support for the parquet/read producer

  #293 opened 2 years ago by vd2org
  0

• Relational Connections: Inherit from Base Schema Rather Than Duplicating

  #286 opened 2 years ago by spicy-sauce
  0

• Relational block: Support for TLS and mTLS

  #279 opened 2 years ago by vd2org
  0

• Introduce `foreach` in `relational.write` for exploding nested data

  #282 opened 2 years ago by spicy-sauce
  0