vmware/versatile-data-kit

Issues

• Configure Auth for the operationsUI when VDK is running on AWS (CSP can be the auth provider)

  #3211 opened 3 months ago by murphp15
  0

• vdk-core: extend configuration to all hooks

  #3210 opened 3 months ago by DeltaMichael
  0

• Upgrade VDK to support kuberentes 1.28

  #3207 opened 3 months ago by murphp15
  0

• Test and Document sending logs to AWS cloud watch

  #3197 opened 3 months ago by murphp15
  0

• [SPIKE] vdk-redshift: Redshift plugin spike

  #3183 opened 3 months ago by DeltaMichael
  0

• Submit abstract GPU Resource Management on the VDK proposal for internal review

  #3192 opened 3 months ago by duyguHsnHsn
  0

• Enable auth in VDK on AWS (use CSP as auth provider)

  #3206 opened 3 months ago by murphp15
  0

• vdk-core: add abstract validate, decorate, execute and recover methods to ManagedConnectionBase

  #3161 opened 3 months ago by DeltaMichael
  0

• source location of datajob sourcecode in UI is slightly wrong

  #3199 opened 3 months ago by murphp15
  0

• Submit GPU Resource Management VDK proposal for internal review

  #3172 opened 3 months ago by murphp15
  0

• vdk-oracle: test removing commit from ingest_payload

  #3155 opened 3 months ago by DeltaMichael
  1

• vdk-core: create new connection hookspec that doesn't expose a cursor

  #3163 opened 3 months ago by DeltaMichael
  0

• vdk-plugins: survey usage of the existing connection hookspec

  #3162 opened 3 months ago by DeltaMichael
  1

• vdk-oracle: remove secrets config in favour of secrets overrides from vdk-core

  #3156 opened 3 months ago by DeltaMichael
  0

• vdk-oracle: rely on vdk-core secrets instead of oracle-specific implementation

  #3182 opened 3 months ago by DeltaMichael
  0

• vdk-plugins: work around caching values from config options

  #3180 opened 3 months ago by DeltaMichael
  0

• VDK server -i is failing silently

  #3179 opened 3 months ago by murphp15
  1

• Create a demo of reading from kafka in a data job

  #3140 opened 3 months ago by murphp15
  0

• When number of pods is set in the config.ini it should propagate to the API

  #3138 opened 3 months ago by murphp15
  0

• [SPIKE] Research LLMs and RAG

  #3092 opened 4 months ago by DeltaMichael
  0

• Find a kafka instance to use or create one if there are none available

  #3141 opened 3 months ago by murphp15
  0

• Number of pods used by a cron job should be configurable through the DataJobDeploymentController

  #3137 opened 3 months ago by murphp15
  0

• vdk-core: create one-pager for ingestion into multiple databases of the same type

  #3129 opened 3 months ago by DeltaMichael
  0

• vdk-core: remove connection hookspec

  #3164 opened 3 months ago by DeltaMichael
  0

• Support internal customers migrating to open source VDK

  #3178 opened 3 months ago by murphp15
  0

• vdk control service installation bug

  #3173 opened 3 months ago by ehsan-farzadnia
  3

• [spike] Add support for pandas data frame for the send_tabular_data_for_ingestion() method.

  #3169 opened 3 months ago by stefan-pulov
  0

• helmchart can't be installed on the latest versions of k8s

  #3177 opened 3 months ago by murphp15
  0

• vdk-oracle: test fetch-ingest scenario with different source and destination

  #3128 opened 3 months ago by DeltaMichael
  0

• vdk-core: create one-pager for connection to multiple databases

  #3166 opened 3 months ago by duyguHsnHsn
  0

• Prepare for community RAG demo

  #3165 opened 3 months ago by gageorgiev
  0

• Wiki: team feedback

  #3095 opened 3 months ago by zverulacis
  3

• Record the demo

  #3149 opened 3 months ago by murphp15
  0

• Prepare slides for Demo on benefits of using VDK

  #3146 opened 3 months ago by murphp15
  0

• [SPIKE] Create an example of writing to postgres using LLamaIndex

  #3150 opened 3 months ago by murphp15
  3

• Deploy a RAG pipeline to a VDK cluster

  #3148 opened 3 months ago by murphp15
  4

• Build a jobs in python not using VDK that will be used for the first section of the demo

  #3147 opened 3 months ago by murphp15
  1

• [SPIKE] Document expected changes to Execution API when using multi pod instances

  #3158 opened 3 months ago by murphp15
  0

• Document expected changes to VDK UI when using multi pod instances

  #3159 opened 3 months ago by murphp15
  0

• The DataJobKubernetesService should configure the number of pods deployed based on configuration in DataJobDeployment

  #3139 opened 3 months ago by murphp15
  0

• Build a data job with larger python dependencies like sentence-transformers

  #3142 opened 3 months ago by murphp15
  2

• Spike: Move away from VDP on AWS

  #3145 opened 3 months ago by stefan-pulov
  0

• vdk-ingest-http: Support for Python 3.12

  #3153 opened 3 months ago by gageorgiev
  0

• Investigate how much work is required to support multi pod data jobs

  #3133 opened 3 months ago by murphp15
  0

• With the latest version of job-builder image vdk server doesn't work

  #3132 opened 3 months ago by murphp15
  0

• Refine the text cleaning before embedding the documents in the RAG pipeline

  #3089 opened 3 months ago by yonitoo
  0

• vdk-dag logs with structlog defaults are very hard to read

  #3126 opened 4 months ago by antoniivanov
  0

• non-run CLI commands log output without context

  #3105 opened 4 months ago by antoniivanov
  0

• Implement state management for incremental data fetch in Confluence data source plugin

  #3100 opened 4 months ago by duyguHsnHsn
  0

• CI/CD On-Call

  #3091 opened 4 months ago by DeltaMichael
  0