Azure/spark-cdm-connector

Issues

• [FeatureRequest] Support for Spark 3.4+ and Microsoft Fabric

  #152 opened 6 months ago by gbrueckl
  0

• [Issue] Releases are missing from Maven

  #142 opened a year ago by carlo-quinonez
  1

• [Issue] Cannot read data when using Databricks Unity Catalog

  #149 opened a year ago by JulesHuisman
  12

• [Issue] Problem datetime format read in spark connector

  #151 opened 8 months ago by kaomiza
  0

• [Issue] Could not read '/foundations.cdm.json'

  #150 opened 9 months ago by PrestonGiorgianni
  3

• Is there any way to use the cdm connector in Delta Live Tables?

  #148 opened a year ago by HoergerL
  1

• [Enhansement] Support local directory

  #147 opened a year ago by scrmz
  0

• [Issue] Issue with connecting to ADSLG2 from Databricks

  #145 opened a year ago by cegladanych
  1

• Can't read lower level manifest even though useSubManifests is set to true

  #146 opened a year ago by brian-custer
  0

• Unable to connect to ADLS Gen2 using Azure Databricks

  #144 opened a year ago by M1ckB
  2

• [Issue] Clarification on setting up Databricks managed identity

  #143 opened a year ago by petermcclanahan
  1

• How to handle binary datatype while using Spark CDM connector in Azure Synapse Analytics

  #141 opened a year ago by sultanmkhan
  0

• [Issue]reading error "AnalysisException: Manifest doesn't exist: model.json"

  #139 opened a year ago by clairezhuang
  0

• [Bug] Spark 3.3: Reading a table gives: java.util.NoSuchElementException: None.get

  #138 opened a year ago by kecheung
  1

• [Issue] AzureCredentialNotFoundException: Could not find ADLS Gen2 Token

  #134 opened a year ago by kecheung
  1

• Notice / Common Errors

  #118 opened 2 years ago by kecheung
  0

• Databricks batch mode - AzureCredentialNotFoundException: Could not find ADLS Gen2 Token.

  #108 opened 2 years ago by dynarch
  2

• CDM read inference failing: The number of columns in CSV/parquet file is not equal to the number of fields in Spark StructType.

  #84 opened a year ago by drinkingbird
  5

• Databricks Spark 3.x "doesn't work" / java.lang.NoClassDefFoundError: org/apache/spark/sql/sources/v2/ReadSupport

  #92 opened 2 years ago by pavanreddy88
  3

• Schema drift: The number of columns in CSV/parquet file is not equal to the number of fields in Spark StructType.

  #86 opened 2 years ago by rgk85
  1

• java.lang.NoClassDefFoundError: org/apache/spark/sql/sources/v2/ReadSupport

  #119 opened 2 years ago by BenConstable9
  1

• Databricks 10.5/Spark 3.2.1: java.lang.NoClassDefFoundError: org/apache/spark/sql/sources/v2/ReadSupport

  #94 opened 2 years ago by NitinSingh12
  1

• [Issue] Exception: The number of columns in CSV/parquet file is not equal to the number of fields in Spark StructType

  #130 opened a year ago by SpanTag85
  1

• The dataframe schema and cdm schema don't have an equal number of fields. Entity Path: "Contact"

  #121 opened 2 years ago by BenConstable9
  5

• NoSuchTableException: Manifest doesn't exist. root.manifest.cdm.json #Spark3.2.1 jar #Databricks

  #124 opened 2 years ago by RushikeshGuajr
  2

• Cannot read column with two different date formats

  #122 opened 2 years ago by RithwikChhugani
  6

• How to avoid the binary type?

  #120 opened 2 years ago by Mineleo0722
  0

• Using spark cdm connector without a manifest file

  #114 opened 2 years ago by RithwikChhugani
  3

• Error while connecting to model.json using spark pools on azure

  #113 opened 2 years ago by RithwikChhugani
  1

• NullPointerException : - The Spark SQL phase planning failed with an internal error. Please, fill a bug report in, and provide the full stack trace.

  #112 opened 2 years ago by IVAGIt2019
  0

• StatusCode=403 StatusDescription=This request is not authorized to perform this operation using this permission.

  #91 opened 2 years ago by poggio84
  1

• Databricks Spark 2.4: java.lang.NoClassDefFoundError: org/apache/spark/sql/connector/catalog/SupportsCatalogOptions

  #111 opened 2 years ago by dynarch
  1

• Release of version 1.19.2

  #93 opened 2 years ago by LauJohansson
  1

• Spark CDM connector v1.19.2 throws "Manifest does not exists" message

  #90 opened 2 years ago by asharma1992
  3

• Does this connector work for open source Spark?

  #88 opened 2 years ago by RedwanAlkurdi
  7

• default.manifest.cdm.json not getting created

  #89 opened 2 years ago by wiyi123
  2

• TextParsingException for large columns. Unable to set univocity parser settings.

  #77 opened 3 years ago by drinkingbird
  6

• CDM DataBricks ERROR java.lang.RuntimeException: Manifest doesn't exist: model.json

  #73 opened 3 years ago by Yeheyesl
  3

• Spark-cdm-connector 0.19.1 - java.lang.NoClassDefFoundError: org/apache/spark/sql/sources/v2/ReadSupport

  #74 opened 3 years ago by islamtg
  7

• Json type not supported by spark cdm connector

  #83 opened 3 years ago by asharma1992
  2

• Attaching to the CDM Folder as external tables in Synapse db

  #76 opened 3 years ago by colinrippeyfinarne
  2

• Cannot be used in Azure China

  #72 opened 3 years ago by simonzhaoms
  2

• Unable to read from secondary endpoint

  #82 opened 3 years ago by bguidinger
  0

• Implicit Parquet format reading from ADLSGen2 throws Null pointer exception

  #81 opened 3 years ago by Prakash5Github
  0

• java.lang.Exception: CdmCorpusDefinition | Duplicate declaration for item: '/entityName/LogicalDefinition/entityName.cdm.json/entityName/hasAttributes/columnName'

  #80 opened 3 years ago by absognety
  1

• The specified resource name contains invalid characters

  #79 opened 3 years ago by GDR88
  2

• Could not find ADLS Gen2 Token when running as Job

  #67 opened 3 years ago by fvalencia12
  7

• Error while reading CDM Entity previously created from ADF

  #65 opened 3 years ago by oxsmose
  4

• Error in - Explicit write, creating an entity in a CDM folder based on a pre-defined model

  #71 opened 3 years ago by sathya1972
  11

• Exception when writing an empty dataframe to cdm using Spark CDM connector

  #70 opened 3 years ago by absognety
  1