GoogleCloudDataproc/hadoop-connectors

Issues

• Can't run GRPC on dataproc due to error: java.lang.NoClassDefFoundError: io/opentelemetry/api/OpenTelemetry

  #1269 opened a month ago by surjikal
  0

• Allow different GCP credentials for reading and writing in the same Spark Session

  #1249 opened 3 months ago by sid-habu
  1

• Could not read CSV files

  #1259 opened 2 months ago by MhdMousaHAMAD
  1

• Issue with cached credentials when attempting to use different keyfiles in the same Spark App

  #1009 opened 2 years ago by josecsotomorales
  2

• d

  #1245 opened 3 months ago by AngusDavis
  0

• Could not initialize class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration

  #1233 opened 4 months ago by lvijnck
  1

• GCS connector throws rate limit errors

  #1231 opened 5 months ago by krisnaru
  0

• gcs-connector- CVE

  #1221 opened 5 months ago by sdkaarush
  0

• hadoop3-2.2.22 and hadoop3-2.2.23 throws NoSuchMethodError at ServiceOptions.getService

  #1206 opened 5 months ago by ebyhr
  0

• Unauthorized access on gRPC via DirectPath have issues

  #998 opened 6 months ago by singhravidutt
  1

• BQ storage libray blocked on update to grpc v1.56

  #1020 opened 6 months ago by singhravidutt
  1

• Conversion from InputStream -> ByteBuffer on gRPC writes creates many byte[] allocations.

  #1123 opened 6 months ago by frankyn
  2

• Bug in `GoogleCloudStorageReadChannel` can cause an infinite loop

  #1180 opened 6 months ago by rathinb-db
  0

• gcs-connector-3.0.0-shaded CVEs

  #1114 opened 10 months ago by wendigo
  1

• gcs-connector:3.0.0 failing due to certificate when accessing to GCS from Github runner with WIF configuration

  #1106 opened 10 months ago by elvin-sadigov-db
  7

• How can I sink GCS connector metrics into GCP Cloud Monitor?

  #1118 opened 9 months ago by PotatoDoggie
  2

• globStatus should prioritize server-side filtering over listing all files and performing local matches

  #1122 opened 10 months ago by evgeniy-b
  0

• gcs-connector 3.0 not working with pyspark

  #1099 opened 10 months ago by GergelyKalmar
  5

• Feature request: automatic identity deduction a la google.auth.default()

  #1109 opened 10 months ago by danking
  0

• Support disabling automatic decompression of gzip files in GCS connector

  #1060 opened a year ago by blackvvine
  0

• GhfsStorageStatistics cannot be cast ERROR

  #1052 opened a year ago by SurajAralihalli
  9

• Question: How to use gcs-connector on GKE with Workload Identity

  #1019 opened a year ago by aristapimenta
  1

• GCS Connector fails with StackOverflowError during accessing hadoop credentials

  #1039 opened a year ago by daichi-m
  0

• how to transfer file from local to gcs bucket using dataproc hadoop in intellij

  #1031 opened a year ago by bhanuprasad1
  0

• flumk sink hdfs to gcs, all gcs write thread blocked

  #1029 opened a year ago by Maplejw
  0

• Memory issues while running Apache Spark streaming applications on Google Dataproc cluster | OutOfMemoryError Java heap space

  #1026 opened a year ago by Sujay39
  0

• GoogleCloudStorageFileSystem#delete recursive does not page

  #1022 opened a year ago by mswintermeyer
  0

• Test failures after HADOOP-18724

  #1014 opened a year ago by mukund-thakur
  0

• GCS connectors 2.1.8 and 2.2.7 are not allowing user authentication

  #864 opened 2 years ago by shnapz
  3

• DirectPath Unauthorized access issues using java-storage

  #993 opened 2 years ago by singhravidutt
  0

• GCS Connector sending generationMatch = 0 for existing objects

  #976 opened 2 years ago by mudit-97
  7

• Writing single file ended with ~9 GCS calls

  #975 opened 2 years ago by kobi-lemberg
  0

• We used a vulnerability scanning tool （SecBinaryCheck）to scan gcs-connector-hadoop3-2.2.6-shaded.jar and found high-risk security vulnerabilities. Is this an issue？?

  #960 opened 2 years ago by Huo662329
  1

• DirectPath have issues with CloudBuild

  #956 opened 2 years ago by singhravidutt
  0

• Unable to read data from public access bucket

  #924 opened 2 years ago by nicojord
  2

• GCS: How to get rid of or better yet not have _temporary data?

  #868 opened 2 years ago by simonvanderveldt
  1

• Reenable `GoogleCloudStorageGrpcIntegrationTest#testOpenLargeObject` test

  #880 opened 2 years ago by arunkumarchacko
  0

• GCS Connector throwing exception when given path with wildcard

  #797 opened 2 years ago by btusakul-sift
  1

• Can ServiceAccountJsonKeyFile be ignored when ServiceAccountPrivateKeyId is set?

  #925 opened 2 years ago by jhsenjaliya
  1

• Type `com/google/protobuf/GeneratedMessage$GeneratedExtension` (current frame, stack[1]) is not assignable to `com/google/protobuf/ExtensionLite`

  #892 opened 2 years ago by sharan21
  4

• Custom implementation of AccessTokenProvider doesn't work according to 2.2.10 documentation.

  #926 opened 2 years ago by akalotkin
  2

• Connectors hadoop3-2.2.8+ are incompatible with latest version of spark-sql (3.3.1)

  #912 opened 2 years ago by bsenyshyn
  3

• Support for Application Default Credentials

  #915 opened 2 years ago by mremdeC
  1

• CSEK support for per bucket/object level

  #913 opened 2 years ago by giftbowen
  0

• Hadoop FileSystem delete method returns false even though file is actually deleted

  #909 opened 2 years ago by selimelawwa
  0

• Performance degradation when upgrading 3-2.2.8

  #891 opened 2 years ago by selimelawwa
  1

• Support existing access token when using UserCredentials auth type

  #869 opened 2 years ago by qcastel
  0

• Integration test flakiness

  #834 opened 2 years ago by singhravidutt
  2

• Allow 2.x versions of the connector to use private token endpoints

  #811 opened 2 years ago by KoopaKing
  2

• Broken links on maven repository for com.google.cloud.bigdataoss:util

  #800 opened 3 years ago by weiminyu
  2