spotify/scio

Issues

• Version 0.14.8 NoMethodError on StreamingOperationalLimits requires newer Google API dependency

  #5513 opened 2 months ago by TJC
  8

• Null Pointer Error on Avro to BigQuery load

  #5512 opened 2 months ago by prakharb10
  2

• Benchmark BigTable maxPendingRequests

  #5514 opened 2 months ago by kellen
  0

• Snowflake Support

  #5500 opened 3 months ago by turb
  4

• Increased memory consumption after upgrade from 13.6 to 14.8

  #5499 opened 3 months ago by f-loris
  0

• SCollectionMatcher issue when targeting Java 17+

  #5483 opened 3 months ago by f-loris
  2

• spotify app issue:

  #5481 opened 3 months ago by webbrowser11
  0

• BinaryIO reads break when file size > 64 MB

  #5472 opened 3 months ago by clairemcginty
  1

• E

  #5470 opened 4 months ago by Apestosimpson
  0

• error message for partitionByKey makaes debugging a bit difficult

  #5468 opened 4 months ago by snallapa
  1

• Improve data colocation support for Parquet writes

  #5466 opened 4 months ago by clairemcginty
  0

• Support for Kafka

  #5433 opened 5 months ago by gmjohnsonjh
  1

• Add Errorhandling to BigTableIO

  #5440 opened 5 months ago by dt-sp
  1

• Benchmark Vectored IO support for scio-parquet/scio-smb

  #5430 opened 5 months ago by clairemcginty
  1

• Importing protobuf Any breaks coder derivation

  #5410 opened 5 months ago by kellen
  0

• Add a utility helper for testing Parquet Projections/FilterPredicates

  #5296 opened 6 months ago by clairemcginty
  1

• Label SMB Reads with metadata about SortedBucketIO class

  #5389 opened 7 months ago by clairemcginty
  0

• typedSparkeySideInput cannot load null values into cache

  #5386 opened 7 months ago by snallapa
  1

• Integration with OpenTelemetry

  #5379 opened 7 months ago by damjad
  4

• AvroCoder fails on nullable Decimal types w/ Avro 1.11.3

  #5331 opened 7 months ago by clairemcginty
  1

• Allow largeHash* and sparkey methods to set a byte size target

  #5355 opened 8 months ago by kellen
  0

• Deadlock in AsyncLookupDoFn

  #5150 opened 8 months ago by RustedBones
  1

• Improve memory usage in scio-extra's sortValues API

  #5338 opened 8 months ago by clairemcginty
  0

• Taps with PubsubIO

  #5232 opened 9 months ago by albertols
  2

• Improve error message when sparkey hits array-size limits

  #5300 opened 9 months ago by kellen
  0

• distinctBy and distinctByKey trigger warning about combineByKey

  #5294 opened 9 months ago by turb
  1

• Better projection support for Parquet SMB reads

  #5303 opened 9 months ago by clairemcginty
  0

• Make SplittableDoFn the default Parquet read implementation

  #5129 opened 9 months ago by clairemcginty
  2

• TransformOverride#ofSource fails with empty Seq input

  #5290 opened 9 months ago by clairemcginty
  0

• SMB writes with CharSequence key can't be read with

  #5285 opened 9 months ago by clairemcginty
  0

• IntelliJ complains about lack of implicit Coders (bug introduced in Scio 0.14)

  #5243 opened 10 months ago by TJC
  1

• Add option for SMB joins to fall back to regular joins

  #5266 opened 10 months ago by clairemcginty
  0

• SmbIO doesn't work when SortedBucketTransforms have SideInputs

  #5240 opened 10 months ago by clairemcginty
  0

• Could we add `SchemaUpdateOption` param to BQ WriteParam?

  #5168 opened a year ago by arthurenc
  1

• ParquetAvroTap does not set projection or dataSupplier

  #5114 opened 10 months ago by clairemcginty
  2

• ParquetAvroFileOperations does not set dataSupplier

  #5115 opened 10 months ago by clairemcginty
  0

• Support Taps for SMB writes/transforms

  #5080 opened a year ago by clairemcginty
  1

• Serialize BucketMetadata#HashType as String?

  #5193 opened a year ago by clairemcginty
  0

• CsvIO limitation of HeaderDecoder and RowDecoder

  #5177 opened a year ago by albertols
  2

• Flaky test in ParquetExampleIOTest

  #5099 opened a year ago by kellen
  0

• Expose extendedErrorInfo in all BQ APIs

  #5103 opened a year ago by RustedBones
  0

• ByteArrayCoder sometimes produces encodings that match Deflate Codec header

  #5147 opened a year ago by clairemcginty
  0

• com.spotify.scio.bigquery.client.BigQuery.defaultInstance().run does not respect destinationTable=null setting for UML

  #5136 opened a year ago by fallonchen
  1

• StorageUtil.toTableSchema fails on BigNumeric BQ column

  #5131 opened a year ago by shnapz
  0

• ParquetAvroDynamicTest is flaky

  #5142 opened a year ago by clairemcginty
  2

• Support setting numShards > 1 in SMB transforms

  #5151 opened a year ago by clairemcginty
  0

• Using sparkey largeHashIntersectByKey blocks pipeline on Dataflow v1

  #5112 opened a year ago by RustedBones
  0

• Document BigTableDoFn

  #5105 opened a year ago by kellen
  0

• Support projections in ParquetAvroFileOperations/ParquetAvroSortedBucketIO

  #5082 opened a year ago by clairemcginty
  1

• Flaky test in SCollectionTest

  #5096 opened a year ago by RustedBones
  0