mjakubowski84/parquet4s
Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
ScalaMIT
Issues
- 4
- 3
Possiblity to write avro IndexedRecords to Parquet using ParquetStreams
#349 opened by dahiyahimanshu - 1
Partitions with nested directories return zero rows
#352 opened by egorsmth - 1
Support vectored io introduced in Parquet 1.14
#345 opened by mjakubowski84 - 2
Efficent way to read big files?
#347 opened by egorsmth - 4
[Question] get a listing of parquet files?
#341 opened by calvinlfer - 1
[Question] Is there a mechanism to detect when the `rotatingWriter` finishes writing to a file and to be notified of the file that was written?
#344 opened by calvinlfer - 2
Unsure how to use for 'semiauto' approach
#327 opened by stacycurl - 2
- 5
Feature request: Expose partitions as a `Stream[F, Stream[F, Record]]` for FS2
#336 opened by calvinlfer - 7
Incorrect value after reading parquet
#338 opened by JstFlip - 3
compatible parquet-hadoop with spark3.1
#325 opened by conderls - 2
[RFC] Refactor timestamp codecs
#333 opened by flipp5b - 1
ParquetSchemaResolver test fails on recent JVMs
#328 opened by i10416 - 1
- 1
Reading from gcs bucket
#321 opened by Nabil272 - 3
Protobuf enums deserialisation
#324 opened by struong - 4
missing tail records of large(~193M) parquet files
#323 opened by conderls - 5
`ParquetReader.projectedGeneric` does not work when selecting more than one column from a same group
#319 opened by tyoras - 4
Add Pekko support
#313 opened by mariadroman - 5
failed to read parquet generated by pandas
#312 opened by conderls - 2
- 6
An example for writing a required or optional value codec for custom type with more than one field.
#304 opened by Eli-Golin - 4
Feature Request: scalapb support
#303 opened by huajiang-tubi - 1
Options `ParquetFileWriter.Mode.OVERWRITE` not deleting old parquet files in S3
#311 opened by jeet23 - 4
Create Parquest Content As Byte Array
#274 opened by kirankbs - 8
- 1
Expose all new Parquet options in Options
#278 opened by mjakubowski84 - 4
Support for map Parquet legacy format
#279 opened by smf-srogozins - 1
- 8
Feature Request: parquet-protobuf
#284 opened by jtjeferreira - 3
- 1
[question] is there a way to have a single parquet writer that writes for a class hierarchy?
#298 opened by normana400 - 1
[question] is there a clever way to register writers for lots of case classes
#299 opened by normana400 - 6
- 4
- 5
- 4
Some of FilteringSpec tests fail when run locally
#288 opened by flipp5b - 9
Concurrently read and write files with parquet4s-fs2
#285 opened by flipp5b - 2
update to hadoop 3.3.4
#282 opened by anina-percipient - 4
- 5
- 2
Read Schema of parquet file
#276 opened by ChrisMuki - 1
Output path's for files in partition
#273 opened by MaksGS09 - 1
Writing a parquet file inside a MinIO bucket.
#275 opened by mouhagaye - 12
NullPointerExceptipn when calling postStop()
#268 opened by SnipyJulmy - 1
Possible to use this in java ?
#269 opened by leryss - 1
- 7
Not receiving all records from partitioned files
#260 opened by samirbajaj - 2
Multiple custom TypedSchemaDefs are ambiguous
#258 opened by Jasper-M