AbsaOSS/spark-metadata-tool
Tool to fix _spark_metadata from Structured Streaming queries
ScalaApache-2.0
Issues
- 1
Improve code-coverage & add GH check action
#59 opened by miroslavpojer - 1
Create _spark_metadata
#55 opened by jozefbakus - 1
Add code coverage support
#51 opened by miroslavpojer - 0
- 0
Show inconsistencies between data and metadata
#49 opened by jozefbakus - 0
Upgrade log4j to 2.15.0
#44 opened by kevinwallimann - 0
- 0
Verify content of the files
#41 opened by jozefbakus - 2
Metadata merge extension
#31 opened by jozefbakus - 0
HDFS Support
#5 opened by DoktorZhor - 1
- 0
Tests are executed twice during release
#36 opened by DoktorZhor - 0
Add .github meta files
#12 opened by Zejnilovic - 0
Documentation
#7 opened by DoktorZhor - 0
Add a dry run feature
#15 opened by Zejnilovic - 3
Add logging
#4 opened by DoktorZhor - 1
DRAFT ISSUE: Merge spark metadata
#30 opened by kevinwallimann - 0
Keep field order in metadata JSON
#8 opened by DoktorZhor - 0
Unix file manager - implement backup logic
#20 opened by DoktorZhor - 0
Use GitHub actions token in workflows
#25 opened by DoktorZhor - 0
Implement assembly logic
#2 opened by DoktorZhor - 0
Implement file backup
#3 opened by DoktorZhor - 1
S3 support
#6 opened by DoktorZhor - 0
Derive filesystem from path
#10 opened by DoktorZhor - 0
fixPath breaks idempotence
#13 opened by DoktorZhor - 0
Refactor tool to use NonEmptyX types
#21 opened by DoktorZhor