AbsaOSS/spark-metadata-tool

Add logging

Closed this issue · 3 comments

We should provide some useful output to help track progress of the running job(e.g. which files are being processed). It can be brief with more detailed logging triggered by verbose and/or debug flags. Logging to STDO should be sufficient.

The tool uses V2 of the AWS SKD, so it should actually be Slf4j https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/logging-slf4j.html

Oh I see. Awesome!