/pyspark_bdd_pipenv

Pyspark BDD examples using PipEnv

Primary LanguagePython

Pyspark BDD Features

Following feature items abide the following BDD design philosophy.

Given(Arrange) -> When(Act) -> Then(Assert)

  1. Basic Pyspark
  2. Basic Pyspark DF Schema
  3. Basic Pyspark Streaming
  4. Basic XML DataFrame Read
  5. Basic JSON DataFrame Read

Tools and Libraries Used

  1. Pycharm Community Edition
  2. PyTest BDD
  3. PyTest Coverage
  4. Github Actions CI/CD

TODO

Integration test with AWS services such as Glue, DynamoDB, etc