Spark-NLP - Navya Devineni

Using PySpark for NLP

  • Cleaning
  • Processing
  • Charting

Cleaning

  • NLP Stopword removal
  • remove all non-letters

Processing

  • Flatmap from one-to-many

Charting