hanuX39/spark-nlp-workshop

Public runnable examples of using John Snow Labs' NLP for Apache Spark.

Spark NLP Workshop

Showcasing notebooks and codes of how to use Spark NLP in Python and Scala.

Table of contents

• Jupyter Notebooks
  • annotation
  • evalulation
  • training
• Tutorial Notebooks
  • Jupyter
  • Colab (for Google Colab)
• Databricks Notebooks

Python Setup

$ java -version
# should be Java 8 (Oracle or OpenJDK)
$ python3 -m venv .sparknlp-env
$ source .sparknlp-env/bin/activate
# spark-nlp by default is based on pyspark 3.x
$ pip install pyspark==3.1.2
$ pip install spark-nlp

Colab setup

# This is only to setup PySpark and Spark NLP on Colab
!wget http://setup.johnsnowlabs.com/colab.sh -O - | bash

Main repository

https://github.com/JohnSnowLabs/spark-nlp

Project's website

Take a look at our official spark-nlp page: http://nlp.johnsnowlabs.com/ for user documentation and examples

Slack community channel

Join Slack

Contributing

If you find any example that is no longer working, please create an issue.

License

Apache Licence 2.0