/spark-snippets

A bunch of snippets for Spark

Primary LanguageScalaApache License 2.0Apache-2.0

Introduction

ml

Machine Learning related snippets.

  • DomainExtractor: A ml transformer converting an url into its domain, if possible. This is supposed to be a reference for creating custom transformers. In Spark 2.3, generic transformers should make it a lot easier. Spark-20271