About develop branch
Opened this issue · 2 comments
Development items
- Add sbt
- Add Batch
- Update README
参考
Spark MLとBreezeでロジスティック回帰
https://qiita.com/mura-s/items/29ccdc7cfebf866d47a2
ローカルのSparkでS3のファイルを扱う
https://qiita.com/uryyyyyyy/items/b1f7a9fea928e1003602
How to pass -D parameter or environment variable to Spark job?
https://stackoverflow.com/questions/28166667/how-to-pass-d-parameter-or-environment-variable-to-spark-job
Serializable Custom Transformer with Spark 2.0 (Scala)
https://qikaigu.com/serializable-custom-transformer-with-spark-2/
LogrithmicTransformer
https://github.com/czehoul/mobileapps-ads-attribution/blob/dbb157e6a6580847dd73001999c64a0489e25936/SparkML/src/main/scala/com/yee/talking/LogTransformer.scala
Extend Spark ML for your own model/transformer types
https://www.oreilly.com/learning/extend-spark-ml-for-your-own-modeltransformer-types
https://docs.databricks.com/applications/machine-learning/mllib/advanced-mllib.html