/glint

Glint: High performance scala parameter server

Primary LanguageScalaMIT LicenseMIT

Glint

Build Status

Glint is a high performance Scala parameter server built using Akka. The aim is to make it easy to develop performant distributed machine learning algorithms using the parameter server architecture. One of the major goals is compatibility with Spark.

Compile

To use the current version you should compile the system manually, publish it to a local repository and include it in your project through sbt. Clone this repository and run:

sbt "+ compile" "+ assembly" "+ publish-local"

The + indicates that it should compile for all scala versions defined in the build.sbt file. The command will compile, assemble and publish the library jar file to the local ivy2 repository, which means you can then use it in your project's build.sbt (on the same machine) as follows:

libraryDependencies += "ch.ethz.inf.da" %% "glint" % "0.1-SNAPSHOT"

Documentation

Refer to the documentation for instructions and examples on how to use the software.