Glint is a high performance Scala parameter server built using Akka. The aim is to make it easy to develop performant distributed machine learning algorithms using the parameter server architecture. One of the major goals is compatibility with Spark.
To use the current version you should compile the system manually, publish it to a local repository and include it in your project through sbt. Clone this repository and run:
sbt "+ compile" "+ assembly" "+ publish-local"
The +
indicates that it should compile for all scala versions defined in the build.sbt
file. The command will compile, assemble and publish the library jar file to the local ivy2 repository, which means you can then use it in your project's build.sbt
(on the same machine) as follows:
libraryDependencies += "ch.ethz.inf.da" %% "glint" % "0.1-SNAPSHOT"
Refer to the documentation for instructions and examples on how to use the software.