lein-aws

This is very use case specific plugin to suit my own needs, but I'd like to expand it to be a more general purpose AWS plugin; pull requests welcomed!

Right it it supposed uploading files to s3 via the s3-put subtask, running and terminating jobflow via the run-flow and terminate-job subtask respectively. It is based on the awesome amazonica library.

Job flows are defined and loaded from a file containing a map of a keyword identified to an amazonina run-job-flow map.

{:my-flow
  {:name "my-job-flow"
  :log-uri "s3n://emr-logs/logs"
  :instances 
    {:instance-groups [
       {:instance-type "m1.large"
        :instance-role "MASTER"
        :instance-count 1
        :market "SPOT"
        :bid-price "0.10"}]}
  :steps [
    {:name "my-step"
     :hadoop-jar-step
       {:jar "s3n://beee0534-ad04-4143-9894-8ddb0e4ebd31/hadoop-jobs/bigml"
        :main-class "bigml.core"
        :args ["s3n://beee0534-ad04-4143-9894-8ddb0e4ebd31/data" "output"]}}]}
}

See the amazonica docs for more information.

Usage

You need to let the plugin know about your aws credentils:

:aws {:access-key "ACCESSKEY"
      :secret-key "SECRETKEY"
      :email "aws-login-email"}

Use this for user-level plugins:

Put [lein-aws "0.1.1-SNAPSHOT"] into the :plugins vector of your :user profile, or if you are on Leiningen 1.x do lein plugin install lein-aws 0.1.1-SNAPSHOT.

Use this for project-level plugins:

Put [lein-aws "0.1.1-SNAPSHOT"] into the :plugins vector of your project.clj.

$ lein help aws

License

Distributed under the Eclipse Public License, the same as Clojure.

whoahbot/lein-aws

lein-aws

Usage

License