Active development years: 2013
For now: simple tests to verify, that 'append' and 'pluggable block placement policy' hadoop's features work. Expect more interesting stuff here later. :)
You will need:
- Java 6 JDK: www.oracle.com/technetwork/java/javase/downloads/index.html
- gradle 1.6 (or newer) build tool: www.gradle.org/
- fabric: http://docs.fabfile.org/en/1.7/
- (optional - if you want to setup the cluster) whirr: http://whirr.apache.org/
Just do gradle build
in root directory. gradle will download all required dependencies and compile classes
I strongly recommend IntelliJ for editing the source. The community edition is free for non-commercial purposes and can be downloaded here: www.jetbrains.com/idea/
Execute gradle idea
, which will generate all required files. Then open the project in IntelliJ and enjoy!
- using in-memory hadoop cluster -
gradle runInMemory
- using real hadoop cluster (you need to set up cluster yourself) -
gradle runOnHadoop -Dmaster=masterAddress
, wheremasterAddress
is an external address of the master machine in your cluster (can belocalhost
too)