- download vagrant box: https://pan.baidu.com/s/1c1SAXTQ
- vagrant box add u16 /path/you_downloaded_box
- vagrant up
- download hbase, hadoop, spark
- download hadoop-native-64-2.6.0.tar to ./ansible/roles/spark2/files
- run
ansible-playbook ./ansible/playbook.yml -i ./ansible/inventory -u vagrant -k
password isvagrant
download jdk8: https://pan.baidu.com/s/1bpxfpvD
download hbase: https://pan.baidu.com/s/1slhdGhZ
download hadoop: https://pan.baidu.com/s/1dFkjWch
download spark: https://pan.baidu.com/s/1dE6ows5
hdfs: http://192.168.11.151:50070/dfshealth.html#tab-datanode
spark: http://192.168.11.152:8080/
hbase: http://192.168.11.153:16010/master-status
-
word count example
- chmod +x ./ansible/deploy-wordcount.sh
- run
./ansible/deploy-wordcount.sh
-
the example for Spark integrate with Hbase
- chmod +x ./ansible/deploy-hbase-example.sh
- run
./ansible/deploy-hbase-example.sh