Dota 2 big data analysis group project for Big Data Engineering and Architecture, CSCI 5751, UMN.
- Java8
- MongoDB
- Spark
- Neo4j
- sbt
Create a config.yml
at the project root. You can refer to the example.
mvn -P FetchStore package
java -jar target/FetchStore.one-jar.jar <start_sequence_num> <total_num> <batch_size>
You can test by setting the sequence number to 4182489531
, which is a very famous professional dota2 game.
For more detail, you can refer to the ETL pipeline documentation.
sbt
run
It will ask you to choose from
- BadManner
- CostTime
- DamageRate
- EcoDistributionTrain
- First15minGain
- FirstBloodPredict
- FirstBloodTrain
- HeroMostStats
- MostBan
- MostPick
- MostPurchasedItem
- MostUsedItem
- Neo4j.Mongo2NeoLoader
- TeamBattleDetector
Each one answers one of our business question, except for 13. Neo4j.Mongo2NeoLoader
is used for loading data from MongoDB to Neo4j.