| title | type | duration | creator | ||||
|---|---|---|---|---|---|---|---|
Hive Queries Lab |
lab |
1:25 |
|
Note: This lab requiress additional prep in order to run successfully:
- Sign up for AWS Account & Credits.
- Note: Instructors will need to distribute individual URLs for the signup form. See linked instructions.
For this lab we will use data from the Bay Area Bike Share Open Data Website
We've downloaded a part of it which is available in your assets folder. Each trip is anonymized and includes:
- Bike number
- Trip start day and time
- Trip end day and time
- Trip start station
- Trip end station
- Rider type – Annual or Casual (24-hour or 3-day member)
If an annual member trip, it will also include the member’s home zip code
The data set also includes:
- Weather information per day per service area
- Bike and dock availability per minute per station
- Spin up EMR cluster
- Log into HUE
- Import Data and create tables
- Top start station
- Chart of top start station
- Top destinations + Map
Bonus:
- Analyze trips hourly
Make sure to terminate your cluster and remove logs from S3 once you're done to avoid unnecessary costs.
- Open your AWS console
- Make sure you're in the correct geographic region (top right)
- Go to the EMR window
- Stop all clusters and make sure they stop
- Go to the S3 window
- Check that there are no buckets you didn't want
- Go to the EC2 window
- Check that there are no running instances