This repo has a collection of scripts, notebooks and HTML visualizations for mining The LIST data. The LIST serves two main types of data: events and places.
We have two types of mining resources: one for the general public (mining_LIST_API_data directory) and another one for users which have access to datasets from 2018 to 2021 (mining_LIST_2018_2021 directory).
The reason for which we have separated them is because data (events and places) downloaded from the LIST API is slightly different (in terms of schema) than the one obtained directly from the LIST.
Nevertheless, we have included in both directories our results from preliminary analyses in HTML format.
This collection of resources are intended for anyone who has previously registered to the The LIST API, and wants to explore the downloaded through the API.
Go to mining_LIST_API_data for starting mining this type of resource.
Note: A FREE account is limited to 1,000 requests per month.
This collection of resources are intended for users with access to LIST dataset from 2018 to 2021. Therefore, only users with access to this dataset will be able to run the notebooks locally. However, the results of our primilary analyses are available in HTML format.
Go to mining_LIST_2018_2021_data for starting mining this type of resource.
Note: The dataset used in this directory is not available in this repository.
Indepedently of the type of resource to mine, we recommend to install the requirements specified in requirements.txt for sections 2 to 5. And also to have Python 3.9+ enviroment.
conda create --name py39 python=3.9
conda activate py39
pip install -r requirements.txt
In those HTML/notebooks we have analysed together all the sample events available from 2017 to 2022, one for Edinburgh, and another one for St Andrews. These are our preliminar results. In this study, we can see how the number of events, schedules, performances have drastically changed over the last 5 years.