Welcome to the Hydro-JULES Summer School multi-dimensional data workshops. This series of three workshops cover the basics of accessing and using multi-dimensional data with Python. Summaries of the three workshops are provided below, along with links to the Python Jupyter Notebooks - that we will be going through with you.
If you are not attending the Summer School, please click here to read this message.
These notebooks were provided as part of the Hydro-JULES summer school. This guidance was written for taking the participants through these notebooks using the JASMIN Notebook Service, where they would have access to the data. You are very welcome to go through these notebooks in your own time and on a different platform. More details on how to use these training notebooks beyond JASMIN Notebook Service has been provided below. These workshops are based on several excellent tutorials, which you will find links to.JULES is a community land surface model that is used both as a standalone model and as the land surface component in the Met Office Unified Model. JULES has been developed by a wide community of UK researchers, coordinated by UKMO and UKCEH. By allowing different land surface processes (surface energy balance, hydrological cycle, carbon cycle, dynamic vegetation, etc.) to interact with each other, JULES provides a framework to assess the impact of modifying a particular process on the ecosystem as a whole, e.g. the impact of climate change on hydrology, and to study potential feedbacks.
- Provide overviews of key Python packages related to processing of multi-dimensional data.
- Introduce you to the Climate and Forecast (CF) Metadata Conventions.
- Introduce you to cloud object storage and related Python packages.
- Provide practice with practical applications of these standards and packages.
During workshops 4 and 5, we will be providing an overview of the associated notebooks, then allow you time to work through them. In the 6th workshop, you will have opportunity to work through a series of exercises in a notebook and ask further questions. We will be using Zoom to deliver these workshops, you will have been emailed joining links for each of the workshops. We look forward to meeting you.
If during the Summer School workshops you require assistance, please contact Kit Macleod or Amulya Chevuturi.
To help get you set up for these three workshops, we provide:
i. Overview and introduction to using notebooks on JASMIN
ii. Introduction to the workshop notebooks
JASMIN provides storage and compute facilities to enable data-intensive environmental science. It provides support for a wide range of data-intensive analysis workflows. It is designed and operated by the Science and Technology Facilities Council (STFC) on behalf of the [Natural Environment Research Council (NERC).
We will be using Jupyter notebooks on the JASMIN Notebook Service JASMIN provide guidance on what is a Jupyter Notebook, the Jaspy Software Environments they provide, how to use the Notebook Service, and links to further learning resources.
To work with this repository during the HydroJULES Summer School training sessions, please click here.
- Log in to JASMIN Notebook Service
- In your JASMIN home directory click on the "Git" tab on your JupyterLab, and select "Clone a Repository" option.
- In the subsequent window put in the GitHub repository address https://github.com/hydro-jules/school.git and tick the download repository option, before selecting the "clone" option.
- It takes up to a few minutes for the repository to clone and once successful, you have a directory named "school" in your File Browser navigator on the left.
- To run any of the notebooks within the repository, please use the kernel option Python 3 + Jaspy Kernel.
To work with this repository on platforms beyond JASMIN and after the HydroJULES Summer School, please click here.
- Please select any other platform like Google Colab and clone the repository there.
- Install the conda environment which will make all the notebooks run using the requirements.txt file via any of the following commands:
conda install --yes --file requirements.txtinstalling using condaconda create --name <env_name> --file requirements.txtinstalling using conda while creating a virtual environmentpip install -r requirements.txtinstalling using pip
- Almost all of the data used in the training notebooks is freely available for the notebooks to work with. The only data on JASMIN group workspace cannot be accessed beyond JASMIN firewalls, which is the CHESS-met data (Robinson et al., 2023). However, this data is freely avaialble at the Environmental Information Data Centre (EIDC). Thus, to anyone who wants to work with this data can go ahead and download the data and use it.
HJSS Workshop 4: Working with multi-dimensional data (netCDF). Introduces NetCDF and using Python packages to access, analyse, and visualise NetCDF files. Link
HJSS Workshop 5: Introduces object storage and the Zarr data format. Link
HJSS Workshop 6: Provides a series of practical applications and the opportunity to ask further questions. Link