CyberConnector

NSF EarthCube Building Block project

This project aims to connect the existing data sources to the Earth science models so the generation of modeling products could be more automatic and effortless.

CyberConnector Online Documentation

Installation

Prerequisite

Java 1.8+ (mandatory, OpenJDK)

Apache Tomcat 8.0+ (mandatory, web container)

ncWMS 2.4.1+ (mandatory, download ncWMS.war and deploy it into Tomcat webapps folder)

cc-thredds-pycsw (optional, if you plan to set up your own catalog)

Apache Maven 3.5.0+ (optional, building CyberConnector.war from source)

Quick Start

Automated Installer

CyberConnector installer support CentOS, Ubuntu/Debian and Mac OS X operating systems. To get started download the latest source code. The installer script requires two parameters: the Anaconda directory and the data directory paths.

Example usage:

cd install
./install.sh /opt/anaconda3 /data

Docker Image

We published a Docker image in DockerHub for docker users. The pull command is:

docker pull csiss/cc

The run command is:

docker run -p 8080:8080 -v DATAPATH:/home/jboss/covaliFiles csiss/cc

Modules

COVALI - a sub-system for comparison and validation of atmospheric and other Earth science models (funded by EarthCube CyberWay)

Usage

COVALI

Example:

General Demo:

Roam around the Globe

COVALI has different projection options and 3-D view to enable multi-perspective viewing the data.

Search Data

Search in UCAR server

Search in the public folder

Search results are listed in a panel where users can directly download the files or load them into the maps.

Add Data

COVALI supports visualizing GRIB/NetCDF data on the maps.

Settings

COVALI provides a Settings menu to controll the two maps. It allows users to manage the added data layers.

Tools

COVALI provides a number of tools to facilitate the comparison and validation among the data.

Animation

Create an animation from multiple data time steps.

Statistic Report

Users can draw points or lines on the map to get a statistics on the values on the points or along the lines.

Regridding

Regridding for NetCDF data is supported but requires additional configuration. Regridding uses ESMF (Earth Science Modeling Framework) and xESMF Python libraries.

First, Anaconda must be installed and it's location must be set in config.properties file. For example: anaconda_path=/opt/anaconda3

Second, a new environment with correct dependencies must be configured:

conda create -n esmpy8 -y
conda install -y -n esmpy8  -c conda-forge "esmf!=*nompi" esmpy xarray=0.14.1 scipy dask netCDF4 xesmf libnetcdf=4.6.2 netcdf4=1.5.1