/dds_web

A cloud-based system for the delivery of data from SciLifeLab Facilities to their users (e.g. research group).

Primary LanguagePythonOtherNOASSERTION

Data Delivery System -- WIP

A a single cloud-based system for all SciLifeLab facilities, where data generated throughout each project can be delivered to the research groups in a fast, secure and simple way.

This project is supported by EIT Digital, activity number 19390. This deliverable consists of design document and implementation report of application and validation of VEIL.AI technology in SciLifeLab context in Sweden.

The Delivery Portal consists of two components:

  • The web interface where the research groups and facilities will be able to follow the data delivery progress. The web interface will also be an option for the delivery within small projects, e.g. small and/or few files.
  • The command line interface (CLI). This will be used for data delivery within larger projects and/or projects resulting in the production of large amounts of data, e.g. sequence data.

Setup docker environment:

1. Docker installation

Mac:
https://docs.docker.com/v17.12/docker-for-mac/install

Ubuntu:
https://docs.docker.com/install/linux/docker-ce/ubuntu/

2. In DS_CLI folder

  • Setup CLI: pip3 install --editable .

3. In root (Data-Delivery-System)

  • Build and run containers In the root folder (Data-Delivery-System/), run:

     docker-compose up
    • To use terminal after starting services, use the -d option.

       docker-compose up -d 
      
    • To stop service:

       docker-compose down

4. After changing DB To rebuild the database after a change, you need to:

  1. Run
    docker rm $(docker ps -a -q) -f
    docker volume prune
    
  2. Run
    docker-compose build --no-cache
    
  3. Run docker-compose up as described above.
  4. If there are still issues, try deleting the pycache folders and repeat the steps.