/news-tracker-ethiopia

Track specific topic(s) in news and social media

Primary LanguagePython

news-tracker-ethiopia

Track specific topic(s) in news and social media.

Built to support Ethiopian Red Cross Society (ERCS).

Setup

Generic requirements:

For 510: Google cloud service account credentials are accessible here, login credentials in Bitwarden

with Docker

  1. Install Docker
  2. Download vector input data from here, unzip and move it to
vector/
  1. Copy your Google, Twitter and Azure credentials in
credentials/
  1. Build the docker image from the root directory
docker build -t rodekruis/news-tracker-ethiopia .
  1. Run and access the docker container
docker run -it --entrypoint /bin/bash rodekruis/news-tracker-ethiopia
  1. Check that everything is working by running the pipeline (see Usage below)

Manual Setup

TBI

Usage

Usage: run-pipeline [OPTIONS]

Options:
  --translate                    translate text with Google API
  --datalake                     upload to Azure datalake
  --help                         show this message and exit