/qlik-community-blog-posts-scraper

Download metadata and links for all Qlik community blog posts into an SQLite database and make it explorable through Datasette, deploy with Docker.

Primary LanguagePythonMIT LicenseMIT

Qlik community blog posts scraper

pre-commit Code style: black Checked with mypy

Download metadata and links for all Qlik community blog posts into a Sqlite database and make it explorable through Datasette, deploy with Docker

  • Find out the most viewed or liked blog post
  • Trending writers
  • Explore through SQL-queries

Installation and usage

Installation

  • Create a virtual environment with Python 3.5 or above
  • Activate virtualenv and install requirements.txt
  • Run python program.py in order to create qlik_posts.db

Usage

  • Create Docker image docker build -t datasette_qlikposts .
  • Run container docker run -d --rm -p 8081:8001 --name datasette_qlik datasette_qlikposts
  • Explore data at http://localhost:8081/