/Optimized-Image-Scraper

Scrapes and serves images as quickly as possible using ML for compression

Primary LanguagePython

Optimized Image Scraper [WIP]

  • Flask backend served with Nginx + Gunicorn
  • React + jQuery frontend
  • PostgreSQL for storing image metadata on filesystem
  • Redis for caching
  • Multithreaded image fetching
  • Dockerized for ease of development
  • ML compression (WIP)

Installation: