/crawler_email_py

In this project I'm creating a web crawler to check email boxes and handle incoming messages.

Primary LanguagePython

crawler_email_py

This is a simple email crawler written in Python.

Requirements

  • Python 3.6+
  • Docker

Docker

  • RabbitMQ
  • Minio

Usage

Create data and logs folder in the root directory.

mkdir data
mkdir logs
mkdir attachments

Added your variables in the .env file.

cp .env.example .env

Required variables:

  • IMAP_GMAIL_HOST
  • IMAP_GMAIL_EMAIL
  • IMAP_GMAIL_PASSWORD
  • LOCAL_FILE_PATH

Start RabbitMQ and Minio

docker-compose up -d

Access RabbitMQ at http://localhost:15672/ with username and password guest.

Access Minio at http://localhost:9002/ with username and password minioadmin.

Install dependencies

pip install -r requirements.txt

Run the script

python3 main.py