death-pledge

From Middle French mortgage and Old French mort gage ("death pledge"), after a translation of judicial Medieval Latin mortuum vadium or mortuum wadium. So called because the deal dies either when the debt is paid or when payment fails.

Installation

Based on this article

Clone this repo, then create the environment

cd death-pledge
python3 -m venv venv && source venv/bin/activate
python -m pip install -r requirements.txt

Copy or create keys, tokens, config to the config/ dir.

Install the deathpledge module as editable

python -m pip install -e .[dev]

If you're using zsh and want to install extras for the dev environment, the bracket [ has a special meaning and needs to be escaped:

python -m pip install -e '.[dev]'

Note: if you edit anything in setup.py, you will need to reinstall.

Usage

Only with the proper credentials can this be run:

Google OAuth for my spreadsheet, or else feed it your own list of URLs
Real estate login
Bing Maps API token

Run python deathpledge --help for a list of options

Example usage

# Scrape the first 5 pages of the gallery
python deathpledge -n 5

# process only new listings not already in clean database
python deathpledge --process

Rebuilding and using the Docker image

docker build -t deathpledge:latest .

# or 

export GIT_HASH=$(git rev-parse HEAD)
docker build --build-arg GIT_HASH=${GIT_HASH::7} -t deathpledge:latest .

The entrypoint is the deathpledge module, so the run command accepts any command line arg that the module would

docker run deathpledge -n 1

Entering the container interactively (for debugging)