Credipy

Credipy is a scraper bot based on selenium, django. This project was made as a part of MLH / Local Hack Day under HackSoc, Indore.

Update: We won :)

The procedure carried out below are done under linux environment and similar can be derived for other OS easily.

Prerequisite

$ wget 'https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh'
$ conda update conda
$ conda create -n credipy python=3 django sqlite3
$ source activate credipy
$ python -m pip install --upgrade pip
$ pip install selenium
$ wget 'https://github.com/mozilla/geckodriver/releases/download/v0.19.1/geckodriver-v0.19.1-linux64.tar.gz'
$ tar -xvzf geckodriver-v0.11.1-linux64.tar.gz
$ rm geckodriver-v0.11.1-linux64.tar.gz
$ chmod +x geckodriver
$ cp geckodriver /usr/local/bin/

Installation

$ git clone https://github.com/aniruddha0pandey/lhd-hacksockindore-credipy.git
$

Development

$ django-admin startproject credipy
$

Deploy

$ python manage.py migrate
$ python manage.py runserver # default port: 8000

Browser Support

Browser	Webdriver API
Firefox	https://github.com/mozilla/geckodriver/releases
Chrome	https://sites.google.com/a/chromium.org/chromedriver/downloads
Edge	https://developer.microsoft.com/en-us/microsoft-edge/tools/webdriver/
Safari	https://webkit.org/blog/6900/webdriver-support-in-safari-10/