/sales-crawler

Saves vital info about the sales users of supported websites offer.

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

sales-crawler

Saves vital info about the sales users of supported websites offer, in a sqlite database.

I'd suggest altering the "delay" values if you don't want to stress the target server.

Supported websites up to date:

  • insomnia.gr
  • aggeliopolis.gr
  • freelist.gr

Note that some parsers need to disguise themselves as some common browser such as firefox to avoid being rejected.

Copyright (C) 2016-2019, GReaperEx(Marios F.)

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, version 3 only.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.