scrapy_experiment

  • Test of Scrapy Item and Pipeline features
  • Store scraped data to CSV and JSON files
  • Check if item exists in db and drop it
  • Store scraped data to PostgreSQL