holgerd77/django-dynamic-scraper

Issues

• SystemError: ffi_prep_closure(): bad user_data (it seems that the version of the libffi library seen at runtime is different from the 'ffi.h' file seen at compile-time)

  #154 opened a year ago by natea
  1

• django 2

  #140 opened 4 years ago by andytwoods
  3

• New Scrapy Support List

  #149 opened 3 years ago by bezkos
  0

• No more python_2_unicode_compatible on django 3.0

  #138 opened 4 years ago by jyr
  1

• How can I save crawled data in multi model?

  #146 opened 3 years ago by rel4xdev
  0

• Django Dynamic Scraper: Celery Tasks not executed in Scrapyd

  #145 opened 4 years ago by benjaminelkrieff
  0

• Dynamically change the url of the "Website" component

  #144 opened 4 years ago by benjaminelkrieff
  0

• Automatically Scrape a HUGE amount of url at scale

  #143 opened 4 years ago by benjaminelkrieff
  0

• django-dynamic-scrapy do not work with python3.x after upgrading

  #132 opened 5 years ago by odainasser
  1

• Read scrapyd hostname from env / remove hardcode hostname

  #136 opened 5 years ago by umrashrf
  1

• Replace django-celery with django-celery-beat and django-celery-results

  #135 opened 5 years ago by umrashrf
  0

• Scehduling error with broker and scrapyd. HELP!

  #134 opened 5 years ago by Aliiibukhari
  0

• Could somebody help me execute the scheduling spiders using djcelery?

  #133 opened 5 years ago by Aliiibukhari
  0

• More than one scheduler, the error raises about TypeError("'run_spiders' object is not iterable",)

  #131 opened 5 years ago by itualoha
  0

• _

  #129 opened 5 years ago by 17637462979
  0

• Support django 2 on_delete for model

  #127 opened 5 years ago by ahmadjd94
  1

• Detail object of scraped element

  #126 opened 5 years ago by rafrasenberg
  1

• event_main.html

  #124 opened 5 years ago by cavidanhasanli
  1

• page.html

  #125 opened 5 years ago by cavidanhasanli
  1

• Support for Scrapy 1.5

  #106 opened 5 years ago by holgerd77
  1

• Installation Failure in Pillow req when Brew's JPEG package isn't installed

  #108 opened 5 years ago by tom-price
  5

• can't install django-dynamic-scraper with django 1.9 and python 3.6

  #115 opened 5 years ago by FelipeDelFierro
  2

• How to utilize - html as string in json response

  #114 opened 5 years ago by shashitechno
  0

• Version 0.13.1 mission migration file.

  #111 opened 6 years ago by yazanhorani
  0

• I get error:Unhandled error in Deferred

  #102 opened 6 years ago by Jasonhy
  2

• urlopen error Int or String expected

  #81 opened 7 years ago by yunmanger1
  1

• Returning multiple elements

  #110 opened 6 years ago by narankhetani
  0

• how to view traceback?

  #107 opened 6 years ago by mohamadiank
  0

• Can DDS supports Python 3.6+?

  #93 opened 7 years ago by xichagui
  2

• ERROR: Spider error processing, DoesNotExist: RequestPageType, KeyError: 'MP', TypeError: must be str, not list`

  #101 opened 6 years ago by brylor
  0

• Django 2+ support

  #105 opened 6 years ago by tigrus
  1

• How to scrape a JSON object instead of a JSON object inside a list?

  #99 opened 7 years ago by Dean-Christian-Armada
  1

• Scraping in time

  #98 opened 7 years ago by moreplavec
  1

• Custom HTTP status codes for DDS checker

  #95 opened 7 years ago by WarToaster
  2

• How to use the scheduling parameters to only run scraper for only 1 time ?

  #94 opened 7 years ago by vaimdev
  1

• Bug with Scrapyd/DDS

  #92 opened 7 years ago by bezkos
  0

• Scrapers Detail Admins Page load too slow

  #90 opened 7 years ago by bezkos
  8

• Question: IN/ACTIVE status on NewsWebsite?

  #91 opened 7 years ago by senoadiw
  4

• multiple jsonpath

  #86 opened 7 years ago by klkim
  1

• OperationalError at /admin/open_news/newswebsite/

  #75 opened 7 years ago by prabhatpankaj
  1

• Zero actions counter and Standard Update

  #88 opened 7 years ago by bezkos
  2

• Scheduler does not work in example project

  #80 opened 7 years ago by zeonn
  2

• DDS unusable with django >= 1.10

  #87 opened 7 years ago by tigrus
  3

• Problem with DDS+Postgresql

  #84 opened 7 years ago by bezkos
  1

• Cannot complete the wikinews example project due to a logging issue

  #89 opened 7 years ago by senoadiw
  2

• [root] ERROR: No base objects found!

  #85 opened 7 years ago
  0

• Scraping with JSONPath does not return all items

  #83 opened 7 years ago by rakanalh
  1

• Using scraped text in another xpath/regex/processors

  #82 opened 7 years ago by renodesper
  1

• pre_url produces ERROR Unsupported URL scheme 'doublehttp' when rerunning scrapy after saving articles to DB

  #76 opened 8 years ago by Akramz
  4

• TypeError: the JSON object must be str, not 'bytes' from utils/task_utils.py on python 3.5 (FIX)

  #78 opened 8 years ago by zeonn
  0