deibit/cansina

Excpetion case no robot file

Closed this issue · 1 comments

Using robots.txt as payload
Traceback (most recent call last):
  File "cansina.py", line 215, in <module>
    print("Reaped %s entries" % (len(robots_content)))
TypeError: object of type 'NoneType' has no len()

Fixed in #13