twiny/spidy

Returns .tv domains as available even though they are not

Oudwins opened this issue · 2 comments

Describe the bug
The crawler marks domains like justin.tv (old twitch.tv) as available when they are not. Inside the results .csv

To Reproduce

  1. install
  2. run on any website
  3. wait to see results

Expected behavior
.tv domains are correctly categorized.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):
tested on windows 10, linux & alpinejs

twiny commented

interesting. i will look that up. thank you for opening a thread about it.

Thank you!