block list

Question

bnkcrypt opened this issue 6 years ago · 3 comments

Is there a way I can create a block list so it does not crawl those links if fund in page like facebook, instagram etc etc

Answer 1 · 2019-01-24T08:54:33.000Z

No, at the moment you can only limit a search to a specific domain name, or use no limitation at all.

Answer 2 · 2019-01-24T08:57:19.000Z

Here can i list to a specific domain ? where can i find some info or documentation on that pls .

Answer 3 · 2019-01-24T08:59:47.000Z

It is just a checkbox when you create a search (Limited?, checked by default).

If it is checked, the crawler will only search on the same domain name you entered when creating a new search.