vezaynk/Sitemap-Generator-Crawler

Whitelist GET arguments

vezaynk opened this issue · 1 comments

An option to enable only some arguments should be introduced to override the global ignore_arguments variable.

This could have been so easy if HTML was stricter and would break websites that don't encode & properly as &

I am forced to figure out ways to parse invalid links.