yymwater/url-pattern-algorithm

the fundamental algorithm used for url normalization,web page classification and web information integration in web seach engine