/VI-crawler

Primary LanguageTypeScriptMIT LicenseMIT

VI-crawler

Web crawler specialized for browse slovak wikipedia

Elastic Search document structure

  • URL

    • visited: date
    • created: date
    • wordsCount: numbers
  • KEY

    • URLS: URL[]
    • created: date