algolia/docsearch-scraper

Issues

• Getting "ValueError: CONFIG is not a valid JSON" when running config file

  #333 opened 8 years ago by stevenbennitt
  5

• Should the crawler respect the <meta name="robots" content="noindex,nofollow">?

  #401 opened 6 years ago by pixelastic
  10

• feat(crawler) Avoid indexing record with empty "text" content

  #361 opened 4 years ago by s-pace
  0

• DocSearch is not capable to run Firefox when the "js_render" option is set

  #399 opened 4 years ago by fmarinitrs
  3

• CI that runs on PRs of configs

  #338 opened 4 years ago by Haroenv
  3

• ImportError: No module named scrapy.linkextractors.lxmlhtml

  #320 opened 8 years ago by umeshkalia
  3

• Only add facets in Algolia options if there is more than one value

  #408 opened 5 years ago by pixelastic
  1

• Assign a unique name to the temporary index

  #426 opened 5 years ago by mojavelinux
  6

• Add versioning tags to the scraper

  #433 opened 6 years ago by s-pace
  0

• Allow the nb_hits updater prompt to be bypassed

  #425 opened 6 years ago by mojavelinux
  7

• ModuleNotFoundError: No module named 'dotenv'

  #436 opened 6 years ago by FeynmanZhou
  5

• What is the proper lvl selector for this h6 tag

  #435 opened 6 years ago by astyfx
  2

• Different Selectors_key for different sitemap.xml files

  #434 opened 6 years ago by geekyP
  1

• config_loader.py syntax error in docker image

  #432 opened 6 years ago by Bleggbeard
  8

• Output CI-friendly progress messages

  #422 opened 6 years ago by mojavelinux
  4

• Exception: Env CHROMEDRIVER_PATH='/usr/bin/chromedriver' is not a path to a file

  #428 opened 6 years ago by pixelastic
  2

• DocSearch default User-Agent

  #404 opened 6 years ago by pixelastic
  6

• start urls has query parameter will be ignored

  #424 opened 6 years ago by nikomal
  1

• Wrong sitemap for docusaurus websites

  #414 opened 6 years ago by pixelastic
  0

• Unable do create Docker image

  #391 opened 6 years ago by pixelastic
  3

• trivial spelling error s/scrapper/scraper/g

  #398 opened 6 years ago by jmarca
  1

• ImportError: No module named dotenv

  #400 opened 6 years ago by EdenKupe
  4

• ImportError: No module named dotenv

  #378 opened 6 years ago by danielcollettepb
  2

• Python version

  #385 opened 6 years ago by oximer
  2

• Unreachable hosts

  #386 opened 6 years ago by oximer
  0

• Error running DocSearch without installing firefox

  #382 opened 6 years ago by s-pace
  1

• Update steps and browser_handler.py

  #371 opened 7 years ago by tatiana-perry
  2

• TODO Docs

  #359 opened 7 years ago by s-pace
  2

• AttributeError: 'ConfigLoader' object has no attribute 'nb_hits_max'

  #367 opened 7 years ago by majolo
  2

• public "metadata" in the docsearch configs?

  #343 opened 7 years ago by phrawzty
  1

• scrap != scrape and this is confusing

  #341 opened 7 years ago by phrawzty
  1

• cli performance

  #337 opened 7 years ago by maxiloc
  1

• Run multiple config files for same index

  #334 opened 8 years ago by stevenbennitt
  4

• Can't seem to run ./docsearch commands on Windows

  #332 opened 8 years ago by stevenbennitt
  6

• Add check for "unknown" parameters in DocSearch config

  #326 opened 8 years ago by JanPetr
  1

• Error running docsearch

  #305 opened 8 years ago by LordBrain
  27

• ImportError: No module named builtins

  #312 opened 8 years ago by redox
  3

• ImportError: No module named 'algolia_helper' (python 3)

  #313 opened 8 years ago by redox
  3

• No module named dotenv

  #317 opened 8 years ago by andreknieriem
  2

• Indexing a `<script>` string breaks the frontend javascript

  #311 opened 8 years ago by redox
  0

• Have an option in the generator to add the left collumn

  #276 opened 8 years ago by maxiloc
  0

• Make sure the design is responsivish

  #275 opened 8 years ago by maxiloc
  0

• Implement a task for email deployment

  #295 opened 8 years ago by LeoErcolanelli
  3

• travis

  #280 opened 8 years ago by maxiloc
  0

• Handle errors of the connector api

  #279 opened 8 years ago by maxiloc
  0

• Rexep in start_url and no facet created

  #285 opened 8 years ago by ElPicador
  0

• Add a warning when deploying with non docsearch account

  #284 opened 8 years ago by maxiloc
  0

• Same default image name

  #288 opened 8 years ago by LeoErcolanelli
  1

• cli tool

  #274 opened 8 years ago by maxiloc
  0

• Add a command to reindex from cli

  #278 opened 8 years ago by maxiloc
  0