algolia/docsearch-scraper

Issues

• If this project is no longer maintained, please delete this repository

  #578 opened a year ago by pptfz
  1

• The prompt record is 0 after running the container

  #577 opened a year ago by pptfz
  0

• Error crawling from docker image, invalid JSON

  #491 opened 4 years ago by jacknewwl
  3

• Algolia search breaks after running subsequent scrapes

  #573 opened a year ago by fredmaggiowski
  2

• Getting Unreachable hosts error when trying to scrape data

  #576 opened a year ago by beeena
  0

• DocSearch: 0 records

  #575 opened a year ago by xsf0105
  0

• unable to run the scraper on local url

  #574 opened 2 years ago by rubai99
  0

• Getitng only 1 NB hit while running from docker

  #571 opened 2 years ago by cybersaksham
  3

• Ignore sidebar headings in algolia indexing

  #572 opened 2 years ago by cybersaksham
  0

• Crawler isn't following links

  #549 opened 3 years ago by lorensr
  5

• Python error when running own scrapper

  #570 opened 2 years ago by pmenichelli
  1

• Cannot index pages when using a custom port

  #461 opened 5 years ago by ArthurFlag
  10

• Docker operation error. Procedure

  #569 opened 2 years ago by pptfz
  2

• Getting ValueError: CONFIG is not a valid JSON

  #567 opened 2 years ago by KaranS-hexaware
  6

• Need help with creating a Docker Compose file

  #568 opened 2 years ago by deepfriedbrain
  5

• Docker image to support ARM64 Platform

  #558 opened 3 years ago by marksou
  7

• Chrome not reachable

  #561 opened 3 years ago by AnthonyGWeb
  2

• TypeError: argument of type 'NoneType' is not iterable

  #551 opened 3 years ago by christophemenager
  2

• The error message for host unreachable in older versions was significantly better...

  #565 opened 3 years ago by elucidsoft
  4

• concurrency settings

  #556 opened 3 years ago by davidejones
  1

• Algolia index records reduction after an undefined amount of time

  #560 opened 3 years ago by FilippoRezzonico
  6

• Crawler does not seem to work on websites that use shadowDOM

  #552 opened 3 years ago by mantou132
  3

• Index updated but results not showing up

  #557 opened 3 years ago by ArthurFlag
  4

• Add content snippet for lvl-n heading match

  #548 opened 3 years ago by mojavelinux
  1

• How to de-dup pages?

  #550 opened 3 years ago by lorensr
  1

• An error was encountered while executing `./docsearch bootstrap`.

  #547 opened 3 years ago by Yue-plus
  6

• Github action for docsearch scraper

  #546 opened 3 years ago by milindsingh
  0

• Record quota exceeded at 5k instead of 10k

  #545 opened 4 years ago by PierreR
  1

• Docsearch doesn't update index correctly

  #543 opened 4 years ago by ArthurFlag
  7

• Partial index promotion due to scrappy spider signals not being handled

  #540 opened 4 years ago by ProTip
  0

• Allow custom ports for `start_urls`

  #539 opened 4 years ago by vjpr
  0

• Jeff bishop sent this to me

  #533 opened 4 years ago by JOHNMDAY-CREATE
  0

• run and docker:run commands don't exist

  #507 opened 4 years ago by CodeSandwich
  7

• <tags custom_settings.attributesForFaceting> tags<attributesForFaceting>

  #531 opened 4 years ago by JOHNMDAY-CREATE
  1

• [core] Setting attributesForFaceting from the config overrides Algolia settings

  #490 opened 5 years ago by s-pace
  2

• Optimize docker image

  #459 opened 5 years ago by mojavelinux
  7

• CONFIG is not a valid JSON

  #513 opened 4 years ago by martavis
  1

• Unable to find image 'article:latest'

  #514 opened 4 years ago by martavis
  1

• [core] ObjectID is not consistent among crawls

  #488 opened 4 years ago by s-pace
  0

• Scraping is expensive. Batch entries to reduce operations?

  #512 opened 4 years ago by KingScooty
  1

• docker:build fails

  #508 opened 4 years ago by CodeSandwich
  1

• How to test run a scraper without using up plan?

  #510 opened 4 years ago by CodeSandwich
  1

• How to handle too big entries?

  #511 opened 4 years ago by CodeSandwich
  1

• Track Last Index Time

  #492 opened 5 years ago by GoPro16
  0

• Scraper does not recognize CHROMEDRIVER_PATH when run from Docker image

  #483 opened 5 years ago by joleroi
  4

• chromedriver dependency broken in docker image v1.3

  #456 opened 5 years ago by pranav7
  11

• Add Python 3 support

  #444 opened 5 years ago by yousefiparsa
  2

• When `js_render: true` is set; `user_agent` option in the config is not respected

  #455 opened 5 years ago by pranav7
  2

• Scraper indexes folders, not just their files

  #439 opened 5 years ago by ArthurFlag
  2

• Using the image from dockerhub

  #438 opened 6 years ago by ArthurFlag
  6