website-scraper/node-website-scraper

Issues

• It never finishes

  #584 opened 24 days ago by lokeb
  3

• Design new logo

  #515 opened 4 months ago by s0ph1e
  2

• Getting iframe tag and src to play video

  #572 opened 4 months ago by jorgelucasea
  2

• throw new Error(`Directory ${absoluteDirectoryPath} exists`);

  #537 opened a year ago by obsidianart
  7

• Incorrect source code for dynamic javascript src

  #530 opened a year ago by diegomachado1
  5

• Adding Plugin stops recursion

  #533 opened a year ago by nigel-daniels
  3

• Cookies are not working

  #446 opened 4 years ago by abd-falyoun
  6

• Pass options to Cheerio?

  #484 opened 2 years ago by gmhenderson
  5

• How do I change the style file name?

  #507 opened 2 years ago by enotmen
  2

• lazy load images are not downloading

  #518 opened 2 years ago by chaybcr
  1

• Running `website-scraper` Without a `package.json` in the Working Directory Triggers Error

  #512 opened 2 years ago by manuth
  5

• Remove plugins export

  #510 opened 2 years ago by s0ph1e
  0

• French characters "à" are not converted correctly

  #500 opened 2 years ago by Jeremytijal
  5

• Website-scraper on Windows 11 throws error while scraping an academic archive site.

  #498 opened 2 years ago by rrgerber
  3

• Default non-downloaded paths to alternate url

  #490 opened 3 years ago by ChristopherJohnson25
  2

• Cookies Issue

  #489 opened 3 years ago by chrisdma
  2

• Scrape files with exact same names when they include french characters

  #466 opened 3 years ago by LucasDemea
  4

• Non-English characters are not converted correctly

  #454 opened 3 years ago by tverona1
  6

• Replace remote image assets with downloaded one

  #494 opened 3 years ago by jeepers3327
  3

• TypeError: text.replace is not a function

  #493 opened 3 years ago by ChristopherJohnson25
  3

• [not serious] Unsure of how to use urlFilter

  #487 opened 3 years ago
  2

• Crawling rate limit or requeue?

  #485 opened 3 years ago by abale
  2

• Add retries for failed requests

  #412 opened 3 years ago by tverona1
  2

• Error thrown by the request module stop the process, even if ignoreErrors was set to true

  #415 opened 3 years ago by max-hk
  3

• urlFilter terminates recursive scraping

  #460 opened 3 years ago by jkanel
  2

• Saving Popup content

  #455 opened 3 years ago by Germminate
  2

• How to get request.uri from each download file

  #456 opened 3 years ago by the-prodigy
  0

• High NPM Vulnerability

  #453 opened 3 years ago by earlvhin
  2

• where to find puppeteer

  #452 opened 4 years ago by CodeStudent09
  1

• `request` is deprecated

  #401 opened 4 years ago by Richienb
  1

• Issue with // URLs

  #440 opened 4 years ago by ap1969
  4

• Ignore data:image URLs

  #429 opened 4 years ago by nikolay-borzov
  3

• Sources are downloaded even if not used by the root page anymore

  #433 opened 4 years ago by lapwat
  13

• Emergency Stop Feature ?

  #431 opened 4 years ago by dobrys
  5

• Ignore offsite requests

  #432 opened 4 years ago by karllson
  2

• Feature Request: Downloading multiple video sources

  #430 opened 4 years ago by chrisodicho
  2

• Relative child URLs not updated consistently

  #419 opened 4 years ago by tverona1
  2

• Follow meta http-equiv redirects

  #428 opened 4 years ago by MartinMuzatko
  5

• URLs with colon (:) fail to save on Windows

  #413 opened 4 years ago by tverona1
  6

• Allow changing filename only and keeping the destination path

  #416 opened 4 years ago by max-hk
  2

• sssss

  #420 opened 4 years ago by evilboyajay
  0

• Corrupted files with special characters

  #409 opened 5 years ago by diegomachado1
  6

• Crawled page contained suspicious content

  #418 opened 4 years ago by gerhardsletten
  2

• Paginated pages using query string are not scrapped when using "bySiteStructure"

  #411 opened 4 years ago by Cerlancism
  2

• Feature request: Plug-in's meta-data

  #407 opened 5 years ago by Asaf-S
  4

• Scraping sites with lazyload srcset imags

  #405 opened 5 years ago by graemec23
  12

• (bug) background-image with double quotes

  #403 opened 5 years ago by mifi
  3

• cannot scrape css stylesheets ONLY

  #404 opened 5 years ago by kriskate
  2

• Url fails when it contains `/js/` in the url even though the url continues after that

  #402 opened 5 years ago by jdtzmn
  2

• An in-range update of coveralls is breaking the build 🚨

  #400 opened 5 years ago by greenkeeper
  2