ContentMine/quickscrape

Issues

• Attempts to locate scraper under --output directory

  #102 opened 7 years ago by bcarradini
  4

• Installation via npm misses tiny-jsonrpc dependency

  #103 opened 7 years ago by bcarradini
  2

• Long garbled link breaks quickscrape mkdir

  #61 opened 7 years ago by chartgerink
  2

• Include source URL in results file

  #101 opened 7 years ago by maxpsq
  0

• Last URL missed

  #100 opened 8 years ago by adclose
  3

• Need Help

  #99 opened 8 years ago by itahmid
  1

• Quickscrape not scraping through my list of 1000 URLs

  #98 opened 8 years ago by alexmaina
  14

• Quickscrape url retrieval failing?

  #97 opened 8 years ago by chartgerink
  1

• installing quickscrape after installing getpapers, breaks getpapers

  #96 opened 8 years ago by rossmounce
  2

• scraper directory uses the user-input output directory

  #95 opened 8 years ago by rossmounce
  6

• Mark that Scraping has been attempted

  #91 opened 8 years ago by tarrow
  0

• Print which scraper was used

  #92 opened 8 years ago by tarrow
  0

• No handler for status code != 200

  #62 opened 9 years ago by lanzer
  4

• Quickscrape hangs and emits warnings

  #76 opened 8 years ago by petermr
  1

• Hangs on URL

  #80 opened 8 years ago by tarrow
  1

• QS hangs indefintely

  #81 opened 8 years ago by tarrow
  6

• Fails on ACS

  #87 opened 8 years ago by bjonnh
  4

• Migrate from Phantom to Nightmare

  #90 opened 8 years ago by tarrow
  0

• undefined response object in UrlResolver

  #88 opened 8 years ago by petermr
  1

• Possible Spooky bug

  #89 opened 8 years ago by petermr
  0

• Quickscrape fails to properly santise filenames

  #85 opened 8 years ago by tarrow
  0

• Issue with URL that contains hyphen

  #79 opened 8 years ago by ficolo
  14

• Hangs on `Loading resource failed with status=fail`

  #82 opened 8 years ago by petermr
  2

• warning: possible EventEmitter memory leak detected. 11 listeners added.

  #52 opened 9 years ago by chreman
  5

• Download multiple supplemental files (e.g. tables)

  #75 opened 8 years ago by petermr
  1

• duplicate abbreviation `-f` in help

  #77 opened 8 years ago by petermr
  0

• Hanging seemingly randomly when downloading a list of URLs

  #74 opened 8 years ago by robintw
  7

• Remove requirement for `-o` with `-n`

  #73 opened 8 years ago by petermr
  2

• scraper directory is wrong

  #67 opened 8 years ago by skasberger
  1

• v0.4.7 breaks scraping in Windows

  #60 opened 8 years ago by chartgerink
  2

• links with many special characters not properly scraped

  #65 opened 8 years ago by chartgerink
  5

• Fails when using relative paths - depends on platform?

  #72 opened 9 years ago by robintw
  0

• Skip already-downloaded articles

  #70 opened 9 years ago by robintw
  1

• possible to just download json file?

  #69 opened 9 years ago by muranava
  1

• switch to wgxpath as xpath lib

  #68 opened 9 years ago by blahah
  0

• Cannot run Quickscrape in headless mode

  #63 opened 9 years ago by lanzer
  3

• Scraper list option?

  #58 opened 9 years ago by chartgerink
  5

• Review command-line help for clarity

  #59 opened 9 years ago by blahah
  0

• How to address non-attribute content in quickscrape

  #57 opened 9 years ago by petermr
  1

• Relative path for scraper definition resolved to wrong location

  #56 opened 9 years ago by dan2097
  0

• Quickscrape halts with no error messages after 'processing URL: ...'

  #55 opened 9 years ago by dsmurrell
  0

• friendlier saving of log info to file [enhancement request]

  #51 opened 9 years ago by rossmounce
  1

• same short arg for urllist and ratelimit -r

  #53 opened 9 years ago by chreman
  1

• DOI resolution gives different results to the direct URL

  #54 opened 9 years ago by markmacgillivray
  4

• TypeError: Cannot call method 'trim' of null

  #50 opened 9 years ago by petermr
  4

• "TypeError: Cannot read property 'actions' of null" if wrong scraper used

  #48 opened 9 years ago by petermr
  0

• Is there a scraper for Elsevier

  #49 opened 9 years ago by petermr
  3

• can't scrape plos one paper

  #47 opened 9 years ago by skasberger
  1

• Handle network problems gracefully

  #46 opened 9 years ago by blahah
  0

• Add time to log output

  #45 opened 9 years ago by blahah
  0