/eggjs-spider

利用eggjs写一个定时爬虫

Primary LanguageJavaScript

spider

利用 eggjs 重构一个爬虫项目

涉及的技术点

  • MongoDB
  • 定时任务
  • puppeteer

QuickStart

see egg docs for more detail.

Development

$ npm i
$ npm run dev
$ open http://localhost:7001/

Deploy

$ npm start
$ npm stop

npm scripts

  • Use npm run lint to check code style.
  • Use npm test to run unit test.
  • Use npm run autod to auto detect dependencies upgrade, see autod for more detail.