/NLP_scraper

Scrape baidu search and eastmoney. Tencent and baidu nlu api.

Primary LanguageJupyter Notebook

Environment

windows

baidu search scraper

Scraper_Baidu_Search.py

MicroBlog scraper

Scraper_MicroBlog_Stock.py

EastMoney scraper

Scraper_EastMoney_Research.py
Scraper_EastMoney_Stocks.py F12 搜索网页元素，找到文章内容链接

baidu baike to get stock list

TODO: search 2 steps in baike

scrape api

  1. 1f8bda8aecca20d44570369e28babdf4 # unknow
  2. a16f3d5ee4d665788e236247f9745570 # google 400 used
  3. 75eb0cefb0bebddf6eb481b60353d525 # github 600 used
  4. 2d7b42ec7382806b9d502668992bfc59 # foxmail 5000 free