FinanceReportScralwer

爬蟲系統架構圖

scraper structure

python packages

bs4 Pymongo Scrapy Dnspython

Environment

Python 3.7 Docker Splash

Data Source

  1. HiStock
  2. TWSE
  3. CNYES

Scrapy Projects

  1. Finance Reports (BalanceSheet,CashFlow,ComprehensiveIncome)
  2. Monthly Income
  3. Stock Price
  4. Ticker Pool
  5. ETF ingredients
  6. Dividend