/crawl-data-slack

Primary LanguageGo

crawl-data-slack

docker-hub gos16052/crawl-data-slack

Setup

Requirements

  • mysql (migrations are run automatically)

Feed hackernews

img

  1. Create new app (https://api.slack.com/apps)
  2. Go to your app - OAuth & Permissions
  3. Add thescopes into bot token scopes (channels.read, chat:write, groups:read, im:read, mpim:read, users:read) It uses 3 apis (conversations.list, chat.postMessage, users.list) img
  4. Install to workspace and copy your bot user token

image

Run the crawler

  1. Pull the repository to run with chromedp
  2. Creata a .env file and write the environments
# Fill ID, PW, HOST, PORT, DATABASE, SLACK_BOT_TOKEN
MYSQL_CONN=<ID>:<PW>@tcp(<HOST>:<PORT>)/<DATABASE>?charset=utf8&parseTime=True
SLACK_BOT_TOKEN=<SLACK_BOT_TOKEN>
  1. Run with the command make up cmd="crawl\ hackernews\ --channel\ <YOUR_CHANNEL>