/GoScraper

A project in go

Primary LanguageGo

This was created during my time as a student at Code Chrysalis

GoScraper

スクリーンショット 2020-11-19 20 24 42

About

This project scrapes websites in GOlang and posts results of the Top Ten Kanji of the scraped website on Twitter onto my twitter via a post Request. Building this application in Go allows one to utilize the power of concurrency that Go provides.

Features

  • Scrape a webapage and rank the Kanji on the site
  • Post the results on twitter
  • Scrape many sites at once with Goroutines

Tech

Golang, go-twitter, HTML, TwitterAPI, Heroku

How to Run

Retrieve dependencies

go get ./...

Compile Program

go build

Run Program

go run main.go utils.go