This is the web UI for Colly.
Lightning Fast and Elegant Scraping Framework for Gophers
Colly provides a clean interface to write any kind of crawler/scraper/spider.
With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving.
We need a visual interface to manage our crawler tasks, so this project created.
CollyFront have defined a lot of APIs such as /api/client which we need to have a backend written by Colly, then the crawler task can be shown on web.
- npm install
- npm run dev
- Your web will be visited on
http://localhost:3000/
- Now we can delevope the api for CollyFront, the apis are defined in
./src/common/uri/. - If you have any suggestion, welcome PR&Issue.