Guiqft/github-scraper-api

GitHub Scraper API

This project was made as a challenge for a seletive process. The challenge consists to build a API with one route that, gived an GitHub repository url, return the numbers of lines and bytes grouped by files extensions. But I was not allowed to use the GitHub API either web scraping libraries.
Besides that, the challenge explicit that the API user should not receive timeout errors either long time responses for subsequent requests.

My Solution

Here you can see my discuss about the solution and the technologies choices: Challenge Solution

Endpoints

http://api.gh-scraper.ml/github-repository-size/?url={{ repository_url }}

Dependencies

• Typescript
• Axios
• Express
• Express CORS
• Express Validator
• HTML Parser
• Redis
• Winston