Web scraping is a computer software technique of extracting information from websites
It matters how we construct the program
- HTML
- JSON
- Javascript
- Authorization....
- web front framework
- so on
We start project with web-client architecture To customize, use socket server architecture
-
GUI browser : Chrome, Firefox, ...
-
CLI browser: w3m, elinks, <- Text
-
CLI browser call : curl, wget
-
Python library/framework : requests, selenium, Scrapy