/python_spiders

Python3 Web Spiders

Primary LanguagePythonMIT LicenseMIT

Basic Tools in Web Spiders in Python3

There are underlying .py and readme files in each directories.

If time available, I will introduce some advanced tools in web spiders.

Basic Tools

XPath methods is in this pacakge. And the directory XPath represents XPath methods in lxml.

requirement.txt

You can use the following command to get the necessary packages in your virtual environment.

pip install -r requirements.txt