/CarInformation

一个爬取汽车资讯的爬虫程序,网站包括汽车之家,太平洋汽车,易车网

Primary LanguagePython

CarInformationSpider

基于scrapy的爬虫程序,主要爬取各个汽车的信息,爬取目标主要是汽车之家,太平洋汽车,易车网等网站

Installation

appdirs (1.4.3)
APScheduler (3.3.1)
asn1crypto (0.22.0)
attrs (16.3.0)
Automat (0.5.0)
beautifulsoup4 (4.5.3)
bs4 (0.0.1)
cffi (1.10.0)
constantly (15.1.0)
cryptography (1.8.1)
cssselect (1.0.1)
EasyProcess (0.2.3)
fake-useragent (0.1.7)
html5lib (0.999999999)
idna (2.5)
incremental (16.10.1)
lxml (3.7.3)
mysqlclient (1.3.10)
olefile (0.44)
packaging (16.8)
parsel (1.1.0)
Pillow (4.1.0)
pip (9.0.1)
pyasn1 (0.2.3)
pyasn1-modules (0.0.8)
pycparser (2.17)
PyDispatcher (2.0.5)
pyOpenSSL (16.2.0)
pyparsing (2.2.0)
pypiwin32 (219)
python-dateutil (2.6.1)
pytz (2017.2)
PyVirtualDisplay (0.2.1)
queuelib (1.4.2)
requests (2.13.0)
Scrapy (1.3.3)
scrapyd (1.2.0)
scrapyd-client (1.1.0)
selenium (3.4.3)
service-identity (16.0.0)
setuptools (35.0.0)
six (1.10.0)
Twisted (17.1.0)
tzlocal (1.4)
urllib3 (1.22)
w3lib (1.17.0)
webencodings (0.5.1)
wheel (0.29.0)
xlrd (1.0.0)
xlwt (1.2.0)
zope.interface (4.3.3)