/webcrawler

Primary LanguagePython

webcrawler

Mas.py

mas.py is one to crawl forloop form, until the next page.

And have tech of beautiful and expression.

py.py

py.py is mongodb insertion with crawl.

Tech of mongodb insert and json/cvs/text convertion

with labmda to skip rows function in cvs read.

update the mongodb(),use update_many()

Mongodb query

Find a column with exsiting value:

{"Driver First Name":{ $exists: true } }