/htmlfetcher

No pain HTML fetching library.

Primary LanguagePython

HTML Parsing

No pain HTML fetching library.

A light wrapper of selenium.

For page with a lot of ajax.

Installation

pip install htmlfetcher

download browser: https://github.com/mozilla/geckodriver/releases

Usage

from htmlfetcher import HTMLFetcher

fetcher = HTMLFetcher(browser='/home/bug/桌面/geckodriver')
text = fetcher.get('http://zhaopin.baidu.com/quanzhi?tid=4139&ie=utf8&oe=utf8&query=python&city_sug=%E6%88%90%E9%83%BD')
fetcher.close()

print(text)