winxos/novel_grab

novel grab

AISTLAB novel grab

novel grab crawler module using python3 and lxml

multiprocesssing with multithread version

winxos, AISTLAB Since 2017-02-19

INSTALL:

pip3 install aistlab_novel_grab

1. USAGE:

RUN COMMAND IN CONSOLE:

novel_grab http://the_url_of_novel_chapters_page

EXAMPLE:

novel_grab http://book.zongheng.com/showchapter/654086.html

SUPPORTED SITES:

• http://book.zongheng.com
• http://www.aoyuge.com
• http://www.quanshu.net

2. USAGE AS PYTHON MODULE:

    from novel_grab.novel_grab import Downloader
    d = Downloader()
    print(d.get_info())
    if d.set_url('http://book.zongheng.com/showchapter/221579.html'):
        d.start()

TIPS

• When d = Downloader(), d.get_info() can get supported sites info.
• Once d.set_url(url) will return the url is valid or not.
• Of course you can use d.get_info() to access the state of d at any time.
• While finished, will create $novel_name$.zip file in your current path, default zip method using zipfile.ZIP_DEFLATED

Just for educational purpose, take care of yourself.