selenext is a micro-framework for web automation/scraping using selenium in Python 2 or Python 3. This is currently still in development, however it's possible to write and run your automations within the framework as it is.
Just download this as a .zip and then unzip the selenext directory into
your site-packages folder. Once there is a stable release, there will
be a pip install available.
selenext is pretty modular, so you should only need the dependencies for the pieces you are using. For database interaction, install:
- peewee
pip install peewee+ installing peewee's dependencies.
You'll need Selenium for doing any browser automation or web scraping.
- selenium python bindings
pip install selenium
If you want to use the requests module along with BeautifulSoup/lxml
to read the content off a web page using the same API as selenium, you
can use the WebReader class to do so. It only supports reading
information off of a page, so methods like click are not implemented.
To use the WebReader, you will need:
- requests
pip install requests - BeautifulSoup4
- lxml
If you need to spin some text, check out spintax for python!
Once you have the dependencies, you can download this repository and start using it, however you may want to read over the documentation below.
Check out the documentation for the various parts and pieces in the wiki. API documentation will be coming soon.