Download and generate EPUB of your favorite books from Safari Books Online library.
I'm not responsible for the use of this program, this is only for personal and educational purpose.
Before any usage please read the O'Reilly's Terms of Service.
If you are a developer and want to help this project, please take a look to the current Milestone.
Checkout also the new APIv2 branch: apiv2
The Community thanks 🙏🏻
- Requirements & Setup
- Usage
- Single Sign-On (SSO), Company, University Login
- Calibre EPUB conversion
- Example: Download Test-Driven Development with Python, 2nd Edition
- Example: Use or not the
--kindleoption
First of all, it requires python3 and pip3 or pipenv to be installed.
$ git clone https://github.com/lorenzodifuccia/safaribooks.git
Cloning into 'safaribooks'...
$ cd safaribooks/
$ pip3 install -r requirements.txt
OR
$ pipenv install && pipenv shellThe program depends of only two Python 3 modules:
lxml>=4.1.1
requests>=2.20.0It's really simple to use, just choose a book from the library and replace in the following command:
- X-es with its ID,
email:passwordwith your own.
$ python3 safaribooks.py --cred "account_mail@mail.com:password01" XXXXXXXXXXXXXThe ID is the digits that you find in the URL of the book description page:
https://www.safaribooksonline.com/library/view/book-name/XXXXXXXXXXXXX/
Like: https://www.safaribooksonline.com/library/view/test-driven-development-with/9781491958698/
$ python3 safaribooks.py --help
usage: safaribooks.py [--cred <EMAIL:PASS> | --login] [--no-cookies]
[--kindle] [--preserve-log] [--help]
<BOOK ID>
Download and generate an EPUB of your favorite books from Safari Books Online.
positional arguments:
<BOOK ID> Book digits ID that you want to download. You can find
it in the URL (X-es):
`https://learning.oreilly.com/library/view/book-
name/XXXXXXXXXXXXX/`
optional arguments:
--cred <EMAIL:PASS> Credentials used to perform the auth login on Safari
Books Online. Es. ` --cred
"account_mail@mail.com:password01" `.
--login Prompt for credentials used to perform the auth login
on Safari Books Online.
--no-cookies Prevent your session data to be saved into
`cookies.json` file.
--kindle Add some CSS rules that block overflow on `table` and
`pre` elements. Use this option if you're going to
export the EPUB to E-Readers like Amazon Kindle.
--preserve-log Leave the `info_XXXXXXXXXXXXX.log` file even if there
isn't any error.
--help Show this help message.The first time you use the program, you'll have to specify your Safari Books Online account credentials (look here for special character).
The next times you'll download a book, before session expires, you can omit the credential, because the program save your session cookies in a file called cookies.json.
For SSO, please use the sso_cookies.py program in order to create the cookies.json file from the SSO cookies retrieved by your browser session (please follow these steps).
What worked for me is:
Using document.cookie from the console does not include the HttpOnly cookies and they are definitely required. I can't work out how to access these via the console but I was able to find a way to get them that isn't too painful.
* Login as usual to https://learning.oreilly.com/
* Open the developer tools with F12
* Go to Network tab in the developer tools
* Access the profile page in the browser: https://learning.oreilly.com/profile/
* In the Network tab, click on the request to /profile/ (it should be the first one)
* Click on the Cookies tab in the request information
* Right-click on the Request cookies text and choose Copy All
* Paste this into the cookies.json file and then remove the outer section of the JSON document
* Run the script without passing credentials: python3 safaribooks.py 9780135262047
p.s. sudo is not necessary.
Format of cookies.json should be:
{
"BrowserCookie": "XXX",
"_gcl_au": "XXX",
"cd_user_id": "XXX",
"csrfsafari": "XXX",
"groot_sessionid": "XXX",
"kampyleSessionPageCounter": "XXX",
"kampyleUserSession": "XXX",
"kampyleUserSessionsCount": "XXX",
"kampyle_userid": "XXX",
"logged_in": "XXX",
"orm-jwt": "XXX",
"orm-rt": "XXX",
"salesforce_id": "XXX",
"sessionid": "XXX"
}
Pay attention if you use a shared PC, because everyone that has access to your files can steal your session.
If you don't want to cache the cookies, just use the --no-cookies option and provide all time your credential through the --cred option or the more safe --login one: this will prompt you for credential during the script execution.
You can configure proxies by setting on your system the environment variable HTTPS_PROXY or using the USE_PROXY directive into the script.
Important: since the script only download HTML pages and create a raw EPUB, many of the CSS and XML/HTML directives are wrong for an E-Reader. To ensure best quality of the output, I suggest you to always convert the EPUB obtained by the script to standard-EPUB with Calibre.
You can also use the command-line version of Calibre with ebook-convert, e.g.:
$ ebook-convert "XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698)/9781491958698.epub" "XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698)/9781491958698_CLEAR.epub"After the execution, you can read the 9781491958698_CLEAR.epub in every E-Reader and delete all other files.
The program offers also an option to ensure best compatibilities for who wants to export the EPUB to E-Readers like Amazon Kindle: --kindle, it blocks overflow on table and pre elements (see example).
In this case, I suggest you to convert the EPUB to AZW3 with Calibre or to MOBI, remember in this case to select Ignore margins in the conversion options:
-
$ python3 safaribooks.py --cred "my_email@gmail.com:MyPassword1!" 9781491958698 ____ ___ _ / __/__ _/ _/__ _____(_) _\ \/ _ `/ _/ _ `/ __/ / /___/\_,_/_/ \_,_/_/ /_/ / _ )___ ___ / /__ ___ / _ / _ \/ _ \/ '_/(_-< /____/\___/\___/_/\_\/___/ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ [-] Logging into Safari Books Online... [*] Retrieving book info... [-] Title: Test-Driven Development with Python, 2nd Edition [-] Authors: Harry J.W. Percival [-] Identifier: 9781491958698 [-] ISBN: 9781491958704 [-] Publishers: O'Reilly Media, Inc. [-] Rights: Copyright © O'Reilly Media, Inc. [-] Description: By taking you through the development of a real web application from beginning to end, the second edition of this hands-on guide demonstrates the practical advantages of test-driven development (TDD) with Python. You’ll learn how to write and run tests before building each part of your app, and then develop the minimum amount of code required to pass those tests. The result? Clean code that works.In the process, you’ll learn the basics of Django, Selenium, Git, jQuery, and Mock, along with curre... [-] Release Date: 2017-08-18 [-] URL: https://learning.oreilly.com/library/view/test-driven-development-with/9781491958698/ [*] Retrieving book chapters... [*] Output directory: /XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698) [-] Downloading book contents... (53 chapters) [#####################################################################] 100% [-] Downloading book CSSs... (2 files) [#####################################################################] 100% [-] Downloading book images... (142 files) [#####################################################################] 100% [-] Creating EPUB file... [*] Done: /XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698)/9781491958698.epub If you like it, please * this project on GitHub to make it known: https://github.com/lorenzodifuccia/safaribooks e don't forget to renew your Safari Books Online subscription: https://learning.oreilly.com [!] Bye!!
The result will be (opening the
EPUBfile with Calibre):
-
$ python3 safaribooks.py --kindle 9781491958698
On the right, the book created with
--kindleoption, on the left without (default):
For any kind of problem, please don't hesitate to open an issue here on GitHub.
Lorenzo Di Fuccia