Python tools for mediawiki with the Translate plugin (some based on pywikibot). This is used for https://www.4training.net to remove some bottlenecks of the project, providing different automation and reports (TODO: document the outcomes of these scripts). Hopefully others can benefit from some of the scripts as well!
- Free software: GNU General Public License v3
Note: pywikitools base path refers to the directory, where you can find README.rst, CONTRIBUTING.rst and requirements.txt.
Install required libraries:
pip install -r requirements.txt:Follow these steps if you are using a virtual environment on a Linux machine:
- To install
virtualenv:sudo python3 -m pip install virtualenv - To create a new virtual environment:
virtualenv --system-site-packages new_venv_name. It is important to include the tag--system-site-packages, else the virtual environment will not be able to import the uno package into your working environment. - To activate the virtual environment:
source new_venv_name/bin/activate - Change into pywikitools base path and run
pip install -r requirements.txt.
- To install
Install LibreOffice UNO (python bridge):
sudo apt-get install python3-uno(on linux)- This is not necessary for all scripts, only for our LibreOffice module and scripts using it (
translateodt.py) - Running the complete test suite requires it, though
- This is not necessary for all scripts, only for our LibreOffice module and scripts using it (
Request a user-config.py (not in the repository) and place it in the base directory (same directory where the python scripts you want to run are located).
Alternatively you can generate it yourself by using a "full" pywikibot installation:
Go to official pywikibot website: https://www.mediawiki.org/wiki/Manual:Pywikibot/Installation and either download tar.gz / zip file or clone the git repository.
Change your current directory into pywikibot (can be found from the git repos you cloned into your working space) and unpack the downloaded zip folder here (
core_stable).Copy the file
4training_family.pyfrom~/pywikitools/pywikibot/familiesinto~/pywikitools/pywikibot/core_stable/pywikibot/families.Change into the
~/pywikitools/pywikibot/core_stabledirectory, where you can also find the filepwb.py.Run this command from the terminal:
python3 pwb.py generate_user_files- select 1: 4training family
- enter the bot user name (Request the username from Samuel)
- don't enter a new password here
Set up configuration in
config.ini:cp config.example.ini config.ini- Change the base path ini
config.inito the directory, where you cloned the pywikitools base folder, for example:base = /YOUR_HOME_PATH/pywikitools/
You're ready to go! Look at the different scripts and how to invoke them and try them out! To get to know everything and to understand what is going on, set the logging level to INFO (default is WARN) by adding
-l info.
python3 path/to/script args
(more cumbersome alternative using a full pywikibot installation: python3 /path/to/pwb.py path/to/script.py args)
If you're not yet logged in, pywikibot will ask you for the password for the user you defined in user-config.py. After successful login, the login cookie is stored in pywikibot.lwp so you don't have to log in every time again.
From your base pywikitools path, run python3 -m unittest discover -s pywikitools/test to run the test suite.
Run also flake8 . to check for any linting issues.
With GitHub Actions these two commands are run also on any push or pull request in the repository. The goal is to cover all important code parts with good tests. Some of the tests are making real API calls, that's why running the tests can take half a minute. More details
We use codecov to calculate the coverage ratio. You can see it in the codecov badge on the repository page or check out the details on codecov.io
- config.example.ini
- Example for all configuration settings
- config.ini
- Not in repository, needs to be created by you
- downloadalltranslations.py
- Download all translated worksheets of a given worksheet
- dropboxupload.py
- Upload files into dropbox
- fortraininglib.py
- Our central library with important functions and API calls
- generateodtbot.py
- Wrapper script for translateodt.py (requires pywikibot)
- resources_bot.py
- Automatically fill out the “Available training resources in...” for each language (requires pywikibot)
- translateodt.py
- Processes English ODT file and replaces it with the translation into another language Introduction for users: https://www.youtube.com/watch?v=g9lZbLaXma0
- cgi-bin/generateodt.py
- CGI-Handler that receives the request (coming from outside like https://www.example.net/cgi-bin/generateodt.py) and calls generateodtbot.py
- correctbot/
- Can automatically correct simple mistakes in texts of different languages (not yet operational)
Jesus says in Matthew 10:8, “Freely you have received; freely give.”
We follow His example and believe His principles are well expressed in the developer world through free and open-source software. That's why we want you to have the four freedoms to freely use, study, share and improve this software. We only require you to release any derived work under the same conditions (you're not allowed to take this code, build upon it and make the result proprietary):
GNU General Public License (Version 3)
By contributing you release your contributed code under the licensing terms explained above. Thank you!
For more details see CONTRIBUTING.rst
Please subscribe to the repository to get informed on changes. We use github issues for specific tasks, wishes, bugs etc. Please don’t hesitate to open a new one! Assign yourself on the issues that you plan to work on.
- TODO
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.