Python Multilingual Ucrel Semantic Analysis System, is a rule based token and Multi Word Expression semantic tagger. The tagger can support any semantic tagset, however the tagset we have concentrated on and released pre-configured spaCy components for is the Ucrel Semantic Analysis System (USAS).
- 📚 Usage Guides - What the package is, tutorials, how to guides, and explanations.
- 🔎 API Reference - The docstrings of the library, with minimum working examples.
- 🚀 Roadmap
PyMUSAS currently support 10 different languages with pre-configured spaCy components that can be downloaded, each language has it's own guide on how to tag text using PyMUSAS. Below we show the languages supported, if the model for that language supports Multi Word Expression (MWE) identification and tagging (all languages support token level tagging by default), and size of the model:
| Language (BCP 47 language code) | MWE Support | Size |
|---|---|---|
| Mandarin Chinese (cmn) | ✔️ | 1.28MB |
| Welsh (cy) | ✔️ | 1.09MB |
| Spanish, Castilian (es) | ✔️ | 0.20MB |
| Finnish (fi) | ❌ | 0.63MB |
| French (fr) | ❌ | 0.08MB |
| Indonesian (id) | ❌ | 0.24MB |
| Italian (it) | ✔️ | 0.50MB |
| Dutch, Flemish (nl) | ❌ | 0.15MB |
| Portuguese (pt) | ✔️ | 0.27MB |
| English (en) | ✔️ | 0.88MB |
Can be installed on all operating systems and supports Python version >= 3.7, to install run:
pip install pymusas
When developing on the project you will want to install the Python package locally in editable format with all the extra requirements, this can be done like so:
pip install -e .[tests]For a zsh shell, which is the default shell for the new Macs you will need to escape with \ the brackets:
pip install -e .\[tests\]This code base uses flake8 and mypy to ensure that the format of the code is consistent and contain type hints. The flake8 settings can be found in ./setup.cfg and the mypy settings within ./pyproject.toml. To run these linters:
isort pymusas tests scripts
flake8
mypyTo run the tests with code coverage (NOTE these are the code coverage tests that the Continuos Integration (CI) reports at the top of this README, the doc tests are not part of this report):
coverage run # Runs the tests (uses pytest)
coverage report # Produces a report on the test coverageTo run the doc tests, these are tests to ensure that examples within the documentation run as expected:
coverage run -m pytest --doctest-modules pymusas/ # Runs the doc tests
coverage report # Produces a report on the doc tests coveragePyMUSAS is an open-source project that has been created and funded by the University Centre for Computer Corpus Research on Language (UCREL) at Lancaster University. For more information on who has contributed to this code base see the contributions page.