OpenQA Tests for Qubes OS
To install, clone this repo to /var/lib/openqa/tests/qubesos
Example command for posting new ISO for test:
openqa-client --host https://openqa.qubes-os.org isos post iso=Qubes-DVD-x86_64-20180224.iso DISTRI=qubesos VERSION=4.0 FLAVOR=install-iso ARCH=x86_64 BUILD=20180224 UEFI_DIRECT=1
Example command for starting tests of updates in current-testing:
openqa-client --host https://openqa.qubes-os.org isos post DISTRI=qubesos VERSION=4.0 FLAVOR=update ARCH=x86_64 BUILD=20180224 UEFI_DIRECT=1
Variables:
- `DISTRI` - always `qubesos`
- `VERSION` - system version, currently not interpreted (but displayed in UI)
- `FLAVOR` - `install-iso` for installation tests, `update` for updates system tests
- `ARCH` - always `x86_64`
- `BUILD` - build number, not interpreted (but displayed in UI)
- `UEFI_DIRECT` - UEFI boots directly to Xen, no separate bootloader
Variables used in tests:
- `INSTALL_TEMPLATES` - space separated list of template groups (`debian`, `whonix`), or `all`
- `USBVM` - USB VM configuration: `none`, `sys-usb` (default), `sys-net` (combined with Net VM)
- `KEYBOARD_LAYOUT` - install with non-default keyboard layout; currently only `us-colemak` value is supported
- `LOCALE` - install with non-default locale; currently only `en_DK.utf8` value is supported
- `SYSTEM_TESTS` - run system tests from those (space separated) modules, each module can be suffixed with ":TIMEOUT" (in seconds); tests are run using nose2
- `VERBOSE_LIBVIRT` - increase libvirt log level, including libxl logging; slows down the system and may lead to huge logs
- `REPO_1` - repository name to install updates (dom0 and vm) from - in addition to standard repos
- `SALT_SYSTEM_TESTS` - run salt formula preparing for system tests (mostly install extra packages)
- `UPDATE_TEMPLATES` - update listed template packages as a whole (space separated list of templates to update)
- `TEST_TEMPLATES` - limit tests to listed templates only (space separated list of templates to test)
- `UPDATE` - install updates in dom0 and all templates
- `QUBES_TEST_EXTRA_INCLUDE`, `QUBES_TEST_EXTRA_EXCLUDE` - passed directly to the test environment