geokrety/geokrety-website-qa

(project) service to report GK health status

Opened this issue · 2 comments

boly38 commented

Following #7 comment :

How should we proceed to have the scenarios launched regularly.
Is there a way to be notified on errors.
Is there some dashboard available?

Another form to say the same needs:

  • A) As Geokrety contributor, I would like to prevent QA regression following commit on master
  • B) As Geokrety OPS, I would like to report QA health of PROD geokrety instance at egular interval

dashboard available?

  • selenium+robot test are generating files as report : log.html, output.xml, and report.html

launched regularly

  • to launch test at regular interval, we just need a VM with python and a cron entry, and a place to store / publish reports.

following commit on master

kumy commented

dashboard available?

selenium+robot test are generating files as report : log.html, output.xml, and report.html

Nice starting point.

launched regularly

to launch test at regular interval, we just need a VM with python and a cron entry,

We have room on the server to deploy new Docker containers.

following commit on master

I think travis could do the job on each commit of https://github.com/geokrety/geokrety-website: maybe we only need to add dedicateed step with python service (need to study/confirm)

If I'm not mistaken, geokrety-website-qa repo already launch the tests in Travis.

We can configure repo geokrety-website to trigger launch via a GitHub webhook to this travis (we should take care to wait for the new docker image to be built and deployed, maybe checking the commit id at the bottom of the page in a loop?) - BTW: we could imagine the same for the master branch and rec instance -

The cron from the point above could be to just post the the webhook to start the check.

and a place to store / publish reports.

What about comitting to gh-pages? like for the API doc https://geokrety.github.io/geokrety-api/api.html / https://github.com/geokrety/geokrety-api/tree/gh-pages . Write access to the git repo can be handled via GitHub personal token https://github.com/settings/tokens

  • 👍1
  • ❤️1