In the web performance tests, use the swap file only to install the stacks
Closed this issue · 3 comments
To a more fair comparison, in the plans with less than 1GB of RAM (needed to install the Bitnami Stacks), the swap file of 512MB created is used to install the Bitnami Stacks and also along the tests.
To fix that, the swap file should be deactivated (and deleted) after the stacks are installed. And perform the test with the memory that the VPS plan has by default.
I have already modified the role for that (not committed yet) and already running some new tests.
Because of this, I have to perform new tests and graphs to reflect that these plans fail sooner, and therefore I have to modify also the criteria.json file.
Tests already generated, only need to crunch the data as soon as I have some free time.
Sorry for the delay with this, I had a very hard week and weekend, an unexpected series of events keep me very busy. Already fixed, and going to commit it right now.
I saw unexpected worse results in the servers, and I don't know exactly why but I suspect that the time when the tests were performed (morning in America and afternoon in Europe) was a very important factor in this, probably the physical servers had more workload. I would try to check this later.