iDEP-SDSU/idep

Ngnix load balancer improvement

Opened this issue · 0 comments

What
Currently, users are assigned to containers based on their IP address. Sometimes iDEP gets stuck for 10-15 minutes and the CPU is at 100% for certain containers. Other users assigned to the same container is severely affected as it is extremely slow or unresponsive.
Possible solution
Change load balancer settings so that new users are assigned to idling containers.

CONTAINER ID        NAME                CPU %               MEM USAGE / LIMIT     MEM %               NET I/O             BLOCK I/O           PIDS
184d78a47738        idep_nginx_1        0.37%               7.059MiB / 125.8GiB   0.01%               475GB / 467GB       1.9GB / 10.3GB      25
83a69257a13b        idep_webapp_25      0.27%               4.586GiB / 12GiB      38.22%              9.28GB / 9.6GB      616GB / 206GB       100
2bc5c193c82f        idep_webapp_30      0.20%               4.313GiB / 12GiB      35.94%              7.75GB / 9.94GB     570GB / 220GB       72
26d2ba25b099        idep_webapp_27      0.24%               3.895GiB / 12GiB      32.46%              8.7GB / 11.3GB      557GB / 188GB       105
c4378b3b476f        idep_webapp_28      0.14%               2.728GiB / 12GiB      22.73%              9.56GB / 9.29GB     475GB / 144GB       71
77f65d74e204        idep_webapp_26      100.22%             3.789GiB / 12GiB      31.57%              7.96GB / 10.2GB     638GB / 346GB       46
ffb6cecc4178        idep_webapp_24      0.07%               2.627GiB / 12GiB      21.89%              10.1GB / 9.86GB     471GB / 199GB       43
f0addf48a5cb        idep_webapp_29      0.21%               5.411GiB / 12GiB      45.10%              10.3GB / 9.88GB     648GB / 198GB       107
7af2cf0ed27b        idep_webapp_23      0.17%               5.811GiB / 12GiB      48.43%              8.45GB / 10.1GB     751GB / 219GB       72
a04d8e6d9c1f        idep_webapp_22      64.27%              1.742GiB / 12GiB      14.52%              8.65GB / 9.78GB     559GB / 226GB       98
4b0eaf068fe6        idep_webapp_21      0.31%               5.287GiB / 12GiB      44.05%              7.78GB / 9.86GB     933GB / 362GB       72
0a62485c5040        idep_webapp_20      0.14%               1.299GiB / 12GiB      10.82%              10.6GB / 10.4GB     797GB / 288GB       71
ad5801cde774        idep_webapp_19      0.28%               1.55GiB / 12GiB       12.92%              10.3GB / 10.1GB     685GB / 341GB       83
66397a426780        idep_webapp_17      0.21%               1.151GiB / 12GiB      9.59%               8.79GB / 11.6GB     628GB / 164GB       104
83f4bc467c8d        idep_webapp_18      0.03%               142.8MiB / 12GiB      1.16%               8.26GB / 10.1GB     738GB / 249GB       22
74b972a78284        idep_webapp_16      0.07%               2.664GiB / 12GiB      22.20%              9.39GB / 10.4GB     695GB / 219GB       43
9b07909df287        idep_webapp_15      0.18%               832.2MiB / 12GiB      6.77%               8.56GB / 11GB       727GB / 241GB       73
b6f7ffd9c4cc        idep_webapp_13      100.41%             3.263GiB / 12GiB      27.19%              10.2GB / 9.16GB     599GB / 182GB       126
b2fc2b5b861f        idep_webapp_10      0.46%               4.341GiB / 12GiB      36.17%              9.53GB / 8.98GB     492GB / 323GB       219
87de0bb9ad90        idep_webapp_11      100.23%             2.251GiB / 12GiB      18.76%              8.87GB / 10.8GB     591GB / 214GB       105
087070eb85c1        idep_webapp_14      0.21%               1.855GiB / 12GiB      15.46%              10.3GB / 9.77GB     824GB / 295GB       98
3e0e9eb8b894        idep_webapp_12      0.29%               2.288GiB / 12GiB      19.06%              8.07GB / 9.66GB     631GB / 169GB       100
31c6a84469a3        idep_webapp_5       0.26%               2.545GiB / 12GiB      21.21%              9.36GB / 9.94GB     535GB / 245GB       105
0d0f91f81363        idep_webapp_7       0.18%               333.8MiB / 12GiB      2.72%               7.91GB / 9.37GB     625GB / 276GB       69
1f47b01d6b25        idep_webapp_6       3.88%               5.838GiB / 12GiB      48.65%              9.27GB / 9.39GB     595GB / 199GB       110
5b841b8aedd5        idep_webapp_9       0.18%               1.543GiB / 12GiB      12.85%              9.72GB / 9.09GB     581GB / 422GB       98
4a2d1ecebf3f        idep_webapp_8       0.07%               1.791GiB / 12GiB      14.93%              7.6GB / 8.12GB      753GB / 600GB       43
750abd43d6a1        idep_webapp_4       0.08%               2.913GiB / 12GiB      24.27%              10.4GB / 9.35GB     611GB / 327GB       44
49af80a31818        idep_webapp_2       0.59%               1.511GiB / 12GiB      12.59%              8.8GB / 10.4GB      689GB / 285GB       103
8df0f4f91b34        idep_webapp_1       0.26%               3.249GiB / 12GiB      27.08%              9.18GB / 11.2GB     822GB / 243GB       127