Error analysis of failed adviser in the period 2021-04-15 - 2021-04-22
Closed this issue · 17 comments
From these reports, we could obtain more integration tests to be added. (we can automate it and open a PR every week in a repo.
Error analysis of failed adviser in the period 2021-04-15 - 2021-04-22
==============================================================
stack n. 1
==============================================================
[[source]]
name = "pypi-org"
url = "https://pypi.org/simple"
verify_ssl = true
[dev-packages]
[packages]
flask = "*"
[requires]
python_version = "3.6"
cases identified n. 15
job_id,recommendation_type,error_message
adviser-210415124352-8446af07a1cf87f7,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210415181803-c91fd57d81e2cf7d,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210416062605-265ce4fecdc70518,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210416123359-5e9e4689581e3674,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210417005703-c5c7f78470167853,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210417121000-b1db2943d3d76748,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210418003008-ebaa32aed4b1bca3,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210418122348-66ad9f148eaa87fe,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210419001750-8592bdad27d56e32,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210419062022-50c19b0f862b9b12,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210420005338-6c5c4ad2b5cd9ff7,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210420122451-f1187defc5a5e06c,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210420182312-60ee66eb84d92b28,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210421003019-fd922f9651eb1b22,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210421122317-d98da3b7c5cd7e28,latest,https://thoth-station.ninja/j/cpu_time_exceeded
==============================================================
==============================================================
stack n. 2
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
awscli = "*"
boto3 = "*"
pandas = "*"
pandas-profiling = "<2.10"
numpy = "*"
scikit-learn = "*"
matplotlib = "*"
seaborn = "*"
ipython = "*"
ipynb = "*"
beautifulsoup4 = "==4.7.1"
papermill = "*"
python-dotenv = "*"
black = "==20.8b1"
pyarrow = "*"
prometheus-api-client = "*"
[dev-packages]
flake8 = "*"
coverage = "*"
sphinx = "*"
[pipenv]
allow_prereleases = false
[requires]
python_version = "3.8"
[thoth.allow_prereleases]
black = true
cases identified n. 4
job_id,recommendation_type,error_message
adviser-210416070607-6d9f1cacfc2b5edc,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210417065425-dcd2473cb1088f9c,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210418015417-86953adacc027578,latest,https://thoth-station.ninja/j/cpu_time_exceeded
adviser-210419185833-f5464e9a5cc3c90f,latest,https://thoth-station.ninja/j/cpu_time_exceeded
==============================================================
==============================================================
stack n. 3
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
pandas = "*"
jupyter = "*"
boto3 = "*"
wget = "*"
python-dotenv = "*"
sklearn = "*"
papermill = "*"
ibm-cloud-sdk-core = "*"
ibm-watson = "*"
[dev-packages]
ipython = "*"
[pipenv]
allow_prereleases = false
[requires]
python_version = "3.6"
cases identified n. 1
job_id,recommendation_type,error_message
adviser-210416081333-3c6f455dcb9f85e9,latest,https://thoth-station.ninja/j/cpu_time_exceeded
==============================================================
==============================================================
stack n. 4
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
thoth-sourcemanagement = "*"
[dev-packages]
pytest = "*"
pytest-timeout = "*"
pytest-cov = "*"
coala-bears = "*"
cases identified n. 1
job_id,recommendation_type,error_message
adviser-210416134143-9ff4c6792bb4b5c4,latest,https://thoth-station.ninja/j/cpu_time_exceeded
==============================================================
==============================================================
stack n. 5
==============================================================
source = []
[packages]
notebook = ">=6.0.2"
jupyterhub = ">=1.3"
jupyterlab = ">=3.0.0"
jupyter-kernel-gateway = "==2.4.0"
supervisor = "==4.1.0"
jupyter-nbrequirements = "*"
jupyter-nbextensions-configurator = "*"
jupyter-server = "==1.4.1"
nbclassic = "==0.2.6"
ipython = "==7.16.1"
cryptography = "==3.3.1"
dictdiffer = "==0.5.0"
[dev-packages]
cases identified n. 1
job_id,recommendation_type,error_message
adviser-210419162405-3a0fffdf9ee1cd73,latest,https://thoth-station.ninja/j/cpu_time_exceeded
==============================================================
==============================================================
stack n. 6
==============================================================
source = []
[packages]
notebook = ">=6.0.2"
jupyterhub = ">=1.3"
jupyterlab = ">=3.0.0"
jupyter-kernel-gateway = "==2.4.0"
supervisor = "==4.1.0"
jupyter-nbrequirements = "*"
jupyter-nbextensions-configurator = "*"
jupyter-server = "==1.4.1"
jupyter-packaging = "~=0.7.3"
nbclassic = "==0.2.6"
ipython = "==7.16.1"
cryptography = "==3.3.1"
dictdiffer = "==0.5.0"
[dev-packages]
cases identified n. 1
job_id,recommendation_type,error_message
adviser-210421172907-cb4a703ef50916bb,latest,https://thoth-station.ninja/j/cpu_time_exceeded
==============================================================
==============================================================
stack n. 7
==============================================================
[[source]]
name = "pypi-org"
url = "https://pypi.org/simple"
verify_ssl = true
[dev-packages]
[packages]
boto3 = "*"
kafka-python = "*"
matplotlib = "*"
numpy = "*"
pandas = "*"
scipy = "*"
tensorflow = "*"
[requires]
python_version = "3.8"
cases identified n. 20
job_id,recommendation_type,error_message
adviser-210415130004-3dc4ab423ddf41de,stable,https://thoth-station.ninja/j/no_stack
adviser-210415183433-3dcfd27ad08beb7d,stable,https://thoth-station.ninja/j/no_stack
adviser-210416064158-39f3381eed262fa4,stable,https://thoth-station.ninja/j/no_stack
adviser-210416125010-30ac3ab6855b4a99,stable,https://thoth-station.ninja/j/no_stack
adviser-210416183402-3a94081465712da7,stable,https://thoth-station.ninja/j/no_stack
adviser-210417062706-33841cc721c13e25,stable,https://thoth-station.ninja/j/no_stack
adviser-210417122614-d88afd3bd7ea1aa0,stable,https://thoth-station.ninja/j/no_stack
adviser-210418004532-8286ee70df88ca6,stable,https://thoth-station.ninja/j/no_stack
adviser-210418012720-4b9e246399184b,stable,https://thoth-station.ninja/j/no_stack
adviser-210418062642-90ffe597ca83d3c8,stable,https://thoth-station.ninja/j/no_stack
adviser-210418123945-ffefe1f87edb3075,stable,https://thoth-station.ninja/j/no_stack
adviser-210418183716-f9ffe303d2c079bd,stable,https://thoth-station.ninja/j/no_stack
adviser-210419003347-9b55d8bdd3ea827,stable,https://thoth-station.ninja/j/no_stack
adviser-210419183011-b8d10d6ac5a5c80e,stable,https://thoth-station.ninja/j/no_stack
adviser-210420063808-4b141eb4e1eb83ca,stable,https://thoth-station.ninja/j/no_stack
adviser-210420124014-210ba76bb7d76b9d,stable,https://thoth-station.ninja/j/no_stack
adviser-210420183925-159898c414874de5,stable,https://thoth-station.ninja/j/no_stack
adviser-210421004658-b7e3345444c2f3c6,stable,https://thoth-station.ninja/j/no_stack
adviser-210421064242-36fc4c38568de4ec,stable,https://thoth-station.ninja/j/no_stack
adviser-210421123916-e3a6b9f1b7990593,stable,https://thoth-station.ninja/j/no_stack
==============================================================
==============================================================
stack n. 8
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
tensorflow = "*"
numpy = "*"
matplotlib = "*"
boto3 = "*"
[dev-packages]
[requires]
python_version = "3.8"
cases identified n. 3
job_id,recommendation_type,error_message
adviser-210416142011-1dac0ec0cdbb7058,latest,Cannot satisfy direct dependencies - direct dependencies of type 'boto3' were removed by pipeline sieves
adviser-210416152901-5e1aa9184a2b7606,latest,Cannot satisfy direct dependencies - direct dependencies of type 'boto3' were removed by pipeline sieves
adviser-210420160701-c051905dcf6b0bf1,latest,Cannot satisfy direct dependencies - direct dependencies of type 'boto3' were removed by pipeline sieves
==============================================================
==============================================================
stack n. 9
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
gzip = "*"
ipynb = "*"
numpy = "*"
pandas = "*"
[dev-packages]
[requires]
python_version = "3.8"
cases identified n. 2
job_id,recommendation_type,error_message
adviser-210416151947-61e1259d1ea166e4,latest,https://thoth-station.ninja/j/solve_direct
adviser-210416151947-61e1259d1ea166e4,latest,https://thoth-station.ninja/j/unresolved
==============================================================
==============================================================
stack n. 10
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
thamos = "*"
behave = "*"
requests = "*"
pyhamcrest = "*"
thoth-storages = "*"
amun = "*"
behave-html-formatter = "*"
gitpython = "*"
pyyaml = "*"
pytoml = "*"
thoth-common = "*"
[dev-packages]
[requires]
python_version = "3.8"
cases identified n. 2
job_id,recommendation_type,error_message
adviser-210416153951-16e43a4be4205123,latest,https://thoth-station.ninja/j/solve_direct
adviser-210416153951-16e43a4be4205123,latest,https://thoth-station.ninja/j/unresolved
==============================================================
==============================================================
stack n. 11
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
pandas = "*"
matplotlib = "*"
[dev-packages]
[requires]
python_version = "3.8"
cases identified n. 1
job_id,recommendation_type,error_message
adviser-210421153924-4b8c3d96224de108,latest,Cannot satisfy direct dependencies - direct dependencies of type 'matplotlib' were removed by pipeline sieves
==============================================================
let's add a few more stacks (I guess that is what you mean) ?
/priority importnant-soon
/label triage/needs-information
@goern: The label(s) priority/importnant-soon cannot be applied, because the repository doesn't have them.
In response to this:
let's add a few more stacks (I guess that is what you mean) ?
/priority importnant-soon
/label triage/needs-information
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.
/priority important-soon
let's add a few more stacks (I guess that is what you mean) ?
/priority importnant-soon
/label triage/needs-information
we can add a folder stacks-tests in integrations-tests?
Thanks for this analysis.
Could you please provide info on deployment where I can find corresponding adviser documents? This will require more info (recommendation type, dev flag value, ...) to debug.
Thanks for this analysis.
Could you please provide info on deployment where I can find corresponding adviser documents? This will require more info (recommendation type,
devflag value, ...) to debug.
Oh, never mind. Found it on moc :)
Thanks for this analysis.
Could you please provide info on deployment where I can find corresponding adviser documents? This will require more info (recommendation type,
devflag value, ...) to debug.
Good point :) I'll add that to the report!
Some of these are using rhel:8+py38 - we should check the state of the ingestion.
These are using rhel:8+py36:
adviser-210415124352-8446af07a1cf87f7
adviser-210415181803-c91fd57d81e2cf7d
adviser-210416062605-265ce4fecdc70518
adviser-210416123359-5e9e4689581e3674
adviser-210417005703-c5c7f78470167853
adviser-210417121000-b1db2943d3d76748
adviser-210418003008-ebaa32aed4b1bca3
adviser-210418122348-66ad9f148eaa87fe
adviser-210419001750-8592bdad27d56e32
adviser-210419062022-50c19b0f862b9b12
adviser-210420005338-6c5c4ad2b5cd9ff7
adviser-210420122451-f1187defc5a5e06c
adviser-210420182312-60ee66eb84d92b28
adviser-210421003019-fd922f9651eb1b22
adviser-210421122317-d98da3b7c5cd7e28
adviser-210416081333-3c6f455dcb9f85e9
adviser-210416134143-9ff4c6792bb4b5c4
Tried to resolve them with the test environment data, it looks like they work (tested with dev and without dev flag).
Let's revisit this issue once rhel:8+py38 data will be available.
Some of these are using rhel:8+py38 - we should check the state of the ingestion.
These are using rhel:8+py36:
adviser-210415124352-8446af07a1cf87f7 adviser-210415181803-c91fd57d81e2cf7d adviser-210416062605-265ce4fecdc70518 adviser-210416123359-5e9e4689581e3674 adviser-210417005703-c5c7f78470167853 adviser-210417121000-b1db2943d3d76748 adviser-210418003008-ebaa32aed4b1bca3 adviser-210418122348-66ad9f148eaa87fe adviser-210419001750-8592bdad27d56e32 adviser-210419062022-50c19b0f862b9b12 adviser-210420005338-6c5c4ad2b5cd9ff7 adviser-210420122451-f1187defc5a5e06c adviser-210420182312-60ee66eb84d92b28 adviser-210421003019-fd922f9651eb1b22 adviser-210421122317-d98da3b7c5cd7e28 adviser-210416081333-3c6f455dcb9f85e9 adviser-210416134143-9ff4c6792bb4b5c4Tried to resolve them with the test environment data, it looks like they work (tested with dev and without dev flag).
Let's revisit this issue once rhel:8+py38 data will be available.
How is possible if test environment data is a subset of prod environment data? @fridex
Some of these are using rhel:8+py38 - we should check the state of the ingestion.
These are using rhel:8+py36:adviser-210415124352-8446af07a1cf87f7 adviser-210415181803-c91fd57d81e2cf7d adviser-210416062605-265ce4fecdc70518 adviser-210416123359-5e9e4689581e3674 adviser-210417005703-c5c7f78470167853 adviser-210417121000-b1db2943d3d76748 adviser-210418003008-ebaa32aed4b1bca3 adviser-210418122348-66ad9f148eaa87fe adviser-210419001750-8592bdad27d56e32 adviser-210419062022-50c19b0f862b9b12 adviser-210420005338-6c5c4ad2b5cd9ff7 adviser-210420122451-f1187defc5a5e06c adviser-210420182312-60ee66eb84d92b28 adviser-210421003019-fd922f9651eb1b22 adviser-210421122317-d98da3b7c5cd7e28 adviser-210416081333-3c6f455dcb9f85e9 adviser-210416134143-9ff4c6792bb4b5c4Tried to resolve them with the test environment data, it looks like they work (tested with dev and without dev flag).
Let's revisit this issue once rhel:8+py38 data will be available.How is possible if test environment data is a subset of prod environment data? @fridex
For the flask stack, it is actually random, if you check the successful adviser runs in the same period, you can see that sometimes succeeds, sometimes not (as shown in the failures above for the same stack):
Analysis of successfull adviser in the period 2021-04-15 - 2021-04-22
Deployment info:
THOTH_DEPLOYMENT_NAME: zero-prod
THOTH_S3_ENDPOINT_URL: https://s3-openshift-storage.apps.zero.massopen.cloud/
THOTH_CEPH_BUCKET: thoth
THOTH_CEPH_BUCKET_PREFIX: data
==============================================================
stack n. 1
==============================================================
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"
[packages]
flask = "*"
[dev-packages]
[requires]
python_version = "3.6"
cases identified n. 9
job_id,source_type,recommendation_type,duration
adviser-210415034346-6a1bffd9ead221fc,CLI,stable,1629
adviser-210416182202-93b8366460f89bee,S2I,latest,706
adviser-210417061248-35ccad2399ea9b3a,S2I,latest,847
adviser-210418061458-b44d5df449b0af24,S2I,latest,691
adviser-210418182040-96a0b0baa9512556,S2I,latest,980
adviser-210419014316-b58be20f30eac8ee,S2I,latest,895
adviser-210419181711-cd34605236cec27f,S2I,latest,767
adviser-210420062122-d63096bb2e469694,S2I,latest,993
adviser-210421062657-9126718d23dfa099,S2I,latest,933
==============================================================
Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
/lifecycle rotten
Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
/close
Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
/lifecycle rotten
@sesheta: Closing this issue.
In response to this:
Rotten issues close after 30d of inactivity.
Reopen the issue with/reopen.
Mark the issue as fresh with/remove-lifecycle rotten./close
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.