COVID Pipeline fails with latest dataset
lresende opened this issue · 0 comments
lresende commented
Processing notebook: /Users/lresende/opensource/elyra/covid-notebooks/notebooks/fit_us_data.ipynb
Input Notebook: /Users/lresende/opensource/elyra/covid-notebooks/notebooks/fit_us_data.ipynb
Output Notebook: /Users/lresende/opensource/elyra/covid-notebooks/notebooks/fit_us_data.ipynb
Working directory: /Users/lresende/opensource/elyra/covid-notebooks/notebooks
[E 2022-02-21 09:41:13.737 ServerApp] Error executing fit_us_data.ipynb in cell 4: KeyError "None of [Index([False, False, False, False, False, False, False, False, False, False,\n ...\n False, False, False, False, False, False, False, False, False, False],\n dtype='object', length=3144)] are in the [columns]"
[E 2022-02-21 09:41:13.738 ServerApp] Uncaught exception POST /elyra/pipeline/schedule?1645465117799 (::1)
HTTPServerRequest(protocol='http', host='localhost:8888', method='POST', uri='/elyra/pipeline/schedule?1645465117799', version='HTTP/1.1', remote_ip='::1')
Traceback (most recent call last):
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 236, in process
**additional_kwargs
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/papermill/execute.py", line 122, in execute_notebook
raise_for_execution_errors(nb, output_path)
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/papermill/execute.py", line 234, in raise_for_execution_errors
raise error
papermill.exceptions.PapermillExecutionError:
---------------------------------------------------------------------------
Exception encountered at "In [4]":
---------------------------------------------------------------------------
KeyError Traceback (most recent call last)
/var/folders/q9/56k2sq6x5dxclhkhsvr8wbcc0000gn/T/ipykernel_95737/785420378.py in <module>
1 util.graph_examples(cases, ts_col_name, {},
----> 2 mask=(np.max(cases[ts_col_name].array, axis=1) < 10))
~/opensource/elyra/covid-notebooks/notebooks/util.py in graph_examples(data_df, col_name, curves, mask, num_to_pick, semilog)
134 :param semilog: If `True`, draw a semilog plot with a logarithmic Y axis
135 """
--> 136 df_subset = data_df[mask]
137 num_to_pick = min(num_to_pick, len(df_subset.index))
138 if num_to_pick == 0:
~/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/pandas/core/frame.py in __getitem__(self, key)
2910 if is_iterator(key):
2911 key = list(key)
-> 2912 indexer = self.loc._get_listlike_indexer(key, axis=1, raise_missing=True)[1]
2913
2914 # take() does not accept boolean indexers
~/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/pandas/core/indexing.py in _get_listlike_indexer(self, key, axis, raise_missing)
1252 keyarr, indexer, new_indexer = ax._reindex_non_unique(keyarr)
1253
-> 1254 self._validate_read_indexer(keyarr, indexer, axis, raise_missing=raise_missing)
1255 return keyarr, indexer
1256
~/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/pandas/core/indexing.py in _validate_read_indexer(self, key, indexer, axis, raise_missing)
1296 if missing == len(indexer):
1297 axis_name = self.obj._get_axis_name(axis)
-> 1298 raise KeyError(f"None of [{key}] are in the [{axis_name}]")
1299
1300 # We (temporarily) allow for some missing keys with .loc, except in
KeyError: "None of [Index([False, False, False, False, False, False, False, False, False, False,\n ...\n False, False, False, False, False, False, False, False, False, False],\n dtype='object', length=3144)] are in the [columns]"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 99, in process
operation_processor.process(operation, elyra_run_name)
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 242, in process
f'{str(pmee.ename)} {str(pmee.evalue)}') from pmee
RuntimeError: (fit_us_data.ipynb) in cell 4: KeyError "None of [Index([False, False, False, False, False, False, False, False, False, False,\n ...\n False, False, False, False, False, False, False, False, False, False],\n dtype='object', length=3144)] are in the [columns]"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/tornado/web.py", line 1704, in _execute
result = await result
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/handlers.py", line 120, in post
response = await PipelineProcessorManager.instance().process(pipeline)
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/processor.py", line 134, in process
res = await asyncio.get_event_loop().run_in_executor(None, processor.process, pipeline)
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/asyncio/futures.py", line 263, in __await__
yield self # This tells Task to wait for completion.
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/asyncio/tasks.py", line 318, in __wakeup
future.result()
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/asyncio/futures.py", line 181, in result
raise self._exception
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 104, in process
raise RuntimeError(f'Error processing operation {operation.name} {str(ex)}') from ex
RuntimeError: Error processing operation fit_us_data (fit_us_data.ipynb) in cell 4: KeyError "None of [Index([False, False, False, False, False, False, False, False, False, False,\n ...\n False, False, False, False, False, False, False, False, False, False],\n dtype='object', length=3144)] are in the [columns]"
[E 2022-02-21 09:41:13.748 ServerApp] {
"Host": "localhost:8888",
"Connection": "keep-alive",
"Content-Length": "12880",
"Sec-Ch-Ua": "\" Not A;Brand\";v=\"99\", \"Chromium\";v=\"98\", \"Google Chrome\";v=\"98\"",
"Authorization": "token 254feb7c1bd01e9eeefca12f8669bbd46137d623f51475ca",
"X-Xsrftoken": "2|faae01c9|167f56a415b0c07788793ba2064622db|1645330609",
"Sec-Ch-Ua-Mobile": "?0",
"Content-Type": "text/plain;charset=UTF-8",
"User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36",
"Sec-Ch-Ua-Platform": "\"macOS\"",
"Accept": "*/*",
"Origin": "http://localhost:8888",
"Sec-Fetch-Site": "same-origin",
"Sec-Fetch-Mode": "cors",
"Sec-Fetch-Dest": "empty",
"Referer": "http://localhost:8888/lab/workspaces/auto-9/tree/pipelines/us_data.pipeline",
"Accept-Encoding": "gzip, deflate, br",
"Accept-Language": "en-US,en;q=0.9,pt-BR;q=0.8,pt;q=0.7",
"Cookie": "_xsrf=2|faae01c9|167f56a415b0c07788793ba2064622db|1645330609; username-localhost-8888=\"2|1:0|10:1645465116|23:username-localhost-8888|44:NGQ5MjgxNTI0ODRlNGI2NzkwMDI2NWY1NjcxNzcyMDc=|8196ad279effd7a7174024dbac43ef92d88a0a9fcb71119e7d45c72111870b11\""
NOT A CONTRIBUTION