acryldata/datahub-helm

Error running Datahub ingestion sources - "PermissionError: [Errno 13] Permission denied: '/tmp/datahub/ingest'\n"

vmm-afonso opened this issue · 4 comments

I just recently installed Datahub using these charts and when I try to run ingestion of any source I get the same error message

Execution finished with errors.
{'exec_id': 'f518fb5d-330d-4d05-8efd-0495467b0e9b',
 'infos': ['2023-07-03 11:01:32.611854 INFO: Starting execution for task with name=RUN_INGEST',
           '2023-07-03 11:01:32.614545 INFO: Caught exception EXECUTING task_id=f518fb5d-330d-4d05-8efd-0495467b0e9b, name=RUN_INGEST, '
           'stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 122, in execute_task\n'
           '    task_event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete\n'
           '    return future.result()\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 73, in execute\n'
           '    SubProcessTaskUtil._write_recipe_to_file(exec_out_dir, file_name, recipe)\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_task_common.py", line 121, in '
           '_write_recipe_to_file\n'
           '    os.makedirs(dir_path, mode = 0o777, exist_ok = True)\n'
           '  File "/usr/local/lib/python3.10/os.py", line 215, in makedirs\n'
           '    makedirs(head, exist_ok=exist_ok)\n'
           '  File "/usr/local/lib/python3.10/os.py", line 225, in makedirs\n'
           '    mkdir(name, mode)\n'
           "PermissionError: [Errno 13] Permission denied: '/tmp/datahub/ingest'\n"],
 'errors': []}



I checked and 'ingest/' doesn't exist inside the pods in /tmp/datahub, not sure if it's supposed to be creating that directory and for whatever reason is failing to do so