AnubisLMS/Anubis

ADD submission pipeline log capture

wabscale opened this issue · 0 comments

We'll want to start off with adding a new pipeline_log blob column to the submission table

class Submission(db.Model):

Create the migration for it (running it will be tricky as it will definitely take a minute to run)

Then replace this with something that will get the logs and store them on some new column of the submission:

elif job.status.succeeded is not None and job.status.succeeded >= 1:
# Attempt to delete the k8s job
delete_pipeline_job(batch_v1, job)

I'm not sure we really need to be explicitly deleting jobs as they finish. We can just rely on kubernetes cleaning them up, or we can add the job ttl https://kubernetes.io/docs/concepts/workloads/controllers/ttlafterfinished/