[cetic/nifi] Parameter context cannot be found when scaling up Nifi Cluster
andyadamides opened this issue · 1 comments
Describe the bug
My setup is a Nifi Cluster, initially with 1 node. I have created a parameter context(while on 1 node) and associated it with process groups(>1) in my Canvas. When I increase to three nodes(they successfully connect in the cluster - verified from Nifi UI and from kubectl get pods with no errors), and when I reach the Nifi UI, to view/edit that very same parameter context I get the error:
No parameter context with id: "<Uuid>"
I also get the same error when I try to reach the parameter context via the APIs. When I list all parameter contexts this param context shows up, but when I try to modify or even delete via API call, I get the same error.
When I scale back to 1 node, repeat the above in the Nifi UI, I can view/edit the parameter context without any issues.
Can anyone please suggest a fix or any pointers as to how to approach this issue?
(1) Scaling down Nifi cluster, i.e. from 3->1 node
(2) Doing changes while on 1 node, i.e. adding a parameter context or changing flows
(3) Scaling up Nifi Cluster, i.e. from 1-> 3 nodes
(4) This results in sync issues, since when step(1) occurs, only the Kubernetes pod gets deleted, and not the Kubernetes PVC relating to state of parameter contexts. Then, when (3) occurs, there are multiple exceptions occurring because the PVC of the nodes that were missing , do not know about the changes.
Repeating the above, but deleting the flowfile repository PVC before (3), solves the issue