Reconciler error
Opened this issue · 0 comments
guyguy333 commented
Hello,
Our nodes are changed everyday (long story) but sometimes, VPC connection is not working and rebooting vpc-node pod results in:
I1020 17:25:00.639714 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"=":8080"
I1020 17:25:01.137435 1 node.go:108] setup "msg"="starting manager"
I1020 17:25:01.139272 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
I1020 17:25:01.140499 1 controller.go:142] controller "msg"="Starting EventSource" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"id":"","nodeName":""},"status":{"linkName":"","macAddress":""}}}
I1020 17:25:01.242497 1 controller.go:142] controller "msg"="Starting EventSource" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"id":""},"status":{}}}
I1020 17:25:01.344076 1 controller.go:149] controller "msg"="Starting Controller" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
I1020 17:25:01.344206 1 controller.go:176] controller "msg"="Starting workers" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" "worker count"=1
E1020 17:25:01.756659 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:01.756829 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:03.206108 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:03.206251 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:04.662746 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:04.662920 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:06.086721 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:06.086872 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:07.542605 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:07.542748 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:08.978448 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:08.978572 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:10.621461 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:10.622092 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:12.095565 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:12.095689 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:13.571530 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:13.642116 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:15.368710 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:15.368933 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:18.359452 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:18.359611 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:23.932903 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:23.933131 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:34.586873 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:34.587262 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
E1020 17:25:55.501756 1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"}
E1020 17:25:55.502024 1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"
It's second time happening in 3 months. Replacing the node fixes the issue.