SUSE Support

Here When You Need Us

Kube-proxy not upgrading correctly

This document (000021284) is provided subject to the disclaimer at the end of this document.


SUSE Rancher 2.7.x


There is a bug affecting the upgrade of Downstream RKE2 clusters from v1.25.x to v1.26.x. The kube-proxy containers don't restart on the worker nodes, and they get stuck on the pre-upgrade version.


A manual workaround is available to force the kube-proxy to upgrade to the correct version.  

The following steps will help upgrade the kube-proxy in the worker nodes:
  1. Log in to the worker node with the non-updated kube-proxy through SSH.
  2. Move the kube-proxy.yaml manifest out of the static pod folder. You might need to change the route if you are using a non-default static pod folder.
    mv /var/lib/rancher/rke2/agent/pod-manifests/kube-proxy.yaml /var/lib/rancher/rke2/agent/kube-proxy.yaml_backup
  3. Restart the rke2-agent service.
    systemctl restart rke2-agent


There is a race condition between the Kubernetes API and the Kubelet. The mirror pod on the API comes back to the node before the new container is created by the Kubelet, so the kube-proxy doesn't upgrade. By restarting the rke2-agent service and moving out the static pod manifest, there is more time for the Kubelet to order containerd to create the pod, this way the mirror pod is delayed enough so the race condition doesn't happen.


This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.

  • Document ID:000021284
  • Creation Date: 28-Nov-2023
  • Modified Date:24-Jan-2024
    • SUSE Rancher

< Back to Support Search

For questions or concerns with the SUSE Knowledgebase please contact: tidfeedback[at]

SUSE Support Forums

Get your questions answered by experienced Sys Ops or interact with other SUSE community experts.

Support Resources

Learn how to get the most from the technical support you receive with your SUSE Subscription, Premium Support, Academic Program, or Partner Program.

Open an Incident

Open an incident with SUSE Technical Support, manage your subscriptions, download patches, or manage user access.