Cattle Cluster Agent flapping with runtime error: slice bounds out of range [:3] with capacity 0
This document (000021006) is provided subject to the disclaimer at the end of this document.
Environment
Situation
0308 15:04:59.702627 55 runtime.go:78] Observed a panic: runtime.boundsError{x:3, y:0, signed:true, code:0x2} (runtime error: slice bounds out of range [:3] with capacity 0) goroutine 3160 [running]: k8s.io/apimachinery/pkg/util/runtime.logPanic({0x3cee760, 0xc00bef0660}) /go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/runtime/runtime.go:74 +0x7d k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xfffffffe}) /go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/runtime/runtime.go:48 +0x75 panic({0x3cee760, 0xc00bef0660}) /usr/lib64/go/1.17/src/runtime/panic.go:1038 +0x215 github.com/rancher/rancher/pkg/catalogv2/helm.decodeHelm3({0x0, 0xc9d32d}) /go/src/github.com/rancher/rancher/pkg/catalogv2/helm/helm3.go:124 +0x1b1 github.com/rancher/rancher/pkg/catalogv2/helm.fromHelm3Data({0x0, 0xc004d60540}, 0x3fc4c34) /go/src/github.com/rancher/rancher/pkg/catalogv2/helm/helm3.go:23 +0x25 github.com/rancher/rancher/pkg/catalogv2/helm.ToRelease({0x47b3a20, 0xc004d60540}, 0x6c696877206e6564) /go/src/github.com/rancher/rancher/pkg/catalogv2/helm/release.go:74 +0x3eb github.com/rancher/rancher/pkg/controllers/dashboard/helm.(*appHandler).OnSecretChange(0xc00baa1950, {0xc005b81080, 0x2d}, 0xc004d60540) /go/src/github.com/rancher/rancher/pkg/controllers/dashboard/helm/apps.go:170 +0xa5
Resolution
kubectl get secrets -A | grep helm.sh/release.v1All secrets with no release data on the downstream cluster need to be deleted to allow cattle-cluster-agent to start properly.
kubectl delete secrets -n <NAMESPACE> <SECRET_NAME>Once the bad Helm release secrets are removed, cattle-cluster-agent pods should successfully start. If desired, the current cattle-cluster-agent pods in a CrashLoopBackOff can be deleted to speed up this process.
Cause
Additional Information
Per the GitHub issue, this is scheduled for the 2023-Q2 releases
Disclaimer
This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.
- Document ID:000021006
- Creation Date: 08-Mar-2023
- Modified Date:08-Mar-2023
-
- SUSE Rancher
For questions or concerns with the SUSE Knowledgebase please contact: tidfeedback[at]suse.com