Troubleshooting Memory Leak Issue on Rancher 2.7.2+

This document (000021094) is provided subject to the disclaimer at the end of this document.

Environment

Rancher 2.7.2 - 2.7.4

Situation

Users have reported instances of memory leaks in Rancher 2.7.2 - 2.7.4 deployments. This issue can lead to increased memory usage, potentially impacting the performance and stability of the system.

Resolution

To resolve the memory leak problem, it is recommended to upgrade to Rancher 2.7.5, which contains a fix for this issue. If this is not possible, please proceed with the steps below as a workaround. 

Step 1: Check Environment Variables

1.1. For the local cluster:

  • Verify if the environment variable CATTLE_REQUEST_CACHE_DISABLED is set to true in the Rancher deployment of the local cluster.

1.2. For downstream clusters with high memory usage:

  • Check the cattle-cluster-agent deployment of any downstream clusters experiencing high memory usage.
  • Confirm if the environment variable CATTLE_REQUEST_CACHE_DISABLED is set to true in the cattle-cluster-agent deployment.

Step 2: Set Memory Limits on Deployments (if necessary). If the memory leak issue persists after adjusting the environment variables, you can try setting memory limits on the deployments as an additional measure. Here's how to do it:

2.1. For the local cluster:

  • Access the Rancher deployment of the local cluster.
  • Set the memory limit for the Rancher deployment to 2Gi.

2.2. For downstream clusters with high memory usage:

  • Access the cattle-cluster-agent deployment of the affected downstream clusters.
  • Set the appropriate memory limit to 2Gi.

 

    By following these steps, including checking and adjusting the environment variables, setting memory limits if necessary, and upgrading to Rancher 2.7.5, you can effectively address the memory leak issue in Rancher 2.7.2 - 2.7.4 deployments.

    Cause

    https://github.com/rancher/rancher/issues/41379

    Disclaimer

    This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.

    • Document ID:000021094
    • Creation Date: 07-Jun-2023
    • Modified Date:19-Jul-2023
      • SUSE Rancher

    < Back to Support Search

    For questions or concerns with the SUSE Knowledgebase please contact: tidfeedback[at]suse.com

    SUSE Support Forums

    Get your questions answered by experienced Sys Ops or interact with other SUSE community experts.

    Join Our Community

    Support Resources

    Learn how to get the most from the technical support you receive with your SUSE Subscription, Premium Support, Academic Program, or Partner Program.


    SUSE Customer Support Quick Reference Guide SUSE Technical Support Handbook Update Advisories
    Support FAQ

    Open an Incident

    Open an incident with SUSE Technical Support, manage your subscriptions, download patches, or manage user access.

    Go to Customer Center