How to speed up or slow down osd recovery
This document (000019693) is provided subject to the disclaimer at the end of this document.
SUSE Enterprise Storage 6
This may happen when osd(s) are stopped or removed from the cluster.
It may also happenwhen osd(s) are added to the cluster.
You can also set these values if you want a quick recovery for your cluster, helping OSDs to perform recovery faster.
- osd max backfills: This is the maximum number of backfill operations allowed to/from OSD. The higher the number, the quicker the recovery, which might impact overall cluster performance until recovery finishes.
- osd recovery max active: This is the maximum number of active recover requests. Higher the number, quicker the recovery, which might impact the overall cluster performance until recovery finishes.
- osd recovery op priority: This is the priority set for recovery operation. Lower the number, higher the recovery priority. Higher recovery priority might cause performance degradation until recovery completes.
ceph-admin:~ # ceph-config --show-config | egrep "osd_recovery_max_active|osd_recovery_op_priority|osd_max_backfills"
osd_max_backfills = 1
osd_recovery_max_active = 3
osd_recovery_op_priority = 3
ceph tell 'osd.*' injectargs --osd-max-backfills=3 --osd-recovery-max-active=9
To set back to default, run:
"ceph config set" also works with SES 6:
To set back to default run:
ceph config rm osd osd_max_backfills
Setting the values to high can cause osd's to restart, causing the cluster to become unstable.
Monitor with "ceph -s".
If osd's start restarting, then reduce the values.
If clients are impacted by the recovery, reduce the values.
To slow down recovery, reduce values to default.
When cluster is healty set values back to default.
This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.
- Document ID:000019693
- Creation Date: 07-Dec-2020
- Modified Date:07-Dec-2020
- SUSE Enterprise Storage
For questions or concerns with the SUSE Knowledgebase please contact: email@example.com