Proxmox Ceph Discard on OSD

bei mir wurden auf den SSD kein Discard / Trim ausgeführt.

Ein ceph config dump zeigte das diese Option nicht aktiv ist.

ceph config dump
WHO     MASK  LEVEL     OPTION                                 VALUE         RO
mon           advanced  auth_allow_insecure_global_id_reclaim  false
osd.10        basic     osd_mclock_max_capacity_iops_ssd       12764.398235
osd.11        basic     osd_mclock_max_capacity_iops_ssd       11254.838483
osd.12        basic     osd_mclock_max_capacity_iops_ssd       15067.281439
osd.13        basic     osd_mclock_max_capacity_iops_ssd       13146.287315
osd.14        basic     osd_mclock_max_capacity_iops_ssd       14661.588902
osd.3         basic     osd_mclock_max_capacity_iops_ssd       6344.392291
osd.4         basic     osd_mclock_max_capacity_iops_ssd       6282.188363
osd.5         basic     osd_mclock_max_capacity_iops_ssd       15347.772624
osd.6         basic     osd_mclock_max_capacity_iops_ssd       20714.653473
osd.7         basic     osd_mclock_max_capacity_iops_ssd       12650.142699
osd.8         basic     osd_mclock_max_capacity_iops_ssd       11235.731015
osd.9         basic     osd_mclock_max_capacity_iops_ssd       18681.420156

mit dem Kommando hier kann man bei allen OSD das Discard / Trim Aktivieren

for OSD in `ceph config dump |grep osd |grep basic |awk '{print $1}'`; do echo $OSD; ceph config set $OSD bdev_async_discard true; ceph config set $OSD bdev_enable_discard true; done

Danach schaut die Sache dann so aus

WHO     MASK  LEVEL     OPTION                                 VALUE         RO
mon           advanced  auth_allow_insecure_global_id_reclaim  false
osd.10        advanced  bdev_async_discard                     true
osd.10        advanced  bdev_enable_discard                    true
osd.10        basic     osd_mclock_max_capacity_iops_ssd       12764.398235
osd.11        advanced  bdev_async_discard                     true
osd.11        advanced  bdev_enable_discard                    true
osd.11        basic     osd_mclock_max_capacity_iops_ssd       11254.838483
osd.12        advanced  bdev_async_discard                     true
osd.12        advanced  bdev_enable_discard                    true
osd.12        basic     osd_mclock_max_capacity_iops_ssd       15067.281439
osd.13        advanced  bdev_async_discard                     true
osd.13        advanced  bdev_enable_discard                    true
osd.13        basic     osd_mclock_max_capacity_iops_ssd       13146.287315
osd.14        advanced  bdev_async_discard                     true
osd.14        advanced  bdev_enable_discard                    true
osd.14        basic     osd_mclock_max_capacity_iops_ssd       14661.588902
osd.3         advanced  bdev_async_discard                     true
osd.3         advanced  bdev_enable_discard                    true
osd.3         basic     osd_mclock_max_capacity_iops_ssd       6344.392291
osd.4         advanced  bdev_async_discard                     true
osd.4         advanced  bdev_enable_discard                    true
osd.4         basic     osd_mclock_max_capacity_iops_ssd       6282.188363
osd.5         advanced  bdev_async_discard                     true
osd.5         advanced  bdev_enable_discard                    true
osd.5         basic     osd_mclock_max_capacity_iops_ssd       15347.772624
osd.6         advanced  bdev_async_discard                     true
osd.6         advanced  bdev_enable_discard                    true
osd.6         basic     osd_mclock_max_capacity_iops_ssd       20714.653473
osd.7         advanced  bdev_async_discard                     true
osd.7         advanced  bdev_enable_discard                    true
osd.7         basic     osd_mclock_max_capacity_iops_ssd       12650.142699
osd.8         advanced  bdev_async_discard                     true
osd.8         advanced  bdev_enable_discard                    true
osd.8         basic     osd_mclock_max_capacity_iops_ssd       11235.731015
osd.9         advanced  bdev_async_discard                     true
osd.9         advanced  bdev_enable_discard                    true
osd.9         basic     osd_mclock_max_capacity_iops_ssd       18681.420156