[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ceph-users
Subject:    [ceph-users] Re: High ceph_osd_commit_latency_ms on Toshiba MG07ACA14TE HDDs
From:       Dan van der Ster <dan () vanderster ! com>
Date:       2021-11-08 15:46:35
Message-ID: CABZ+qqkFPTaNYU+n+0iMcXhU3EaP8WUTVO_dq+d+OXLrGwV3-Q () mail ! gmail ! com
[Download RAW message or body]

Hi Benoît,

On Mon, Nov 8, 2021 at 4:31 PM Benoît Knecht <bknecht@protonmail.ch> wrote:
> 
> Hi Dan,
> 
> On Thursday, November 4th, 2021 at 11:33, Dan van der Ster <dan@vanderster.com> \
> wrote:
> > - Are we running the same firmware as you? (We have 0104). I wonder if
> > Toshiba has changed the implementation of the cache in the meantime...
> 
> I just checked, and all our Toshiba MG07ACA14TE drives run firmware version 0101; \
> and as far as I know, Toshiba doesn't provide firmware images for its drives, so I \
> don't think it's possible to upgrade/downgrade the firmware on those drives. 
> > - Is anyone aware of some HBA or other setting in the middle that
> > might be masking this setting from reaching the drive?
> 
> In our case it's an LSI SAS3008 card, and we disable the write cache with `smartctl \
> --set=wcache,off /dev/sdX`.

Eventually we found it necessary to make the change by

echo 'write through' >  /sys/class/scsi_disk/sdX/cache_type

And now we have a udev rule to apply it to all sata/scsi disks:

# cat /etc/udev/rules.d/99-ceph-write-through.rules
ACTION=="add", SUBSYSTEM=="scsi_disk", ATTR{cache_type}:="write through"

Thanks!

Dan

> 
> Cheers,
> 
> --
> Ben
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-leave@ceph.io


[prev in list] [next in list] [prev in thread] [next in thread]