[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ceph-community
Subject:    [Ceph-community] Noobie question about OSD fail
From:       pmcgarry () redhat ! com (Patrick McGarry)
Date:       2016-07-27 17:24:02
Message-ID: CAAZbbf2+7fLCUYEDh2LiMK6DA-FVrZGHag-fua4+my5RGo2n1Q () mail ! gmail ! com
[Download RAW message or body]

Moving this to ceph-user.


On Wed, Jul 27, 2016 at 8:36 AM, Kostya Velychkovsky
<velychkovsky at gmail.com> wrote:
> Hello. I have test CEPH cluster with 5 nodes:  3 MON and 2 OSD
>
> This is my ceph.conf
>
> [global]
> fsid = 714da611-2c40-4930-b5b9-d57e70d5cf7e
> mon_initial_members = node1
> mon_host = node1,node3,node4
>
> auth_cluster_required = cephx
> auth_service_required = cephx
> auth_client_required = cephx
> osd_pool_default_size = 2
> public_network = X.X.X.X/24
>
> [mon]
> osd report timeout = 15
> osd min down reports = 2
>
> [osd]
> mon report interval max = 30
> mon heartbeat interval = 15
>
>
> So, while I run some fail tests and hard reset one OSD node, I have long
> timeout while ceph mark this OSD down, ~15 minutes
>
> and ceph -s display that cluster OK.
> ---------------
>     cluster 714da611-2c40-4930-b5b9-d57e70d5cf7e
>      health HEALTH_OK
>      monmap e5: 3 mons at ....
>             election epoch 272, quorum 0,1,2 node1,node3,node4
>      osdmap e90: 2 osds: 2 up, 2 in
> ---------------
> Only after ~15 minutes mon nodes Mark this OSD down, and change state of
> cluster
> ----------------
>      osdmap e86: 2 osds: 1 up, 2 in; 64 remapped pgs
>             flags sortbitwise
>       pgmap v3927: 64 pgs, 1 pools, 10961 MB data, 2752 objects
>             22039 MB used, 168 GB / 189 GB avail
>             2752/5504 objects degraded (50.000%)
>                   64 active+undersized+degraded
> ---------------
>
> I tried to ajust 'osd report timeout'  but have the same result.
>
> Can you pls help me tune my cluster to decrease this reaction time ?
>
> --
> Best Regards
>
> Kostiantyn Velychkovsky
>
> _______________________________________________
> Ceph-community mailing list
> Ceph-community at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-community-ceph.com
>



-- 

Best Regards,

Patrick McGarry
Director Ceph Community || Red Hat
http://ceph.com  ||  http://community.redhat.com
@scuttlemonkey || @ceph

[prev in list] [next in list] [prev in thread] [next in thread]