[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ceph-users
Subject:    [ceph-users] Help with down OSD with Ceph 12.1.4 on Bluestore back
From:       mnelson () redhat ! com (Mark Nelson)
Date:       2017-08-29 23:14:27
Message-ID: 9993dea9-3836-e064-77e4-dc30d54baaad () redhat ! com
[Download RAW message or body]

Hi Bryan,

Check out your SCSI device failures, but if that doesn't pan out, Sage 
and I have been tracking this:

http://tracker.ceph.com/issues/21171

There's a fix in place being tested now!

Mark

On 08/29/2017 05:41 PM, Bryan Banister wrote:
> Found some bad stuff in the messages file about SCSI block device fails?
> I think I found my smoking gun?
> 
> -B
> 
> 
> 
> *From:* ceph-users [mailto:ceph-users-bounces at lists.ceph.com] *On Behalf
> Of *Bryan Banister
> *Sent:* Tuesday, August 29, 2017 5:02 PM
> *To:* ceph-users at lists.ceph.com
> *Subject:* [ceph-users] Help with down OSD with Ceph 12.1.4 on Bluestore
> back
> 
> 
> 
> /Note: External Email/
> 
> ------------------------------------------------------------------------
> 
> Hi all,
> 
> 
> 
> Not sure what to do with this down OSD:
> 
> 
> 
> -2> 2017-08-29 16:55:34.588339 7ffff2d58700  1 --
> 7.128.13.57:6979/18818 --> 7.128.13.55:0/52877 -- osd_ping(ping_reply
> e935 stamp 2017-08-29 16:55:34.587991) v4 -- 0x555567397000 con 0
> 
> -1> 2017-08-29 16:55:34.588351 7ffff2557700  1 --
> 7.128.13.57:6978/18818 --> 7.128.13.55:0/52877 -- osd_ping(ping_reply
> e935 stamp 2017-08-29 16:55:34.587991) v4 -- 0x555567395000 con 0
> 
> 0> 2017-08-29 16:55:34.650061 7fffecd93700 -1
> /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVA \
> ILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.1.4/rpm/el7/BUILD/ceph-12.1.4/src/os/bluestore/KernelDevice.cc:
>  In function 'void KernelDevice::_aio_thread()' thread 7fffecd93700 time
> 2017-08-29 16:55:34.648642
> 
> /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVA \
> ILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.1.4/rpm/el7/BUILD/ceph-12.1.4/src/os/bluestore/KernelDevice.cc:
>                 
> 372: FAILED assert(r >= 0)
> 
> 
> 
> ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
> 
> 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char
> const*)+0x110) [0x555555fb4420]
> 
> 2: (KernelDevice::_aio_thread()+0x4b5) [0x555555f59ce5]
> 
> 3: (KernelDevice::AioCompletionThread::entry()+0xd) [0x555555f5e3cd]
> 
> 4: (()+0x7dc5) [0x7ffff5635dc5]
> 
> 5: (clone()+0x6d) [0x7ffff472a73d]
> 
> NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed
> to interpret this.
> 
> 
> 
> --- logging levels ---
> 
> 0/ 5 none
> 
> 0/ 1 lockdep
> 
> 0/ 1 context
> 
> [snip]
> 
> 
> 
> Any help with recovery would be greatly appreciated, thanks!
> 
> -Bryan
> 
> 
> 
> ------------------------------------------------------------------------
> 
> 
> Note: This email is for the confidential use of the named addressee(s)
> only and may contain proprietary, confidential or privileged
> information. If you are not the intended recipient, you are hereby
> notified that any review, dissemination or copying of this email is
> strictly prohibited, and to please notify the sender immediately and
> destroy this email and any attachments. Email transmission cannot be
> guaranteed to be secure or error-free. The Company, therefore, does not
> make any guarantees as to the completeness or accuracy of this email or
> any attachments. This email is for informational purposes only and does
> not constitute a recommendation, offer, request or solicitation of any
> kind to buy, sell, subscribe, redeem or perform any type of transaction
> of a financial product.
> 
> 
> ------------------------------------------------------------------------
> 
> Note: This email is for the confidential use of the named addressee(s)
> only and may contain proprietary, confidential or privileged
> information. If you are not the intended recipient, you are hereby
> notified that any review, dissemination or copying of this email is
> strictly prohibited, and to please notify the sender immediately and
> destroy this email and any attachments. Email transmission cannot be
> guaranteed to be secure or error-free. The Company, therefore, does not
> make any guarantees as to the completeness or accuracy of this email or
> any attachments. This email is for informational purposes only and does
> not constitute a recommendation, offer, request or solicitation of any
> kind to buy, sell, subscribe, redeem or perform any type of transaction
> of a financial product.
> 
> 
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 


[prev in list] [next in list] [prev in thread] [next in thread]