[prev in list] [next in list] [prev in thread] [next in thread] 

List:       openais
Subject:    Re: [Openais] binding to corosync
From:       eXeC001er <execooler () gmail ! com>
Date:       2013-04-03 12:19:39
Message-ID: CALBCzHeXk-fz9BxbAf5T7=9Gz3=8Hv2QbB8Z_iaE=k-3+fAMug () mail ! gmail ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]


have found the following:

1. I compiled corosync and libqb without '-pthread'

2. thread stack size on Solaris:
    platform 32 bit  = 1 MB
    platform 64 bit = 2 MB

The second case is related to corosync, because it
defines IPC_DISPATCH_SIZE = 1 MB without '--enable-small-memory-footprint'.

Thanks.

2013/3/28 Jan Friesse <jfriesse@redhat.com>

> Hi,
> your testing machine was Linux? Solaris (or actually, OpenIndiana) was
> tested in 2.0 time frame successfully. This really looks like problem in
> LibQB (regression?). Can you please try to contact
> quarterback-devel@lists.fedorahosted.org (or file a libqb issue at
> github), because from corosync side, there is now way how to help.
>
> Regards,
>   Honza
>
> eXeC001er napsal(a):
> > 2013/3/28 Jan Friesse <jfriesse@redhat.com>
> >
> >> Hi,
> >> corosync functions never returns ERRNO errors. They are returning errors
> >> like CS_ERR_*. What is return value you've got from cmap_initialize?
> >>
> >
> > the stack-trace:
> >
> > /3@3:   -> libvotequorum:votequorum_initialize(0x8834b2c, 0x0, 0x0,
> > 0xfea63855)
> > /2: nanosleep(0xFE99BF48, 0x00000000)       = 0
> > /3@3:     -> libqb:qb_hdb_handle_create()
> > /3@3:     <- libqb:qb_hdb_handle_create() = 0
> > /3@3:     -> libcorosync_common:hdb_error_to_cs()
> > /3@3:     <- libcorosync_common:hdb_error_to_cs() = 1
> > /3@3:     -> libqb:qb_hdb_handle_get()
> > /3@3:     <- libqb:qb_hdb_handle_get() = 0
> > /3@3:     -> libcorosync_common:hdb_error_to_cs()
> > /3@3:     <- libcorosync_common:hdb_error_to_cs() = 1
> > /3@3:     -> libqb:qb_ipcc_connect()
> > /3: so_socket(PF_UNIX, SOCK_STREAM, 0, 0x00000000, SOV_DEFAULT) = 8
> > /3: fcntl(8, F_GETFD, 0x00000000)           = 0
> > /3: fcntl(8, F_SETFD, 0x00000001)           = 0
> > /3: fcntl(8, F_SETFL, FNONBLOCK)            = 0
> > /3: connect(8, 0xFE67C13A, 21, SOV_DEFAULT)     = 0
> > /3: sigaction(SIGPIPE, 0xFE67C0E0, 0xFE67C140)  = 0
> > /3: send(8, "FFFFFFFF\0\0\0\018\0\0\0".., 24, 0)    = 24
> > /3: sigaction(SIGPIPE, 0xFE67C0E0, 0x00000000)  = 0
> > /3: sigaction(SIGPIPE, 0xFE67C0D0, 0xFE67C130)  = 0
> > /3: recv(8, 0xFE67C210, 3112, 64)           Err#11 EAGAIN
> > /3: sigaction(SIGPIPE, 0xFE67C0D0, 0x00000000)  = 0
> > /3: shutdown(8, SHUT_RDWR, SOV_DEFAULT)     = 0
> > /3: close(8)                    = 0
> > /3@3:     <- libqb:qb_ipcc_connect() = 0
> > /3@3:     -> libcorosync_common:qb_to_cs_error()
> > /3@3:     <- libcorosync_common:qb_to_cs_error() = 12
> > /3@3:     -> libqb:qb_hdb_handle_put(0xfe9f3070, 0x0, 0xb86775,
> 0xfe67ce7c)
> > /3@3:     <- libqb:qb_hdb_handle_put() = 0
> > /3@3:     -> libqb:qb_hdb_handle_destroy(0xfe9f3070, 0x0, 0xb86775, 0x0)
> > /3@3:       -> libqb:qb_ipcc_disconnect(0x0, 0x8835b88, 0x0, 0x1)
> > /3@3:       <- libqb:qb_ipcc_disconnect() = 0
> > /3@3:     <- libqb:qb_hdb_handle_destroy() = 0
> > /3@3:   <- libvotequorum:votequorum_initialize() = 12
> >
> > As you can see it returns CS_ERR_NOT_EXIST.
> >
> > same behaviour with CMAP and another services.
> >
> > forgot to say: OS is Solaris.
> >
> > Thanks.
> >
> >>
> >> Regards,
> >>   Honza
> >>
> >> eXeC001er napsal(a):
> >>> Hello.
> >>>
> >>> I tried to create an application that uses corosync via its libraries,
> >> but
> >>> it seems something wrong.
> >>> On the machine where i debug corosync-tests work fine, but my
> application
> >>> does not work. The application cannot intialize CMAP connection (same
> >> with
> >>> VOTEQUORUM).
> >>> "*_initialize" function returned EEXIST error. on server side i see
> >> "Error
> >>> in connection setup (7104-7367-0): Broken pipe (32)".
> >>>
> >>> My appliacation is multi-thread and "*_initialize" is called not in
> main
> >>> thread.
> >>>
> >>> Any ideas?
> >>>
> >>> Thanks.
> >>>
> >>>
> >>>
> >>>
> >>> _______________________________________________
> >>> Openais mailing list
> >>> Openais@lists.linux-foundation.org
> >>> https://lists.linuxfoundation.org/mailman/listinfo/openais
> >>
> >>
> >
> >
> >
> > _______________________________________________
> > Openais mailing list
> > Openais@lists.linux-foundation.org
> > https://lists.linuxfoundation.org/mailman/listinfo/openais
>
>

[Attachment #5 (text/html)]

<span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">have \
found the following:</span><div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">
 <br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">1. \
I compiled corosync and libqb without &#39;-pthread&#39;</div><div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">
 <br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">2. \
thread stack size on Solaris:</div><div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">
  platform 32 bit   = 1 MB</div><div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)"> \
platform 64 bit = 2 MB</div><div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">
 <br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">The \
second case is related to corosync, because it defines  IPC_DISPATCH_SIZE = 1 MB \
without &#39;--enable-small-memory-footprint&#39;.</div> <div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)"><br></div><div \
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:18px;background-color:rgb(255,255,255)">
 Thanks.</div><br><div class="gmail_quote">2013/3/28 Jan Friesse <span \
dir="ltr">&lt;<a href="mailto:jfriesse@redhat.com" \
target="_blank">jfriesse@redhat.com</a>&gt;</span><br><blockquote class="gmail_quote" \
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> Hi,<br>
your testing machine was Linux? Solaris (or actually, OpenIndiana) was<br>
tested in 2.0 time frame successfully. This really looks like problem in<br>
LibQB (regression?). Can you please try to contact<br>
<a href="mailto:quarterback-devel@lists.fedorahosted.org">quarterback-devel@lists.fedorahosted.org</a> \
(or file a libqb issue at<br> github), because from corosync side, there is now way \
how to help.<br> <br>
Regards,<br>
   Honza<br>
<br>
eXeC001er napsal(a):<br>
<div class="HOEnZb"><div class="h5">&gt; 2013/3/28 Jan Friesse &lt;<a \
href="mailto:jfriesse@redhat.com">jfriesse@redhat.com</a>&gt;<br> &gt;<br>
&gt;&gt; Hi,<br>
&gt;&gt; corosync functions never returns ERRNO errors. They are returning errors<br>
&gt;&gt; like CS_ERR_*. What is return value you&#39;ve got from cmap_initialize?<br>
&gt;&gt;<br>
&gt;<br>
&gt; the stack-trace:<br>
&gt;<br>
&gt; /3@3:    -&gt; libvotequorum:votequorum_initialize(0x8834b2c, 0x0, 0x0,<br>
&gt; 0xfea63855)<br>
&gt; /2: nanosleep(0xFE99BF48, 0x00000000)          = 0<br>
&gt; /3@3:       -&gt; libqb:qb_hdb_handle_create()<br>
&gt; /3@3:       &lt;- libqb:qb_hdb_handle_create() = 0<br>
&gt; /3@3:       -&gt; libcorosync_common:hdb_error_to_cs()<br>
&gt; /3@3:       &lt;- libcorosync_common:hdb_error_to_cs() = 1<br>
&gt; /3@3:       -&gt; libqb:qb_hdb_handle_get()<br>
&gt; /3@3:       &lt;- libqb:qb_hdb_handle_get() = 0<br>
&gt; /3@3:       -&gt; libcorosync_common:hdb_error_to_cs()<br>
&gt; /3@3:       &lt;- libcorosync_common:hdb_error_to_cs() = 1<br>
&gt; /3@3:       -&gt; libqb:qb_ipcc_connect()<br>
&gt; /3: so_socket(PF_UNIX, SOCK_STREAM, 0, 0x00000000, SOV_DEFAULT) = 8<br>
&gt; /3: fcntl(8, F_GETFD, 0x00000000)                = 0<br>
&gt; /3: fcntl(8, F_SETFD, 0x00000001)                = 0<br>
&gt; /3: fcntl(8, F_SETFL, FNONBLOCK)                  = 0<br>
&gt; /3: connect(8, 0xFE67C13A, 21, SOV_DEFAULT)       = 0<br>
&gt; /3: sigaction(SIGPIPE, 0xFE67C0E0, 0xFE67C140)   = 0<br>
&gt; /3: send(8, &quot;FFFFFFFF\0\0\0\018\0\0\0&quot;.., 24, 0)      = 24<br>
&gt; /3: sigaction(SIGPIPE, 0xFE67C0E0, 0x00000000)   = 0<br>
&gt; /3: sigaction(SIGPIPE, 0xFE67C0D0, 0xFE67C130)   = 0<br>
&gt; /3: recv(8, 0xFE67C210, 3112, 64)                Err#11 EAGAIN<br>
&gt; /3: sigaction(SIGPIPE, 0xFE67C0D0, 0x00000000)   = 0<br>
&gt; /3: shutdown(8, SHUT_RDWR, SOV_DEFAULT)       = 0<br>
&gt; /3: close(8)                              = 0<br>
&gt; /3@3:       &lt;- libqb:qb_ipcc_connect() = 0<br>
&gt; /3@3:       -&gt; libcorosync_common:qb_to_cs_error()<br>
&gt; /3@3:       &lt;- libcorosync_common:qb_to_cs_error() = 12<br>
&gt; /3@3:       -&gt; libqb:qb_hdb_handle_put(0xfe9f3070, 0x0, 0xb86775, \
0xfe67ce7c)<br> &gt; /3@3:       &lt;- libqb:qb_hdb_handle_put() = 0<br>
&gt; /3@3:       -&gt; libqb:qb_hdb_handle_destroy(0xfe9f3070, 0x0, 0xb86775, \
0x0)<br> &gt; /3@3:          -&gt; libqb:qb_ipcc_disconnect(0x0, 0x8835b88, 0x0, \
0x1)<br> &gt; /3@3:          &lt;- libqb:qb_ipcc_disconnect() = 0<br>
&gt; /3@3:       &lt;- libqb:qb_hdb_handle_destroy() = 0<br>
&gt; /3@3:    &lt;- libvotequorum:votequorum_initialize() = 12<br>
&gt;<br>
&gt; As you can see it returns CS_ERR_NOT_EXIST.<br>
&gt;<br>
&gt; same behaviour with CMAP and another services.<br>
&gt;<br>
&gt; forgot to say: OS is Solaris.<br>
&gt;<br>
&gt; Thanks.<br>
&gt;<br>
&gt;&gt;<br>
&gt;&gt; Regards,<br>
&gt;&gt;    Honza<br>
&gt;&gt;<br>
&gt;&gt; eXeC001er napsal(a):<br>
&gt;&gt;&gt; Hello.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; I tried to create an application that uses corosync via its \
libraries,<br> &gt;&gt; but<br>
&gt;&gt;&gt; it seems something wrong.<br>
&gt;&gt;&gt; On the machine where i debug corosync-tests work fine, but my \
application<br> &gt;&gt;&gt; does not work. The application cannot intialize CMAP \
connection (same<br> &gt;&gt; with<br>
&gt;&gt;&gt; VOTEQUORUM).<br>
&gt;&gt;&gt; &quot;*_initialize&quot; function returned EEXIST error. on server side \
i see<br> &gt;&gt; &quot;Error<br>
&gt;&gt;&gt; in connection setup (7104-7367-0): Broken pipe (32)&quot;.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; My appliacation is multi-thread and &quot;*_initialize&quot; is called \
not in main<br> &gt;&gt;&gt; thread.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Any ideas?<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Thanks.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; _______________________________________________<br>
&gt;&gt;&gt; Openais mailing list<br>
&gt;&gt;&gt; <a href="mailto:Openais@lists.linux-foundation.org">Openais@lists.linux-foundation.org</a><br>
 &gt;&gt;&gt; <a href="https://lists.linuxfoundation.org/mailman/listinfo/openais" \
target="_blank">https://lists.linuxfoundation.org/mailman/listinfo/openais</a><br> \
&gt;&gt;<br> &gt;&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; _______________________________________________<br>
&gt; Openais mailing list<br>
&gt; <a href="mailto:Openais@lists.linux-foundation.org">Openais@lists.linux-foundation.org</a><br>
 &gt; <a href="https://lists.linuxfoundation.org/mailman/listinfo/openais" \
target="_blank">https://lists.linuxfoundation.org/mailman/listinfo/openais</a><br> \
<br> </div></div></blockquote></div><br>



_______________________________________________
Openais mailing list
Openais@lists.linux-foundation.org
https://lists.linuxfoundation.org/mailman/listinfo/openais

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic