[prev in list] [next in list] [prev in thread] [next in thread]
List: gluster-devel
Subject: Re: [Gluster-devel] [Gluster-Maintainers] gNFS vs NFS Ganesha performance (was: Re: Proposal to chan
From: Sankarshan Mukhopadhyay <sankarshan.mukhopadhyay () gmail ! com>
Date: 2019-11-22 15:32:28
Message-ID: CAJWA-5Yxf0dQHjpUTAetJnYuLqAgcgQVr9U8+bpFqdPqM9Vtug () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/related)]
[Attachment #4 (multipart/alternative)]
It would be good to compare and contrast performance numbers based on
additional detail about the test workbench as well as configuration for the
workloads. Else, it is just a lot of graphs along with lists of end-results
and drawing inferences are difficult.
On Fri, Nov 22, 2019 at 4:21 PM Yaniv Kaul <ykaul@redhat.com> wrote:
> Spinning off the conversation, comments within
>
> On Fri, Nov 22, 2019 at 8:28 AM Xie Changlong <zgrep@139.com> wrote:
>
> <snip>
>
>> Interesting - we've seen far better performance with Ganesha v4.1 vs.
>> gnfs.
>>
>> Would be great if you could share the details.
>>
>> vdbench 6/4 random read/write
>>
>>
>>
> You are comparing old versions of Gluster (assuming it's downstream, Red
> Hat's version - it was released January 2018 - almost 2 years ago) and
> certainly an old version of NFS Ganesha.
> We believe newer releases are substantially better.
> Just sharing the internal number of improvement we are seeing:
> glusterfs-6.0-17 vs glusterfs-3.12.2-47 (rhel 7.7)
> 33.86%
> 1075.49%
> 232.88%
> 761.36%
> 91.15%
> 138.01%
> -30.07% <-- there's a bug about it.
> 28.59%
> 12.36%
> -1.44%
>
> (The RHEL release isn't up-to-date either)
>
> Y.
>
> Same for NFS Ganesha and Windows support.
>>
>> ganesha 2.5.5, glusterfs 3.12.2, windows server 2003. Use windows nfsv3
>> mount nfs-ganesha and test read/write with vdbench50406. Following is crash
>> bt
>>
>> Btw, the environment has been redeployed, so i can't share more.
>>
>>
>> It's difficult to counterpart without referring to specific issues. It's
>> eveb to harder to fix them ;-)
>>
>> Gnfs is stable enough, we have about ~1000 servers, 4~24 servers for a
>>> gluster cluster, about ~2000 nfs clients, all works fine till the last two
>>> years expect some memleak issue.
>>>
>>
>> Nice! Would be great for the Gluster community to learn more about the
>> use case!
>>
>>
>> It's my pleasure.
>>
>>
>> Y.
>>
>>> Thanks
>>>
>>> -Xie
>>>
>>> On Thu, Nov 21, 2019 at 5:31 AM Amar Tumballi <amarts@gmail.com> wrote:
>>>
>>>> Hi All,
>>>>
>>>> As per the discussion on https://review.gluster.org/23645, recently we
>>>> changed the status of gNFS (gluster's native NFSv3 support) feature to
>>>> 'Depricated / Orphan' state. (ref:
>>>> https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L185..L189).
>>>> With this email, I am proposing to change the status again to 'Odd Fixes'
>>>> (ref: https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L22
>>>> )
>>>>
>>>> TL;DR;
>>>>
>>>> I understand the current maintainers are not able to focus on
>>>> maintaining it as the focus of the project, as earlier described, is
>>>> keeping NFS-Ganesha based integration with glusterfs. But, I am
>>>> volunteering along with Xie Changlong (currently working at Chinamobile),
>>>> to keep the feature running as it used to in previous versions. Hence the
>>>> status of 'Odd Fixes'.
>>>>
>>>> Before sending the patch to make these changes, I am proposing it here
>>>> now, as gNFS is not even shipped with latest glusterfs-7.0 releases. I have
>>>> heard from some users that it was working great for them with earlier
>>>> releases, as all they wanted was NFS v3 support, and not much of features
>>>> from gNFS. Also note that, even though the packages are not built, none of
>>>> the regression tests using gNFS are stopped with latest master, so it is
>>>> working same from at least last 2 years.
>>>>
>>>> I request the package maintainers to please add '--with gnfs' (or
>>>> --enable-gnfs) back to their release script through this email, so those
>>>> users wanting to use gNFS happily can continue to use it. Also points to
>>>> users/admins is that, the status is 'Odd Fixes', so don't expect any
>>>> 'enhancements' on the features provided by gNFS.
>>>>
>>>> Happy to hear feedback, if any.
>>>>
>>>> Regards,
>>>> Amar
>>>>
>>>
[Attachment #7 (text/html)]
<div dir="ltr"><div>It would be good to compare and contrast performance numbers \
based on additional detail about the test workbench as well as configuration for the \
workloads. Else, it is just a lot of graphs along with lists of end-results and \
drawing inferences are difficult.</div><br><div class="gmail_quote"><div dir="ltr" \
class="gmail_attr">On Fri, Nov 22, 2019 at 4:21 PM Yaniv Kaul <<a \
href="mailto:ykaul@redhat.com">ykaul@redhat.com</a>> wrote:<br></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div \
style="font-family:arial,helvetica,sans-serif">Spinning off the conversation, \
comments within<br></div></div><br><div class="gmail_quote"><div dir="ltr" \
class="gmail_attr">On Fri, Nov 22, 2019 at 8:28 AM Xie Changlong <<a \
href="mailto:zgrep@139.com" target="_blank">zgrep@139.com</a>> \
wrote:<br></div><div><br></div><div \
style="font-family:arial,helvetica,sans-serif"><snip></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"><div><p> </p>Interesting - we've seen far \
better performance with Ganesha v4.1 vs. gnfs. <br>
<blockquote type="cite"><div dir="auto">
</div>
</blockquote>
<blockquote type="cite">
<div dir="auto">
<div dir="auto">Would be great if you could share the details. <br>
</div>
</div>
</blockquote>
<p>vdbench 6/4 random read/write<br>
</p>
<p><img src="cid:16e927c112e478b4eb71" alt=""></p>
<p><br></p></div></blockquote><div><br></div><div \
style="font-family:arial,helvetica,sans-serif">You are comparing old versions of \
Gluster (assuming it's downstream, Red Hat's version - it was released \
January 2018 - almost 2 years ago) and certainly an old version of NFS \
Ganesha.</div><div style="font-family:arial,helvetica,sans-serif">We believe newer \
releases are substantially better.</div><div \
style="font-family:arial,helvetica,sans-serif">Just sharing the internal number of \
improvement we are seeing:</div><div \
style="font-family:arial,helvetica,sans-serif">glusterfs-6.0-17 vs \
glusterfs-3.12.2-47 (rhel \
7.7)<br>33.86%<br>1075.49%<br>232.88%<br>761.36%<br>91.15%<br>138.01%<br></div><div \
style="font-family:arial,helvetica,sans-serif">-30.07% <-- there's a bug \
about it.</div><div style="font-family:arial,helvetica,sans-serif"></div><div \
style="font-family:arial,helvetica,sans-serif">28.59%<br>12.36%<br>-1.44%</div><div \
style="font-family:arial,helvetica,sans-serif"><br></div><div \
style="font-family:arial,helvetica,sans-serif">(The RHEL release isn't up-to-date \
either)</div><div style="font-family:arial,helvetica,sans-serif"><br></div><div \
style="font-family:arial,helvetica,sans-serif">Y.</div><div \
style="font-family:arial,helvetica,sans-serif"><br></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"><div><p> </p>
<blockquote type="cite">
<div dir="auto">
<div dir="auto">Same for NFS Ganesha and Windows support.</div>
<div dir="auto"><br>
</div>
</div>
</blockquote>
<p>ganesha 2.5.5, glusterfs 3.12.2, windows server 2003. Use
windows nfsv3 mount nfs-ganesha and test read/write with
vdbench50406. Following is crash bt<br>
</p>
<p><img src="cid:16e927c112e25410e22" alt=""></p>
<p>Btw, the environment has been redeployed, so i can't share more.<br>
</p>
<p><br>
</p>
<blockquote type="cite">
<div dir="auto">
<div dir="auto">It's difficult to counterpart without referring
to specific issues. It's eveb to harder to fix them ;-) <br>
</div>
</div>
</blockquote>
<blockquote type="cite">
<div dir="auto">
<div dir="auto">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div>
<p> </p>
<p>Gnfs is stable enough, we have about ~1000 servers,
4~24 servers for a gluster cluster, about ~2000 nfs
clients, all works fine till the last two years expect
some memleak issue. <br>
</p>
</div>
</blockquote>
</div>
</div>
<div dir="auto"><br>
</div>
<div dir="auto">Nice! Would be great for the Gluster community
to learn more about the use case! <br>
</div>
</div>
</blockquote>
<p><br>
</p>
<p>It's my pleasure.</p>
<p><br>
</p>
<blockquote type="cite">
<div dir="auto">
<div dir="auto">Y. </div>
<div dir="auto">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div>
<p> </p>
<p>Thanks</p>
<p> -Xie<br>
</p>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, Nov 21,
2019 at 5:31 AM Amar Tumballi <<a \
href="mailto:amarts@gmail.com" rel="noreferrer" \
target="_blank">amarts@gmail.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div dir="ltr">Hi \
All, <div><br>
</div>
<div>As per the discussion on <a \
href="https://review.gluster.org/23645" rel="noreferrer" \
target="_blank">https://review.gluster.org/23645</a>, recently we changed the status \
of gNFS
(gluster's native NFSv3 support) feature to
'Depricated / Orphan' state. (ref: <a \
href="https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L185..L189" \
rel="noreferrer" target="_blank">https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L185..L189</a>).
With this email, I am proposing to change
the status again to 'Odd Fixes' (ref: <a \
href="https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L22" \
rel="noreferrer" target="_blank">https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L22</a>) \
</div> <div><br>
</div>
<div>TL;DR;</div>
<div><br>
</div>
<div>
<div>I understand the current maintainers
are not able to focus on maintaining it as
the focus of the project, as earlier
described, is keeping NFS-Ganesha based
integration with glusterfs. But, I am
volunteering along with Xie Changlong
(currently working at Chinamobile), to
keep the feature running as it used to in
previous versions. Hence the status of
'Odd Fixes'. </div>
<div><br>
</div>
<div>Before sending the patch to make these
changes, I am proposing it here now, as
gNFS is not even shipped with latest
glusterfs-7.0 releases. I have heard from
some users that it was working great for
them with earlier releases, as all they
wanted was NFS v3 support, and not much of
features from gNFS. Also note that, even
though the packages are not built, none of
the regression tests using gNFS are
stopped with latest master, so it is
working same from at least last 2 years. </div>
</div>
<div><br>
</div>
<div>I request the package maintainers to
please add '--with gnfs' (or --enable-gnfs)
back to their release script through this
email, so those users wanting to use gNFS
happily can continue to use it. Also points
to users/admins is that, the status is 'Odd
Fixes', so don't expect any \
'enhancements' on the features provided by gNFS.</div>
<div><br>
</div>
<div>Happy to hear feedback, if any.</div>
<div><br>
</div>
<div>Regards,</div>
\
<div>Amar</div></div></blockquote></div></div></blockquote></div></blockquote></div></ \
div></div></blockquote></div></blockquote></div></div></blockquote><div><br></div><div><br></div></div></div>
--000000000000087b2b0597f0f650--
["nehilhidedagefho.png" (image/png)]
["mncknlfpefcedmbl.png" (image/png)]
_______________________________________________
Community Meeting Calendar:
APAC Schedule -
Every 2nd and 4th Tuesday at 11:30 AM IST
Bridge: https://bluejeans.com/441850968
NA/EMEA Schedule -
Every 1st and 3rd Tuesday at 01:00 PM EDT
Bridge: https://bluejeans.com/441850968
Gluster-devel mailing list
Gluster-devel@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-devel
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic