[prev in list] [next in list] [prev in thread] [next in thread]
List: gluster-devel
Subject: Re: [Gluster-devel] Rebalance improvement.
From: Susant Palai <spalai () redhat ! com>
Date: 2020-08-03 7:29:01
Message-ID: CA+xDNC2Jz0hgqy+6D5qguuoekR_ZSOTRi8Jzw6gbTy=0as2bcQ () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Centos Users can add the following repo and install the build from the
master branch to try out the feature. [Testing purpose only, not ready for
consumption in production env.]
[gluster-nightly-master] baseurl=
http://artifacts.ci.centos.org/gluster/nightly/master/7/x86_64/ gpgcheck=0
keepalive=1 enabled=1 repo_gpgcheck = 0 name=Gluster Nightly builds (master
branch)
A summary of perf numbers from our test lab :
DirSize - 1Million Old New %diff Depth - 100 (Run 1) 353 74 +377% Depth -
100 (Run 2) 348 72 +377~% Depth - 50 246 122 +100% Depth - 3 174 114 +52%
Susant
On Mon, Aug 3, 2020 at 11:16 AM Susant Palai <spalai@redhat.com> wrote:
> Hi,
> Recently, we have pushed some performance improvements for Rebalance
> Crawl which used to consume a significant amount of time, out of the entire
> rebalance process.
>
>
> The patch [1] is recently merged in upstream and may land as an
> experimental feature in the upcoming upstream release.
>
> The improvement currently works only for pure-distribute Volume. (which
> can be expanded).
>
>
> Things to look forward to in future :
> - Parallel Crawl in Rebalance
> - Global Layout
>
> Once these improvements are in place, we would be able to reduce the
> overall rebalance time by a significant time.
>
> Would request our community to try out the feature and give us feedback.
>
> More information regarding the same will follow.
>
>
> Thanks & Regards,
> Susant Palai
>
>
> [1] https://review.gluster.org/#/c/glusterfs/+/24443/
>
[Attachment #5 (text/html)]
<div dir="ltr"><div dir="ltr"><div dir="ltr">Centos Users can add the following repo \
and install the build from the master branch to try out the feature. [Testing purpose \
only, not ready for consumption in production env.]<div><br></div><div><span \
style="color:rgb(32,33,36);font-family:Roboto,sans-serif;font-size:14px;white-space:pre-wrap;background-color:rgb(248,249,250)">[gluster-nightly-master]
baseurl=</span><a href="http://artifacts.ci.centos.org/gluster/nightly/master/7/x86_64/" \
target="_blank" dir="ltr" rel="noopener nofollow noreferrer" \
style="text-decoration-line:none;color:rgb(26,115,232);background:rgb(248,249,250);fon \
t-size:14px;margin:0px;padding:0px;vertical-align:baseline;font-family:Roboto,sans-ser \
if;white-space:pre-wrap">http://artifacts.ci.centos.org/gluster/nightly/master/7/x86_64/</a><span \
style="color:rgb(32,33,36);font-family:Roboto,sans-serif;font-size:14px;white-space:pre-wrap;background-color:rgb(248,249,250)">
gpgcheck=0
keepalive=1
enabled=1
repo_gpgcheck = 0
name=Gluster Nightly builds (master branch)</span><br></div><div><span \
style="color:rgb(32,33,36);font-family:Roboto,sans-serif;font-size:14px;white-space:pre-wrap;background-color:rgb(248,249,250)"><br></span></div><div><span \
style="color:rgb(32,33,36);font-family:Roboto,sans-serif;font-size:14px;white-space:pre-wrap;background-color:rgb(248,249,250)">A \
summary of perf numbers from our test lab :</span></div><div><br></div><div><span \
style="color:rgb(53,53,53);font-family:monospace;white-space:pre">DirSize - \
1Million Old New %diff Depth - 100 (Run 1) 353 74 +377%
Depth - 100 (Run 2) 348 72 +377~%
Depth - 50 246 122 +100%
Depth - 3 174 114 +52%</span></div><div><br></div><div>Susant</div><div><br></div></div></div></div><br><div \
class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Aug 3, 2020 at 11:16 AM \
Susant Palai <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>> \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div \
style="overflow-wrap: break-word;">Hi,<div> Recently, we have pushed some \
performance improvements for Rebalance Crawl which used to consume a significant \
amount of time, out of the entire rebalance \
process.</div><div><br></div><div><br></div><div>The patch [1] is recently merged in \
upstream and may land as an experimental feature in the upcoming upstream \
release.</div><div><br></div><div>The improvement currently works only for \
pure-distribute Volume. (which can be \
expanded).</div><div><br></div><div><br></div><div>Things to look forward to in \
future :</div><div> - Parallel Crawl in Rebalance</div><div> - Global \
Layout</div><div><br></div><div>Once these improvements are in place, we would be \
able to reduce the overall rebalance time by a significant \
time.</div><div><br></div><div>Would request our community to try out the feature and \
give us feedback.</div><div><br></div><div>More information regarding the same will \
follow.</div><div><br></div><div><br></div><div>Thanks & \
Regards,</div><div>Susant Palai</div><div><br></div><div><br></div><div>[1] <a \
href="https://review.gluster.org/#/c/glusterfs/+/24443/" \
target="_blank">https://review.gluster.org/#/c/glusterfs/+/24443/</a></div></div></blockquote></div>
_______________________________________________
Community Meeting Calendar:
Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968
Gluster-devel mailing list
Gluster-devel@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-devel
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic