[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lustre-discuss
Subject:    Re: [lustre-discuss] Recommendation on number of OSTs
From:       Backer via lustre-discuss <lustre-discuss () lists ! lustre ! org>
Date:       2024-01-13 1:52:42
Message-ID: CAPq+oAKWbn47WKnEa_8DCZznnUWJBoYJGocV7uvMh6j58uFD3g () mail ! gmail ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]


Thanks for the advice!

On Fri, 12 Jan 2024 at 19:23, Andreas Dilger <adilger@whamcloud.com> wrote:

> I would recommend *not* to use too many OSTs as this causes fragmentation
> of the free space, and excess overhead in managing the connections.  Today,
> single OSTs can be up to 500TiB in size (or larger, though not necessarily
> optimal for performance). Depending on your cluster size and total
> capacity, it is typical for large systems to have a couple hundred OSTs,
> 2-4 per OSS balancing the storage and network bandwidth.
>
> On Jan 12, 2024, at 07:37, Backer via lustre-discuss <
> lustre-discuss@lists.lustre.org> wrote:
>
>
> Hi All,
>
> What is the recommendation on the total number of OSTs?
>
> In order to maximize throughput, go for more number of OSS with small
> OSTs. This means that it will end up with 1000s of OSTs. Any suggestions or
> recommendations?
>
> Thank you,
>
>
> Cheers, Andreas
> --
> Andreas Dilger
> Lustre Principal Architect
> Whamcloud
>
>
>
>
>
>
>
>

[Attachment #5 (text/html)]

<div dir="ltr">Thanks for the advice!  <br></div><br><div class="gmail_quote"><div \
dir="ltr" class="gmail_attr">On Fri, 12 Jan 2024 at 19:23, Andreas Dilger &lt;<a \
href="mailto:adilger@whamcloud.com">adilger@whamcloud.com</a>&gt; \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">



<div style="overflow-wrap: break-word;">
<div>I would recommend *not* to use too many OSTs as this causes fragmentation of the \
free space, and excess overhead in managing the connections.   Today, single OSTs can \
be up to 500TiB in size (or larger, though not necessarily optimal for performance).  \
Depending on your cluster size and total capacity, it is typical for large systems to \
have a couple hundred OSTs, 2-4 per OSS balancing the storage and network \
bandwidth.</div> <div><br>
</div>
On Jan 12, 2024, at 07:37, Backer via lustre-discuss &lt;<a \
href="mailto:lustre-discuss@lists.lustre.org" \
target="_blank">lustre-discuss@lists.lustre.org</a>&gt; wrote:<br> <div>
<blockquote type="cite"><br>
<div>
<div dir="ltr">Hi All,<br>
<div><br>
</div>
<div>What is the recommendation on the total number of OSTs?    </div>
<div><br>
</div>
<div>In order to maximize throughput, go for more number of OSS with small OSTs. This \
means that it will end up with 1000s of OSTs. Any suggestions or recommendations?  \
</div> <div>
<div><br>
</div>
</div>
<div>Thank you,  </div>
</div>
</div>
</blockquote>
</div>
<br>
<div>
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-in \
dent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
 <div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-i \
ndent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
 <div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-i \
ndent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
 <div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-i \
ndent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
 <div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-i \
ndent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
 <div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-i \
ndent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
 <div>Cheers, Andreas</div>
<div>--</div>
<div>Andreas Dilger</div>
<div>Lustre  Principal Architect</div>
<div>Whamcloud</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
</div>
<br>
<br>
</div>
<br>
</div>

</blockquote></div>



_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[prev in list] [next in list] [prev in thread] [next in thread]