[prev in list] [next in list] [prev in thread] [next in thread]
List: lustre-discuss
Subject: Re: [lustre-discuss] LFS Quota
From: "Harr, Cameron" <harr1 () llnl ! gov>
Date: 2019-01-11 21:20:27
Message-ID: 5c4ad6ec-a4a3-66fd-6af1-37d3d92d023d () llnl ! gov
[Download RAW message or body]
[Attachment #2 (text/plain)]
When you're over the soft limit, you *should* see an '*' in the listing, as well as \
time left in the grace period. We've had mixed success with that actually working \
however. Cameron
On 1/9/19 5:21 AM, Moreno Diego (ID SIS) wrote:
Hi ANS,
About the soft limits and not receiving any warning or notification when the soft \
quota is reached, this would be the expected behavior. The soft quota is used \
together with the grace period to give some "extra" time to the user to remove \
inodes/blocks, as per the Lustre Operations Manual:
Soft limit -- The grace timer is started once the soft limit is exceeded. At this \
point, the user/group/project can still allocate block/inode. When the grace time \
expires and if the user is still above the soft limit, the soft limit becomes a hard \
limit and the user/group/project can't allocate any new block/inode any more. The \
user/group/project should then delete files to be under the soft limit. The soft \
limit MUST be smaller than the hard limit. If the soft limit is not needed, it should \
be set to zero (0).
I'm not aware of any warnings triggered by Lustre when the soft quota is reached, \
though that would be interesting to have. I know some people using external tools to \
monitor Lustre quotas and trigger warnings or similar for users exceeding their soft \
quota.
Regards,
Diego
From: lustre-discuss \
<lustre-discuss-bounces@lists.lustre.org><mailto:lustre-discuss-bounces@lists.lustre.org> \
on behalf of ANS <ans3456@gmail.com><mailto:ans3456@gmail.com>
Date: Wednesday, 9 January 2019 at 10:00
To: "lustre-discuss@lists.lustre.org"<mailto:lustre-discuss@lists.lustre.org> \
<lustre-discuss@lists.lustre.org><mailto:lustre-discuss@lists.lustre.org>
Subject: Re: [lustre-discuss] LFS Quota
Dear All,
Can anyone look into it.
Thanks,
ANS
On Mon, Jan 7, 2019 at 6:38 PM ANS <ans3456@gmail.com<mailto:ans3456@gmail.com>> \
wrote: Dear All,
I am trying to set quota on lustre but unfortunately i have issued the below \
commands:-
tunefs.lustre --param ost.quota_type=ug /dev/mapper/mds1
checking for existing Lustre data: found
Reading CONFIGS/mountdata
Read previous values:
Target: data-MDT0000
Index: 0
Lustre FS: data
Mount type: ldiskfs
Flags: 0x1001
(MDT no_primnode )
Persistent mount opts: user_xattr,errors=remount-ro
Parameters: mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib<mailto:mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib> \
failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib<mailto:failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib>
Permanent disk data:
Target: data-MDT0000
Index: 0
Lustre FS: data
Mount type: ldiskfs
Flags: 0x1041
(MDT update no_primnode )
Persistent mount opts: user_xattr,errors=remount-ro
Parameters: mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib<mailto:mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib> \
failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib<mailto:failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib> \
ost.quota_type=ug
After this i have issued lctl conf_param home.quota.mdt=ugp and now i am able to see \
quota enabled in mdt but will there be any affect to the above version as i have \
issue that command to 2 mdts where i am having 4 mdts in total. Do i need to issue \
any further commands to revert those.
After enabling quota and file space crossed soft limit but i am unable to get warning \
till it reached near hard limit.
Can anyone help me out.
Thanks,
ANS
--
Thanks,
ANS.
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[Attachment #3 (text/html)]
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>When you're over the soft limit, you *should* see an '*' in the listing, as well \
as time left in the grace period. We've had mixed success with that actually working \
however.<br> Cameron<br>
</p>
<div class="moz-cite-prefix">On 1/9/19 5:21 AM, Moreno Diego (ID SIS) wrote:<br>
</div>
<blockquote type="cite" cite="mid:5B9F0D4D-2D12-47AA-8CED-3184AE4A483B@id.ethz.ch">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Courier;
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
<div class="WordSection1">
<p class="MsoNormal">Hi ANS,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">About the soft limits and not receiving any warning or \
notification when the soft quota is reached, this would be the expected behavior. The \
soft quota is used together with the grace period to give some "extra" time to the \
user to remove inodes/blocks, as per the Lustre Operations Manual:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:Courier">Soft limit -- The grace timer \
is started once the soft limit is exceeded. At this point, the user/group/project can \
still allocate block/inode. When the grace time expires and if the user is still \
above the soft limit, the soft limit becomes a hard limit and the user/group/project \
can't allocate any new block/inode any more. The user/group/project should then \
delete files to be under the soft limit. The soft limit MUST be smaller than the hard \
limit. If the soft limit is not needed, it should be set to zero \
(0).<o:p></o:p></span></p> <p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I'm not aware of any warnings triggered by Lustre when the soft \
quota is reached, though that would be interesting to have. I know some people using \
external tools to monitor Lustre quotas and trigger warnings or similar for users \
exceeding their soft quota.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="color:black">Diego</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: \
</span></b><span style="font-size:12.0pt;color:black">lustre-discuss <a \
class="moz-txt-link-rfc2396E" href="mailto:lustre-discuss-bounces@lists.lustre.org"> \
<lustre-discuss-bounces@lists.lustre.org></a> on behalf of ANS <a \
class="moz-txt-link-rfc2396E" href="mailto:ans3456@gmail.com"> \
<ans3456@gmail.com></a><br> <b>Date: </b>Wednesday, 9 January 2019 at 10:00<br>
<b>To: </b><a class="moz-txt-link-rfc2396E" \
href="mailto:lustre-discuss@lists.lustre.org">"lustre-discuss@lists.lustre.org"</a>
<a class="moz-txt-link-rfc2396E" \
href="mailto:lustre-discuss@lists.lustre.org"><lustre-discuss@lists.lustre.org></a><br>
<b>Subject: </b>Re: [lustre-discuss] LFS Quota<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Dear All,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Can anyone look into it.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">ANS<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, Jan 7, 2019 at 6:38 PM ANS <<a \
href="mailto:ans3456@gmail.com" moz-do-not-send="true">ans3456@gmail.com</a>> \
wrote:<o:p></o:p></p> </div>
<blockquote style="border:none;border-left:solid #CCCCCC
1.0pt;padding:0cm 0cm 0cm
6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal">Dear All, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I am trying to set quota on lustre but unfortunately i have \
issued the below commands:-<o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">tunefs.lustre --param ost.quota_type=ug \
/dev/mapper/mds1<o:p></o:p></p> </div>
<div>
<p class="MsoNormal">checking for existing Lustre data: found<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Reading CONFIGS/mountdata<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"> Read previous values:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Target: data-MDT0000<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Index: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Lustre FS: data<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Mount type: ldiskfs<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Flags: 0x1001<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> (MDT \
no_primnode )<o:p></o:p></p> </div>
<div>
<p class="MsoNormal">Persistent mount opts: \
user_xattr,errors=remount-ro<o:p></o:p></p> </div>
<div>
<p class="MsoNormal">Parameters: <a class="moz-txt-link-abbreviated" \
href="mailto:mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib"> \
mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib</a> <a \
class="moz-txt-link-abbreviated" \
href="mailto:failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib"> \
failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib</a><o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"> Permanent disk data:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Target: data-MDT0000<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Index: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Lustre FS: data<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Mount type: ldiskfs<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Flags: 0x1041<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> (MDT update \
no_primnode )<o:p></o:p></p> </div>
<div>
<p class="MsoNormal">Persistent mount opts: \
user_xattr,errors=remount-ro<o:p></o:p></p> </div>
<div>
<p class="MsoNormal">Parameters: <a class="moz-txt-link-abbreviated" \
href="mailto:mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib"> \
mgsnode=192.168.2.9@o2ib:192.168.2.10@o2ib</a> <a \
class="moz-txt-link-abbreviated" \
href="mailto:failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib"> \
failover.node=192.168.2.9@o2ib:192.168.2.10@o2ib</a> ost.quota_type=ug<o:p></o:p></p> \
</div> <div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">After this i have issued lctl conf_param home.quota.mdt=ugp \
and now i am able to see quota enabled in mdt but will there be any affect to the \
above version as i have issue that command to 2 mdts where i am having 4 mdts in \
total. Do i need to issue any further commands to revert those.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">After enabling quota and file space crossed soft limit but i am \
unable to get warning till it reached near hard limit.<o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Can anyone help me out.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">ANS<o:p></o:p></p>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Thanks, <o:p></o:p></p>
<div>
<p class="MsoNormal">ANS.<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" \
href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a> <a \
class="moz-txt-link-freetext" \
href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a>
</pre>
</blockquote>
</body>
</html>
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
--===============8523181269836670302==--
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic