[prev in list] [next in list] [prev in thread] [next in thread] 

List:       gpfsug-discuss
Subject:    Re: [gpfsug-discuss] NFSIO metrics absent in pmcollector
From:       "Markus Rohwedder" <rohwedder () de ! ibm ! com>
Date:       2021-04-20 10:34:59
Message-ID: OF31DF44B6.CE4FF8E6-ON002586BD.003985E9-C12586BD.003A2298 () notes ! na ! collabserv ! com
[Download RAW message or body]

[Attachment #2 (multipart/related)]

[Attachment #4 (multipart/alternative)]

[Attachment #6 (text/plain)]

Hello Dorigo,

in contrast to the basic Spectrum Scale metrics, the NFS and SMB sensors
rely on a proxy mechanism that provides the metrics out of the CES stack.
In case you have not used the installer, you may miss some steps.

- Please check if you have the requires packages installed.
(For example gpfs.pm-ganesha-10.0.0-2.el8.x86_64 or similar for NFS)

- The config section should have the "Generic" keyword, like this

{
        name = "NFSIO"
        period = 10
        restrict = "cesNodes"
        type = "Generic"
},

See here in the KC:
https://www.ibm.com/docs/en/spectrum-scale/5.0.5?topic=tool-enabling-protocol-metrics


 /var/log/zimon/ZIMonSensors.log may provides some additional clues as
well.

Mit freundlichen Grüßen / Kind regards

Dr. Markus Rohwedder

IBM Systems / Lab Services Europe / EMEA Storage Competence Center
                                                                                      \
                
                                                                                      \
                
                                                                                      \
                
                                                                                      \
                
                                                                                      \
  Phone:            +49 162 4159920       IBM Deutschland GmbH                        \
                
                                                                                      \
  E-Mail:           rohwedder@de.ibm.com  Am Weiher 24                                \
                
                                                                                      \
                
                                         65451 Kelsterbach                            \
                
                                                                                      \
                
                                         Germany                                      \
                
                                                                                      \
                
                                                                                      \
                
                                                                                      \
  IBM Deutschland                                                                     \
  GmbH /                                                                              \
  Vorsitzender des                                                                    \
  Aufsichtsrats:                                                                      \
  Sebastian                                                                           \
  Krause /                                                                            \
  Geschäftsführung:                                                                 \
  Gregor Pillen                                                                       \
  (Vorsitzender),                                                                     \
  Agnes Heftberger,                                                                   \
  Norbert Janzen,                                                                     \
  Markus Koerner,                                                                     \
  Christian Noll,                                                                     \
  Nicole Reimer /                                                                     \
  Sitz der                                                                            \
  Gesellschaft:                                                                       \
  71139 Ehningen,                                                                     \
  IBM-Allee 1 /                                                                       \
  Registergericht:                                                                    \
  Amtsgericht                                                                         \
  Stuttgart,                                                                          \
  HRB14562                                                                            \
                
                                                                                      \
                
                                                                                      \
                
                                                                                      \






From:	"Dorigo Alvise (PSI)" <alvise.dorigo@psi.ch>
To:	"'gpfsug-discuss@spectrumscale.org'"
            <gpfsug-discuss@spectrumscale.org>
Cc:	"'sls-htc-admins@lists.psi.ch'" <sls-htc-admins@lists.psi.ch>
Date:	20.04.2021 12:19
Subject:	[EXTERNAL] [gpfsug-discuss] NFSIO metrics absent in pmcollector
Sent by:	gpfsug-discuss-bounces@spectrumscale.org



Dear Community, I've activated CES-related metrics by simply doing:
[root@xbl-ces-91 ~]# mmperfmon config show |egrep -A4 'NFS|SMB' name =
"NFSIO" period = 5 ‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ \
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ZjQcmQRYFpfptBannerStart
 This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
Dear Community,

I've activated CES-related metrics by simply doing:

[root@xbl-ces-91 ~]# mmperfmon config show |egrep -A4 'NFS|SMB'
        name = "NFSIO"
        period = 5
},
{
        name = "SMBGlobalStats"
        period = 5
},
{
        name = "SMBStats"
        period = 5
}

Despite that, I get no result for any nfs* metrics:

--------------------------------------------
[root@xbl-ces-91 ~]# telnet localhost 9084
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
get -j metrics nfs_read bucket_size 5 last 1
Error: no data available for query
.
Connection closed by foreign host.

[root@xbl-ces-91 ~]# mmperfmon query "nfs_read"
Error: no data available for query
.

mmperfmon: Command failed. Examine previous error messages to determine
cause.
--------------------------------------------


I am pretty sure my collector is working correctly as it returns data for a
different metrics:

[root@xbl-ces-91 ~]# telnet localhost 9084
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
get -j metrics gpfs_fs_bytes_read last 20 bucket_size 1
{"header" : {"bcount" : 20,"bsize" : 1,"t_start" : 1618912752,"t_end" :
1618912772},"legend" : [{"caption" : "gpfs_fs_bytes_read","semType" :
2,"aggrType" : "value difference between start and end of the
bucket","type" : 4,"keys" : ["xbl-ces-91.psi.ch|GPFSFilesystem|
lenovoxbl.psi.ch|perf|gpfs_fs_bytes_read"]},{"caption" :
"gpfs_fs_bytes_read","semType" : 2,"aggrType" : "value difference between
start and end of the bucket","type" : 4,"keys" : ["xbl-ces-91.psi.ch|
GPFSFilesystem|lenovoxbl.psi.ch|tiered|gpfs_fs_bytes_read"]},{"caption" :
"gpfs_fs_bytes_read","semType" : 2,"aggrType" : "value difference between
start and end of the bucket","type" : 4,"keys" : ["xbl-ces-92.psi.ch|
GPFSFilesystem|lenovoxbl.psi.ch|perf|gpfs_fs_bytes_read"]},{"caption" :
"gpfs_fs_bytes_read","semType" : 2,"aggrType" : "value difference between
start and end of the bucket","type" : 4,"keys" : ["xbl-ces-92.psi.ch|
GPFSFilesystem|lenovoxbl.psi.ch|tiered|gpfs_fs_bytes_read"]}],"rows" :
[…]

Any clue ? Is the activation of NFSIO enough in the mmperfmon's config file
(this is the first time I try to configure CES monitoring) ?

Thank you,

   Alvise_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


[Attachment #7 (text/html)]

<html><body><p><font size="2">Hello Dorigo,</font><br><br><font size="2">in contrast \
to the basic Spectrum Scale metrics, the NFS and SMB sensors rely on a proxy \
mechanism that provides the metrics out of the CES stack.</font><br><font size="2">In \
case you have not used the installer, you may miss some steps.</font><br><br><font \
size="2">- Please check if you have the requires packages installed. </font><br><font \
size="2">(For example gpfs.pm-ganesha-10.0.0-2.el8.x86_64 or similar for \
NFS)</font><br><br><font size="2">- The config section should have the \
&quot;Generic&quot; keyword, like this</font><br><br><font size="2">{</font><br><font \
size="2">        name = &quot;NFSIO&quot;</font><br><font size="2">        period = \
10</font><br><font size="2">        restrict = &quot;cesNodes&quot;</font><br><font \
size="2">        type = &quot;Generic&quot;</font><br><font \
size="2">},</font><br><br><font size="2">See here in the KC:</font><br><a \
href="https://www.ibm.com/docs/en/spectrum-scale/5.0.5?topic=tool-enabling-protocol-metrics"><font \
size="2">https://www.ibm.com/docs/en/spectrum-scale/5.0.5?topic=tool-enabling-protocol-metrics</font></a><font \
size="2"><br></font><br><font size="2"> /var/log/zimon/ZIMonSensors.log may provides \
some additional clues as well.</font><br><br><font size="2" face="Arial">Mit \
freundlichen Grüßen / Kind regards</font><br><br><b><font face="Arial">Dr. Markus \
Rohwedder</font></b><br><br><font size="1" face="Arial">IBM Systems / Lab Services \
Europe / EMEA Storage Competence Center</font><table border="0" cellspacing="0" \
cellpadding="0"><tr valign="top"><td class="small_font" width="600" colspan="4" \
valign="middle"><hr width="100%" size="2" align="left" style="color:#0055AA; \
"></td></tr> <tr valign="top"><td class="small_font" width="600" colspan="4" \
valign="middle"><img width="1" height="1" \
src="cid:1__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" alt=""></td></tr> \
<tr valign="top"><td class="inner" width="39" valign="middle"><font size="1" \
color="#0055AA" face="Arial">Phone:</font></td><td class="inner" width="157" \
valign="middle"><font size="1" color="#0055AA" face="Arial">+49 162 \
4159920</font></td><td class="inner" width="246" valign="middle"><font size="1" \
color="#0055AA" face="Arial"> IBM Deutschland GmbH</font></td><td width="158" \
rowspan="4" valign="middle"><div align="right"><img \
src="cid:2__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" width="158" height="40" \
align="bottom"></div></td></tr> <tr valign="top"><td class="inner" width="39" \
valign="middle"><font size="1" color="#0055AA" face="Arial">E-Mail:</font></td><td \
class="inner" width="157" valign="middle"><font size="1" color="#0055AA" \
face="Arial">rohwedder@de.ibm.com</font></td><td class="inner" width="246" \
valign="middle"><font size="1" color="#0055AA" face="Arial"> Am Weiher \
24</font></td></tr> <tr valign="top"><td class="inner" width="39" \
valign="middle"><img width="1" height="1" \
src="cid:1__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" alt=""></td><td \
class="inner" width="157" valign="middle"><img width="1" height="1" \
src="cid:1__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" alt=""></td><td \
class="inner" width="246" valign="middle"><font size="1" color="#0055AA" \
face="Arial"> 65451 Kelsterbach</font></td></tr> <tr valign="top"><td class="inner" \
width="39" valign="middle"><img width="1" height="1" \
src="cid:1__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" alt=""></td><td \
class="inner" width="157" valign="middle"><img width="1" height="1" \
src="cid:1__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" alt=""></td><td \
class="inner" width="246" valign="middle"><font size="1" color="#0055AA" \
face="Arial"> Germany</font></td></tr> <tr valign="top"><td class="small_font" \
width="600" colspan="4" valign="middle"><hr width="100%" size="2" align="left" \
style="color:#0055AA; "></td></tr> <tr valign="top"><td class="foot" width="600" \
colspan="4" valign="middle"><font size="1" color="#999999" face="Arial">IBM \
Deutschland GmbH / Vorsitzender des Aufsichtsrats: Sebastian Krause / \
Geschäftsführung: Gregor Pillen (Vorsitzender), Agnes Heftberger, Norbert Janzen, \
Markus Koerner, Christian Noll, Nicole Reimer / Sitz der Gesellschaft: 71139 \
Ehningen, IBM-Allee 1 / Registergericht: Amtsgericht Stuttgart, HRB14562 \
</font></td></tr> <tr valign="top"><td class="small_font" width="600" colspan="4" \
valign="middle"><img width="1" height="1" \
src="cid:1__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" \
alt=""></td></tr></table><br><img width="16" height="16" \
src="cid:3__=8FBB0C2EDFAA03798f9e8a93df938690918c8FB@" border="0" alt="Inactive hide \
details for &quot;Dorigo Alvise (PSI)&quot; ---20.04.2021 12:19:44---Dear Community, \
I've activated CES-related metrics by "><font size="2" color="#424282">&quot;Dorigo \
Alvise (PSI)&quot; ---20.04.2021 12:19:44---Dear Community, I've activated \
CES-related metrics by simply doing:</font><br><br><font size="2" \
color="#5F5F5F">From:        </font><font size="2">&quot;Dorigo Alvise (PSI)&quot; \
&lt;alvise.dorigo@psi.ch&gt;</font><br><font size="2" color="#5F5F5F">To:        \
</font><font size="2">&quot;'gpfsug-discuss@spectrumscale.org'&quot; \
&lt;gpfsug-discuss@spectrumscale.org&gt;</font><br><font size="2" color="#5F5F5F">Cc: \
</font><font size="2">&quot;'sls-htc-admins@lists.psi.ch'&quot; \
&lt;sls-htc-admins@lists.psi.ch&gt;</font><br><font size="2" color="#5F5F5F">Date:    \
</font><font size="2">20.04.2021 12:19</font><br><font size="2" \
color="#5F5F5F">Subject:        </font><font size="2">[EXTERNAL] [gpfsug-discuss] \
NFSIO metrics absent in pmcollector</font><br><font size="2" color="#5F5F5F">Sent by: \
</font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr \
width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><font \
size="1" color="#FFFFFF">Dear Community, I've activated CES-related metrics by simply \
doing: [root@xbl-ces-91 ~]# mmperfmon config show |egrep -A4 'NFS|SMB' name = \
&quot;NFSIO&quot; period = 5 \
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ \
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ZjQcmQRYFpfptBannerStart</font> \
<br><b><font face="Arial">This Message Is From an External Sender \
</font></b><br><font size="2" face="Arial">This message came from outside your \
organization. </font><br><font size="1" \
color="#FFFFFF">ZjQcmQRYFpfptBannerEnd</font><br><font face="Calibri">Dear \
Community,</font><br><font face="Calibri"> </font><br><font face="Calibri">I've \
activated CES-related metrics by simply doing:<br><br>[root@xbl-ces-91 ~]# mmperfmon \
config show |egrep -A4 'NFS|SMB'</font><br><font face="Calibri">        name = \
&quot;NFSIO&quot;</font><br><font face="Calibri">        period = 5</font><br><font \
face="Calibri">},</font><br><font face="Calibri">{</font><br><font face="Calibri">    \
name = &quot;SMBGlobalStats&quot;</font><br><font face="Calibri">        period = \
5</font><br><font face="Calibri">},</font><br><font face="Calibri">{</font><br><font \
face="Calibri">        name = &quot;SMBStats&quot;</font><br><font face="Calibri">    \
period = 5</font><br><font face="Calibri">}</font><br><font face="Calibri"> \
</font><br><font face="Calibri">Despite that, I get no result for any nfs* \
metrics:</font><br><font face="Calibri"> </font><br><font \
face="Calibri">--------------------------------------------</font><br><font \
face="Calibri">[root@xbl-ces-91 ~]# telnet localhost 9084</font><br><font \
face="Calibri">Trying 127.0.0.1...</font><br><font face="Calibri">Connected to \
localhost.</font><br><font face="Calibri">Escape character is '^]'.</font><br><font \
face="Calibri">get -j metrics nfs_read bucket_size 5 last 1</font><br><font \
face="Calibri">Error: no data available for query</font><br><font \
face="Calibri">.</font><br><font face="Calibri">Connection closed by foreign \
host.</font><br><font face="Calibri"> </font><br><font \
face="Calibri">[root@xbl-ces-91 ~]# mmperfmon query \
&quot;nfs_read&quot;</font><br><font face="Calibri">Error: no data available for \
query</font><br><font face="Calibri">.</font><br><font face="Calibri"> \
</font><br><font face="Calibri">mmperfmon: Command failed. Examine previous error \
messages to determine cause.</font><br><font \
face="Calibri">--------------------------------------------</font><br><font \
face="Calibri"> </font><br><font face="Calibri"> </font><br><font face="Calibri">I am \
pretty sure my collector is working correctly as it returns data for a different \
metrics:</font><br><font face="Calibri"> </font><br><font \
face="Calibri">[root@xbl-ces-91 ~]# telnet localhost 9084</font><br><font \
face="Calibri">Trying 127.0.0.1...</font><br><font face="Calibri">Connected to \
localhost.</font><br><font face="Calibri">Escape character is '^]'.</font><br><font \
face="Calibri">get -j metrics gpfs_fs_bytes_read last 20 bucket_size \
1</font><br><font face="Calibri">{&quot;header&quot; : {&quot;bcount&quot; : \
20,&quot;bsize&quot; : 1,&quot;t_start&quot; : 1618912752,&quot;t_end&quot; : \
1618912772},&quot;legend&quot; : [{&quot;caption&quot; : \
&quot;gpfs_fs_bytes_read&quot;,&quot;semType&quot; : 2,&quot;aggrType&quot; : \
&quot;value difference between start and end of the bucket&quot;,&quot;type&quot; : \
4,&quot;keys&quot; : \
[&quot;xbl-ces-91.psi.ch|GPFSFilesystem|lenovoxbl.psi.ch|perf|gpfs_fs_bytes_read&quot;]},{&quot;caption&quot; \
: &quot;gpfs_fs_bytes_read&quot;,&quot;semType&quot; : 2,&quot;aggrType&quot; : \
&quot;value difference between start and end of the bucket&quot;,&quot;type&quot; : \
4,&quot;keys&quot; : \
[&quot;xbl-ces-91.psi.ch|GPFSFilesystem|lenovoxbl.psi.ch|tiered|gpfs_fs_bytes_read&quot;]},{&quot;caption&quot; \
: &quot;gpfs_fs_bytes_read&quot;,&quot;semType&quot; : 2,&quot;aggrType&quot; : \
&quot;value difference between start and end of the bucket&quot;,&quot;type&quot; : \
4,&quot;keys&quot; : \
[&quot;xbl-ces-92.psi.ch|GPFSFilesystem|lenovoxbl.psi.ch|perf|gpfs_fs_bytes_read&quot;]},{&quot;caption&quot; \
: &quot;gpfs_fs_bytes_read&quot;,&quot;semType&quot; : 2,&quot;aggrType&quot; : \
&quot;value difference between start and end of the bucket&quot;,&quot;type&quot; : \
4,&quot;keys&quot; : \
[&quot;xbl-ces-92.psi.ch|GPFSFilesystem|lenovoxbl.psi.ch|tiered|gpfs_fs_bytes_read&quot;]}],&quot;rows&quot; \
: </font><br><font face="Calibri">[…]</font><br><font face="Calibri"> \
</font><br><font face="Calibri">Any clue ? Is the activation of NFSIO enough in the \
mmperfmon's config file (this is the first time I try to configure CES monitoring) \
?</font><br><font face="Calibri"> </font><br><font face="Calibri">Thank \
you,</font><br><font face="Calibri"> </font><br><font face="Calibri">   \
Alvise</font><tt><font \
size="2">_______________________________________________<br>gpfsug-discuss mailing \
list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><tt><font size="2"><a \
href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></tt><tt><font \
size="2">&nbsp;<br></font></tt><br><br><BR> </body></html>


["ecblank.gif" (image/gif)]
["1A548529.gif" (image/gif)]
["graycol.gif" (image/gif)]

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic