[prev in list] [next in list] [prev in thread] [next in thread]
List: opennms-discuss
Subject: Re: [opennms-discuss] ver 19.0.1 Insufficient Memory errors
From: "Hernandez, Paul" <Paul_Hernandez () mentor ! com>
Date: 2017-08-04 19:28:00
Message-ID: 082b5cda227b44d89466c637cbbc6c1c () svr-orw-mbx-01 ! mgc ! mentorg ! com
[Download RAW message or body]
Hi Jesse,
Would you confirm that the "thread leak in SnmpUtils" issue handled nicely with the \
patches below, has been resolved in version 20.0.1? I am currently performing a new \
install of 20.0.1
Thanks,
Paul
From: Jesse White [mailto:jesse@opennms.org]
Sent: Tuesday, May 30, 2017 10:00 AM
To: General OpenNMS Discussion <opennms-discuss@lists.sourceforge.net>; Hernandez, \
Paul <Paul_Hernandez@mentor.com>
Cc: Kroonen, Kevin <Kevin_Kroonen@mentor.com>; Figueroa, Willie \
<willie_figueroa@mentor.com>
Subject: Re: [opennms-discuss] ver 19.0.1 Insufficient Memory errors
Hi Paul,
Thanks for the detailed report. OpennMS Horizon 19.0.0, 19.0.1 and 19.1.0 are \
affected by a thread leak in SnmpUtils: https://issues.opennms.org/browse/NMS-9233
The fix will be included in the next release of OpennMS Horizon.
If you're looking for a fix today, you can try replacing the affected .jar files with \
the patched files attached to the JIRA issue.
Best,
Jesse
On 05/30/2017 12:46 PM, Hernandez, Paul wrote:
Hi,
Am running 19.0.1 and unable to keep OpenNMS running for more than a couple of days.
The Server information is as follows:
OS: CentOS Linux release 7.2.1511 (Core) on VMware VM
VCPU: 4
RAM: 16GB
SWAP: 16GB
Total Number of Servers monitored: 4584
Total Number of Services: 31202
While onms is running, the web interface is nicely responsive and server loads using \
"top" look reasonable. No excessive wait state and early on (1/2 hr after start) I \
see:
[root@orw-onms-dev-vm opennms]# free -h
total used free shared buff/cache available
Mem: 15G 5.6G 362M 263M 9.8G 9.5G
Swap: 15G 377M 15G
I have read what I can find and have opennmsc.conf set to provide this:
ps -ef | grep open
root 572 1 99 09:04 ? 00:50:12 /usr/java/latest/bin/java \
-Djava.endorsed.dirs=/opt/opennms/lib/endorsed -Dopennms.home=/opt/opennms -Xmx4096m \
-XX:+HeapDumpOnOutOfMemoryError -d64 -XX:+UseStringDeduplication \
-XX:+PrintGCTimeStamps -XX:+PrintGCDetails -XX:+UseG1GC \
-Xloggc:/var/log/opennms/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 \
-XX:GCLogFileSize=20M -Dcom.sun.management.jmxremote.authenticate=true \
-Dcom.sun.management.jmxremote.login.config=opennms \
-Dcom.sun.management.jmxremote.access.file=/opt/opennms/etc/jmxremote.access \
-DisThreadContextMapInheritable=true -Dgroovy.use.classvalue=true \
-XX:MaxMetaspaceSize=256m -Djava.io.tmpdir=/opt/opennms/data/tmp -jar \
/opt/opennms/lib/opennms_bootstrap.jar start
The output.log file typically will contain a very large number of this trace prior, \
to running out of memory:
java.io.IOException: Only 32bit unsigned integers are supported at position 271
at org.snmp4j.asn1.BER.decodeUnsignedInteger(BER.java:684)
at org.snmp4j.smi.Counter32.decodeBER(Counter32.java:65)
at org.snmp4j.smi.AbstractVariable.createFromBER(AbstractVariable.java:172)
at org.snmp4j.smi.VariableBinding.decodeBER(VariableBinding.java:191)
at org.snmp4j.PDU.decodeBER(PDU.java:584)
at org.snmp4j.mp.MPv2c.prepareDataElements(MPv2c.java:201)
at org.snmp4j.MessageDispatcherImpl.dispatchMessage(MessageDispatcherImpl.java:276)
at org.snmp4j.MessageDispatcherImpl.processMessage(MessageDispatcherImpl.java:385)
at org.snmp4j.MessageDispatcherImpl.processMessage(MessageDispatcherImpl.java:345)
at org.snmp4j.transport.AbstractTransportMapping.fireProcessMessage(AbstractTransportMapping.java:76)
at org.snmp4j.transport.DefaultUdpTransportMapping$ListenThread.run(DefaultUdpTransportMapping.java:423)
at java.lang.Thread.run(Thread.java:745)
A typical error file: hs_err_pid73808.log top 50 lines show:
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 12288 bytes for committing reserved \
memory. # Possible reasons:
# The system is out of physical RAM or swap space
# In 32 bit mode, the process size limit was hit
# Possible solutions:
# Reduce memory load on the system
# Increase physical memory or swap space
# Check if swap backing store is full
# Use 64 bit Java on a 64 bit OS
# Decrease Java heap size (-Xmx/-Xms)
# Decrease number of Java threads
# Decrease Java thread stack sizes (-Xss)
# Set larger code cache with -XX:ReservedCodeCacheSize=
# This output file may be truncated or incomplete.
#
# Out of Memory Error (os_linux.cpp:2627), pid=73808, tid=0x00007f522eff1700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode linux-amd64 \
compressed oops) # Failed to write core dump. Core dumps have been disabled. To \
enable core dumping, try "ulimit -c unlimited" before starting Java again #
--------------- T H R E A D ---------------
Current thread (0x00007f5251ab4800): JavaThread \
"DefaultUDPTransportMapping_0.0.0.0/0" daemon [_thread_new, id=129126, \
stack(0x00007f522eef1000,0x00007f522eff2000)]
Stack: [0x00007f522eef1000,0x00007f522eff2000], sp=0x00007f522eff09a0, free \
space=1022k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native \
code) V [libjvm.so+0xac703a] VMError::report_and_die()+0x2ba
V [libjvm.so+0x4fc7eb] report_vm_out_of_memory(char const*, int, unsigned long, \
VMErrorType, char const*)+0x8b V [libjvm.so+0x923c43] \
os::Linux::commit_memory_impl(char*, unsigned long, bool)+0x103 V \
[libjvm.so+0x923d0c] os::pd_commit_memory(char*, unsigned long, bool)+0xc V \
[libjvm.so+0x91d7ca] os::commit_memory(char*, unsigned long, bool)+0x2a V \
[libjvm.so+0x9220ff] os::pd_create_stack_guard_pages(char*, unsigned long)+0x7f V \
[libjvm.so+0xa6bdbe] JavaThread::create_stack_guard_pages()+0x5e V \
[libjvm.so+0xa755a4] JavaThread::run()+0x34 V [libjvm.so+0x926268] \
java_start(Thread*)+0x108 C [libpthread.so.0+0x7dc5] start_thread+0xc5
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00007f5251abb000 JavaThread "Timer-25740" daemon [_thread_blocked, id=129129, \
stack(0x00007f522ebee000,0x00007f522ecef000)]
.
.
.
Would moving to 19.1.0 be advised?
Thanks,
Paul
From: Hernandez, Paul
Sent: Thursday, May 11, 2017 2:42 PM
To: opennms-discuss@lists.sourceforge.net<mailto:opennms-discuss@lists.sourceforge.net>
Subject: Search: "Not Providing service"
Has anyone ever found the need to search for the set of hosts which currently are \
*not* providing a service? In other words if you have a requisition with a number of \
services defined (in this case net-snmp ones) and say you populate a large number of \
hosts into this req from your datacenter. Furthermore you've hosts OS's spanning \
years of versions and flavors of the OS.
Now you'd like a way to easily find which hosts are not providing a service (for a \
number of reasons like buggy net-snmp, snmp was never installed, the net-snmp is too \
old to support the "extend" feature etc etc) via Search.
Search has "Providing service" but what you'd like is to discover which hosts \
*aren't* providing the service. Yes you could pour through the large list of alerts \
(consider 1000's of hosts) but would it not be nice to simply have search filter them \
out quickly?
I hope that I am missing something and there is an easy way to do this. And if not, \
and others find the idea of use, maybe make this into an enhancement request.
Thanks,
Paul
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ
opennms-discuss mailing list
To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss
[Attachment #3 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:"Courier New \;color\:black";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Tahoma",sans-serif;
color:windowtext;
font-weight:bold;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Tahoma",sans-serif;
color:black;
font-weight:bold;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Tahoma",sans-serif;
color:windowtext;
font-weight:bold;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Tahoma",sans-serif;
color:black;
font-weight:bold;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black">Hi \
Jesse,<o:p></o:p></span></b></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black"><o:p> </o:p></span></b></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black">Would \
you confirm that the “thread leak in SnmpUtils” issue handled nicely with \
the patches below, has been resolved in version 20.0.1?<o:p></o:p></span></b></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black">I am \
currently performing a new install of 20.0.1<o:p></o:p></span></b></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black"><o:p> </o:p></span></b></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black">Thanks,<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black">Paul<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black"><o:p> </o:p></span></b></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black"><o:p> </o:p></span></b></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="color:windowtext">From:</span></b><span \
style="color:windowtext"> Jesse White [mailto:jesse@opennms.org] <br>
<b>Sent:</b> Tuesday, May 30, 2017 10:00 AM<br>
<b>To:</b> General OpenNMS Discussion <opennms-discuss@lists.sourceforge.net>; \
Hernandez, Paul <Paul_Hernandez@mentor.com><br> <b>Cc:</b> Kroonen, Kevin \
<Kevin_Kroonen@mentor.com>; Figueroa, Willie \
<willie_figueroa@mentor.com><br> <b>Subject:</b> Re: [opennms-discuss] ver \
19.0.1 Insufficient Memory errors<o:p></o:p></span></p> </div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi Paul,<br>
<br>
Thanks for the detailed report. OpennMS Horizon 19.0.0, 19.0.1 and 19.1.0 are \
affected by a thread leak in SnmpUtils:<br> <a \
href="https://issues.opennms.org/browse/NMS-9233">https://issues.opennms.org/browse/NMS-9233</a><br>
<br>
The fix will be included in the next release of OpennMS Horizon.<br>
<br>
If you're looking for a fix today, you can try replacing the affected .jar files with \
the patched files attached to the JIRA issue.<br> <br>
Best,<br>
Jesse<span style="font-size:12.0pt"><o:p></o:p></span></p>
<div>
<p class="MsoNormal">On 05/30/2017 12:46 PM, Hernandez, Paul wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Hi,</span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Am running 19.0.1 \
and unable to keep OpenNMS running for more than a couple of \
days.</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">The Server \
information is as follows:</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">OS: CentOS Linux \
release 7.2.1511 (Core) on VMware VM</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">VCPU: \
4</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">RAM: \
16GB</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">SWAP: \
16GB</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Total Number of \
Servers monitored: 4584</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Total Number of \
Services: 31202</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">While onms is \
running, the web interface is nicely responsive and server loads using \
“top” look reasonable. No excessive wait state and early on (1/2 hr after \
start) I see:</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">[root@orw-onms-dev-vm opennms]# free \
-h</span></b><o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> \
total \
used free \
shared buff/cache available</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">Mem: \
15G \
5.6G \
362M \
263M \
9.8G 9.5G</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">Swap: \
15G \
377M 15G</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">I have read what I \
can find and have opennmsc.conf set to provide this:</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New ;color:black",serif">ps \
-ef | grep open</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">root \
572 1 99 09:04 \
? 00:50:12 /usr/java/latest/bin/java \
-Djava.endorsed.dirs=/opt/opennms/lib/endorsed -Dopennms.home=/opt/opennms <span \
style="background:yellow;mso-highlight:yellow">-Xmx4096m</span> \
-XX:+HeapDumpOnOutOfMemoryError <span \
style="background:yellow;mso-highlight:yellow">-d64</span> -XX<span \
style="background:yellow;mso-highlight:yellow">:+UseStringDeduplication</span> \
-XX:+PrintGCTimeStamps -XX:+PrintGCDetails -XX<span \
style="background:yellow;mso-highlight:yellow">:+UseG1GC</span>
-Xloggc:/var/log/opennms/gc.log -XX:+UseGCLogFileRotation \
-XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=20M \
-Dcom.sun.management.jmxremote.authenticate=true \
-Dcom.sun.management.jmxremote.login.config=opennms \
-Dcom.sun.management.jmxremote.access.file=/opt/opennms/etc/jmxremote.access
-DisThreadContextMapInheritable=true -Dgroovy.use.classvalue=true \
-XX:MaxMetaspaceSize=256m -Djava.io.tmpdir=/opt/opennms/data/tmp -jar \
/opt/opennms/lib/opennms_bootstrap.jar start</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">The output.log \
file typically will contain a very large number of this trace prior, to running out \
of memory:</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">java.io.IOException: Only 32bit unsigned integers are \
supported at position 271</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"> at \
org.snmp4j.asn1.BER.decodeUnsignedInteger(BER.java:684)</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.smi.Counter32.decodeBER(Counter32.java:65)</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.smi.AbstractVariable.createFromBER(AbstractVariable.java:172)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.smi.VariableBinding.decodeBER(VariableBinding.java:191)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.PDU.decodeBER(PDU.java:584)</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"> at \
org.snmp4j.mp.MPv2c.prepareDataElements(MPv2c.java:201)</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.MessageDispatcherImpl.dispatchMessage(MessageDispatcherImpl.java:276)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.MessageDispatcherImpl.processMessage(MessageDispatcherImpl.java:385)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.MessageDispatcherImpl.processMessage(MessageDispatcherImpl.java:345)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.transport.AbstractTransportMapping.fireProcessMessage(AbstractTransportMapping.java:76)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
org.snmp4j.transport.DefaultUdpTransportMapping$ListenThread.run(DefaultUdpTransportMapping.java:423)</span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> at \
java.lang.Thread.run(Thread.java:745)</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">A typical error \
file: hs_err_pid73808.log top 50 lines \
show:</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">#</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># There is insufficient memory for the Java Runtime \
Environment to continue.</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Native memory allocation (mmap) failed to map 12288 \
bytes for committing reserved memory.</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Possible reasons:</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"># The system is out of physical RAM or swap \
space</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># In 32 bit mode, the process size limit \
was hit</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Possible solutions:</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"># Reduce memory load on the \
system</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Increase physical memory or swap \
space</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Check if swap backing store is \
full</span></b><o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"># Use 64 bit Java on a 64 bit \
OS</span></b><o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"># Decrease Java heap size \
(-Xmx/-Xms)</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Decrease number of Java \
threads</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Decrease Java thread stack sizes \
(-Xss)</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Set larger code cache with \
-XX:ReservedCodeCacheSize=</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># This output file may be truncated or \
incomplete.</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">#</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Out of Memory Error (os_linux.cpp:2627), \
pid=73808, tid=0x00007f522eff1700</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">#</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># JRE version: Java(TM) SE Runtime Environment \
(8.0_121-b13) (build 1.8.0_121-b13)</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"># Java VM: Java HotSpot(TM) 64-Bit Server VM \
(25.121-b13 mixed mode linux-amd64 compressed oops)</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New ;color:black",serif"># \
Failed to write core dump. Core dumps have been disabled. To enable core dumping, try \
"ulimit -c unlimited" before starting Java again</span></b><o:p></o:p></p> \
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">#</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"> </span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">--------------- T H R E A D \
---------------</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"> </span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">Current thread (0x00007f5251ab4800): JavaThread \
"DefaultUDPTransportMapping_0.0.0.0/0" daemon [_thread_new, id=129126, \
stack(0x00007f522eef1000,0x00007f522eff2000)]</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> </span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">Stack: [0x00007f522eef1000,0x00007f522eff2000], \
sp=0x00007f522eff09a0, free space=1022k</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">Native frames: (J=compiled Java code, j=interpreted, Vv=VM \
code, C=native code)</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">V [libjvm.so+0xac703a] \
VMError::report_and_die()+0x2ba</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">V [libjvm.so+0x4fc7eb] \
report_vm_out_of_memory(char const*, int, unsigned long, VMErrorType, char \
const*)+0x8b</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">V [libjvm.so+0x923c43] \
os::Linux::commit_memory_impl(char*, unsigned long, \
bool)+0x103</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">V [libjvm.so+0x923d0c] \
os::pd_commit_memory(char*, unsigned long, bool)+0xc</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">V [libjvm.so+0x91d7ca] \
os::commit_memory(char*, unsigned long, bool)+0x2a</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">V [libjvm.so+0x9220ff] \
os::pd_create_stack_guard_pages(char*, unsigned \
long)+0x7f</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">V [libjvm.so+0xa6bdbe] \
JavaThread::create_stack_guard_pages()+0x5e</span></b><o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">V [libjvm.so+0xa755a4] \
JavaThread::run()+0x34</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">V [libjvm.so+0x926268] \
java_start(Thread*)+0x108</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif">C [libpthread.so.0+0x7dc5] \
start_thread+0xc5</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif">--------------- P R O C E S S \
---------------</span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
New ;color:black",serif"> </span></b><o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Courier \
<p class="MsoNormal" style="margin-left:.5in"><b><span \
style="font-size:10.0pt;font-family:"Courier New \
;color:black",serif"> 0x00007f5251abb000 JavaThread \
"Timer-25740" daemon [_thread_blocked, id=129129, \
stack(0x00007f522ebee000,0x00007f522ecef000)]</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> \
.</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> \
.</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> \
.</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Would moving to \
19.1.0 be advised?</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Thanks,</span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Paul</span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Hernandez, Paul <br>
<b>Sent:</b> Thursday, May 11, 2017 2:42 PM<br>
<b>To:</b> <a href="mailto:opennms-discuss@lists.sourceforge.net">opennms-discuss@lists.sourceforge.net</a><br>
<b>Subject:</b> Search: "Not Providing service"<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Has anyone ever \
found the need to search for the set of hosts which currently are *not* providing a \
service? In other words if you have a requisition with a number of services \
defined (in this case net-snmp ones) and say you populate a large number of hosts \
into this req from your datacenter. Furthermore you’ve hosts OS’s \
spanning years of versions and flavors of the OS.</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Now you’d \
like a way to easily find which hosts are not providing a service (for a number of \
reasons like buggy net-snmp, snmp was never installed, the net-snmp is too old to \
support the “extend” feature etc etc) via \
Search.</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Search has \
“Providing service” but what you’d like is to discover which \
hosts *aren’t* providing the service. Yes you could pour through the large list \
of alerts (consider 1000’s of hosts) but would it not be nice to simply have \
search filter them out quickly?</span></b><o:p></o:p></p> <p \
class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">I hope that I am \
missing something and there is an easy way to do this. And if not, and others \
find the idea of use, maybe make this into an enhancement \
request.</span></b><o:p></o:p></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Thanks,</span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif">Paul</span></b><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> </span></b><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New \
Roman",serif"><br> <br>
<br>
<o:p></o:p></span></p>
<pre>------------------------------------------------------------------------------<o:p></o:p></pre>
<pre>Check out the vibrant tech community on one of the world's \
most<o:p></o:p></pre> <pre>engaging tech sites, Slashdot.org! <a \
href="http://sdm.link/slashdot">http://sdm.link/slashdot</a><o:p></o:p></pre> <p \
class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New \
Roman",serif"><br> <br>
<br>
<o:p></o:p></span></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Please read the OpenNMS Mailing List FAQ:<o:p></o:p></pre>
<pre><a href="http://www.opennms.org/index.php/Mailing_List_FAQ">http://www.opennms.org/index.php/Mailing_List_FAQ</a><o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>opennms-discuss mailing list<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>To *unsubscribe* or change your subscription options, see the bottom of this \
page:<o:p></o:p></pre> <pre><a \
href="https://lists.sourceforge.net/lists/listinfo/opennms-discuss">https://lists.sourceforge.net/lists/listinfo/opennms-discuss</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New \
Roman",serif"><o:p> </o:p></span></p> </div>
</body>
</html>
[Attachment #4 (--===============4469827260782297276==)]
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ
opennms-discuss mailing list
To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic