[prev in list] [next in list] [prev in thread] [next in thread]
List: opennms-discuss
Subject: Re: [opennms-discuss] httpDataCollection / fetching multiple results
From: "Roskens, Ronald" <Ronald.Roskens () biworldwide ! com>
Date: 2011-07-30 16:55:32
Message-ID: C9265D4839934844B7FD633ADAFB733C2BC438F6 () BIEXCHMB02 ! biperf ! com
[Download RAW message or body]
The HttpCollector does not support indexed data collection. How much control over the \
app do you have? Can you update the format of the data that it returns so instead of \
text, maybe in an xml format?
Ron
________________________________
From: Jay Christopherson [jc.listmail@gmail.com]
Sent: Friday, July 29, 2011 4:28 PM
To: General OpenNMS Discussion
Subject: [opennms-discuss] httpDataCollection / fetching multiple results
I have an app that returns multiple result sets in a single GET like so via a web \
interface:
jmsWorker.analyticsScoreWorker.avgQueueTimeMs 410507.0 412913.0 411083.0
lbsClient.tyntecSyncClient.avgProcessTimeMs 146.0 157.0 155.0
lbsClient.tyntecSyncClient.processCount 1329.0 1251.0 1253.0
locationModel.synchronousLocationModel.avgRunTimeMs 524.0 551.0 563.0
locationModel.synchronousLocationModel.runCount 1972.0 1869.0 1843.0
processor.analyticsScoreProcessor.avgProcessTimeMs 613.0 644.0 654.0
processor.analyticsScoreProcessor.processCount 1972.0 1871.0 1841.0
processor.defaultSyncLocationProcessor.Vodafone.avgProcessTimeMs 1030.0 1034.0 1034.0
processor.defaultSyncLocationProcessor.Vodafone.processCount 363.0 357.0 365.0
I'm trying to figure out a way that I can use the httpDataCollector to fetch these \
results and insert them into a JRobin database, where each line represents a single \
JRB database with three datasources, like so:
jmsWorker.analyticsScoreWorker.avgQueueTimeMs
--> worker1
--> 410507.0
--> worker2
--> 412913.0
--> worker3
---> 411083.0
and so on...
(representing the data entered into a single JRB database).
I know I can create each JRB database by hand (JRobin API), populate them with \
datasources, assign them to a node for display, and even shove the data in. I can \
do all of this outside of OpenNMS itself. Why would I want to do this? Because this \
data is being fetched from a database and OpenNMS does not currently have a \
SQLCollector and these statistics are not available via JMX (at least, not as \
Attributes).
So, I can do all of this by hand, BUT I also want to be able to monitor these results \
via thresholds and as far as I can tell, if a ONMS data collector is not doing the \
collecting, I can't do a threshold on it. So my idea was to use the \
httpDataCollector to collect the data so that I could threshold on it.
It looks like though that the httpDataCollector is designed to only operate with one \
result set (i.e., one JRB destination with 1 or more datasources in it). I need a \
way to operate on many result sets at one time, parsing line by line.
Is this even possible with httpDataCollector? Is there any way at all to do it with \
ONMS or am I trying to fit a square peg into a round hole?
Thanks-
Jay
This e-mail message is being sent solely for use by the intended recipient(s) and may \
contain confidential information. Any unauthorized review, use, disclosure or \
distribution is prohibited. If you are not the intended recipient, please contact \
the sender by phone or reply by e-mail, delete the original message and destroy all \
copies. Thank you.
[Attachment #3 (text/html)]
<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style id="owaParaStyle">P {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
</style>
</head>
<body fPStyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">
<p>The HttpCollector does not support indexed data collection. How much control \
over the app do you have? Can you update the format of the data that it returns so \
instead of text, maybe in an xml format?</p> <p> </p>
<p>Ron</p>
<div style="FONT-FAMILY: Times New Roman; COLOR: #000000; FONT-SIZE: 16px">
<hr tabindex="-1">
<div style="DIRECTION: ltr" id="divRpF226140"><font color="#000000" size="2" \
face="Tahoma"><b>From:</b> Jay Christopherson [jc.listmail@gmail.com]<br> \
<b>Sent:</b> Friday, July 29, 2011 4:28 PM<br> <b>To:</b> General OpenNMS \
Discussion<br> <b>Subject:</b> [opennms-discuss] httpDataCollection / fetching \
multiple results<br> </font><br>
</div>
<div></div>
<div>I have an app that returns multiple result sets in a single GET like so via a \
web interface: <div><br>
</div>
<div>
<div>jmsWorker.analyticsScoreWorker.avgQueueTimeMs 410507.0 412913.0 \
411083.0</div> <div>lbsClient.tyntecSyncClient.avgProcessTimeMs 146.0 157.0 \
155.0</div> <div>lbsClient.tyntecSyncClient.processCount 1329.0 1251.0 1253.0</div>
<div>locationModel.synchronousLocationModel.avgRunTimeMs 524.0 551.0 563.0</div>
<div>locationModel.synchronousLocationModel.runCount 1972.0 1869.0 1843.0</div>
<div>processor.analyticsScoreProcessor.avgProcessTimeMs 613.0 644.0 654.0</div>
<div>processor.analyticsScoreProcessor.processCount 1972.0 1871.0 1841.0</div>
<div>processor.defaultSyncLocationProcessor.Vodafone.avgProcessTimeMs 1030.0 1034.0 \
1034.0</div> <div>processor.defaultSyncLocationProcessor.Vodafone.processCount 363.0 \
357.0 365.0</div> </div>
<div><br>
</div>
<div>I'm trying to figure out a way that I can use the httpDataCollector to fetch \
these results and insert them into a JRobin database, where each line represents a \
single JRB database with three datasources, like so:</div> <div><br>
</div>
<div>jmsWorker.analyticsScoreWorker.avgQueueTimeMs</div>
<div> --> worker1</div>
<div> --> 410507.0</div>
<div> --> worker2</div>
<div> --> 412913.0</div>
<div> --> worker3</div>
<div> ---> 411083.0</div>
<div><br>
</div>
<div>and so on...</div>
<div><br>
</div>
<div>(representing the data entered into a single JRB database).</div>
<div><br>
</div>
<div>I know I can create each JRB database by hand (JRobin API), populate them with \
datasources, assign them to a node for display, and even shove the data in. I \
can do all of this outside of OpenNMS itself. Why would I want to do this? \
Because this data is being fetched from a database and OpenNMS does not \
currently have a SQLCollector and these statistics are not available via JMX (at \
least, not as Attributes).</div> <div><br>
</div>
<div>So, I can do all of this by hand, BUT I also want to be able to monitor these \
results via thresholds and as far as I can tell, if a ONMS data collector is not \
doing the collecting, I can't do a threshold on it. So my idea was to use the \
httpDataCollector to collect the data so that I could threshold on it.</div>
<div><br>
</div>
<div>It looks like though that the httpDataCollector is designed to only operate with \
one result set (i.e., one JRB destination with 1 or more datasources in it). I \
need a way to operate on many result sets at one time, parsing line by line.</div> \
<div><br> </div>
<div>Is this even possible with httpDataCollector? Is there any way at all to \
do it with ONMS or am I trying to fit a square peg into a round hole?</div> <div><br>
</div>
<div>Thanks-</div>
<div>Jay</div>
<div><br>
</div>
<div> </div>
<div><br>
</div>
</div>
</div>
</div>
<BR>
This e-mail message is being sent solely for use by the intended recipient(s) and may \
contain confidential information. Any unauthorized review, use, disclosure or \
distribution is prohibited. If you are not the intended recipient, please contact \
the sender by phone or reply by e-mail, delete the original message and destroy all \
copies. Thank you.<BR> </body>
</html>
[Attachment #4 (--===============8286899185677520923==)]
------------------------------------------------------------------------------
Got Input? Slashdot Needs You.
Take our quick survey online. Come on, we don't ask for help often.
Plus, you'll get a chance to win $100 to spend on ThinkGeek.
http://p.sf.net/sfu/slashdot-survey
_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ
opennms-discuss mailing list
To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic