[prev in list] [next in list] [prev in thread] [next in thread]
List: wsf-javascript-dev
Subject: Re: [Dev] Adding drill down capabilities to the Area Chart in IS Analytics Server Dashboard
From: Inosh Goonewardena <inosh () wso2 ! com>
Date: 2016-06-30 6:40:59
Message-ID: CAND3XXas_d-hw2C0ctxVMe3eR01NWTh+xYAzfii+pVmtzRLyKQ () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Hi Hasintha,
Currently, we are not doing any region based summarizations for sessions.
So at the moment we don't need this field in session stream. However if
there is such requirement we can add it to the stream. Not only the region
if there any other information that is useful related to sessions we can
add them to the stream
On Thu, Jun 30, 2016 at 11:51 AM, Hasintha Indrajee <hasintha@wso2.com>
wrote:
> Hi Inosh,
>
> Do we need this new field in session stream as well ?
>
> On Wed, Jun 29, 2016 at 3:13 PM, Nuwandi Wickramasinghe <nuwandiw@wso2.com
> > wrote:
>
>> Please find the public jira in [1]
>>
>> [1] https://wso2.org/jira/browse/IDENTITY-4739
>>
>> On Wed, Jun 29, 2016 at 2:51 PM, Hasintha Indrajee <hasintha@wso2.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> Had an offline discussion with Nuwandi and following are some points.
>>>
>>> - We can filter region from IP and provide ability to drill down, but if
>>> we follow this approach, region is not shown in the tables. This leads to a
>>> different user experience.
>>>
>>> Since we don't have any other possible solutions as suggested by Mohan,
>>> let's go with the first approach. Please create a jira for this and state
>>> required changes to the stream definitions.
>>>
>>> On Wed, Jun 29, 2016 at 12:38 PM, Mohanadarshan Vivekanandalingam <
>>> mohan@wso2.com> wrote:
>>>
>>>> HI Johann & Hasintha,
>>>>
>>>> Appreciate any feedback on above, then we can implement accordingly and
>>>> do some perf tests.. If drill capability is required for Map then we need
>>>> to follow above option.. Here, we can
>>>>
>>>> 1) Change the stream in Identity level and publish
>>>> 2) Change at DAS level by adding another attributes in Siddhi scope..
>>>>
>>>> But, I like to avoid option [2] to avoid unnecessary event conversions
>>>> (which impact the TPS).. Then, option [1] is the only solution in this
>>>> case..
>>>>
>>>> Thanks,
>>>> Mohan
>>>>
>>>>
>>>> On Tue, Jun 28, 2016 at 4:16 PM, Nuwandi Wickramasinghe <
>>>> nuwandiw@wso2.com> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> IS Analytics dashboard contains a map in which we have marked the
>>>>> regions of users who have authenticated through Identity Server. Our
>>>>> concern is whether we should allow to drill down from this map.
>>>>>
>>>>> Normally when drilling down from a gadget, in the dashboard we only
>>>>> show the data related to that selected field. And there's a data table
>>>>> below which shows the raw data corresponding to the selected field. This
>>>>> data table is populated using the raw stream which is published from
>>>>> Identity Server side.
>>>>>
>>>>> When implementing drill down capabilities from the area chart (map),
>>>>> we are facing an issue in populating the data table since the raw data
>>>>> stream published from IS contains only the remoteIp (which is used to
>>>>> determine the region) but not the region field itself.
>>>>>
>>>>> Regions and IP addresses have one to many relationship. Which means a
>>>>> large range of IPs corresponds to one region. Therefore we can get the
>>>>> region from IP but not vise versa. This leaves the issue that we cannot
>>>>> search in the raw stream using the region selected from the map.
>>>>>
>>>>> Suggested solution is to change the raw data stream to contain an
>>>>> additional 'region' attribute which could be used to search for the data
>>>>> related to a particular region. The value of region for the raw data will
>>>>> be sent as 'NOT_AVAILABLE'. We are planning to update this value to the
>>>>> correct region according to the remoteIp value using a spark query. We
>>>>> considered updating the records from the execution plan but that could
>>>>> delay the real time process.
>>>>>
>>>>> If we are going to implement this, Hasintha will have to introduce the
>>>>> new region attribute to the stream with a default value. Also this might
>>>>> introduce some performance degrade in the db level.
>>>>>
>>>>> We are still considering the need of drilling down from the region
>>>>> map. Appreciate other opinions regarding the subject.
>>>>>
>>>>> Thanks
>>>>> Nuwandi
>>>>>
>>>>> --
>>>>>
>>>>> Best Regards,
>>>>>
>>>>> Nuwandi Wickramasinghe
>>>>>
>>>>> Software Engineer
>>>>>
>>>>> WSO2 Inc.
>>>>>
>>>>> Web : http://wso2.com
>>>>>
>>>>> Mobile : 0719214873
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> *V. Mohanadarshan*
>>>> *Associate Tech Lead,*
>>>> *Data Technologies Team,*
>>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>>> *lean.enterprise.middleware.*
>>>>
>>>> email: mohan@wso2.com
>>>> phone:(+94) 771117673
>>>>
>>>
>>>
>>>
>>> --
>>> Hasintha Indrajee
>>> WSO2, Inc.
>>> Mobile:+94 771892453
>>>
>>>
>>
>>
>> --
>>
>> Best Regards,
>>
>> Nuwandi Wickramasinghe
>>
>> Software Engineer
>>
>> WSO2 Inc.
>>
>> Web : http://wso2.com
>>
>> Mobile : 0719214873
>>
>
>
>
> --
> Hasintha Indrajee
> WSO2, Inc.
> Mobile:+94 771892453
>
>
--
Thanks & Regards,
Inosh Goonewardena
Associate Technical Lead- WSO2 Inc.
Mobile: +94779966317
[Attachment #5 (text/html)]
<div dir="ltr"><div>Hi Hasintha, <br><br></div>Currently, we are not doing any region \
based summarizations for sessions. So at the moment we don't need this field in \
session stream. However if there is such requirement we can add it to the stream. Not \
only the region if there any other information that is useful related to sessions we \
can add them to the stream<br></div><div class="gmail_extra"><br><div \
class="gmail_quote">On Thu, Jun 30, 2016 at 11:51 AM, Hasintha Indrajee <span \
dir="ltr"><<a href="mailto:hasintha@wso2.com" \
target="_blank">hasintha@wso2.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Hi Inosh,<div><br></div><div>Do we need this \
new field in session stream as well ?</div></div><div class="HOEnZb"><div \
class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 29, 2016 \
at 3:13 PM, Nuwandi Wickramasinghe <span dir="ltr"><<a \
href="mailto:nuwandiw@wso2.com" target="_blank">nuwandiw@wso2.com</a>></span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr">Please find the public jira in \
[1]<div><br></div><div>[1] <a href="https://wso2.org/jira/browse/IDENTITY-4739" \
target="_blank">https://wso2.org/jira/browse/IDENTITY-4739</a></div></div><div><div><div \
class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 29, 2016 at 2:51 PM, \
Hasintha Indrajee <span dir="ltr"><<a href="mailto:hasintha@wso2.com" \
target="_blank">hasintha@wso2.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr"><div>Hi all,</div><div><br></div><div>Had an \
offline discussion with Nuwandi and following are some points. \
</div><div><br></div><div>- We can filter region from IP and provide ability to drill \
down, but if we follow this approach, region is not shown in the tables. This leads \
to a different user experience. </div><div><br></div>Since we don't have any \
other possible solutions as suggested by Mohan, let's go with the first approach. \
Please create a jira for this and state required changes to the stream definitions. \
</div><div class="gmail_extra"><div><div><br><div class="gmail_quote">On Wed, Jun 29, \
2016 at 12:38 PM, Mohanadarshan Vivekanandalingam <span dir="ltr"><<a \
href="mailto:mohan@wso2.com" target="_blank">mohan@wso2.com</a>></span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr">HI Johann & \
Hasintha,<div><br></div><div>Appreciate any feedback on above, then we can implement \
accordingly and do some perf tests.. If drill capability is required for Map then we \
need to follow above option.. Here, we can</div><div><br></div><div>1) Change the \
stream in Identity level and publish </div><div>2) Change at DAS level by adding \
another attributes in Siddhi scope.. </div><div><br></div><div>But, I like to avoid \
option [2] to avoid unnecessary event conversions (which impact the TPS).. Then, \
option [1] is the only solution in this case.. \
</div><div><br></div><div>Thanks,</div><div>Mohan</div><div><br></div></div><div \
class="gmail_extra"><div><div><br><div class="gmail_quote">On Tue, Jun 28, 2016 at \
4:16 PM, Nuwandi Wickramasinghe <span dir="ltr"><<a \
href="mailto:nuwandiw@wso2.com" target="_blank">nuwandiw@wso2.com</a>></span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr">Hi all,<div><br></div><div>IS Analytics \
dashboard contains a map in which we have marked the regions of users who have \
authenticated through Identity Server. Our concern is whether we should allow to \
drill down from this map.</div><div><br></div><div>Normally when drilling down from a \
gadget, in the dashboard we only show the data related to that selected field. And \
there's a data table below which shows the raw data corresponding to the selected \
field. This data table is populated using the raw stream which is published from \
Identity Server side.</div><div><br></div><div>When implementing drill down \
capabilities from the area chart (map), we are facing an issue in populating the data \
table since the raw data stream published from IS contains only the remoteIp (which \
is used to determine the region) but not the region field \
itself.</div><div><br></div><div>Regions and IP addresses have one to many \
relationship. Which means a large range of IPs corresponds to one region. Therefore \
we can get the region from IP but not vise versa. This leaves the issue that we \
cannot search in the raw stream using the region selected from the \
map.</div><div><br></div><div>Suggested solution is to change the raw data stream to \
contain an additional 'region' attribute which could be used to search for \
the data related to a particular region. The value of region for the raw data will be \
sent as 'NOT_AVAILABLE'. We are planning to update this value to the correct \
region according to the remoteIp value using a spark query. We considered updating \
the records from the execution plan but that could delay the real time \
process.</div><div><br></div><div>If we are going to implement this, Hasintha will \
have to introduce the new region attribute to the stream with a default value. Also \
this might introduce some performance degrade in the db \
level.</div><div><br></div><div>We are still considering the need of drilling down \
from the region map. Appreciate other opinions regarding the \
subject.</div><div><br></div><div><div>Thanks</div><div>Nuwandi<br \
clear="all"><div><br></div>-- <br><div data-smartmail="gmail_signature"><div \
dir="ltr">
<p style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Best Regards,</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Nuwandi Wickramasinghe</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Software Engineer</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">WSO2 Inc.</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Web : <a href="http://wso2.com/" \
target="_blank">http://wso2.com</a></span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Mobile : <a href="tel:0719214873" \
value="+94719214873" target="_blank">0719214873</a></span></p>
</div></div>
</div></div></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span><font \
color="#888888">-- <br><div data-smartmail="gmail_signature"><div dir="ltr"><div><div \
dir="ltr"><div><div dir="ltr"><font face="georgia, serif" color="#444444" size="2"><b \
style="background-color:rgb(255,255,255)">V. Mohanadarshan</b></font><div><div><font \
face="times new roman, serif" color="#444444" size="1"><b \
style="background-color:rgb(255,255,255)">Associate Tech \
Lead,</b></font></div><div><font face="times new roman, serif" color="#444444" \
size="1"><b style="background-color:rgb(255,255,255)">Data Technologies \
Team,</b></font></div><div><font face="times new roman, serif" color="#444444" \
size="1"><b style="background-color:rgb(255,255,255)">WSO2, Inc. <a \
href="http://wso2.com" target="_blank">http://wso2.com</a> \
</b></font></div><div><font face="times new roman, serif" color="#444444" size="1"><b \
style="background-color:rgb(255,255,255)">lean.enterprise.middleware.</b></font></div></div><div><font \
face="georgia, serif" color="#444444" size="2"><b \
style="background-color:rgb(255,255,255)"><br></b></font></div><div><font \
style="background-color:rgb(255,255,255)" color="#444444" size="1">email: <a \
href="mailto:mohan@wso2.com" target="_blank">mohan@wso2.com</a> \
</font></div><div><font style="background-color:rgb(255,255,255)" color="#444444" \
size="1">phone:<a href="tel:%28%2B94%29%20771117673" value="+94771117673" \
target="_blank">(+94) 771117673</a></font></div></div></div></div></div></div></div> \
</font></span></div> </blockquote></div><br><br \
clear="all"><div><br></div></div></div><span><font color="#888888">-- <br><div \
data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Hasintha \
Indrajee</div><div>WSO2, Inc.</div><div>Mobile:<a href="tel:%2B94%20771892453" \
value="+94771892453" target="_blank">+94 \
771892453</a></div><div><br></div></div></div></div></div> </font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div \
data-smartmail="gmail_signature"><div dir="ltr">
<p style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Best Regards,</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Nuwandi Wickramasinghe</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Software Engineer</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">WSO2 Inc.</span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Web : <a href="http://wso2.com/" \
target="_blank">http://wso2.com</a></span></p><span \
style="font-family:verdana,sans-serif"> </span><p \
style="margin-bottom:0in;line-height:100%"><span \
style="font-family:verdana,sans-serif">Mobile : <a href="tel:0719214873" \
value="+94719214873" target="_blank">0719214873</a></span></p>
</div></div>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div \
data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Hasintha \
Indrajee</div><div>WSO2, Inc.</div><div>Mobile:<a href="tel:%2B94%20771892453" \
value="+94771892453" target="_blank">+94 \
771892453</a></div><div><br></div></div></div></div></div> </div>
</div></div></blockquote></div><br><br clear="all"><br>-- <br><div \
class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div \
dir="ltr">Thanks & Regards,<br><br>Inosh Goonewardena<br>Associate Technical \
Lead- WSO2 Inc.<br>Mobile: +94779966317<br></div></div></div></div> </div>
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic