[prev in list] [next in list] [prev in thread] [next in thread]
List: wsf-java-dev
Subject: Re: [Dev] Anomaly detection with an Open source ML/Analytic server - GSOC idea
From: Dilin Dampahalage <dilin () wso2 ! com>
Date: 2019-02-07 5:52:44
Message-ID: CAFOU92fF4uYPzb6ZrE8croF9PQoh24yvP3eTnpasdn7_PsEP3w () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Hi Gayan,
We have a CSV file with for Authentication data with few records. I have
attached it here. I collected this data using IS Analytics Server as @ashen
have mentioned. You can collect more information similarly.
Thanks,
Dilin
On Thu, Feb 7, 2019 at 10:51 AM Ashen Weerathunga <ashen@wso2.com> wrote:
> Hi Gayan,
>
> Thank you for your interest in this project. Main objective of this
> project would be to integrate anomaly detection with WSO2 Identity Server
> [1] data. We will update the project details accordingly. So we are mainly
> focusing on authentication data and OAuth access token related data which
> are generated from WSO2 IS.
>
> As an example when you consider a login activity there can be following
> data,
>
> - Browser and OS related data
> - Geo location of the user based on the IP address
> - Application related data
> - Login time
> - Data generated from WSO2 IS (username, userstore, tenant domain,
> user roles etc)
>
> So the idea is to derive an anomaly detection model based on the mentioned
> data to provide real time results back to WSO2 IS for decision making [2].
> We have already integrated the WSO2 Stream Processor with WSO2 IS for
> monitoring purpose. Please refer [3] for more details to get an idea about
> the data that we already collect.
>
> [1] https://wso2.com/identity-and-access-management
> [2] https://docs.wso2.com/display/IS570/Adaptive+Authentication
> [3] https://docs.wso2.com/display/IS570/Analytics
>
> Thanks,
> Ashen
>
> On Thu, Feb 7, 2019 at 12:10 AM Gayan Kavirathne <
> gayankavirathne.14@cse.mrt.ac.lk> wrote:
>
>> Hi all,
>>
>> Thank you very much for the detailed description of the aforementioned
>> project idea. Yet. it's not clear when querying the engine with *{User,
>> Activity, Time, and activity data} *what is activity data. And it would
>> be great if i can access a masked data set before submitting a proposal.
>>
>> A brief about myself,
>> I recently graduated from the Department of CSE at the University of
>> Moratuwa. Now I'm following a fulltime masters specialized in Data
>> science. My final year R&D project was on estimating rainfall leveraging
>> Commercial Microwave Links (Watch this video we made
>> <https://www.youtube.com/watch?v=T9FxUWXMPAM>to get a quick
>> understanding ). As a research student, I'm working on a project for
>> Spatio-Temporal Analysis of Dengue Epidemics in Sri Lanka using mobility
>> models for infectious disease.
>>
>>
>> Best Regards!
>> Gayan Sandaruwanthis video we made
>> Undergraduate,
>> Computer Science & Engineering,
>> University Of Moratuwa - Sri Lanka
>> Mobile +94779713087
>> [image:
>> https://lk.linkedin.com/in/gayan-sandaruwan-51b864113?trk=profile-badge]
>> <https://lk.linkedin.com/in/gayan-sandaruwan-51b864113?trk=profile-badge>
>>
>
>
> --
> *Ashen Weerathunga*
> Senior Software Engineer
> WSO2 Inc.: http://wso2.com
> lean.enterprise.middleware
>
> Email: ashen@wso2.com
> Mobile: +94716042995
> LinkedIn: *http://lk.linkedin.com/in/ashenweerathunga
> <http://lk.linkedin.com/in/ashenweerathunga>*
>
> <http://wso2.com/signature>
>
>
--
*Dilin Dampahalage*
Software Engineer | WSO2
Email : dilin@wso2.com
Mobile : +94 771 462939
web : http://wso2.com
<http://wso2.com/signature>
[Attachment #5 (text/html)]
<div dir="ltr">Hi Gayan,<div><br></div><div>We have a CSV file with for \
Authentication data with few records. I have attached it here. I collected this data \
using IS Analytics Server as @ashen have mentioned. You can collect more information \
similarly.</div><div><br></div><div>Thanks,</div><div>Dilin </div></div><br><div \
class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Feb 7, 2019 at 10:51 AM \
Ashen Weerathunga <<a href="mailto:ashen@wso2.com">ashen@wso2.com</a>> \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div \
dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Hi \
Gayan,<div><br></div><div>Thank you for your interest in this project. Main objective \
of this project would be to integrate anomaly detection with WSO2 Identity Server [1] \
data. We will update the project details accordingly. So we are mainly focusing on \
authentication data and OAuth access token related data which are generated from WSO2 \
IS. </div><div><br></div><div>As an example when you consider a login activity there \
can be following data,</div><div><ul><li>Browser and OS related data</li><li>Geo \
location of the user based on the IP address</li><li>Application related \
data</li><li>Login time</li><li>Data generated from WSO2 IS (username, userstore, \
tenant domain, user roles etc)</li></ul></div><div>So the idea is to derive an \
anomaly detection model based on the mentioned data to provide real time results back \
to WSO2 IS for decision making [2]. We have already integrated the WSO2 Stream \
Processor with WSO2 IS for monitoring purpose. Please refer [3] for more details to \
get an idea about the data that we already collect.</div><div><br></div><div>[1] <a \
href="https://wso2.com/identity-and-access-management" \
target="_blank">https://wso2.com/identity-and-access-management</a></div><div>[2] <a \
href="https://docs.wso2.com/display/IS570/Adaptive+Authentication" \
target="_blank">https://docs.wso2.com/display/IS570/Adaptive+Authentication</a></div><div>[3] \
<a href="https://docs.wso2.com/display/IS570/Analytics" \
target="_blank">https://docs.wso2.com/display/IS570/Analytics</a><br></div><div><br></ \
div><div>Thanks,</div><div>Ashen</div></div></div></div></div></div></div><br><div \
class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Feb 7, 2019 at 12:10 AM \
Gayan Kavirathne <<a href="mailto:gayankavirathne.14@cse.mrt.ac.lk" \
target="_blank">gayankavirathne.14@cse.mrt.ac.lk</a>> wrote:<br></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div>Hi \
all,</div><div><br></div><div>Thank you very much for the detailed description of the \
aforementioned project idea. Yet. it's not clear when querying the engine with<i> \
</i><span style="color:rgb(0,0,0)"><i>{User, Activity, Time, and<b> activity \
data</b>} </i>what is activity data. And it would be great if i can access a masked \
data set before submitting a proposal. <br></span></div><div><span \
style="color:rgb(0,0,0)"><br></span></div><div><span style="color:rgb(0,0,0)">A brief \
about myself,</span></div><div><span style="color:rgb(0,0,0)">I recently graduated \
from the Department of CSE at the University of Moratuwa. Now I'm following a \
fulltime masters specialized in Data science. My final year R&D project was on \
estimating rainfall leveraging Commercial Microwave Links (Watch <a \
href="https://www.youtube.com/watch?v=T9FxUWXMPAM" target="_blank">this video we made \
</a>to get a quick understanding ). As a research student, I'm working on a \
project for Spatio-Temporal Analysis of Dengue Epidemics in Sri Lanka using mobility \
models for infectious disease.</span></div><div dir="ltr"><br></div><div \
dir="ltr"><br></div><div>Best Regards!<br clear="all"></div><div dir="ltr"><div><div \
dir="ltr" class="gmail-m_383537572417052523gmail-m_-7770138602930018856gmail-m_4024783296167591855gmail_signature"><div \
dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div><div><div>Gayan \
Sandaruwan<span style="color:rgb(0,0,0)">this video we made \
</span></div>Undergraduate,<br></div>Computer Science & \
Engineering,<br></div>University Of Moratuwa - Sri Lanka<br></div>Mobile \
+94779713087<br><a href="https://lk.linkedin.com/in/gayan-sandaruwan-51b864113?trk=profile-badge" \
target="_blank"><img \
src="https://static.licdn.com/scds/common/u/img/webpromo/btn_viewmy_160x33.png" \
alt="https://lk.linkedin.com/in/gayan-sandaruwan-51b864113?trk=profile-badge"></a><br></div></div></div></div></div></div></div></div></div></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" \
class="gmail-m_383537572417052523gmail-m_-7770138602930018856gmail_signature"><div \
dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div \
dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><font \
color="#303f48"><span style="font-size:12px"><b>Ashen \
Weerathunga</b></span></font></div><div><font color="#303f48"><span \
style="font-size:12px">Senior</span></font><span \
style="color:rgb(48,63,72);font-size:12px"> Software Engineer</span><font \
color="#888888" style="color:rgb(136,136,136);font-size:12.8px"><font \
color="#888888"><br></font></font><span \
style="color:rgb(48,63,72);font-size:12px">WSO2 Inc.: </span><font color="#888888" \
style="color:rgb(136,136,136);font-size:12.8px"><font color="#888888"><a \
href="http://wso2.com/" style="color:rgb(17,85,204)" \
target="_blank">http://wso2.com</a></font></font><br><font><font \
color="#303f48"><span \
style="font-size:12px">lean.enterprise.middleware</span></font><br><br></font><font><font \
color="#303f48"><span style="font-size:12px">Email:</span></font><font \
color="#888888"><span style="font-size:12.8px"> </span></font><a \
href="mailto:ashen@wso2.com" style="color:rgb(17,85,204);font-size:12.8px" \
target="_blank">ashen@wso2.com</a><br></font></div><font><span \
style="font-size:12px"><font color="#303f48">Mobile:</font><font color="#888888"> \
</font></span></font><a \
style="font-size:12.8px;color:rgb(17,85,204)">+94716042995</a></div><div dir="ltr"><a \
value="+16502658311"><font><font><font color="#303f48"><span \
style="font-size:12px">LinkedIn:</span></font><font color="#3d85c6" face="georgia, \
serif"><span style="font-size:12.8px"> </span><span \
style="line-height:15px;font-size:12.8px"></span></font></font></font></a><font \
face="georgia, serif" style="color:rgb(136,136,136);font-size:12.8px"><font \
color="#3d85c6"><u><a href="http://lk.linkedin.com/in/ashenweerathunga" \
style="color:rgb(17,85,204)" \
target="_blank">http://lk.linkedin.com/in/ashenweerathunga</a></u></font></font><br></div><div \
dir="ltr"><font face="georgia, serif" \
style="color:rgb(136,136,136);font-size:12.8px"><font color="#3d85c6"><a \
href="http://wso2.com/signature" target="_blank"><img \
src="http://c.content.wso2.com/signatures/wso2-signature-general.png" width="420" \
height="94"><br></a><br><br></font></font></div></div></div></div></div></div></div></div></div></div></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" \
class="gmail_signature"><div dir="ltr"><div><div><div><div><b>Dilin \
Dampahalage<br></b></div>Software Engineer | WSO2<b><br><br></b></div>Email : <a \
href="mailto:dilin@wso2.com" target="_blank">dilin@wso2.com</a><br></div>Mobile : +94 \
771 462939<br></div>web : <a href="http://wso2.com" \
target="_blank">http://wso2.com</a><br><br><a href="http://wso2.com/signature" \
target="_blank"><img \
src="http://c.content.wso2.com/signatures/wso2-signature-general.png" \
alt=""></a><br><div><div><div><b></b></div></div></div></div></div>
--00000000000049b623058147494a--
["data.csv" (text/csv)]
META_TENANTID,CONTEXTID,EVENTID,EVENTTYPE,USERNAME,LOCALUSERNAME,USERSTOREDOMAIN,TENAN \
TDOMAIN,REMOTEIP,REGION,INBOUNDAUTHTYPE,SERVICEPROVIDER,REMEMBERMEENABLED,FORCEAUTHENA \
BLED,PASSIVEAUTHENABLED,ROLESCOMMASEPARATED,AUTHENTICATIONSTEP,IDENTITYPROVIDER,AUTHEN \
TICATIONSUCCESS,AUTHSTEPSUCCESS,STEPAUTHENTICATOR,ISFIRSTLOGIN,IDENTITYPROVIDERTYPE,UTCTIME,TIMESTAMP
-1234,022e7442-b200-48e5-a1af-5ed6165db12e,d6ee0676-922d-4cac-8512-884b5d024333,step,a \
dmin,admin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,admin,1,LOCAL,0,1,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:42:25 PM IST",1540033945370
-1234,022e7442-b200-48e5-a1af-5ed6165db12e,10e10178-6bc6-4c6c-95b1-b9ba1461a514,overal \
l,admin,admin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,admin,1,LOCAL,1,1,BasicAuthenticator,1,LOCAL,"Oct \
20, 2018 04:42:28 PM IST",1540033948621
-1234,cdf2f882-1191-449a-87d8-2f118e11a1b7,c1737c92-b441-4e96-a3d6-a6439f485c25,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,1,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:42:46 PM IST",1540033966060
-1234,cdf2f882-1191-449a-87d8-2f118e11a1b7,666cbf2d-962d-478d-8b50-c038b94f987f,overal \
l,dilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,1,1,BasicAuthenticator,1,LOCAL,"Oct \
20, 2018 04:42:49 PM IST",1540033969246
-1234,80b08924-6283-4657-8173-99f7de961c1a,0ada929f-2a56-48f8-9965-a6c5b003f589,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,1,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:43:46 PM IST",1540034026042
-1234,80b08924-6283-4657-8173-99f7de961c1a,c6d0fdfb-f189-4e14-9a2d-7e24279caf82,overal \
l,dilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,1,1,BasicAuthenticator,1,LOCAL,"Oct \
20, 2018 04:43:46 PM IST",1540034026125
-1234,4bc65220-1e65-4fbb-9410-1f30a2d6095a,6331c35d-b548-411f-9229-1ab669e050cc,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:43:58 PM IST",1540034038032
-1234,4bc65220-1e65-4fbb-9410-1f30a2d6095a,b7012f8f-eaa1-45be-9daf-526d582a4c97,step,a \
dmin,admin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,admin,1,LOCAL,0,1,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:03 PM IST",1540034043705
-1234,4bc65220-1e65-4fbb-9410-1f30a2d6095a,3590ffcd-0e1b-416c-bef5-06c875fd5bbe,overal \
l,admin,admin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,admin,1,LOCAL,1,1,BasicAuthenticator,1,LOCAL,"Oct \
20, 2018 04:44:03 PM IST",1540034043734
-1234,e42e422c-5afd-4067-b99f-09450bad4ce1,4baeec17-980a-4ca4-9efe-5809eabe3284,step,a \
dmin,admin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,admin,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:12 PM IST",1540034052164
-1234,e42e422c-5afd-4067-b99f-09450bad4ce1,e8662d5d-8646-42a8-b3ae-5e29b612b79c,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,1,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:16 PM IST",1540034056892
-1234,e42e422c-5afd-4067-b99f-09450bad4ce1,32ca3250-c4b3-4b8c-b825-2ee5f38a54b6,overal \
l,dilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,1,1,BasicAuthenticator,1,LOCAL,"Oct \
20, 2018 04:44:16 PM IST",1540034056961
-1234,3f5019b7-16b1-4150-ab32-54075743786f,fdaa40d2-659c-467f-ad2c-1284af12951e,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:25 PM IST",1540034065504
-1234,3f5019b7-16b1-4150-ab32-54075743786f,5b4c6530-e357-4457-9078-9757fd801917,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:28 PM IST",1540034068976
-1234,3f5019b7-16b1-4150-ab32-54075743786f,02310431-0cb8-4c7f-9a47-3d3828816acd,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:32 PM IST",1540034072108
-1234,3f5019b7-16b1-4150-ab32-54075743786f,753e9fde-1a77-4d39-87ac-726b40dfbcc6,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:35 PM IST",1540034075245
-1234,3f5019b7-16b1-4150-ab32-54075743786f,e94160d1-d5cd-49fa-b576-09b0d6bdf666,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:38 PM IST",1540034078330
-1234,3f5019b7-16b1-4150-ab32-54075743786f,3524ad0f-dee8-434c-bbfa-79969b1ab4a1,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:41 PM IST",1540034081547
-1234,3f5019b7-16b1-4150-ab32-54075743786f,f937842f-59d7-422e-913a-c13083db0ab1,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:44 PM IST",1540034084988
-1234,3f5019b7-16b1-4150-ab32-54075743786f,ca103a0f-d7ef-4dac-bffb-9c85c9130adf,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:48 PM IST",1540034088319
-1234,3f5019b7-16b1-4150-ab32-54075743786f,c88e992f-910a-4ca5-b4cc-8d0a632cfe34,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:44:54 PM IST",1540034094757
-1234,3f5019b7-16b1-4150-ab32-54075743786f,e6711fe3-5f17-4f26-bd08-a1f0107a2bca,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,0,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:45:00 PM IST",1540034100174
-1234,3f5019b7-16b1-4150-ab32-54075743786f,66b2a5e1-1745-4ef3-a78c-6bdaf36a5ab3,step,d \
ilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,0,1,NOT_AVAILABLE,0,LOCAL,"Oct \
20, 2018 04:45:05 PM IST",1540034105705
-1234,3f5019b7-16b1-4150-ab32-54075743786f,96c128a8-af10-40be-8377-e6e67ac4dcbd,overal \
l,dilin,dilin,PRIMARY,carbon.super,127.0.0.1,NOT_AVAILABLE,samlsso,wso2_sp_dashboard,0,0,0,NOT_AVAILABLE,1,LOCAL,1,1,BasicAuthenticator,1,LOCAL,"Oct \
20, 2018 04:45:05 PM IST",1540034105745
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic