[prev in list] [next in list] [prev in thread] [next in thread]
List: esb-java-dev
Subject: Re: [Dev] [ML/DAS] java.lang.StackOverflowError in Recommendation Algorithm in spark 1.6.2
From: Supun Sethunga <supuns () wso2 ! com>
Date: 2016-08-31 17:29:48
Message-ID: CAMUGTrrD9JhdEPsxdLskq9KyqfAYa7qoqj0FnFaoCV_VZQuRgw () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
We can reduce the default one, but usually a will user increase/change that
when tuning hyper-parameters to increase the accuracy. So we need a
solution that would work globally (for any value). A typical 'user''
cannot/shouldn't enable checkpointing, as IMO its a server configuration.
anyway, the default one is 20, which is still in the lower side :)
On Wed, Aug 31, 2016 at 7:15 PM, Nirmal Fernando <nirmal@wso2.com> wrote:
> Can't we reduce the default number of iterations? and document how to
> enable 'check pointing'.
>
> On Wed, Aug 31, 2016 at 7:03 PM, Supun Sethunga <supuns@wso2.com> wrote:
>
>> Hi all,
>>
>> We are encountering $subject in ML, for the default hyper-parameter
>> values. A similar issue has been reported in [1], but with a different
>> algorithm.
>>
>> This occurs when the number of iterations for model training is large.
>> The solution suggested at [1] (setting a checkpoint directory) works for
>> our scenario, and is the only solid solution we have for the moment. But as
>> mentioned in [2], checkpointing add some overhead for spark operations, and
>> requires some tuning based on the use case. Therefore, I'm not sure is it a
>> good idea to enable checkpointing in ML, as it would affect DAS's
>> performance. (This checkpointing is done for the Spark Context, and it is
>> shared by both ML and DAS)
>>
>> Other option would be to, set checkpointing at the start of the
>> Recommendation algorithm, and once the model is trained, then unset
>> checkpointing. Since we are encountering this issue only at this particular
>> algorithm, it is not needed to be done for any other algorithm.
>>
>> Would like to know what would be the best approach?
>>
>> [1] https://issues.apache.org/jira/browse/SPARK-13546
>> [2] http://spark.apache.org/docs/1.6.2/streaming-programming
>> -guide.html#checkpointing
>>
>>
>>
>> *Stack Trace:*
>>
>> Caused by: java.lang.StackOverflowError
>> at java.io.ObjectInputStream$BlockDataInputStream.peekByte(Obje
>> ctInputStream.java:2606)
>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1506)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1774)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>> at scala.collection.immutable.$colon$colon.readObject(List.scala:362)
>> at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass
>> .java:1058)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>> at scala.collection.immutable.$colon$colon.readObject(List.scala:366)
>> at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass
>> .java:1058)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>> at scala.collection.immutable.$colon$colon.readObject(List.scala:362)
>> at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass
>> .java:1058)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>> at scala.collection.immutable.$colon$colon.readObject(List.scala:362)
>> at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass
>> .java:1058)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStrea
>> m.java:2000)
>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
>> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStre
>> am.java:1801)
>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
>> at scala.collection.immutable.$colon$colon.readObject(List.scala:362)
>> at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>>
>>
>> Regards,
>> Supun
>> --
>> *Supun Sethunga*
>> Senior Software Engineer
>> WSO2, Inc.
>> http://wso2.com/
>> lean | enterprise | middleware
>> Mobile : +94 716546324
>> Blog: http://supunsetunga.blogspot.com
>>
>
>
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>
--
*Supun Sethunga*
Senior Software Engineer
WSO2, Inc.
http://wso2.com/
lean | enterprise | middleware
Mobile : +94 716546324
Blog: http://supunsetunga.blogspot.com
[Attachment #5 (text/html)]
<div dir="ltr">We can reduce the default one, but usually a will user increase/change \
that when tuning hyper-parameters to increase the accuracy. So we need a solution \
that would work globally (for any value). A typical 'user'' \
cannot/shouldn't enable checkpointing, as IMO its a server \
configuration.<div><br></div><div>anyway, the default one is 20, which is still in \
the lower side :)</div></div><div class="gmail_extra"><br><div class="gmail_quote">On \
Wed, Aug 31, 2016 at 7:15 PM, Nirmal Fernando <span dir="ltr"><<a \
href="mailto:nirmal@wso2.com" target="_blank">nirmal@wso2.com</a>></span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr">Can't we reduce the default number of \
iterations? and document how to enable 'check pointing'. </div><div \
class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Wed, Aug 31, \
2016 at 7:03 PM, Supun Sethunga <span dir="ltr"><<a href="mailto:supuns@wso2.com" \
target="_blank">supuns@wso2.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Hi all,<div><br></div><div>We are encountering \
$subject in ML, for the default hyper-parameter values. A similar issue has been \
reported in [1], but with a different algorithm.</div><div><br></div><div>This occurs \
when the number of iterations for model training is large. The solution suggested at \
[1] (setting a checkpoint directory) works for our scenario, and is the only solid \
solution we have for the moment. But as mentioned in [2], checkpointing add some \
overhead for spark operations, and requires some tuning based on the use case. \
Therefore, I'm not sure is it a good idea to enable checkpointing in ML, as it \
would affect DAS's performance. (This checkpointing is done for the Spark \
Context, and it is shared by both ML and DAS)</div><div><br></div><div>Other option \
would be to, set checkpointing at the start of the Recommendation algorithm, and once \
the model is trained, then unset checkpointing. Since we are encountering this issue \
only at this particular algorithm, it is not needed to be done for any other \
algorithm.</div><div><br></div><div>Would like to know what would be the best \
approach?</div><div><br></div><div>[1] <a \
href="https://issues.apache.org/jira/browse/SPARK-13546" \
target="_blank">https://issues.apache.org/jira<wbr>/browse/SPARK-13546</a></div><div>[2] \
<a href="http://spark.apache.org/docs/1.6.2/streaming-programming-guide.html#checkpointing" \
target="_blank">http://spark.apache.org/do<wbr>cs/1.6.2/streaming-programming<wbr>-gui \
de.html#checkpointing</a></div><div><b><br></b></div><div><b><br></b></div><div><b><br></b></div><div><b>Stack \
Trace:</b></div><div><br></div><div>Caused by: \
java.lang.StackOverflowError</div><div><span style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream$Bloc<wbr>kDataInputStream.peekByte(Obje<wbr>ctInputStream.java:2606)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>ClassDesc(ObjectInputStream.<wbr>java:1506)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1774)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object(ObjectInputStream.java:<wbr>371)</div><div><span \
style="white-space:pre-wrap"> </span>at \
scala.collection.immutable.$co<wbr>lon$colon.readObject(List.scal<wbr>a:362)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.GeneratedMethodAcc<wbr>essor51.invoke(Unknown Source)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.lang.reflect.Method.invok<wbr>e(Method.java:497)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectStreamClass.invo<wbr>keReadObject(ObjectStreamClass<wbr>.java:1058)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1900)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object(ObjectInputStream.java:<wbr>371)</div><div><span \
style="white-space:pre-wrap"> </span>at \
scala.collection.immutable.$co<wbr>lon$colon.readObject(List.scal<wbr>a:366)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.GeneratedMethodAcc<wbr>essor51.invoke(Unknown Source)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.lang.reflect.Method.invok<wbr>e(Method.java:497)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectStreamClass.invo<wbr>keReadObject(ObjectStreamClass<wbr>.java:1058)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1900)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object(ObjectInputStream.java:<wbr>371)</div><div><span \
style="white-space:pre-wrap"> </span>at \
scala.collection.immutable.$co<wbr>lon$colon.readObject(List.scal<wbr>a:362)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.GeneratedMethodAcc<wbr>essor51.invoke(Unknown Source)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.lang.reflect.Method.invok<wbr>e(Method.java:497)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectStreamClass.invo<wbr>keReadObject(ObjectStreamClass<wbr>.java:1058)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1900)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object(ObjectInputStream.java:<wbr>371)</div><div><span \
style="white-space:pre-wrap"> </span>at \
scala.collection.immutable.$co<wbr>lon$colon.readObject(List.scal<wbr>a:362)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.GeneratedMethodAcc<wbr>essor51.invoke(Unknown Source)</div><div><span \
style="white-space:pre-wrap"> </span>at \
sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.lang.reflect.Method.invok<wbr>e(Method.java:497)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectStreamClass.invo<wbr>keReadObject(ObjectStreamClass<wbr>.java:1058)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1900)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>Object0(ObjectInputStream.java<wbr>:1351)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.defa<wbr>ultReadFields(ObjectInputStrea<wbr>m.java:2000)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>SerialData(ObjectInputStream.<wbr>java:1924)</div><div><span \
style="white-space:pre-wrap"> </span>at \
java.io.ObjectInputStream.read<wbr>OrdinaryObject(ObjectInputStre<wbr>am.java:1801)</div><div><span \
</font></span></div></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span \
class="HOEnZb"><font color="#888888">-- <br><div \
data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div \
dir="ltr"><br>Thanks & regards,<br>Nirmal<br><br>Team Lead - WSO2 Machine \
Learner<br>Associate Technical Lead - Data Technologies Team, WSO2 Inc.<br>Mobile: <a \
href="tel:%2B94715779733" value="+94715779733" \
target="_blank">+94715779733</a><br>Blog: <a href="http://nirmalfdo.blogspot.com/" \
target="_blank">http://nirmalfdo.blogspot.com/</a><br><br><img \
src="http://c.content.wso2.com/signatures/general.png" width="420" \
height="115"><br></div></div></div></div></div></div> </font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div \
class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div \
dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div \
dir="ltr"><div><div dir="ltr"><b><font face="verdana, sans-serif" size="1">Supun \
Sethunga</font></b><div><font face="verdana, sans-serif" size="1">Senior Software \
Engineer<br></font></div><div><font face="verdana, sans-serif" size="1">WSO2, \
Inc.</font></div><div><font face="verdana, sans-serif" size="1"><a \
href="http://wso2.com/" \
target="_blank">http://wso2.com/</a><br></font></div><div><font face="verdana, \
sans-serif" size="1">lean | enterprise | middleware</font></div><div><font \
face="verdana, sans-serif" size="1">Mobile : +94 716546324</font></div><div><font \
face="verdana, sans-serif" size="1">Blog: <a href="http://supunsetunga.blogspot.com" \
target="_blank">http://supunsetunga.blogspot.com</a></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</div>
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic