'Re: [Dev] Error while publishing throttling events to global policy server'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       wsf-java-dev
Subject:    Re: [Dev] Error while publishing throttling events to global policy server
From:       Harsha Kumara <harshak () wso2 ! com>
Date:       2018-01-27 2:49:19
Message-ID: CAF1mz2BGStxyPiOS3TjhoXbK7oOGHQo7v6RmWcj+RT-J-2DyUw () mail ! gmail ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]

On Sat, Jan 27, 2018 at 12:06 AM, Jason De Silva <jasons@wso2.com> wrote:

> Hi Isuru,
>
> Yes, That was the cause thank you for pointing it out. However, In the
> puppet script DataPublisher is set to false [2]. We will need to fix this
> in the script IMO. Created a git issue to fix it in puppet scripts [2] and
> to handle it gracefully in apim side [3].
>
> [1] https://github.com/wso2/puppet-apim/blob/v2.1.0/wso2am_
> runtime/hieradata/dev/wso2/wso2am_runtime/pattern-6/gatew
> ay-manager.yaml#L98
>
I think in this case, we didn't assume gateway manager will serve requests.
It's gateway workers who serves the traffic.

> [2] https://github.com/wso2/puppet-apim/issues/63
> [3] https://github.com/wso2/product-apim/issues/2630
>
> Regards,
> Jason
>
> Jason De Silva
> *Software Engineer - QA*
> Mobile: +94 (0) 772 097 678
> Email: jasons@wso2.com
> WSO2 Inc. www.wso2.com
> <http://wso2.com/signature>
>
> On Fri, Jan 26, 2018 at 8:14 PM, Isuru Haththotuwa <isuruh@wso2.com>
> wrote:
>
>> You have set DataPublisher.Enabled to false, need to set it to true.
>>
>> On Fri, Jan 26, 2018 at 8:02 PM, Jason De Silva <jasons@wso2.com> wrote:
>>
>>> Hi All,
>>>
>>> We have configured APIM 2.1.0 cluster (pattern 6) via puppet referring
>>> the doc at [3]. We are encountering the below NPE [2] for each API
>>> invocation. We are using a wum updated 2.1.0 pack. Below is the relevant
>>> "ThrottlingConfigurations" [1] of api-manager.xml.
>>> What can be the cause for this?
>>>
>>> [1]
>>> <ThrottlingConfigurations>
>>>         <EnableAdvanceThrottling>true</EnableAdvanceThrottling>
>>>         <DataPublisher>
>>>             <Enabled>false</Enabled>
>>>             <Type>Binary</Type>
>>>                 <ReceiverUrlGroup>tcp://tm.dev.wso2.org:9611
>>> </ReceiverUrlGroup>
>>>                 <AuthUrlGroup>ssl://tm.dev.wso2.org:9711</AuthUrlGroup>
>>>                 <Username>admin</Username>
>>>                 <Password>admin</Password>
>>>             <DataPublisherPool>
>>>                 <MaxIdle>1000</MaxIdle>
>>>                 <InitIdleCapacity>200</InitIdleCapacity>
>>>             </DataPublisherPool>
>>>             <DataPublisherThreadPool>
>>>                 <CorePoolSize>200</CorePoolSize>
>>>                 <MaxmimumPoolSize>1000</MaxmimumPoolSize>
>>>                 <KeepAliveTime>200</KeepAliveTime>
>>>             </DataPublisherThreadPool>
>>>         </DataPublisher>
>>>         <PolicyDeployer>
>>>             <ServiceURL>https://tm.dev.wso2.org:9443/services/</ServiceU
>>> RL>
>>>             <Username>admin</Username>
>>>           <Password>admin</Password>
>>>         </PolicyDeployer>
>>>   ....
>>>
>>>
>>> [2]
>>> TID: [-1234] [] [2018-01-26 14:07:41,822] ERROR
>>> {org.wso2.carbon.apimgt.gateway.throttling.publisher.ThrottleDataPublisher}
>>> -  Error while publishing throttling events to global policy server
>>> {org.wso2.carbon.apimgt.gateway.throttling.publisher.Throttl
>>> eDataPublisher}
>>> java.lang.NullPointerException
>>>     at org.wso2.carbon.apimgt.gateway.throttling.publisher.Throttle
>>> DataPublisher.publishNonThrottledEvent(ThrottleDataPublisher.java:119)
>>>     at org.wso2.carbon.apimgt.gateway.handlers.throttling.ThrottleH
>>> andler.doRoleBasedAccessThrottlingWithCEP(ThrottleHandler.java:349)
>>>     at org.wso2.carbon.apimgt.gateway.handlers.throttling.ThrottleH
>>> andler.doThrottle(ThrottleHandler.java:512)
>>>     at org.wso2.carbon.apimgt.gateway.handlers.throttling.ThrottleH
>>> andler.handleRequest(ThrottleHandler.java:460)
>>>     at org.apache.synapse.rest.API.process(API.java:325)
>>>     at org.apache.synapse.rest.RESTRequestHandler.dispatchToAPI(RES
>>> TRequestHandler.java:90)
>>>     at org.apache.synapse.rest.RESTRequestHandler.process(RESTReque
>>> stHandler.java:69)
>>>     at org.apache.synapse.core.axis2.Axis2SynapseEnvironment.inject
>>> Message(Axis2SynapseEnvironment.java:304)
>>>     at org.apache.synapse.core.axis2.SynapseMessageReceiver.receive
>>> (SynapseMessageReceiver.java:78)
>>>     at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>>>     at org.apache.synapse.transport.passthru.ServerWorker.processNo
>>> nEntityEnclosingRESTHandler(ServerWorker.java:330)
>>>     at org.apache.synapse.transport.passthru.ServerWorker.run(Serve
>>> rWorker.java:159)
>>>     at org.apache.axis2.transport.base.threads.NativeWorkerPool$1.r
>>> un(NativeWorkerPool.java:172)
>>>     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool
>>> Executor.java:1142)
>>>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo
>>> lExecutor.java:617)
>>>     at java.lang.Thread.run(Thread.java:745)
>>>
>>> [3] https://docs.wso2.com/display/AM2xx/Using+Puppet+Modules+to+
>>> Set+up+WSO2+API-M+with+Pattern+6#0abc8ab76a4d4ddfaa7faf25e4b39cba
>>>
>>> Jason De Silva
>>> *Software Engineer - QA*
>>> Mobile: +94 (0) 772 097 678
>>> Email: jasons@wso2.com
>>> WSO2 Inc. www.wso2.com
>>> <http://wso2.com/signature>
>>>
>>
>>
>>
>> --
>> Thanks and Regards,
>>
>> Isuru H.
>> +94 716 358 048 <+94%2071%20635%208048>* <http://wso2.com/>*
>>
>>
>>
>

-- 
Harsha Kumara
Software Engineer, WSO2 Inc.
Mobile: +94775505618
Blog:harshcreationz.blogspot.com

[Attachment #5 (text/html)]

<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jan \
27, 2018 at 12:06 AM, Jason De Silva <span dir="ltr">&lt;<a \
href="mailto:jasons@wso2.com" target="_blank">jasons@wso2.com</a>&gt;</span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Hi \
Isuru,<br><br></div>Yes, That was the cause thank you for pointing it out. However, \
In the puppet script DataPublisher is set to false [2]. We will need to fix this in \
the script IMO. Created a git issue to fix it in puppet scripts [2] and to handle it \
gracefully in apim side [3].<br><br>[1] <a \
href="https://github.com/wso2/puppet-apim/blob/v2.1.0/wso2am_runtime/hieradata/dev/wso2/wso2am_runtime/pattern-6/gateway-manager.yaml#L98" \
target="_blank">https://github.com/wso2/puppet<wbr>-apim/blob/v2.1.0/wso2am_<wbr>runti \
me/hieradata/dev/wso2/<wbr>wso2am_runtime/pattern-6/gatew<wbr>ay-manager.yaml#L98</a></div></div></div></blockquote><div>I \
think in this case, we didn&#39;t assume gateway manager will serve requests. \
It&#39;s gateway workers who serves the traffic.</div><blockquote class="gmail_quote" \
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div \
dir="ltr"><div><div>[2] <a href="https://github.com/wso2/puppet-apim/issues/63" \
target="_blank">https://github.com/wso2/<wbr>puppet-apim/issues/63</a><br></div><div>[3] \
<a href="https://github.com/wso2/product-apim/issues/2630" \
target="_blank">https://github.com/wso2/<wbr>product-apim/issues/2630</a><br><br></div>Regards,<br></div>Jason<br></div><div \
class="gmail_extra"><span class=""><br clear="all"><div><div \
class="m_2295207296072960202gmail_signature" data-smartmail="gmail_signature"><div \
dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div \
dir="ltr"><span><font color="#888888"><div><div><div><font \
face="arial,helvetica,sans-serif">Jason De Silva<br></font></div><font \
face="arial,helvetica,sans-serif"><b>Software Engineer - QA</b><br></font></div> \
<font face="arial,helvetica,sans-serif">Mobile: <a \
href="tel:%2B94%20%280%29%20772%20097%20678" value="+94773381250" target="_blank">+94 \
(0) 772 097 678</a><br></font></div></font></span><span><font color="#888888"><font \
face="arial,helvetica,sans-serif"><span><font color="#888888">Email: </font></span><a \
href="mailto:jasons@wso2.com" \
target="_blank">jasons@wso2.com</a><br></font></font></span><span><font \
color="#888888">WSO2 Inc. <a href="http://www.wso2.com" \
target="_blank">www.wso2.com</a></font></span><br></div></div><div dir="ltr"><span><a \
href="http://wso2.com/signature" target="_blank"><img \
src="http://c.content.wso2.com/signatures/wso2-signature-general.png"></a><span></span><span></span><a \
href="http:///" target="_blank"></a><br></span></div></div></div></div></div></div></div></div></div></div>
 <br></span><div><div class="h5"><div class="gmail_quote">On Fri, Jan 26, 2018 at \
8:14 PM, Isuru Haththotuwa <span dir="ltr">&lt;<a href="mailto:isuruh@wso2.com" \
target="_blank">isuruh@wso2.com</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">You have set DataPublisher.Enabled to false, \
need to set it to true.<br></div><div class="gmail_extra"><div><div \
class="m_2295207296072960202h5"><br><div class="gmail_quote">On Fri, Jan 26, 2018 at \
8:02 PM, Jason De Silva <span dir="ltr">&lt;<a href="mailto:jasons@wso2.com" \
target="_blank">jasons@wso2.com</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr"><div><div>Hi All,<br><br></div>We have \
configured APIM 2.1.0 cluster (pattern 6) via puppet referring the doc at [3]. We are \
encountering the below NPE [2] for each API invocation. We are using a wum updated \
2.1.0 pack. Below is the relevant &quot;ThrottlingConfigurations&quot; [1] of \
api-manager.xml.<br></div>What can be the cause for \
this?<br><br><div>[1]<br>&lt;ThrottlingConfigurations&gt;<br>               \
&lt;EnableAdvanceThrottling&gt;true&lt;<wbr>/EnableAdvanceThrottling&gt;<br>          \
&lt;DataPublisher&gt;<br>                       \
&lt;Enabled&gt;false&lt;/Enabled&gt;<br>                       \
&lt;Type&gt;Binary&lt;/Type&gt;<br>                               \
&lt;ReceiverUrlGroup&gt;tcp://<a href="http://tm.dev.wso2.org:9611" \
target="_blank">tm.dev<wbr>.wso2.org:9611</a>&lt;/ReceiverUrlGro<wbr>up&gt;<br>       \
&lt;AuthUrlGroup&gt;ssl://<a href="http://tm.dev.wso2.org:9711" \
target="_blank">tm.dev.wso<wbr>2.org:9711</a>&lt;/AuthUrlGroup&gt;<br>                \
&lt;Username&gt;admin&lt;/Username&gt;<br>                               \
&lt;Password&gt;admin&lt;/Password&gt;<br>                       \
&lt;DataPublisherPool&gt;<br>                               \
&lt;MaxIdle&gt;1000&lt;/MaxIdle&gt;<br>                               \
&lt;InitIdleCapacity&gt;200&lt;/InitIdl<wbr>eCapacity&gt;<br>                       \
&lt;/DataPublisherPool&gt;<br>                       \
&lt;DataPublisherThreadPool&gt;<br>                               \
&lt;CorePoolSize&gt;200&lt;/CorePoolSiz<wbr>e&gt;<br>                               \
&lt;MaxmimumPoolSize&gt;1000&lt;/Maxmim<wbr>umPoolSize&gt;<br>                        \
&lt;KeepAliveTime&gt;200&lt;/KeepAliveT<wbr>ime&gt;<br>                       \
&lt;/DataPublisherThreadPool&gt;<br>               &lt;/DataPublisher&gt;<br>         \
&lt;PolicyDeployer&gt;<br>                       &lt;ServiceURL&gt;<a \
href="https://tm.dev.wso2.org:9443/services/" \
target="_blank">https://tm.dev.wso<wbr>2.org:9443/services/</a>&lt;/ServiceU<wbr>RL&gt;<br> \
&lt;Username&gt;admin&lt;/Username&gt;<br>                   \
&lt;Password&gt;admin&lt;/Password&gt;<br>               &lt;/PolicyDeployer&gt;<br>  \
....</div><div><br><div><div><div><br>[2]<br>TID: [-1234] [] [2018-01-26 \
14:07:41,822] ERROR {org.wso2.carbon.apimgt.gatewa<wbr>y.throttling.publisher.Throttl<wbr>eDataPublisher} \
-   Error while publishing throttling events to global policy server \
{org.wso2.carbon.apimgt.gatewa<wbr>y.throttling.publisher.Throttl<wbr>eDataPublisher}<br>java.lang.NullPointerException<br> \
at org.wso2.carbon.apimgt.gateway<wbr>.throttling.publisher.Throttle<wbr>DataPublisher.publishNonThrott<wbr>ledEvent(ThrottleDataPublisher<wbr>.java:119)<br> \
at org.wso2.carbon.apimgt.gateway<wbr>.handlers.throttling.ThrottleH<wbr>andler.doRoleBasedAccessThrott<wbr>lingWithCEP(ThrottleHandler.ja<wbr>va:349)<br> \
at org.wso2.carbon.apimgt.gateway<wbr>.handlers.throttling.ThrottleH<wbr>andler.doThrottle(ThrottleHand<wbr>ler.java:512)<br> \
at org.wso2.carbon.apimgt.gateway<wbr>.handlers.throttling.ThrottleH<wbr>andler.handleRequest(ThrottleH<wbr>andler.java:460)<br> \
at <a href="http://org.apache.synapse.rest.API.pr" \
target="_blank">org.apache.synapse.rest.API.pr</a><wbr>ocess(API.java:325)<br>       \
at org.apache.synapse.rest.RESTRe<wbr>questHandler.dispatchToAPI(RES<wbr>TRequestHandler.java:90)<br> \
at org.apache.synapse.rest.RESTRe<wbr>questHandler.process(RESTReque<wbr>stHandler.java:69)<br> \
at org.apache.synapse.core.axis2.<wbr>Axis2SynapseEnvironment.inject<wbr>Message(Axis2SynapseEnvironmen<wbr>t.java:304)<br> \
at org.apache.synapse.core.axis2.<wbr>SynapseMessageReceiver.receive<wbr>(SynapseMessageReceiver.java:7<wbr>8)<br> \
at org.apache.axis2.engine.AxisEn<wbr>gine.receive(AxisEngine.java:1<wbr>80)<br>      \
at org.apache.synapse.transport.p<wbr>assthru.ServerWorker.processNo<wbr>nEntityEnclosingRESTHandler(Se<wbr>rverWorker.java:330)<br> \
at org.apache.synapse.transport.p<wbr>assthru.ServerWorker.run(Serve<wbr>rWorker.java:159)<br> \
at org.apache.axis2.transport.bas<wbr>e.threads.NativeWorkerPool$1.r<wbr>un(NativeWorkerPool.java:172)<br> \
at java.util.concurrent.ThreadPoo<wbr>lExecutor.runWorker(ThreadPool<wbr>Executor.java:1142)<br> \
at java.util.concurrent.ThreadPoo<wbr>lExecutor$Worker.run(ThreadPoo<wbr>lExecutor.java:617)<br> \
at java.lang.Thread.run(Thread.ja<wbr>va:745)<br><br>[3] <a \
href="https://docs.wso2.com/display/AM2xx/Using+Puppet+Modules+to+Set+up+WSO2+API-M+with+Pattern+6#0abc8ab76a4d4ddfaa7faf25e4b39cba" \
target="_blank">https://docs.wso2.com/display/<wbr>AM2xx/Using+Puppet+Modules+to+<wbr>Set+up+WSO2+API-M+with+Pattern<wbr>+6#0abc8ab76a4d4ddfaa7faf25e4b<wbr>39cba</a> \
<br><span class="m_2295207296072960202m_41051626560111758HOEnZb"><font \
color="#888888"><br clear="all"><div><div \
class="m_2295207296072960202m_41051626560111758m_4722679244915230430gmail_signature"><div \
dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div \
dir="ltr"><span><font color="#888888"><div><div><div><font \
face="arial,helvetica,sans-serif">Jason De Silva<br></font></div><font \
face="arial,helvetica,sans-serif"><b>Software Engineer - QA</b><br></font></div> \
<font face="arial,helvetica,sans-serif">Mobile: <a \
href="tel:%2B94%20%280%29%20772%20097%20678" value="+94773381250" target="_blank">+94 \
(0) 772 097 678</a><br></font></div></font></span><span><font color="#888888"><font \
face="arial,helvetica,sans-serif"><span><font color="#888888">Email: </font></span><a \
href="mailto:jasons@wso2.com" \
target="_blank">jasons@wso2.com</a><br></font></font></span><span><font \
color="#888888">WSO2 Inc. <a href="http://www.wso2.com" \
target="_blank">www.wso2.com</a></font></span><br></div></div><div dir="ltr"><span><a \
href="http://wso2.com/signature" target="_blank"><img \
src="http://c.content.wso2.com/signatures/wso2-signature-general.png"></a><span></span><span></span><a \
href="http:///" target="_blank"></a><br></span></div></div></div></div></div></div></div></div></div></div>
 </font></span></div></div></div></div></div>
</blockquote></div><br><br clear="all"><br></div></div><span \
class="m_2295207296072960202HOEnZb"><font color="#888888">-- <br><div \
class="m_2295207296072960202m_41051626560111758gmail_signature" \
data-smartmail="gmail_signature"><div dir="ltr"><div>Thanks and Regards,<br><br>Isuru \
H.<br></div><div> <a href="tel:+94%2071%20635%208048" value="+94716358048" \
target="_blank">+94 716 358 048</a><i><a href="http://wso2.com/" \
target="_blank"></a></i><br><br><br></div></div></div> </font></span></div>
</blockquote></div><br></div></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div \
class="gmail_signature" data-smartmail="gmail_signature"><div \
dir="ltr"><div><div><div>Harsha Kumara<br></div>Software Engineer, WSO2 \
Inc.<br></div>Mobile: +94775505618<br></div>Blog:<a \
href="http://harshcreationz.blogspot.com" \
target="_blank">harshcreationz.blogspot.com</a><br></div></div> </div></div>

_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[prev in list] [next in list] [prev in thread] [next in thread] 