[prev in list] [next in list] [prev in thread] [next in thread]
List: wsf-java-dev
Subject: Re: [Dev] java.net.SocketTimeoutException with SP analytics worker & postgres
From: Bernard Paris <bernard.paris () uclouvain ! be>
Date: 2019-02-14 8:12:53
Message-ID: 8E628368-0691-4EFB-BA08-D4EAD1AE8101 () uclouvain ! be
[Download RAW message or body]
[Attachment #2 (text/plain)]
Hello,
nothing to do with this, Analytics worker again at 400% CPU this morning, I had to \
kill -9 the process then restart. It never ran more than 3 days ;-(.
First I have
[2019-02-13 23:53:12,795] WARN {org.apache.thrift.transport.TIOStreamTransport} - \
Error closing output stream. java.net.SocketException: Socket is \
closed
at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1524)
at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1545)
at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
at org.apache.thrift.transport.TSocket.close(TSocket.java:196)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
in the logs (often during the night —> purging ?), then
[2019-02-14 00:01:46,401] WARN {} - IOException occurred while connecting to \
pgsql.uclouvain.be:5440<http://pgsql.uclouvain.be:5440> java.io.EOFException at \
org.postgresql.core.PGStream.receiveChar(PGStream.java:295)
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-02-14 00:01:48,660] WARN {} - IOException occurred while connecting to \
pgsql.uclouvain.be:5440<http://pgsql.uclouvain.be:5440> \
java.net.SocketTimeoutException
at java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.postgresql.core.PGStream.<init>(PGStream.java:69)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-02-14 00:05:25,337] ERROR {org.postgresql.Driver} - Connection error: \
org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.EOFException
My datasources config for all 4 DBs:
WSO2EI_ANALYTICS_WKR_PERMISSIONS_DB
WSO2EI_ANALYTICS_WKR_EI_ANALYTICS_DB
WSO2EI_ANALYTICS_METRICS_DB
WSO2EI_ANALYTICS_CARBON_DB
definition:
configuration:
jdbcUrl: \
'jdbc:postgresql://pgsql.domain:5440/WSO2EI_ANALYTICS_WKR_CARBON_DB' username: user
password: secret
driverClassName: org.postgresql.Driver
maxPoolSize: 20
idleTimeout: 20000
connectionTestQuery: SELECT 1
validationTimeout: 5000
isAutoCommit: false
type: RDBMS
description: "The datasource used for registry and user manager"
name: WSO2_CARBON_DB
We plan to switch to mySQL
Bernard
Le 7 févr. 2019 à 10:55, Dilini Muthumala <dilini@wso2.com<mailto:dilini@wso2.com>> \
a écrit :
Hi Bernard,
Those are Hikari Connection Pool configurations. You can find documentation on each \
of these parameters in 'Configurations' section in [1]. I have quoted 'idleTimeout' \
and 'validationTimeout' parameter descriptions below in this email for your \
convenience.
As for the issue you are getting, it would be better if you could share the complete \
log file. However from the looks of it, it seems like a connection problem. Please \
see [2].
Thanks,
Dilini
[1] https://github.com/brettwooldridge/HikariCP/tree/HikariCP-2.4.1
[2] https://stackoverflow.com/questions/15806083/org-postgresql-util-psqlexception-the-connection-attempt-failed
HikariCP Parameter descriptions:
⌚idleTimeout
This property controls the maximum amount of time that a connection is allowed to sit \
idle in the pool. Whether a connection is retired as idle or not is subject to a \
maximum variation of +30 seconds, and average variation of +15 seconds. A connection \
will never be retired as idle before this timeout. A value of 0 means that idle \
connections are never removed from the pool. Default: 600000 (10 minutes)
⌚validationTimeout
This property controls the maximum amount of time that a connection will be tested \
for aliveness. This value must be less than the connectionTimeout. The lowest \
accepted validation timeout is 1000ms (1 second). Default: 5000
On Wed, Feb 6, 2019 at 3:37 PM Bernard Paris \
<bernard.paris@uclouvain.be<mailto:bernard.paris@uclouvain.be>> wrote: Hello,
since this problem is still alive, could anyone give us an idea of what exactly are
idleTimeout
and
validationTimeout
parameters we are to define in deployment.yaml worker file, or what are their \
matching name in TOMCAT connection JDBC pool ?
Thanks
Bernard
[2019-02-01 02:45:23,770] WARN {} - IOException occurred while connecting to \
pgsql.hifolks.be:5440<http://pgsql.uclouvain.be:5440/> \
java.net.SocketTimeoutException
at java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.postgresql.core.PGStream.<init>(PGStream.java:69)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-02-01 02:45:31,458] WARN {org.apache.thrift.transport.TIOStreamTransport} - \
Error closing output stream. java.net.SocketException: Socket is closed at \
sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1524)
at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1545)
at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
at org.apache.thrift.transport.TSocket.close(TSocket.java:196)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-02-01 02:45:31,459] ERROR {org.postgresql.Driver} - Connection error: \
org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException
at java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.postgresql.core.PGStream.<init>(PGStream.java:69)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)
... 14 more
Le 28 janv. 2019 Ã 10:15, Bernard Paris \
<bernard.paris@uclouvain.be<mailto:bernard.paris@uclouvain.be>> a écrit :
Hi devs,
we are evaluating wso2-EI 6.4 in pre-prod environment, running EI with analytics \
worker.
I followed the guide at
https://docs.wso2.com/display/SP430/Configuring+Datasources
to configure postgres datasources in deployment.yaml, for all dbs:
METRICS_DB
CARBON_DB
PERMISSIONS_DB
EI_ANALYTICS_DB
Library is postgresql-42.2.2.jar
The system works fine for some days but after a while the analytics worker stops \
responding. I need to manually kill the (worker) process because "carbon.sh stop" \
doesn't do the stuff, then restart the worker… that will be ok for 3 or 4 days.
In comparison to datasources of wso2-EI in master-datasources.xml, db connector \
attributes are the same, except an extra one "testOnBorrow" set to true. \
Unfortunately this attribute is not allowed in deployment.yaml.
Any help should be appreciate to get the system stable.
[2019-01-24 01:48:52,291] INFO {org.wso2.carbon.databridge.core.DataBridge} - user \
admin connected [2019-01-24 01:48:52,291] INFO \
{org.wso2.carbon.databridge.core.DataBridge} - user admin connected [2019-01-24 \
01:48:52,289] WARN {org.apache.thrift.transport.TIOStreamTransport} - Error closing \
output stream. java.net.SocketException: Socket is closed
at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1524)
at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1545)
at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
at org.apache.thrift.transport.TSocket.close(TSocket.java:196)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-01-24 01:54:17,423] WARN {} - IOException occurred while connecting to \
pgsql.server.be:5440<http://pgsql.uclouvain.be:5440/> java.io.EOFException at \
org.postgresql.core.PGStream.receiveChar(PGStream.java:295)
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-01-24 01:54:22,204] ERROR {org.postgresql.Driver} - Connection error: \
org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.EOFException
at org.postgresql.core.PGStream.receiveChar(PGStream.java:295)
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)
... 14 more
[2019-01-24 01:55:53,456] INFO {org.wso2.carbon.databridge.core.DataBridge} - user \
admin connected [2019-01-24 01:55:31,190] WARN {} - IOException occurred while \
connecting to pgsql.server.be<http://pgsql.uclouvain.be:5440/>:5440<http://pgsql.uclouvain.be:5440/> \
java.io.EOFException at org.postgresql.core.PGStream.receiveChar(PGStream.java:295)
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2019-01-24 01:56:09,847] INFO {org.wso2.carbon.databridge.core.DataBridge} - user \
admin connected [2019-01-24 01:55:58,072] WARN {} - IOException occurred while \
connecting to pgsql.server.be<http://pgsql.uclouvain.be:5440/>:5440<http://pgsql.uclouvain.be:5440/> \
java.io.EOFException at org.postgresql.core.PGStream.receiveChar(PGStream.java:295)
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)
at com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)
at com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
_______________________________________________
Dev mailing list
Dev@wso2.org<mailto:Dev@wso2.org>
http://wso2.org/cgi-bin/mailman/listinfo/dev
_______________________________________________
Dev mailing list
Dev@wso2.org<mailto:Dev@wso2.org>
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Attachment #3 (text/html)]
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: \
after-white-space;" class=""> Hello,
<div class=""><br class="">
</div>
<div class="">nothing to do with this, Analytics worker again at 400% CPU this \
morning, I had to kill -9 the process then restart. It never ran more than 3 \
days ;-(. <div class=""><br class="">
</div>
<div class="">First I have </div>
<div class=""><br class="">
</div>
<div class="">
<div class="">
<div class="">[2019-02-13 23:53:12,795] WARN \
{org.apache.thrift.transport.TIOStreamTransport} - Error closing output stream. \
java.net.SocketException: Socket is closed</div> <div class=""> \
at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1524)</div> <div \
class=""> at \
sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1545)</div> <div \
class=""> at \
sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71)</div> <div \
class=""> at \
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)</div> <div \
class=""> at \
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)</div> <div \
class=""> at \
java.io.FilterOutputStream.close(FilterOutputStream.java:158)</div> <div \
class=""> at \
org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)</div>
<div class=""> at \
org.apache.thrift.transport.TSocket.close(TSocket.java:196)</div> <div \
class=""> at \
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)</div>
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> <div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">in the logs (often during the night —> purging ?), \
then </div> </div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[2019-02-14 00:01:46,401] WARN {} - IOException occurred while \
connecting to <a href="http://pgsql.uclouvain.be:5440" \
class="">pgsql.uclouvain.be:5440</a> java.io.EOFException</div> <div class=""> \
at \
org.postgresql.core.PGStream.receiveChar(PGStream.java:295)</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)</div>
<div class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> <div class=""><br class="">
</div>
<div class="">[2019-02-14 00:01:48,660] WARN {} - IOException occurred while \
connecting to <a href="http://pgsql.uclouvain.be:5440" \
class="">pgsql.uclouvain.be:5440</a> java.net.SocketTimeoutException</div> <div \
class=""> at \
java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111)</div> <div \
class=""> at \
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)</div> <div class=""> \
at java.net.Socket.connect(Socket.java:589)</div> <div \
class=""> at \
org.postgresql.core.PGStream.<init>(PGStream.java:69)</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> <div class=""><br class="">
</div>
<div class="">[2019-02-14 00:05:25,337] ERROR {org.postgresql.Driver} - Connection \
error: org.postgresql.util.PSQLException: The connection attempt failed.</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> <div class="">Caused by: \
java.io.EOFException</div> </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">My datasources config for all 4 DBs:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: \
after-white-space;"> <span style="background-color: rgb(255, 255, 255);" \
class="">WSO2EI_ANALYTICS_WKR_PERMISSIONS_DB </span></div> <div class="" \
style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: \
after-white-space;"> <span style="background-color: rgb(255, 255, 255);" \
class="">WSO2EI_ANALYTICS_WKR_EI_ANALYTICS_DB</span></div> \
WSO2EI_ANALYTICS_METRICS_DB<br class=""> WSO2EI_ANALYTICS_CARBON_DB</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div class=""> definition:</div>
<div class=""> configuration:</div>
<div class=""> jdbcUrl: 'jdbc:<a \
href="postgresql://pgsql.domain:5440/WSO2EI_ANALYTICS_WKR_CARBON_DB'" \
class="">postgresql://pgsql.domain:5440/WSO2EI_ANALYTICS_WKR_CARBON_DB'</a></div> \
<div class=""> username: user</div> <div \
class=""> password: secret</div> <div \
class=""> driverClassName: \
org.postgresql.Driver</div> <div class=""> \
maxPoolSize: 20</div> <div class=""> \
idleTimeout: 20000</div> <div class=""> \
connectionTestQuery: SELECT 1</div> <div class=""> \
validationTimeout: 5000</div> <div class=""> \
isAutoCommit: false</div> <div class=""> type: \
RDBMS</div> <div class=""> description: "The datasource used \
for registry and user manager"</div> <div class=""> name: \
WSO2_CARBON_DB</div> </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">We plan to switch to mySQL</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Bernard</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">Le 7 févr. 2019 à 10:55, Dilini Muthumala <<a \
href="mailto:dilini@wso2.com" class="">dilini@wso2.com</a>> a écrit :</div> <br \
class="Apple-interchange-newline"> <div class="">
<div dir="ltr" class="">
<div dir="ltr" class="">
<div dir="ltr" class="">Hi Bernard,
<div class=""><br class="">
</div>
<div class="">Those are Hikari Connection Pool configurations. You can find \
documentation on each of these parameters in 'Configurations' section in [1]. I have \
quoted '<span style="background-color:rgba(27,31,35,0.05);color:rgb(36,41,46);font-family:SFMono-Regular,Consolas,"Liberation \
Mono",Menlo,Courier,monospace;font-size:13.6px" \
class="">idleTimeout'</span> and '<em \
style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class=""><code \
style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation \
Mono",Menlo,Courier,monospace;font-size:13.6px;background-color:rgba(27,31,35,0.05);border-radius:3px;margin:0px;padding:0.2em \
0.4em;font-style:normal" class="">validationTimeout'</code></em> parameter \
descriptions below in this email for your convenience. </div> <div class=""><br \
class=""> </div>
<div class="">As for the issue you are getting, it would be better if you could share \
the complete log file. However from the looks of it, it seems like a connection \
problem. Please see [2].</div> <div class=""><br class="">
</div>
<div class="">Thanks,</div>
<div class="">Dilini</div>
<div class=""><br class="">
</div>
<div class="">[1] <a \
href="https://github.com/brettwooldridge/HikariCP/tree/HikariCP-2.4.1" \
target="_blank" class="">https://github.com/brettwooldridge/HikariCP/tree/HikariCP-2.4.1</a></div>
<div class="">[2] <a \
href="https://stackoverflow.com/questions/15806083/org-postgresql-util-psqlexception-the-connection-attempt-failed" \
class="">https://stackoverflow.com/questions/15806083/org-postgresql-util-psqlexception-the-connection-attempt-failed</a></div>
<div class=""><br class="">
</div>
<div class="">HikariCP Parameter descriptions:</div>
<div class=""><br class="">
</div>
<div class="">
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <span \
style="color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class="">⌚</span><code \
style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation \
Mono",Menlo,Courier,monospace;font-size:13.6px;background-color:rgba(27,31,35,0.05);border-radius:3px;margin:0px;padding:0.2em \
0.4em;color:rgb(36,41,46)" class="">idleTimeout<br class=""> </code><span \
style="color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class="">This property \
controls the maximum amount of time that a connection is allowed to sit idle in the \
pool. Whether a connection is retired as idle or not is subject to a maximum \
variation of +30 seconds, and average variation of +15 seconds. A connection \
will never be retired as idle </span><em \
style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class="">before</em><span \
style="color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class=""> this timeout. \
A value of 0 means that idle connections are never removed from the \
pool. </span><em \
style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class="">Default: 600000 (10 \
minutes)</em></blockquote> <blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> </blockquote>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <em \
style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class=""><br class=""> \
</em><em style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class=""><span \
style="font-style:normal" class="">⌚</span><code \
style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation \
Mono",Menlo,Courier,monospace;font-size:13.6px;background-color:rgba(27,31,35,0.05);border-radius:3px;margin:0px;padding:0.2em \
0.4em;font-style:normal" class="">validationTimeout<br class=""> </code></em><em \
style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,system-ui,"Segoe \
UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI \
Emoji","Segoe UI Symbol";font-size:16px" class=""><span \
style="font-style:normal" class="">This property controls the maximum amount of time \
that a connection will be tested for aliveness. This value must be less than \
the </span><code \
style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation \
Mono",Menlo,Courier,monospace;font-size:13.6px;background-color:rgba(27,31,35,0.05);border-radius:3px;margin:0px;padding:0.2em \
0.4em;font-style:normal" class="">connectionTimeout</code><span \
style="font-style:normal" class="">. The lowest accepted validation timeout is \
1000ms (1 second). </span><em style="box-sizing:border-box" class="">Default: \
5000</em></em></blockquote> </div>
</div>
</div>
</div>
<br class="">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Feb 6, 2019 at 3:37 PM Bernard Paris <<a \
href="mailto:bernard.paris@uclouvain.be" target="_blank" \
class="">bernard.paris@uclouvain.be</a>> wrote:<br class=""> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <div class="">Hello,
<div class=""><br class="">
</div>
<div class="">since this problem is still alive, could anyone give us an idea of what \
exactly are </div> <div class="">
<div class=""> idleTimeout</div>
<div class="">and</div>
<div class=""> validationTimeout</div>
</div>
<div class=""><br class="">
</div>
<div class="">parameters we are to define in deployment.yaml worker file, or what are \
their matching name in TOMCAT connection JDBC pool ?</div> <div class=""><br \
class=""> </div>
<div class="">Thanks</div>
<div class="">Bernard</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
[2019-02-01 02:45:23,770] WARN {} - IOException occurred while connecting \
to <a href="http://pgsql.uclouvain.be:5440/" target="_blank" \
class="">pgsql.hifolks.be:5440</a> java.net.SocketTimeoutException<br class=""> \
at \
java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111)<br class=""> \
at \
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)<br class=""> \
at \
java.net.Socket.connect(Socket.java:589)<br class=""> \
at \
org.postgresql.core.PGStream.<init>(PGStream.java:69)<br class=""> \
at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)<br \
class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)<br \
class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)<br class=""> \
at \
org.postgresql.Driver.makeConnection(Driver.java:452)<br class=""> \
at \
org.postgresql.Driver.connect(Driver.java:254)<br class=""> \
at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)<br \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)<br \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)<br class=""> \
at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)<br class=""> \
at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)<br class=""> \
at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)<br class=""> \
at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)<br class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)<br \
class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)<br \
class=""> at \
java.lang.Thread.run(Thread.java:748)<br class=""> <br class="">
[2019-02-01 02:45:31,458] WARN {org.apache.thrift.transport.TIOStreamTransport} \
- Error closing output stream. java.net.SocketException: Socket is closed<br \
class=""> at \
sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1524)<br class=""> \
at \
sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1545)<br class=""> \
at \
sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71)<br class=""> \
at \
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)<br class=""> \
at \
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)<br class=""> \
at \
java.io.FilterOutputStream.close(FilterOutputStream.java:158)<br class=""> \
at \
org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)<br \
class=""> at \
org.apache.thrift.transport.TSocket.close(TSocket.java:196)<br class=""> \
at \
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)<br \
class=""> at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)<br \
class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)<br \
class=""> at \
java.lang.Thread.run(Thread.java:748)<br class=""> <br class="">
[2019-02-01 02:45:31,459] ERROR {org.postgresql.Driver} - Connection error: \
org.postgresql.util.PSQLException: The connection attempt failed.<br class=""> \
at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)<br \
class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)<br \
class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)<br class=""> \
at \
org.postgresql.Driver.makeConnection(Driver.java:452)<br class=""> \
at \
org.postgresql.Driver.connect(Driver.java:254)<br class=""> \
at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)<br \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)<br \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)<br class=""> \
at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)<br class=""> \
at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)<br class=""> \
at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)<br class=""> \
at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)<br class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)<br \
class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)<br \
class=""> at \
java.lang.Thread.run(Thread.java:748)<br class=""> Caused by: \
java.net.SocketTimeoutException<br class=""> \
at \
java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111)<br class=""> \
at \
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)<br class=""> \
at \
java.net.Socket.connect(Socket.java:589)<br class=""> \
at \
org.postgresql.core.PGStream.<init>(PGStream.java:69)<br class=""> \
at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)<br \
class=""> ... 14 more</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">Le 28 janv. 2019 Ã 10:15, Bernard Paris <<a \
href="mailto:bernard.paris@uclouvain.be" target="_blank" \
class="">bernard.paris@uclouvain.be</a>> a écrit :</div> <br \
class="gmail-m_2452556060447583536gmail-m_357178076938841090gmail-m_1452368364199415278gmail-m_4502657322979062757Apple-interchange-newline">
<div class="">
<div class="">
<div class="">Hi devs,</div>
<div class="">
<div class=""><br class="">
</div>
<div class="">we are evaluating wso2-EI 6.4 in pre-prod environment, running EI with \
analytics worker.</div> <div class=""><br class="">
</div>
<div class="">I followed the guide at</div>
<div class=""><a href="https://docs.wso2.com/display/SP430/Configuring+Datasources" \
target="_blank" class="">https://docs.wso2.com/display/SP430/Configuring+Datasources</a></div>
<div class="">to configure postgres datasources in deployment.yaml, for all \
dbs: </div> </div>
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px" class="">
<div class="">
<div class="">METRICS_DB</div>
</div>
<div class="">
<div class="">CARBON_DB</div>
</div>
<div class="">
<div class="">PERMISSIONS_DB</div>
</div>
<div class="">
<div class="">EI_ANALYTICS_DB</div>
</div>
</blockquote>
<div class="">
<div class=""><br class="">
</div>
<div class="">Library is postgresql-42.2.2.jar</div>
<div class=""><br class="">
</div>
<div class="">The system works fine for some days but after a while the analytics \
worker stops responding.</div> <div class="">I need to manually kill the \
(worker) process because "carbon.sh stop" doesn't do the stuff, then \
restart the worker… that will be ok for 3 or 4 days.</div> <div class=""><br \
class=""> </div>
<div class="">In comparison to datasources of wso2-EI in master-datasources.xml, db \
connector attributes are the same, except an extra one "testOnBorrow" set \
to true.</div> <div class="">Unfortunately this attribute is not allowed \
in deployment.yaml.</div> <div class=""><br class="">
</div>
<div class="">Any help should be appreciate to get the system stable.</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[2019-01-24 01:48:52,291] INFO \
{org.wso2.carbon.databridge.core.DataBridge} - user admin connected</div> <div \
class="">[2019-01-24 01:48:52,291] INFO \
{org.wso2.carbon.databridge.core.DataBridge} - user admin connected</div> </div>
<div class="">
<div class="">[2019-01-24 01:48:52,289] WARN \
{org.apache.thrift.transport.TIOStreamTransport} - Error closing output stream. \
java.net.SocketException: Socket is closed</div> <div class=""> \
at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1524)</div> <div \
class=""> at \
sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1545)</div> <div \
class=""> at \
sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71)</div> <div \
class=""> at \
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)</div> <div \
class=""> at \
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) </div> <div \
class=""> at \
java.io.FilterOutputStream.close(FilterOutputStream.java:158)</div> <div \
class=""> at \
org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)</div>
<div class=""> at \
org.apache.thrift.transport.TSocket.close(TSocket.java:196)</div> <div \
class=""> at \
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)</div>
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> </div>
<div class="">
<div class="">[2019-01-24 01:54:17,423] WARN {} - IOException occurred while \
connecting to <a href="http://pgsql.uclouvain.be:5440/" target="_blank" \
class="">pgsql.server.be:5440</a> java.io.EOFException</div> <div \
class=""> at \
org.postgresql.core.PGStream.receiveChar(PGStream.java:295)</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)</div>
<div class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> </div>
<div class="">
<div class="">[2019-01-24 01:54:22,204] ERROR {org.postgresql.Driver} - Connection \
error: org.postgresql.util.PSQLException: The connection attempt failed.</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> <div class="">Caused by: \
java.io.EOFException</div> <div class=""> at \
org.postgresql.core.PGStream.receiveChar(PGStream.java:295)</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)</div>
<div class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)</div>
<div class=""> ... 14 more</div>
<div class=""><br class="">
</div>
<div class="">[2019-01-24 01:55:53,456] INFO \
{org.wso2.carbon.databridge.core.DataBridge} - user admin connected</div> <div \
class="">[2019-01-24 01:55:31,190] WARN {} - IOException occurred while \
connecting to <a href="http://pgsql.uclouvain.be:5440/" target="_blank" \
class="">pgsql.server.be</a><a href="http://pgsql.uclouvain.be:5440/" target="_blank" \
class="">:5440</a> java.io.EOFException</div> <div class=""> \
at org.postgresql.core.PGStream.receiveChar(PGStream.java:295)</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)</div>
<div class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> <div class=""><br class="">
</div>
<div class="">[2019-01-24 01:56:09,847] INFO \
{org.wso2.carbon.databridge.core.DataBridge} - user admin connected</div> <div \
class="">[2019-01-24 01:55:58,072] WARN {} - IOException occurred while \
connecting to <a href="http://pgsql.uclouvain.be:5440/" target="_blank" \
class="">pgsql.server.be</a><a href="http://pgsql.uclouvain.be:5440/" target="_blank" \
class="">:5440</a> java.io.EOFException</div> <div class=""> \
at org.postgresql.core.PGStream.receiveChar(PGStream.java:295)</div> <div \
class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:453)</div>
<div class=""> at \
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)</div>
<div class=""> at \
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)</div> \
<div class=""> at \
org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)</div> <div \
class=""> at \
org.postgresql.Driver.makeConnection(Driver.java:452)</div> <div class=""> \
at org.postgresql.Driver.connect(Driver.java:254)</div> <div \
class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)</div> \
<div class=""> at \
com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)</div>
<div class=""> at \
com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:496)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool.access$300(HikariPool.java:69)</div> <div \
class=""> at \
com.zaxxer.hikari.pool.HikariPool$1.run(HikariPool.java:367)</div> <div \
class=""> at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)</div> <div \
class=""> at \
java.util.concurrent.FutureTask.run(FutureTask.java:266)</div> <div class=""> \
at \
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)</div> \
<div class=""> at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)</div> \
<div class=""> at \
java.lang.Thread.run(Thread.java:748)</div> </div>
</div>
</div>
_______________________________________________<br class="">
Dev mailing list<br class="">
<a href="mailto:Dev@wso2.org" target="_blank" class="">Dev@wso2.org</a><br class="">
<a href="http://wso2.org/cgi-bin/mailman/listinfo/dev" target="_blank" \
class="">http://wso2.org/cgi-bin/mailman/listinfo/dev</a><br class=""> </div>
</blockquote>
</div>
<br class="">
</div>
</div>
_______________________________________________<br class="">
Dev mailing list<br class="">
<a href="mailto:Dev@wso2.org" target="_blank" class="">Dev@wso2.org</a><br class="">
<a href="http://wso2.org/cgi-bin/mailman/listinfo/dev" rel="noreferrer" \
target="_blank" class="">http://wso2.org/cgi-bin/mailman/listinfo/dev</a><br \
class=""> </blockquote>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</body>
</html>
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--===============6653364654970072920==--
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic