[prev in list] [next in list] [prev in thread] [next in thread] 

List:       spacewalk-list
Subject:    [Spacewalk-list] ERROR com.redhat.rhn.taskomatic.task.SynchProbeState - Error during probe state
From:       Christian_Fröstl <christian.froestl () nubon ! com>
Date:       2014-10-31 9:57:33
Message-ID: D0791B9D.1DA7F%christian.froestl () nubon ! com
[Download RAW message or body]

Hi there,

I get some deadlocks since a few days during the spacewalk sync probe, but I cannot \
figure out why. Any ideas? I get the error messages in log file:

2014-10-30 14:57:01,263 [DefaultQuartzScheduler_Worker-1] ERROR \
                com.redhat.rhn.taskomatic.task.SynchProbeState  - Error during probe \
                state sync
com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected
  Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked by \
process 19943. Process 19943 waits for ShareLock on transaction 26404529; blocked by \
process 3792.  Hint: See server log for query details.
  Where: SQL statement "update rhn_probe_state set state = 'PENDING', output = \
'Awaiting update' where last_check < ( select current_timestamp - interval '1 minute' \
* greatest(15, (3 * rhn_deployed_probe.check_interval_minutes)) from \
rhn_deployed_probe where rhn_deployed_probe.recid = rhn_probe_state.probe_id )" \
                PL/pgSQL function "rhn_synch_probe_state" line 2 at SQL statement
        at com.redhat.rhn.common.translation.SqlExceptionTranslator.postgreSqlException(SqlExceptionTranslator.java:54)
                
        at com.redhat.rhn.common.translation.SqlExceptionTranslator.sqlException(SqlExceptionTranslator.java:44)
                
        at com.redhat.rhn.common.db.datasource.CachedStatement.executeCallable(CachedStatement.java:543)
                
        at com.redhat.rhn.common.db.datasource.CallableMode.execute(CallableMode.java:35)
                
        at com.redhat.rhn.taskomatic.task.SynchProbeState.execute(SynchProbeState.java:44)
                
        at com.redhat.rhn.taskomatic.task.RhnJavaJob.execute(RhnJavaJob.java:82)
        at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
 Caused by: org.postgresql.util.PSQLException: ERROR: deadlock detected
  Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked by \
process 19943. Process 19943 waits for ShareLock on transaction 26404529; blocked by \
process 3792.  Hint: See server log for query details.
  Where: SQL statement "update rhn_probe_state set state = 'PENDING', output = \
'Awaiting update' where last_check < ( select current_timestamp - interval '1 minute' \
* greatest(15, (3 * rhn_deployed_probe.check_interval_minutes)) from \
rhn_deployed_probe where rhn_deployed_probe.recid = rhn_probe_state.probe_id )" \
                PL/pgSQL function "rhn_synch_probe_state" line 2 at SQL statement
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
                
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
                
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
                
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
                
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
                
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:360)
                
        at com.mchange.v2.c3p0.impl.NewProxyCallableStatement.execute(NewProxyCallableStatement.java:2417)
                
        at com.redhat.rhn.common.db.NamedPreparedStatement.execute(NamedPreparedStatement.java:117)
                
        at com.redhat.rhn.common.db.datasource.CachedStatement.executeCallable(CachedStatement.java:528)
                
        ... 6 more
2014-10-30 14:57:01,267 [DefaultQuartzScheduler_Worker-1] ERROR \
com.redhat.rhn.taskomatic.task.SynchProbeState  - \
com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected  Detail: \
Process 3792 waits for ShareLock on transaction 26404507; blocked by process 19943. \
Process 19943 waits for ShareLock on transaction 26404529; blocked by process 3792.  \
Hint: See server log for query details.  Where: SQL statement "update rhn_probe_state \
set state = 'PENDING', output = 'Awaiting update' where last_check < ( select \
current_timestamp - interval '1 minute' * greatest(15, (3 * \
rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe where \
rhn_deployed_probe.recid = rhn_probe_state.probe_id )" PL/pgSQL function \
"rhn_synch_probe_state" line 2 at SQL statement 2014-10-30 14:57:01,267 \
[DefaultQuartzScheduler_Worker-1] ERROR \
com.redhat.rhn.taskomatic.task.SynchProbeState  - \
com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected  Detail: \
Process 3792 waits for ShareLock on transaction 26404507; blocked by process 19943. \
Process 19943 waits for ShareLock on transaction 26404529; blocked by process 3792.  \
Hint: See server log for query details.  Where: SQL statement "update rhn_probe_state \
set state = 'PENDING', output = 'Awaiting update' where last_check < ( select \
current_timestamp - interval '1 minute' * greatest(15, (3 * \
rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe where \
rhn_deployed_probe.recid = rhn_probe_state.probe_id )" PL/pgSQL function \
"rhn_synch_probe_state" line 2 at SQL statement

Thanks in advance,
Christian


[Attachment #3 (text/html)]

<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: \
after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, \
sans-serif;"> <div>Hi there,</div>
<div><br>
</div>
<div>I get some deadlocks since a few days during the spacewalk sync probe, but I \
cannot figure out why. Any ideas?</div> <div>I get the error messages in log \
file:</div> <div><br>
</div>
<div>
<div>2014-10-30 14:57:01,263 [DefaultQuartzScheduler_Worker-1] ERROR \
com.redhat.rhn.taskomatic.task.SynchProbeState &nbsp;- Error during probe state \
sync</div> <div>com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock \
detected</div> <div>&nbsp; Detail: Process 3792 waits for ShareLock on transaction \
26404507; blocked by process 19943.</div> <div>Process 19943 waits for ShareLock on \
transaction 26404529; blocked by process 3792.</div> <div>&nbsp; Hint: See server log \
for query details.</div> <div>&nbsp; Where: SQL statement &quot;update \
rhn_probe_state set state = 'PENDING', output = 'Awaiting update' where last_check \
&lt; ( select current_timestamp - interval '1 minute' * greatest(15, (3 * \
rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe  where \
rhn_deployed_probe.recid = rhn_probe_state.probe_id )&quot;</div> <div>PL/pgSQL \
function &quot;rhn_synch_probe_state&quot; line 2 at SQL statement</div> <div>&nbsp; \
&nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.common.translation.SqlExceptionTranslator.postgreSqlException(SqlExceptionTranslator.java:54)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.common.translation.SqlExceptionTranslator.sqlException(SqlExceptionTranslator.java:44)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.common.db.datasource.CachedStatement.executeCallable(CachedStatement.java:543)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.common.db.datasource.CallableMode.execute(CallableMode.java:35)</div> \
<div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.taskomatic.task.SynchProbeState.execute(SynchProbeState.java:44)</div> \
<div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.taskomatic.task.RhnJavaJob.execute(RhnJavaJob.java:82)</div> \
<div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)</div> <div>&nbsp; \
&nbsp; &nbsp; &nbsp; at org.quartz.core.JobRunShell.run(JobRunShell.java:216)</div> \
<div>&nbsp; &nbsp; &nbsp; &nbsp; at \
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)</div> \
<div>Caused by: org.postgresql.util.PSQLException: ERROR: deadlock detected</div> \
<div>&nbsp; Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked \
by process 19943.</div> <div>Process 19943 waits for ShareLock on transaction \
26404529; blocked by process 3792.</div> <div>&nbsp; Hint: See server log for query \
details.</div> <div>&nbsp; Where: SQL statement &quot;update rhn_probe_state set \
state = 'PENDING', output = 'Awaiting update' where last_check &lt; ( select \
current_timestamp - interval '1 minute' * greatest(15, (3 * \
rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe  where \
rhn_deployed_probe.recid = rhn_probe_state.probe_id )&quot;</div> <div>PL/pgSQL \
function &quot;rhn_synch_probe_state&quot; line 2 at SQL statement</div> <div>&nbsp; \
&nbsp; &nbsp; &nbsp; at \
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)</div> \
<div>&nbsp; &nbsp; &nbsp; &nbsp; at \
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:360)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.mchange.v2.c3p0.impl.NewProxyCallableStatement.execute(NewProxyCallableStatement.java:2417)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.common.db.NamedPreparedStatement.execute(NamedPreparedStatement.java:117)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; at \
com.redhat.rhn.common.db.datasource.CachedStatement.executeCallable(CachedStatement.java:528)</div>
 <div>&nbsp; &nbsp; &nbsp; &nbsp; ... 6 more</div>
<div>2014-10-30 14:57:01,267 [DefaultQuartzScheduler_Worker-1] ERROR \
com.redhat.rhn.taskomatic.task.SynchProbeState &nbsp;- \
com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected</div> \
<div>&nbsp; Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked \
by process 19943.</div> <div>Process 19943 waits for ShareLock on transaction \
26404529; blocked by process 3792.</div> <div>&nbsp; Hint: See server log for query \
details.</div> <div>&nbsp; Where: SQL statement &quot;update rhn_probe_state set \
state = 'PENDING', output = 'Awaiting update' where last_check &lt; ( select \
current_timestamp - interval '1 minute' * greatest(15, (3 * \
rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe  where \
rhn_deployed_probe.recid = rhn_probe_state.probe_id )&quot;</div> <div>PL/pgSQL \
function &quot;rhn_synch_probe_state&quot; line 2 at SQL statement</div> \
<div>2014-10-30 14:57:01,267 [DefaultQuartzScheduler_Worker-1] ERROR \
com.redhat.rhn.taskomatic.task.SynchProbeState &nbsp;- \
com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected</div> \
<div>&nbsp; Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked \
by process 19943.</div> <div>Process 19943 waits for ShareLock on transaction \
26404529; blocked by process 3792.</div> <div>&nbsp; Hint: See server log for query \
details.</div> <div>&nbsp; Where: SQL statement &quot;update rhn_probe_state set \
state = 'PENDING', output = 'Awaiting update' where last_check &lt; ( select \
current_timestamp - interval '1 minute' * greatest(15, (3 * \
rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe  where \
rhn_deployed_probe.recid = rhn_probe_state.probe_id )&quot;</div> <div>PL/pgSQL \
function &quot;rhn_synch_probe_state&quot; line 2 at SQL statement</div> </div>
<div><br>
</div>
<div>Thanks in advance,</div>
<div>Christian</div>
<div><br>
</div>
</body>
</html>



_______________________________________________
Spacewalk-list mailing list
Spacewalk-list@redhat.com
https://www.redhat.com/mailman/listinfo/spacewalk-list
--===============7698558371057585682==--


[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic