[prev in list] [next in list] [prev in thread] [next in thread] 

List:       cassandra-user
Subject:    Re: Cassandra error Insufficient space to compact
From:       aaron morton <aaron () thelastpickle ! com>
Date:       2011-03-31 23:15:04
Message-ID: B954E216-85BC-4532-8B1B-EF1550839569 () thelastpickle ! com
[Download RAW message or body]

Where are the connection refused messages ? Are they client side ? Can you cannot to \
the cluster with nodetool and run the ring command ? 

Aaron
On 31 Mar 2011, at 11:44, Anurag Gujral wrote:

> I restarted the cassandra node with more disks when I try to connect to cassandra i \
> get connection refused errors. I see the following in the logs
> INFO [HintedHandoff:1] 2011-03-30 19:37:42,189 HintedHandOffManager.java (line 304) \
> Started hinted handoff for endpoint /10.97.145.35 INFO [HintedHandoff:1] 2011-03-30 \
> 19:37:42,190 HintedHandOffManager.java (line 360) Finished hinted handoff of 0 rows \
> to endpoint /10.97.145.35 INFO [ScheduledTasks:1] 2011-03-30 19:39:03,500 \
> Gossiper.java (line 224) InetAddress /10.97.145.35 is now dead. INFO \
> [COMMIT-LOG-WRITER] 2011-03-30 19:39:27,695 CommitLogSegment.java (line 50) \
> Creating new commitlog segment \
> /var/lib/cassandra/commitlog/CommitLog-1301531967695.log INFO [HintedHandoff:1] \
> 2011-03-30 19:39:34,588 HintedHandOffManager.java (line 284) Checking remote schema \
> before delivering hints INFO [GossipStage:1] 2011-03-30 19:39:34,588 Gossiper.java \
> (line 600) InetAddress  *.*/.*.*is now UP INFO [HintedHandoff:1] 2011-03-30 \
> 19:39:34,588 HintedHandOffManager.java (line 290) Sleeping 3601ms to stagger hint \
> delivery INFO [HintedHandoff:1] 2011-03-30 19:39:38,190 HintedHandOffManager.java \
> (line 304) Started hinted handoff for endpoint /10.97.145.35 INFO [HintedHandoff:1] \
> 2011-03-30 19:39:38,190 HintedHandOffManager.java (line 360) Finished hinted \
> handoff of 0 rows to endpoint /10.97.145.35 
> Does this imply cassandra is  not going to respond when it is coming up
> 
> Please Sugest
> 
> Thanks
> Anurag
> 
> On Wed, Mar 30, 2011 at 4:59 PM, Narendra Sharma <narendra.sharma@gmail.com> wrote
> > 
> 
> 
> The space referred in the log message is disk space and not heap. So check if you \
> are running low on disk space.  
> Thanks,
> Naren
> 
> 
> On Wed, Mar 30, 2011 at 4:55 PM, Anurag Gujral <anurag.gujral@gmail.com> wrote:
> Hi All,
> I am getting following message from cassandra
> 
> WARN [CompactionExecutor:1] 2011-03-30 18:46:33,272 CompactionManager.java (line \
> 406) insufficient space to compact all requested files SSTableReader( 
> I am using 16G of java heap space ,please let me know should I consider this as a \
> sign of  something which I need to worry about. Thanks
> Anurag
> 
> 
> 
> -- 
> Narendra Sharma
> Solution Architect
> http://www.persistentsys.com
> http://narendrasharma.blogspot.com/
> 
> 
> 


[Attachment #3 (unknown)]

<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; \
-webkit-line-break: after-white-space; ">Where are the connection refused messages ? \
Are they client side ? Can you cannot to the cluster with nodetool and run the ring \
command ?&nbsp;<div><br></div><div>Aaron<br><div><div>On 31 Mar 2011, at 11:44, \
Anurag Gujral wrote:</div><br class="Apple-interchange-newline"><blockquote \
type="cite">I restarted the cassandra node with more disks when I try to connect to \
cassandra i get connection refused errors.<br>I see the following in the logs<br>INFO \
[HintedHandoff:1] 2011-03-30 19:37:42,189 HintedHandOffManager.java (line 304) \
Started hinted handoff for endpoint /<a \
href="http://10.97.145.35/">10.97.145.35</a><br> &nbsp;INFO [HintedHandoff:1] \
2011-03-30 19:37:42,190 HintedHandOffManager.java (line 360) Finished hinted handoff \
of 0 rows to endpoint /<a href="http://10.97.145.35/">10.97.145.35</a><br>&nbsp;INFO \
[ScheduledTasks:1] 2011-03-30 19:39:03,500 Gossiper.java (line 224) InetAddress /<a \
href="http://10.97.145.35/">10.97.145.35</a> is now dead.<br> &nbsp;INFO \
[COMMIT-LOG-WRITER] 2011-03-30 19:39:27,695 CommitLogSegment.java (line 50) Creating \
new commitlog segment \
/var/lib/cassandra/commitlog/CommitLog-1301531967695.log<br>&nbsp;INFO \
[HintedHandoff:1] 2011-03-30 19:39:34,588 HintedHandOffManager.java (line 284) \
Checking remote schema before delivering hints<br> &nbsp;INFO [GossipStage:1] \
2011-03-30 19:39:34,588 Gossiper.java (line 600) InetAddress&nbsp; *.*/.*.*is now \
UP<br>&nbsp;INFO [HintedHandoff:1] 2011-03-30 19:39:34,588 HintedHandOffManager.java \
(line 290) Sleeping 3601ms to stagger hint delivery<br> &nbsp;INFO [HintedHandoff:1] \
2011-03-30 19:39:38,190 HintedHandOffManager.java (line 304) Started hinted handoff \
for endpoint /<a href="http://10.97.145.35/">10.97.145.35</a><br>&nbsp;INFO \
[HintedHandoff:1] 2011-03-30 19:39:38,190 HintedHandOffManager.java (line 360) \
Finished hinted handoff of 0 rows to endpoint /<a \
href="http://10.97.145.35/">10.97.145.35</a><br> <br>Does this imply cassandra \
is&nbsp; not going to respond when it is coming up<br><br>Please \
Sugest<br><br>Thanks<br>Anurag<br><br><div class="gmail_quote">On Wed, Mar 30, 2011 \
at 4:59 PM, Narendra Sharma <span dir="ltr">&lt;<a \
href="mailto:narendra.sharma@gmail.com">narendra.sharma@gmail.com</a>&gt;</span> \
wrote<br> :<br><br><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt \
0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">The space \
referred in the log message is disk space and not heap. So check if you are running \
low on disk space.&nbsp;<div> \
<br></div><div>Thanks,</div><div>Naren<div><div></div><div class="h5"><br><br><div \
class="gmail_quote">On Wed, Mar 30, 2011 at 4:55 PM, Anurag Gujral <span \
dir="ltr">&lt;<a href="mailto:anurag.gujral@gmail.com" \
target="_blank">anurag.gujral@gmail.com</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px \
solid rgb(204, 204, 204); padding-left: 1ex;">Hi \
All,<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; I am getting following \
message from cassandra<br><br>&nbsp;WARN [CompactionExecutor:1] 2011-03-30 \
18:46:33,272 CompactionManager.java (line 406) insufficient space to compact all \
requested files SSTableReader(<br>


<br>I am using 16G of java heap space ,please let me know should I consider this as a \
sign of&nbsp; something which I need to worry about.<br>Thanks<br><font \
color="#888888">Anurag<br> </font></blockquote></div><br><br \
clear="all"><br></div></div>-- <br><font color="#999999">Narendra \
Sharma</font><div><font color="#999999">Solution Architect</font><br><div><i><a \
href="http://www.persistentsys.com/" \
target="_blank">http://www.persistentsys.com</a></i></div>

<div><i><a href="http://narendrasharma.blogspot.com/" \
target="_blank">http://narendrasharma.blogspot.com/</a></i></div><div><br></div></div><br>
 </div>
</blockquote></div><br>
</blockquote></div><br></div></body></html>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic