[prev in list] [next in list] [prev in thread] [next in thread]
List: cassandra-user
Subject: Re: Cleanup and old files
From: David McNelis <dmcnelis () gmail ! com>
Date: 2013-12-31 3:24:09
Message-ID: CACy0uxmCgQVCXsALNdpWjLv18yPCZivQoZt-KYnH8gqoMPc01A () mail ! gmail ! com
[Download RAW message or body]
I see the SSTable in this log statement: Stream context metadata (along
with a bunch of other files)....but I do not see it in the list of files
"Opening" (which I see quite a bit of, as expected).
Safe to try moving that file off server (to a backup location)? If I tried
this, would I want to shut down the node first and monitor startup to see
if it all of a sudden is 'missing' something / throws an error then?
On Mon, Dec 30, 2013 at 9:26 PM, Aaron Morton <aaron@thelastpickle.com>wrot=
e:
> Check the SSTable is actually in use by cassandra, if it=92s missing a
> component or otherwise corrupt it will not be opened at run time and so n=
ot
> included in all the fun games the other SSTables get to play.
>
> If you have the last startup in the logs check for an =93Opening=85 =93 m=
essage
> or an ERROR about the file.
>
> Cheers
>
> -----------------
> Aaron Morton
> New Zealand
> @aaronmorton
>
> Co-Founder & Principal Consultant
> Apache Cassandra Consulting
> http://www.thelastpickle.com
>
> On 30/12/2013, at 1:28 pm, David McNelis <dmcnelis@gmail.com> wrote:
>
> I am currently running a cluster with 1.2.8. One of my larger column
> families on one of my nodes has keyspace-tablename-ic-####-Data.db with a
> modify date in August.
>
> Since august we have added several nodes (with vnodes), with the same
> number of vnodes as all the existing nodes.
>
> As a result, (we've since gone from 15 to 21 nodes), then ~32% of my data
> of the original 15 nodes should have been essentially balanced out to the=
6
> new nodes. (1/15 + 1/16 + .... 1/21).
>
> When I run a cleanup, however, the old data files never get updated, and =
I
> can't believe that they all should have remained the same.
>
> The only recently updated files in that data directory are secondary inde=
x
> sstable files. Am I doing something wrong here? Am I thinking about thi=
s
> wrong?
>
> David
>
>
>
[Attachment #3 (text/html)]
<div dir="ltr">I see the SSTable in this log statement: Stream context metadata \
(along with a bunch of other files)....but I do not see it in the list of files \
"Opening" (which I see quite a bit of, as expected).<div> \
<br></div><div>Safe to try moving that file off server (to a backup location)? If I \
tried this, would I want to shut down the node first and monitor startup to see if it \
all of a sudden is 'missing' something / throws an error then?</div> \
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Dec 30, 2013 \
at 9:26 PM, Aaron Morton <span dir="ltr"><<a href="mailto:aaron@thelastpickle.com" \
target="_blank">aaron@thelastpickle.com</a>></span> wrote:<br> <blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div style="word-wrap:break-word">Check the SSTable is \
actually in use by cassandra, if it’s missing a component or otherwise corrupt it \
will not be opened at run time and so not included in all the fun games the other \
SSTables get to play. <div> <br></div><div>If you have the last startup in the logs \
check for an “Opening… “ message or an ERROR about the file. \
</div><div><br></div><div>Cheers</div><div><br><div> <div \
style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-au \
to;font-style:normal;font-weight:normal;line-height:normal;text-transform:none;white-space:normal;font-family:Helvetica;word-wrap:break-word;word-spacing:0px">
<div>-----------------</div><div>Aaron Morton</div><div>New \
Zealand</div><div>@aaronmorton</div><div><br></div><div>Co-Founder & Principal \
Consultant</div><div>Apache Cassandra Consulting</div><div><a \
href="http://www.thelastpickle.com" \
target="_blank">http://www.thelastpickle.com</a></div> </div>
</div><div><div class="h5">
<br><div><div>On 30/12/2013, at 1:28 pm, David McNelis <<a \
href="mailto:dmcnelis@gmail.com" target="_blank">dmcnelis@gmail.com</a>> \
wrote:</div><br><blockquote type="cite"><div dir="ltr">I am currently running a \
cluster with 1.2.8. One of my larger column families on one of my nodes has \
keyspace-tablename-ic-####-Data.db with a modify date in August.<div> \
<br></div><div>Since august we have added several nodes (with vnodes), with the same \
number of vnodes as all the existing nodes.</div> <div><br></div><div>As a result, \
(we've since gone from 15 to 21 nodes), then ~32% of my data of the original 15 \
nodes should have been essentially balanced out to the 6 new nodes. (1/15 + 1/16 + \
.... 1/21).</div><div>
<br></div><div>When I run a cleanup, however, the old data files never get updated, \
and I can't believe that they all should have remained the \
same.</div><div><br></div><div>The only recently updated files in that data directory \
are secondary index sstable files. Am I doing something wrong here? Am I thinking \
about this wrong?</div>
<div><br></div><div>David</div></div>
</blockquote></div><br></div></div></div></div></blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic