[prev in list] [next in list] [prev in thread] [next in thread]
List: cassandra-user
Subject: Re: Normal to have an 8g commit log?
From: Sebastian Estevez <sebastian.estevez () datastax ! com>
Date: 2015-05-22 14:29:42
Message-ID: CACCmCN8-UDL3GyahwMgjmu31KX7SuRJeMaeKB3d3B20z3iOEBA () mail ! gmail ! com
[Download RAW message or body]
Correct, the segments are allocated and reused and have the size you
specify in the YAML.
Only one known issue where it will grow beyond 8gb that I'm aware of if
you're running an old version:
https://issues.apache.org/jira/browse/CASSANDRA-7511
All the best,
[image: datastax_logo.png] <http://www.datastax.com/>
Sebastián Estévez
Solutions Architect | 954 905 8615 | sebastian.estevez@datastax.com
[image: linkedin.png] <https://www.linkedin.com/company/datastax> [image:
facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
<https://twitter.com/datastax> [image: g+.png]
<https://plus.google.com/+Datastax/about>
<http://feeds.feedburner.com/datastax>
<http://cassandrasummit-datastax.com/>
DataStax is the fastest, most scalable distributed database technology,
delivering Apache Cassandra to the world's most innovative enterprises.
Datastax is built to be agile, always-on, and predictably scalable to any
size. With more than 500 customers in 45 countries, DataStax is the
database technology and transactional backbone of choice for the worlds
most innovative companies such as Netflix, Adobe, Intuit, and eBay.
On Fri, May 22, 2015 at 10:13 AM, Ali Akhtar <ali.rac200@gmail.com> wrote:
> So it won't increase beyond 8gb ish?
> On May 22, 2015 6:39 PM, "Sebastian Estevez" <
> sebastian.estevez@datastax.com> wrote:
>
> > Yes. 2.1 commitlogs are 8gb. 2.0 were 1gb. you can configure this in the
> > yaml.
> >
> >
> > http://docs.datastax.com/en/cassandra/1.2/cassandra/configuration/configCassandra_yaml_r.html?scroll=reference_ds_qfg_n1r_1k__commitlog_segment_size_in_mb
> >
> > All the best,
> >
> >
> > [image: datastax_logo.png] <http://www.datastax.com/>
> >
> > Sebastián Estévez
> >
> > Solutions Architect | 954 905 8615 | sebastian.estevez@datastax.com
> >
> > [image: linkedin.png] <https://www.linkedin.com/company/datastax> [image:
> > facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
> > <https://twitter.com/datastax> [image: g+.png]
> > <https://plus.google.com/+Datastax/about>
> > <http://feeds.feedburner.com/datastax>
> >
> > <http://cassandrasummit-datastax.com/>
> >
> > DataStax is the fastest, most scalable distributed database technology,
> > delivering Apache Cassandra to the world's most innovative enterprises.
> > Datastax is built to be agile, always-on, and predictably scalable to any
> > size. With more than 500 customers in 45 countries, DataStax is the
> > database technology and transactional backbone of choice for the worlds
> > most innovative companies such as Netflix, Adobe, Intuit, and eBay.
> >
> > On Fri, May 22, 2015 at 6:51 AM, Ali Akhtar <ali.rac200@gmail.com> wrote:
> >
> > > I have a single node c* server (used for dev). I've been playing around
> > > with it, inserting / removing several million rows. At the moment, all
> > > tables have been dropped / truncated, and the data directory itself is
> > > showing about 45mb used (most of it is probably in the OpsCenter tables
> > > rather than mine).
> > >
> > > However, the commitlog directory shows a size of 8.1g. Is that really
> > > normal? If this keeps up, I may run out of disk space due to the size of
> > > the commit log rather than because of data.
> > >
> > > I have run nodetool compact, but it didnt bring down the size.
> > >
> >
> >
[Attachment #3 (text/html)]
<div dir="ltr">Correct, the segments are allocated and reused and have the size you \
specify in the YAML.<div><br></div><div>Only one known issue where it will grow \
beyond 8gb that I'm aware of if you're running an old \
version:</div><div><br></div><div><a class="" \
href="https://issues.apache.org/jira/browse/CASSANDRA-7511" \
style="color:rgb(204,0,0);font-family:'Helvetica \
Neue',helvetica,arial,verdana,sans-serif;font-size:25px;line-height:35px;backgroun \
d-color:rgb(245,245,245)">https://issues.apache.org/jira/browse/CASSANDRA-7511</a><br></div></div><div \
class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div \
dir="ltr"><div><div dir="ltr"><span><p \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt">All the best,</p><p \
dir="ltr" style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><br></p><p \
dir="ltr" style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span \
style="text-decoration:underline;font-size:12px;font-family:Arial;color:rgb(17,85,204);vertical-align:baseline;white-space:pre-wrap"><a \
href="http://www.datastax.com/" style="text-decoration:none" target="_blank"><img \
src="https://lh3.googleusercontent.com/pVhGeSH7Pht91xjoj4-LSCmsBLEJnOtq9c52j-z5RQD-I_v \
qkjnlxxkkHZZPQYi-2xgAropKv0UMqXxu24XYSkSXg-WQ82UB2nZ2DHu9yusG97HKdKzgJcRg55Lxinrnkw" \
width="187px;" height="39px;" style="border:none" \
alt="datastax_logo.png"></a></span></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent">Sebastián \
Estévez</span></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent">Solutions \
Architect |</span><span \
style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);font-weight:bold;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><span style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent">954 \
905 8615 | <a href="mailto:sebastian.estevez@datastax.com" \
target="_blank">sebastian.estevez@datastax.com</a></span></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><a \
href="https://www.linkedin.com/company/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh3.googleusercontent.com/mtwNeSEAXaqeWwFu3bQmYfrSh4u1-RklZGXi_qeKa_xk1aG \
iVTDY4D8dFBMmJDRTR8G5E3C1rQhSsvh5-qsgxDJn0EnyB7QA4ymlNcjE-aZ2Bs5j4Azw6SAzFeGhlouE9w" \
width="27px;" height="27px;" alt="linkedin.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="https://www.facebook.com/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh4.googleusercontent.com/y-b0_-GHQA7rCMcAmCgyhwfRCnHWNV996qbYdUM4zrr5rWr \
7drbMmqcaE6cLuv_QplGMp30Z5IMZ1N3ScZqwbNcL91BXnUiXgjeuO1XcEq9v45v65i0svNGk1srzYkmMlQ" \
width="27px;" height="27px;" alt="facebook.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Calibri;color:rgb(102,102,102);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="https://twitter.com/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh4.googleusercontent.com/ZdAbTYu8I6ebOtAT1Umh9JHlULX4st8OlFMMNZr_YoF4C_9 \
4k_vziIHnUs1I9csY57-RUoeQyBPjbkGg3RTwM9QBVSh_aojEjvg3iyxZRHxvyPyXs_wScfyz3x3R8BVlMQ" \
width="27px;" height="27px;" alt="twitter.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Calibri;color:rgb(102,102,102);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="https://plus.google.com/+Datastax/about" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh6.googleusercontent.com/gcFd7WMLL8mrrumsfosMiEjhDw29KePMjKcs-2BKezcUcvn \
uNWeqgZiig9OMStR6yt3e1KqZrJ_KDHnsgq_cTpjfjniP_ZzgT1ISGs1Dr7S2hGgfDbw9f7npg_F3IvxCNw" \
width="27px;" height="27px;" alt="g+.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Calibri;color:rgb(102,102,102);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="http://feeds.feedburner.com/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh6.googleusercontent.com/24_538J0j5M0NHQx-jkRiV_IHrhsh-98hpi--Qz9b0-I4ll \
vWuYI6LgiVJsul0AhxL0gMTOHgw3G0SvIXaT2C7fsKKa_DdQ2uOJ-bQ6h_mQ7k7iMybcR1dr1VhWgLMxcmg" \
width="27px;" height="27px;" style="border:none"></span></a><br></p><br></span><a \
href="http://cassandrasummit-datastax.com/" target="_blank"><img \
src="http://datastax.com/all/images/cs_logo_color_sm.png" \
style="font-size:12.8000001907349px" width="96" height="52"></a></div><div \
dir="ltr"><br></div><div dir="ltr">Da<span style="font-size:12.8000001907349px"><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap">taStax \
is the </span></span><span style="font-size:12.8000001907349px"><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap">fastest, \
mo</span></span><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap">st \
scalable distributed database technology, delivering Apache Cassandra to the world's \
most innovative enterprises. Datastax is built to be agile, always-on, and \
predictably scalable to any size. With more than 500 customers in 45 countries, \
</span><span style="font-size:12px;font-family:Arial;vertical-align:baseline;white-space:pre-wrap">DataStax \
is the database technology and transactional backbone of choice for the worlds most \
innovative companies such as Netflix, Adobe, Intuit, and eBay.</span><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap"> \
</span></div></div></div></div></div> <br><div class="gmail_quote">On Fri, May 22, \
2015 at 10:13 AM, Ali Akhtar <span dir="ltr"><<a \
href="mailto:ali.rac200@gmail.com" \
target="_blank">ali.rac200@gmail.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><p dir="ltr">So it won't increase beyond 8gb ish?</p><div \
class="HOEnZb"><div class="h5"> <div class="gmail_quote">On May 22, 2015 6:39 PM, \
"Sebastian Estevez" <<a href="mailto:sebastian.estevez@datastax.com" \
target="_blank">sebastian.estevez@datastax.com</a>> wrote:<br \
type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Yes. 2.1 commitlogs \
are 8gb. 2.0 were 1gb. you can configure this in the yaml.<div><br></div><div><a \
href="http://docs.datastax.com/en/cassandra/1.2/cassandra/configuration/configCassandra_yaml_r.html?scroll=reference_ds_qfg_n1r_1k__commitlog_segment_size_in_mb" \
target="_blank">http://docs.datastax.com/en/cassandra/1.2/cassandra/configuration/conf \
igCassandra_yaml_r.html?scroll=reference_ds_qfg_n1r_1k__commitlog_segment_size_in_mb</a><br></div></div><div \
class="gmail_extra"><br clear="all"><div><div><div dir="ltr"><div><div \
dir="ltr"><span><p style="line-height:1.15;margin-top:0pt;margin-bottom:0pt">All the \
best,</p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><br></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span \
style="text-decoration:underline;font-size:12px;font-family:Arial;color:rgb(17,85,204);vertical-align:baseline;white-space:pre-wrap"><a \
href="http://www.datastax.com/" style="text-decoration:none" target="_blank"><img \
src="https://lh3.googleusercontent.com/pVhGeSH7Pht91xjoj4-LSCmsBLEJnOtq9c52j-z5RQD-I_v \
qkjnlxxkkHZZPQYi-2xgAropKv0UMqXxu24XYSkSXg-WQ82UB2nZ2DHu9yusG97HKdKzgJcRg55Lxinrnkw" \
width="187px;" height="39px;" style="border:none" \
alt="datastax_logo.png"></a></span></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent">Sebastián \
Estévez</span></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent">Solutions \
Architect |</span><span \
style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);font-weight:bold;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><span style="font-size:15px;font-family:Calibri;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><a \
href="tel:954%20905%208615" value="+19549058615" target="_blank">954 905 8615</a> | \
<a href="mailto:sebastian.estevez@datastax.com" \
target="_blank">sebastian.estevez@datastax.com</a></span></p><p dir="ltr" \
style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><a \
href="https://www.linkedin.com/company/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh3.googleusercontent.com/mtwNeSEAXaqeWwFu3bQmYfrSh4u1-RklZGXi_qeKa_xk1aG \
iVTDY4D8dFBMmJDRTR8G5E3C1rQhSsvh5-qsgxDJn0EnyB7QA4ymlNcjE-aZ2Bs5j4Azw6SAzFeGhlouE9w" \
width="27px;" height="27px;" alt="linkedin.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="https://www.facebook.com/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh4.googleusercontent.com/y-b0_-GHQA7rCMcAmCgyhwfRCnHWNV996qbYdUM4zrr5rWr \
7drbMmqcaE6cLuv_QplGMp30Z5IMZ1N3ScZqwbNcL91BXnUiXgjeuO1XcEq9v45v65i0svNGk1srzYkmMlQ" \
width="27px;" height="27px;" alt="facebook.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Calibri;color:rgb(102,102,102);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="https://twitter.com/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh4.googleusercontent.com/ZdAbTYu8I6ebOtAT1Umh9JHlULX4st8OlFMMNZr_YoF4C_9 \
4k_vziIHnUs1I9csY57-RUoeQyBPjbkGg3RTwM9QBVSh_aojEjvg3iyxZRHxvyPyXs_wScfyz3x3R8BVlMQ" \
width="27px;" height="27px;" alt="twitter.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Calibri;color:rgb(102,102,102);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="https://plus.google.com/+Datastax/about" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh6.googleusercontent.com/gcFd7WMLL8mrrumsfosMiEjhDw29KePMjKcs-2BKezcUcvn \
uNWeqgZiig9OMStR6yt3e1KqZrJ_KDHnsgq_cTpjfjniP_ZzgT1ISGs1Dr7S2hGgfDbw9f7npg_F3IvxCNw" \
width="27px;" height="27px;" alt="g+.png" style="border:none"></span></a><span \
style="font-size:15px;font-family:Calibri;color:rgb(102,102,102);vertical-align:baseline;white-space:pre-wrap;background-color:transparent"> \
</span><a href="http://feeds.feedburner.com/datastax" \
style="color:rgb(17,85,204);font-size:12.8000001907349px;line-height:11.7760000228882px;text-decoration:none" \
target="_blank"><span \
style="font-size:15px;font-family:Calibri;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap;background-color:transparent"><img \
src="https://lh6.googleusercontent.com/24_538J0j5M0NHQx-jkRiV_IHrhsh-98hpi--Qz9b0-I4ll \
vWuYI6LgiVJsul0AhxL0gMTOHgw3G0SvIXaT2C7fsKKa_DdQ2uOJ-bQ6h_mQ7k7iMybcR1dr1VhWgLMxcmg" \
width="27px;" height="27px;" style="border:none"></span></a><br></p><br></span><a \
href="http://cassandrasummit-datastax.com/" target="_blank"><img \
src="http://datastax.com/all/images/cs_logo_color_sm.png" \
style="font-size:12.8000001907349px" width="96" height="52"></a></div><div \
dir="ltr"><br></div><div dir="ltr">Da<span style="font-size:12.8000001907349px"><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap">taStax \
is the </span></span><span style="font-size:12.8000001907349px"><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap">fastest, \
mo</span></span><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap">st \
scalable distributed database technology, delivering Apache Cassandra to the world's \
most innovative enterprises. Datastax is built to be agile, always-on, and \
predictably scalable to any size. With more than 500 customers in 45 countries, \
</span><span style="font-size:12px;font-family:Arial;vertical-align:baseline;white-space:pre-wrap">DataStax \
is the database technology and transactional backbone of choice for the worlds most \
innovative companies such as Netflix, Adobe, Intuit, and eBay.</span><span \
style="font-size:12px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;white-space:pre-wrap"> \
</span></div></div></div></div></div> <br><div class="gmail_quote">On Fri, May 22, \
2015 at 6:51 AM, Ali Akhtar <span dir="ltr"><<a href="mailto:ali.rac200@gmail.com" \
target="_blank">ali.rac200@gmail.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">I have a single node c* server (used for dev). \
I've been playing around with it, inserting / removing several million rows. At \
the moment, all tables have been dropped / truncated, and the data directory itself \
is showing about 45mb used (most of it is probably in the OpsCenter tables rather \
than mine).<div><br></div><div>However, the commitlog directory shows a size of 8.1g. \
Is that really normal? If this keeps up, I may run out of disk space due to the size \
of the commit log rather than because of data.</div><div><br></div><div>I have run \
nodetool compact, but it didnt bring down the size.</div></div> \
</blockquote></div><br></div> </blockquote></div>
</div></div></blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic