[prev in list] [next in list] [prev in thread] [next in thread] 

List:       cassandra-user
Subject:    Re: Separating storage and processing
From:       Devopam Mittra <devopam () gmail ! com>
Date:       2021-11-17 3:42:32
Message-ID: CAGd0WxKGMo31qybgYvXgduasvVDvCmxHd2PbmmLBZCWfpw1TvA () mail ! gmail ! com
[Download RAW message or body]

Hi there,
Please don't be worried about under utilization of CPU/RAM as it will
increase with active usage of the data in due course.

However, as pointed out already by other members , you may want to relook
at the hardware itself wherein 5TB per node storage with higher CPU+RAM can
rather be reconfigured into a larger number of lower capacity nodes ( less
CPU+RAM, Storage). It will give you more distribution resulting in faster
query response and faster recovery from node failure.

It will be a massive exercise to reorganize but the benefits are surely
more than the effort put in.
Moving to another platform/solution just for this reason isn't perhaps the
best option as you will lose the benefits of cassandra in that platform and
will have to remodel your data from scratch again.

regards
Dev




On Mon, Nov 15, 2021 at 11:30 AM onmstester onmstester <onmstester@zoho.com>
wrote:

> Hi,
> In our Cassandra cluster, because of big rows in input data/data model
> with TTL of several months, we ended up using almost 80% of storage (5TB
> per node), but having less than 20% of CPU usage which almost all of it
> would be writing rows to memtables and compacting sstables, so a lot of CPU
> capacity wasted.
> I wonder if there is anything we can do to solve this problem using
> Cassandra or should migrate from Cassandra to something that separates
> storage and processing (currently i'm not aware of anything as satble as
> cassandra)?
>
> Sent using Zoho Mail <https://www.zoho.com/mail/>
>
>
>

[Attachment #3 (text/html)]

<div dir="ltr">Hi there,<div>Please don&#39;t be worried about under utilization of \
CPU/RAM as it will increase with active usage of the data in due  \
course.</div><div><br></div><div>However, as pointed out already by other members , \
you may want to relook at the hardware itself wherein 5TB per node storage with \
higher CPU+RAM can rather be reconfigured into a larger number of lower capacity \
nodes ( less CPU+RAM, Storage). It will give you more distribution resulting in \
faster query response and faster recovery from node failure.  \
</div><div><br></div><div>It will be a massive exercise to reorganize but the \
benefits  are surely more than the effort put in.</div><div>Moving to another \
platform/solution just for this reason isn&#39;t perhaps the best  option as you will \
lose the benefits of cassandra in that platform and will have to remodel your data \
from scratch again.</div><div><br></div><div>regards</div><div>Dev</div><div><br></div><div><br \
clear="all"><div><div dir="ltr" class="gmail_signature" \
data-smartmail="gmail_signature"><div \
dir="ltr"><br></div></div></div></div></div><br><div class="gmail_quote"><div \
dir="ltr" class="gmail_attr">On Mon, Nov 15, 2021 at 11:30 AM onmstester onmstester \
&lt;<a href="mailto:onmstester@zoho.com">onmstester@zoho.com</a>&gt; \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><u></u><div><div \
style="font-family:Verdana,Arial,Helvetica,sans-serif;font-size:10pt"><div>Hi, \
<br></div><div>In our Cassandra cluster, because of big rows in input data/data model \
with TTL of several months, we ended up using almost 80% of storage (5TB per node), \
but having less than 20% of CPU usage which almost all of it would be writing rows to \
memtables and compacting sstables, so a lot of CPU capacity wasted.<br></div><div>I \
wonder if there is anything we can do to solve this problem using Cassandra or should \
migrate from Cassandra to something that separates storage and processing (currently \
i&#39;m not aware of anything as satble as cassandra)?<br></div><div><br></div><div \
id="gmail-m_-7078111151697431554Zm-_Id_-Sgn"><p><span \
style="color:rgb(42,42,42)">Sent using <a style="color:rgb(89,143,222)" \
href="https://www.zoho.com/mail/" target="_blank">Zoho \
Mail</a></span><br></p></div><div><br></div></div><br></div></blockquote></div>



[prev in list] [next in list] [prev in thread] [next in thread]