[prev in list] [next in list] [prev in thread] [next in thread]
List: cassandra-user
Subject: Re: Tombstone experience
From: Rahul Singh <rahul.xavier.singh () gmail ! com>
Date: 2018-08-24 12:17:47
Message-ID: ffc5b2e7-d778-4a04-8e28-bb7c5f69878c () Spark
[Download RAW message or body]
Thanks! Great tips on clearing tombstones. The TTL vs. business rules challenge is \
one we've seen in enterprises moving from relational to non-relational because there \
is no thought to planning a data retention policy.
Periodic business rules based cleaning via Spark works well if you use it to set a \
short TTL that you would have deleted and that will eventually clear our data \
depending on the value you set. My suggestion for those cases where you must do \
business rules deletions, use a continuous spark job / Spark streaming on another DC \
to maintain data hygiene.
Rahul Singh
Chief Executive Officer
m 202.905.2818
Anant Corporation
1010 Wisconsin Ave NW, Suite 250
Washington, D.C. 20007
We build and manage digital business technology platforms.
On Aug 24, 2018, 1:46 AM -0400, Charulata Sharma (charshar) \
<charshar@cisco.com.invalid>, wrote:
> Hi All,
>
> I have shared my experience of tombstone clearing in this blog post.
> Sharing it in this forum for wider distribution.
>
> https://medium.com/cassandra-tombstones-clearing-use-case/the-curios-case-of-tombstones-d897f681a378
>
>
> Thanks,
> Charu
[Attachment #3 (text/html)]
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title></title>
</head>
<body>
<div name="messageBodySection">Thanks! Great tips on clearing tombstones. The TTL vs. \
business rules challenge is one we've seen in enterprises moving from relational to \
non-relational because there is no thought to planning a data retention policy.<br /> \
<br /> Periodic business rules based cleaning via Spark works well if you use it to \
set a short TTL that you would have deleted and that will eventually clear our data \
depending on the value you set. My suggestion for those cases where you must do \
business rules deletions, use a continuous spark job / Spark streaming on another DC \
to maintain data hygiene.</div> <div name="messageSignatureSection"><br />
Rahul Singh<br />
Chief Executive Officer<br />
m 202.905.2818<br />
<br />
Anant Corporation<br />
1010 Wisconsin Ave NW, Suite 250<br />
Washington, D.C. 20007<br />
<br />
We build and manage digital business technology platforms.</div>
<div name="messageReplySection">On Aug 24, 2018, 1:46 AM -0400, Charulata Sharma \
(charshar) <charshar@cisco.com.invalid>, wrote:<br /> <blockquote type="cite">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Hi All,</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt">       I have shared my \
experience of tombstone clearing in this blog post.</span></p> <p \
class="MsoNormal"><span style="font-size:11.0pt">Sharing it in this forum for wider \
distribution.</span></p> <p class="MsoNormal"><span style="font-family:"Times \
New Roman""> </span></p> <p class="MsoNormal"><a \
href="https://medium.com/cassandra-tombstones-clearing-use-case/the-curios-case-of-tombstones-d897f681a378"><span \
style="font-size:10.5pt;font-family:Helvetica;color:#00AFFA;text-decoration:none">http \
s://medium.com/cassandra-tombstones-clearing-use-case/the-curios-case-of-tombstones-d897f681a378</span></a></p>
<p class="MsoNormal"><span style="font-family:"Times New \
Roman""> </span></p> <p class="MsoNormal"><span \
style="font-family:"Times New Roman""> </span></p> <p \
class="MsoNormal"><span style="font-family:"Times New \
Roman"">Thanks,</span></p> <p class="MsoNormal"><span \
style="font-family:"Times New Roman"">Charu</span></p> </div>
</blockquote>
</div>
</body>
</html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic