[prev in list] [next in list] [prev in thread] [next in thread]
List: cassandra-user
Subject: RE: Re:RE: data not beening syncd in different nodes
From: Kyrylo Lebediev <Kyrylo_Lebediev () epam ! com ! INVALID>
Date: 2018-08-31 10:08:01
Message-ID: AM5PR03MB292983F56436597AD4CC7B86F90F0 () AM5PR03MB2929 ! eurprd03 ! prod ! outlook ! com
[Download RAW message or body]
TTL 60 seconds - small value (even smaller than compaction window). This means that \
even if all replicas are consistent, data is deleted really quickly so that results \
may differ even for 2 consecutive queries. How about this theory?
CL in your driver - depends on which CL is default for your particular driver.
Regards,
Kyrill
From: David Ni <zn1314@126.com>
Sent: Friday, August 31, 2018 12:53 PM
To: user@cassandra.apache.org
Subject: Re:RE: data not beening syncd in different nodes
Hi Kyrylo
I have already tried consistency quorum and all,still the same result.
the java code write data to cassandra does not set CL,does this mean the default CL \
is one? the tpstats out is like below ,there are some dropped mutations, but it \
doesn't grow during a very long time Pool Name Active Pending \
Completed Blocked All time blocked MutationStage 0 \
0 300637997 0 0 ViewMutationStage \
0 0 0 0 0 ReadStage \
0 0 4357929 0 0 RequestResponseStage 0 \
0 306954791 0 0 ReadRepairStage 0 \
0 472027 0 0 CounterMutationStage 0 \
0 0 0 0 MiscStage 0 \
0 0 0 0 CompactionExecutor 0 \
0 17976139 0 0 MemtableReclaimMemory 0 0 \
53018 0 0 PendingRangeCalculator 0 0 \
11 0 0 GossipStage 0 0 \
59889799 0 0 SecondaryIndexManagement 0 0 \
0 0 0 HintsDispatcher 0 0 \
7 0 0 MigrationStage 0 0 \
101 0 0 MemtablePostFlush 0 0 \
41470 0 0 PerDiskMemtableFlushWriter_0 0 0 \
52779 0 0 ValidationExecutor 0 0 \
80 0 0 Sampler 0 0 \
0 0 0 MemtableFlushWriter 0 0 \
40301 0 0 InternalResponseStage 0 0 \
70 0 0 AntiEntropyStage 0 0 \
352 0 0 CacheCleanupExecutor 0 0 \
0 0 0 Native-Transport-Requests 0 0 158242159 \
0 13412
Message type Dropped
READ 0
RANGE_SLICE 0
_TRACE 1
HINT 0
MUTATION 34
COUNTER_MUTATION 0
BATCH_STORE 0
BATCH_REMOVE 0
REQUEST_RESPONSE 0
PAGED_RANGE 0
READ_REPAIR 0
and yes,we are inserting data with TTL=60 seconds
we have 200 vehicles and updating this table every 5 or 10 seconds;
At 2018-08-31 17:10:50, "Kyrylo Lebediev" \
<Kyrylo_Lebediev@epam.com.INVALID<mailto:Kyrylo_Lebediev@epam.com.INVALID>> wrote:
Looks like you're querying the table at CL = ONE which is default for cqlsh.
If you run cqlsh on nodeX it doesn't mean you retrieve data from this node. What this \
means is that nodeX will be coordinator, whereas actual data will be retrieved from \
any node, based on token range + dynamic snitch data (which, I assume, you use as \
it's turned on by default). Which CL you use when you write data?
Try querying using CL = QUORUM or ALL. What's your result in this case?
If you run 'nodetool tpstats' across all the nodes, are there dropped mutations?
As you use TimeWindowCompactionStrategy, do you insert data with TTL?
These buckets seem to be too small for me: 'compaction_window_size': '2', \
'compaction_window_unit': 'MINUTES'. Do you have such a huge amount of writes so that \
such bucket size makes sense?
Regards,
Kyrill
From: David Ni <zn1314@126.com<mailto:zn1314@126.com>>
Sent: Friday, August 31, 2018 11:39 AM
To: user@cassandra.apache.org<mailto:user@cassandra.apache.org>
Subject: data not beening syncd in different nodes
Hi Experts,
I am using 3.9 cassandra in production environment,we have 6 nodes,the RF of \
keyspace is 3, I have a table which below definition: CREATE TABLE \
nev_prod_tsp.heartbeat ( vin text PRIMARY KEY,
create_time timestamp,
pkg_sn text,
prot_ver text,
trace_time timestamp,
tsp_sn text
) WITH bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = 'heartbeat'
AND compaction = {'class': \
'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy', \
'compaction_window_size': '2', 'compaction_window_unit': 'MINUTES', 'max_threshold': \
'32', 'min_threshold': '4'} AND compression = {'chunk_length_in_kb': '64', 'class': \
'org.apache.cassandra.io.compress.LZ4Compressor'} AND crc_check_chance = 1.0
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 60
AND gc_grace_seconds = 120
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.2
AND speculative_retry = '99PERCENTILE';
I am updating this table's data every 5 or 10 seconds,
the data sample is as below:
cassandra@cqlsh> select * from nev_prod_tsp.heartbeat;
vin | create_time | pkg_sn | prot_ver | trace_time \
| tsp_sn
-------------------+---------------------------------+--------+----------+---------------------------------+--------------------------------------
LLXA2A408JA002371 | 2018-08-31 08:16:07.348000+0000 | 128209 | 2 | \
2018-08-31 08:16:09.000000+0000 | ad4c2b13-d894-4804-9cf2-e07a3c5851bd \
LLXA2A400JA002333 | 2018-08-31 08:16:06.386000+0000 | 142944 | 2 | 2018-08-31 \
08:16:04.000000+0000 | 6ba9655c-8542-4251-ba9b-93ae7420ecc7 LLXA2A402JA002351 | \
2018-08-31 08:16:09.451000+0000 | 196040 | 2 | 2018-08-31 08:16:07.000000+0000 \
| 9b6a5d7d-4917-46bc-a247-8a0ff8c1e699
........
but we I select all data from this table,the results from different nodes are not the \
same:
node1: about 60 rows
node2:about 140 rows
node3:about 30 rows
node4:about 140 rows
node5:about 70 rows
node6:about 140 rows
I have tried compact and repair on all nodes,but didn't help.
Could any one give me some help?Thanks very much.
[Attachment #3 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@SimSun";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:SimSun;
mso-fareast-language:ZH-CN;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:SimSun;
mso-fareast-language:ZH-CN;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:42.5pt 42.5pt 42.5pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">TTL \
60 seconds – small value (even smaller than compaction window). This means that \
even if all replicas are consistent, data is deleted really quickly so that results \
may differ even for 2 consecutive queries. How about this \
theory?<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">CL \
in your driver – depends on which CL is default for your particular \
driver.<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Regards,
<o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Kyrill<o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> David Ni \
<zn1314@126.com> <br>
<b>Sent:</b> Friday, August 31, 2018 12:53 PM<br>
<b>To:</b> user@cassandra.apache.org<br>
<b>Subject:</b> Re:RE: data not beening syncd in different \
nodes<o:p></o:p></span></p> <p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Hi \
Kyrylo<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">I have \
already tried consistency quorum and all,still the same result.<o:p></o:p></span></p> \
</div> <div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">the \
java code write data to cassandra does not set CL,does this mean the default CL is \
one?<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">the \
tpstats out is like below ,there are some dropped mutations, but it doesn't grow \
during a very long time<o:p></o:p></span></p> </div>
<div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Pool \
Name \
Active Pending Completed Blocked \
All time blocked<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MutationStage \
0 \
0 300637997 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">ViewMutationStage \
0 \
0 0 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">ReadStage \
\
0 0 \
4357929 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">RequestResponseStage \
0 0 \
306954791 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">ReadRepairStage \
0 \
0 472027 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">CounterMutationStage \
0 0 \
0 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MiscStage \
\
0 0 \
0 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">CompactionExecutor \
0 0 \
17976139 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MemtableReclaimMemory \
0 0 \
53018 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">PendingRangeCalculator \
0 0 \
11 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">GossipStage \
\
0 0 59889799 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">SecondaryIndexManagement \
0 0 \
0 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">HintsDispatcher \
0 \
0 7 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MigrationStage \
0 \
0 101 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MemtablePostFlush \
0 0 \
41470 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">PerDiskMemtableFlushWriter_0 \
0 0 \
52779 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">ValidationExecutor \
0 \
0 80 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Sampler \
\
0 0 \
0 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MemtableFlushWriter \
0 0 \
40301 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">InternalResponseStage \
0 0 \
70 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">AntiEntropyStage \
0 \
0 352 \
0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">CacheCleanupExecutor \
0 0 \
0 0 \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Native-Transport-Requests \
0 0 158242159 \
0 \
13412<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Message \
type \
Dropped<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">READ \
\
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">RANGE_SLICE \
0<o:p></o:p></span></p> \
</div> <div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">_TRACE \
\
1<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">HINT \
\
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">MUTATION \
\
34<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">COUNTER_MUTATION \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">BATCH_STORE \
0<o:p></o:p></span></p> \
</div> <div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">BATCH_REMOVE \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">REQUEST_RESPONSE \
0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">PAGED_RANGE \
0<o:p></o:p></span></p> \
</div> <div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">READ_REPAIR \
0<o:p></o:p></span></p> \
</div> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">and \
yes,we are inserting data with TTL=60 seconds<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">we have \
200 vehicles and updating this table every 5 or 10 seconds;<o:p></o:p></span></p> \
</div> <p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><br> At \
2018-08-31 17:10:50, "Kyrylo Lebediev" <<a \
href="mailto:Kyrylo_Lebediev@epam.com.INVALID">Kyrylo_Lebediev@epam.com.INVALID</a>> \
wrote:<br> <br>
<o:p></o:p></span></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in \
6.0pt;margin-left:4.8pt;margin-right:0in"> <div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Looks \
like you’re querying the table at CL = ONE which is default for cqlsh. \
</span><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">If \
you run cqlsh on nodeX it doesn’t mean you retrieve data from this node. What \
this means is that nodeX will be coordinator, whereas actual data will be retrieved \
from any node, based on token range + dynamic snitch data (which, I assume, you \
use as it’s turned on by default).</span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Which \
CL you use when you write data?</span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Try \
querying using CL = QUORUM or ALL. What’s your result in this case?</span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">If \
you run ‘nodetool tpstats’ across all the nodes, are there dropped \
mutations?</span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"> </span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"> </span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">As \
you use </span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">TimeWindowCompactionStrategy, \
do you insert data with TTL? <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">These \
buckets seem to be too small for me: </span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">'compaction_window_size': \
'2', 'compaction_window_unit': 'MINUTES'. <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Do \
you have such a huge amount of writes so that such bucket size makes \
sense?</span><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"> </span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Regards,
</span><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Kyrill</span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"> </span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">From:</span></b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> \
David Ni <<a href="mailto:zn1314@126.com">zn1314@126.com</a>> <br>
<b>Sent:</b> Friday, August 31, 2018 11:39 AM<br>
<b>To:</b> <a href="mailto:user@cassandra.apache.org">user@cassandra.apache.org</a><br>
<b>Subject:</b> data not beening syncd in different nodes</span><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Hi \
Experts,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
I am using 3.9 cassandra in production environment,we have 6 nodes,the RF of \
keyspace is 3, I have a table which below definition:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> CREATE \
TABLE nev_prod_tsp.heartbeat (<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
vin text PRIMARY KEY,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
create_time timestamp,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
pkg_sn text,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
prot_ver text,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
trace_time timestamp,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
tsp_sn text<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">) WITH \
bloom_filter_fp_chance = 0.01<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND caching = {'keys': 'ALL', 'rows_per_partition': \
'NONE'}<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND comment = 'heartbeat'<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND compaction = {'class': \
'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy', \
'compaction_window_size': '2', 'compaction_window_unit': 'MINUTES', 'max_threshold': \
'32', 'min_threshold': '4'}<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND compression = {'chunk_length_in_kb': '64', 'class': \
'org.apache.cassandra.io.compress.LZ4Compressor'}<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND crc_check_chance = 1.0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND dclocal_read_repair_chance = 0.1<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND default_time_to_live = 60<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND gc_grace_seconds = 120<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND max_index_interval = 2048<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND memtable_flush_period_in_ms = 0<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND min_index_interval = 128<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND read_repair_chance = 0.2<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> \
AND speculative_retry = '99PERCENTILE';<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">I am \
updating this table's data every 5 or 10 seconds,<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">the \
data sample is as below:<o:p></o:p></span></p> </div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">cassandra@cqlsh> \
select * from nev_prod_tsp.heartbeat;<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> vin \
| create_time \
| pkg_sn | prot_ver | \
trace_time \
| tsp_sn<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">-------- \
-----------+---------------------------------+--------+----------+---- \
-----------------------------+--------------------------------------<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> LLXA2A408JA002371 \
| 2018-08-31 08:16:07.348000+0000 | 128209 | 2 | \
2018-08-31 08:16:09.000000+0000 | \
ad4c2b13-d894-4804-9cf2-e07a3c5851bd<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> LLXA2A400JA002333 \
| 2018-08-31 08:16:06.386000+0000 | 142944 | 2 | \
2018-08-31 08:16:04.000000+0000 | \
6ba9655c-8542-4251-ba9b-93ae7420ecc7<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> LLXA2A402JA002351 \
| 2018-08-31 08:16:09.451000+0000 | 196040 | 2 | \
2018-08-31 08:16:07.000000+0000 | \
9b6a5d7d-4917-46bc-a247-8a0ff8c1e699<o:p></o:p></span></p> </div>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">........<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">but we \
I select all data from this table,the results from different nodes are not the \
same:<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">node1: \
about 60 rows<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">node2:about \
140 rows<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">node3:about \
30 rows<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">node4:about \
140 rows<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">node5:about \
70 rows<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">node6:about \
140 rows<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">I have \
tried compact and repair on all nodes,but didn't help.<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Could \
any one give me some help?Thanks very much.<o:p></o:p></span></p> </div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span \
style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
<p><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<p> <o:p></o:p></p>
</div>
</body>
</html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic