[prev in list] [next in list] [prev in thread] [next in thread]
List: flume-user
Subject: RE: ChannelException, bytecapacity
From: "Mangtani, Kushal" <Kushal.Mangtani () viasat ! com>
Date: 2014-05-13 6:08:36
Message-ID: 4D0460317630EE44880FCCD3194AAA50DC1551 () wdc1exchmbxp03 ! hq ! corp ! viasat ! com
[Download RAW message or body]
I would suggest putting your flume config when you are posting your questio=
n. Just from the looks of it; that Your source cannot put events in channel=
.Two reasons:
1) Either the transaction capacity is the issue. You have to tweak it to ma=
ke sure the channel never gets full.Also;make sure that the capacity of cha=
nnel is sufficient.
2) One more thing to note is that your downstream rate from channel to sink=
could also relatively low causing the channel to be always full. Read abou=
t batch size in sinks.
Hope this helps.
-Kushal Mangtani
________________________________
From: Andrew Ehrlich [andrew@aehrlich.com]
Sent: Monday, May 12, 2014 4:40 PM
To: user@flume.apache.org
Subject: ChannelException, bytecapacity
I can't understand what this error is trying to tell me. Can anyone help?
Caused by: org.apache.flume.ChannelException: Put queue for MemoryTransacti=
on of byteCapacity 1832743000 bytes cannot add an event of size 598876 byt=
es because 299200 bytes are already used. Try consider comitting more frequ=
ently, increasing byteCapacity or increasing thread count
If the byteCapacity is 1.7GB, why would trying to add a 584kb event to a ch=
annel with 292kb used raise an exception?
Thanks,
Andrew
[Attachment #3 (text/html)]
<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style id="owaParaStyle">P {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
P {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
</style>
</head>
<body fPStyle="1" ocsi="0">
<div style="FONT-FAMILY: Tahoma; DIRECTION: ltr; COLOR: #000000; FONT-SIZE: 10pt">
<p>I would suggest putting your flume config when you are posting your question. Just \
from the looks of it; that Your source cannot put events in channel .Two reasons:</p> \
<p>1) Either the transaction capacity is the issue. You have to tweak it to make sure \
the channel never gets full.Also;make sure that the capacity of channel is \
sufficient.</p> <p>2) One more thing to note is that your downstream rate from \
channel to sink could also relatively low causing the channel to be \
always full. Read about batch size in sinks.</p> <p> </p>
<p>Hope this helps.</p>
<p> </p>
<p>-Kushal Mangtani</p>
<div style="FONT-FAMILY: Times New Roman; COLOR: #000000; FONT-SIZE: 16px">
<hr tabindex="-1">
<div style="DIRECTION: ltr" id="divRpF979203"><font color="#000000" size="2" \
face="Tahoma"><b>From:</b> Andrew Ehrlich [andrew@aehrlich.com]<br> <b>Sent:</b> \
Monday, May 12, 2014 4:40 PM<br> <b>To:</b> user@flume.apache.org<br>
<b>Subject:</b> ChannelException, bytecapacity<br>
</font><br>
</div>
<div></div>
<div>
<div dir="ltr">I can't understand what this error is trying to tell me. Can anyone \
help? <div><br>
</div>
<div>Caused by: org.apache.flume.ChannelException: Put queue for MemoryTransaction of \
byteCapacity 1832743000 bytes cannot add an event of size 598876 bytes because \
299200 bytes are already used. Try consider comitting more frequently, increasing \
byteCapacity or increasing thread count<br>
</div>
<div><br>
</div>
<div>If the byteCapacity is 1.7GB, why would trying to add a 584kb event to a channel \
with 292kb used raise an exception?</div> <div><br>
</div>
<div>Thanks,</div>
<div>Andrew</div>
</div>
</div>
</div>
</div>
</body>
</html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic