[prev in list] [next in list] [prev in thread] [next in thread]
List: flume-user
Subject: Re: Sinks stop processing with GC errors
From: "Bhaskar V. Karambelkar" <bhaskarvk () gmail ! com>
Date: 2015-10-28 20:10:17
Message-ID: CAA8wT0ndQUeTnhv6gfb3CW89MH3cubmACroW8SGZDX1L1=AEOg () mail ! gmail ! com
[Download RAW message or body]
This is a classic example of how not to ask a question.
You haven't told us anything that will help us debug this issue. For
starters what's the amount of RAM avail on your box, how much have you
allocated to the JVM, Did you try verbose GC and/or GC logging ?
On Wed, Oct 28, 2015 at 2:59 PM, Sutanu Das <sd2302@att.com> wrote:
> Team, My hdfs sinks stop processing and I see there GC errors in Flume log
>
>
>
> Any ideas? Please help.
>
>
>
>
>
> ary.path= org.apache.flume.node.Application --conf-file
> /etc/flume/conf/airwave_xml.conf --name airwave_xml start
>
> Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor"
> java.lang.OutOfMemoryError: GC overhead limit exceeded
>
> at java.lang.ClassLoader.findLoadedClass0(Native Method)
>
> at java.lang.ClassLoader.findLoadedClass(ClassLoader.java:1093)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:407)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
> at java.lang.ClassLoader.defineClass1(Native Method)
>
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
>
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
>
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
> at
> org.apache.log4j.spi.ThrowableInformation.getThrowableStrRep(ThrowableInformation.java:87)
>
> at
> org.apache.log4j.spi.LoggingEvent.getThrowableStrRep(LoggingEvent.java:413)
>
> at
> org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:313)
>
> at
> org.apache.log4j.RollingFileAppender.subAppend(RollingFileAppender.java:276)
>
> at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
>
> at
> org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
>
> at
> org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
>
> at org.apache.log4j.Category.callAppenders(Category.java:206)
>
> at org.apache.log4j.Category.forcedLog(Category.java:391)
>
> at org.apache.log4j.Category.log(Category.java:856)
>
> at
> org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:576)
>
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:466)
>
> at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>
> at
> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>
> at java.lang.Thread.run(Thread.java:744)
>
> Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor"
> java.lang.OutOfMemoryError: GC overhead limit exceeded
>
> Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor"
> java.lang.OutOfMemoryError: GC overhead limit exceeded
>
> Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor"
> java.lang.OutOfMemoryError: GC overhead limit exceeded
>
[Attachment #3 (text/html)]
<div dir="ltr">This is a classic example of how not to ask a question.<div>You \
haven't told us anything that will help us debug this issue. For starters \
what's the amount of RAM avail on your box, how much have you allocated to the \
JVM, Did you try verbose GC and/or GC logging \
?</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div \
class="gmail_quote">On Wed, Oct 28, 2015 at 2:59 PM, Sutanu Das <span \
dir="ltr"><<a href="mailto:sd2302@att.com" \
target="_blank">sd2302@att.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div>
<p class="MsoNormal">Team, My hdfs sinks stop processing and I see there GC errors in \
Flume log<u></u><u></u></p> <p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Any ideas? Please help.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">ary.path= org.apache.flume.node.Application --conf-file \
/etc/flume/conf/airwave_xml.conf --name airwave_xml start<u></u><u></u></p> <p \
class="MsoNormal">Exception in thread \
"SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: \
GC overhead limit exceeded<u></u><u></u></p> <p class="MsoNormal"> at \
java.lang.ClassLoader.findLoadedClass0(Native Method)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.lang.ClassLoader.findLoadedClass(ClassLoader.java:1093)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.lang.ClassLoader.loadClass(ClassLoader.java:407)<u></u><u></u></p> <p \
class="MsoNormal"> at \
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.lang.ClassLoader.loadClass(ClassLoader.java:358)<u></u><u></u></p> <p \
class="MsoNormal"> at java.lang.ClassLoader.defineClass1(Native \
Method)<u></u><u></u></p> <p class="MsoNormal"> at \
java.lang.ClassLoader.defineClass(ClassLoader.java:800)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)<u></u><u></u></p>
<p class="MsoNormal"> at \
java.net.URLClassLoader.defineClass(URLClassLoader.java:449)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.net.URLClassLoader.access$100(URLClassLoader.java:71)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.net.URLClassLoader$1.run(URLClassLoader.java:361)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.net.URLClassLoader$1.run(URLClassLoader.java:355)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.security.AccessController.doPrivileged(Native Method)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.net.URLClassLoader.findClass(URLClassLoader.java:354)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.lang.ClassLoader.loadClass(ClassLoader.java:425)<u></u><u></u></p> <p \
class="MsoNormal"> at \
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)<u></u><u></u></p> <p \
class="MsoNormal"> at \
java.lang.ClassLoader.loadClass(ClassLoader.java:358)<u></u><u></u></p> <p \
class="MsoNormal"> at \
org.apache.log4j.spi.ThrowableInformation.getThrowableStrRep(ThrowableInformation.java:87)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.log4j.spi.LoggingEvent.getThrowableStrRep(LoggingEvent.java:413)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:313)<u></u><u></u></p> \
<p class="MsoNormal"> at \
org.apache.log4j.RollingFileAppender.subAppend(RollingFileAppender.java:276)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.log4j.WriterAppender.append(WriterAppender.java:162)<u></u><u></u></p> <p \
class="MsoNormal"> at \
org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.log4j.Category.callAppenders(Category.java:206)<u></u><u></u></p> <p \
class="MsoNormal"> at \
org.apache.log4j.Category.forcedLog(Category.java:391)<u></u><u></u></p> <p \
class="MsoNormal"> at \
org.apache.log4j.Category.log(Category.java:856)<u></u><u></u></p> <p \
class="MsoNormal"> at \
org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:576)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:466)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)<u></u><u></u></p>
<p class="MsoNormal"> at \
org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)<u></u><u></u></p> \
<p class="MsoNormal"> at \
java.lang.Thread.run(Thread.java:744)<u></u><u></u></p> <p \
class="MsoNormal">Exception in thread \
"SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: \
GC overhead limit exceeded<u></u><u></u></p> <p class="MsoNormal">Exception in thread \
"SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: \
GC overhead limit exceeded<u></u><u></u></p> <p class="MsoNormal">Exception in thread \
"SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: \
GC overhead limit exceeded<u></u><u></u></p> </div>
</div>
</blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic