[prev in list] [next in list] [prev in thread] [next in thread] 

List:       flume-user
Subject:    Re: Log4JAppender Sink Groups
From:       Cameron Gandevia <cgandevia () gmail ! com>
Date:       2012-11-27 5:55:07
Message-ID: CAAYV3tbiJNOhiA2P_MLr2RR+VUrXQXRnW4zjG=7Eqzu9xp9j1w () mail ! gmail ! com
[Download RAW message or body]

Awesome I will take a look and submit a patch when we have it worked out.

Thanks
On Nov 26, 2012 7:32 PM, "Brock Noland" <brock@cloudera.com> wrote:

> That can also be accomplished with the FailoverRPCClient.
>
>
> https://github.com/apache/flume/tree/trunk/flume-ng-sdk/src/main/java/org/apache/flume/api
>
> It looks to me like we need extend the log4j appender to support
> FailoverRPCClient.
>
> There is also the log4j2 flume appender which is basically an embedded
> agent:
>
> http://logging.apache.org/log4j/2.x/manual/appenders.html#FlumeAppender
>
> Brock
>
> On Mon, Nov 26, 2012 at 9:16 PM, Cameron Gandevia <cgandevia@gmail.com>wrote:
>
>> Hi
>>
>> It doesn't seem possible to configure the log4j appender to use sink
>> groups without running a flume agent on the node producing the log output.
>> We need to support high availability of the logging system and my
>> understanding is this is accomplished using sink groups. Am I missing
>> something in how you would configure this?
>>
>> Thanks
>>
>> Cameron Gandevia
>>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>

[Attachment #3 (text/html)]

<p dir="ltr">Awesome I will take a look and submit a patch when we have it worked \
out.</p> <p dir="ltr">Thanks</p>
<div class="gmail_quote">On Nov 26, 2012 7:32 PM, &quot;Brock Noland&quot; &lt;<a \
href="mailto:brock@cloudera.com">brock@cloudera.com</a>&gt; wrote:<br \
type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex"> That can also be accomplished with \
the FailoverRPCClient.<div><br></div><div><a \
href="https://github.com/apache/flume/tree/trunk/flume-ng-sdk/src/main/java/org/apache/flume/api" \
target="_blank">https://github.com/apache/flume/tree/trunk/flume-ng-sdk/src/main/java/org/apache/flume/api</a></div>



<div><br></div><div>It looks to me like we need extend the log4j appender to support \
FailoverRPCClient.</div><div><br></div><div>There is also the log4j2 flume appender \
which is basically an embedded agent:</div><div><br>


</div><div><a href="http://logging.apache.org/log4j/2.x/manual/appenders.html#FlumeAppender" \
target="_blank">http://logging.apache.org/log4j/2.x/manual/appenders.html#FlumeAppender</a></div><div><br></div><div>Brock<br><br>
 <div class="gmail_quote">

On Mon, Nov 26, 2012 at 9:16 PM, Cameron Gandevia <span dir="ltr">&lt;<a \
href="mailto:cgandevia@gmail.com" target="_blank">cgandevia@gmail.com</a>&gt;</span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex">


Hi<div><br></div><div>It doesn&#39;t seem possible to configure the log4j appender to \
use sink groups without running a flume agent on the node producing the log output. \
We need to support high availability of the logging system and my understanding is \
this is accomplished using sink groups. Am I missing something in how you would \
configure this?</div>




<div><br></div><div>Thanks<span><font color="#888888"><br><br>Cameron Gandevia<br>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br>Apache MRUnit - Unit \
testing MapReduce - <a href="http://incubator.apache.org/mrunit/" \
target="_blank">http://incubator.apache.org/mrunit/</a><br> </div>
</blockquote></div>



[prev in list] [next in list] [prev in thread] [next in thread]