'Re: Load Balancing sink group not working'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       flume-user
Subject:    Re: Load Balancing sink group not working
From:       Johny Rufus <jrufus () cloudera ! com>
Date:       2015-04-16 23:02:16
Message-ID: CALmgQN6WN-GOJQorNkPjpSibSsXMEpo+dTUjFQ1fqEz9BDTbuQ () mail ! gmail ! com
[Download RAW message or body]

Sink Groups are designed to operate such that only one sink is chosen at
any time out of the configured sinks in the group, to process data out of
the channel. So this is the expected behavior. As you had noted, removing
the sink group  will result in each sink processing the data out of the
channel simultaneously.

Thanks,
Rufus

On Thu, Apr 16, 2015 at 3:30 PM, Rahul Ravindran <rahulrv@yahoo.com> wrote:

> Looking further into jstack, it looks like in the default configuration
> (without sink groups), there is a thread per sink, while there is only one
> thread when using the sink group which would explain the drop in throughput
> when using sink groups. Am I missing something?
>
> ~Rahul.
>
>
>
>   On Thursday, April 16, 2015 12:47 PM, Rahul Ravindran <rahulrv@yahoo.com>
> wrote:
>
>
> Hi,
> Below is my flume config and I am attempting to get Load Balancing sink
> group to LB across multiple machines. I see only 2 threads created for the
> entire sink group when using load balancing sink group and see the below
> message in the logs(and I see no throughput on draining events from the
> channel). On the other hand, if I comment out the sink group definition
> from the flume config and thus use the DefaultSinkProcessor, I see a lot
> more threads and events draining a lot faster. I suspect this is a problem
> with my config, but I could not find anything obvious. Could anyone here
> help?
>
> *Flume log output:*
> flume.log:16 Apr 2015 17:18:07,549 INFO [main]
> (org.apache.flume.node.Application.startAllComponents:138) - Starting new
> configuration:{ sourceRunners:{netcat=EventDrivenSourceRunner: {
> source:org.apache.flume.source.NetcatSource{name:netcat,state:IDLE} },
> spool=EventDrivenSourceRunner: {
> source:org.apache.flume.source.SpoolDirectorySource{name:spool,state:IDLE}
> }} sinkRunners:{mainSinks=SinkRunner: {
> policy:org.apache.flume.sink.LoadBalancingSinkProcessor@15f66cff
> counterGroup:{ name:null counters:{} } }, replaySinks=SinkRunner: {
> policy:org.apache.flume.sink.LoadBalancingSinkProcessor@656de49c
> counterGroup:{ name:null counters:{} } }}
> channels:{mainChannel=org.apache.flume.channel.MemoryChannel{name:
> mainChannel}, replayChannel=org.apache.flume.channel.MemoryChannel{name:
> replayChannel}} }
>
> *Flume config:*
> agent1.channels.mainChannel.type = MEMORY
> agent1.channels.mainChannel.capacity = 150000
> agent1.channels.mainChannel.transactionCapacity = 10000
>
> agent1.channels.replayChannel.type = MEMORY
> agent1.channels.replayChannel.capacity = 50000
> agent1.channels.replayChannel.transactionCapacity = 5000
>
> # netcat source
> agent1.sources.netcat.channels = mainChannel
> agent1.sources.netcat.type= netcat
> agent1.sources.netcat.bind = 127.0.0.1
> agent1.sources.netcat.port = 44444
> agent1.sources.netcat.ack-every-event = false
> agent1.sources.netcat.max-line-length = 8192
>
> # spool directory source
> agent1.sources.spool.channels = replayChannel
> agent1.sources.spool.type = spooldir
> agent1.sources.spool.bufferMaxLineLength = 8192
> agent1.sources.spool.bufferMaxLines = 1000
> agent1.sources.spool.batchSize = 1000
> agent1.sources.spool.spoolDir = /br/agent_aud/replay
> agent1.sources.spool.inputCharset = ISO-8859-1
> #Label the event as a replayed event
> agent1.sources.spool.interceptors = staticInterceptor
> agent1.sources.spool.interceptors.staticInterceptor.type = static
> agent1.sources.spool.interceptors.staticInterceptor.key = t
> agent1.sources.spool.interceptors.staticInterceptor.value = r
>
>
> agent1.sinks.avroMainSink1.type = avro
> agent1.sinks.avroMainSink1.channel = mainChannel
> agent1.sinks.avroMainSink1.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroMainSink1.port = 4545
> agent1.sinks.avroMainSink1.connect-timeout = 30000
> agent1.sinks.avroMainSink1.request-timeout = 20000
> agent1.sinks.avroMainSink1.batch-size = 200
>
> agent1.sinks.avroReplaySink1.type = avro
> agent1.sinks.avroReplaySink1.channel = replayChannel
> agent1.sinks.avroReplaySink1.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroReplaySink1.port = 4545
> agent1.sinks.avroReplaySink1.connect-timeout = 300000
> agent1.sinks.avroReplaySink1.batch-size = 2000
>
> agent1.sinks.avroMainSink2.type = avro
> agent1.sinks.avroMainSink2.channel = mainChannel
> agent1.sinks.avroMainSink2.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroMainSink2.port = 4546
> agent1.sinks.avroMainSink2.connect-timeout = 30000
> agent1.sinks.avroMainSink2.request-timeout = 20000
> agent1.sinks.avroMainSink2.batch-size = 200
>
> agent1.sinks.avroReplaySink2.type = avro
> agent1.sinks.avroReplaySink2.channel = replayChannel
> agent1.sinks.avroReplaySink2.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroReplaySink2.port = 4546
> agent1.sinks.avroReplaySink2.connect-timeout = 300000
> agent1.sinks.avroReplaySink2.batch-size = 2000
>
> agent1.sinks.avroMainSink3.type = avro
> agent1.sinks.avroMainSink3.channel = mainChannel
> agent1.sinks.avroMainSink3.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroMainSink3.port = 4547
> agent1.sinks.avroMainSink3.connect-timeout = 30000
> agent1.sinks.avroMainSink3.request-timeout = 20000
> agent1.sinks.avroMainSink3.batch-size = 200
>
> agent1.sinks.avroReplaySink3.type = avro
> agent1.sinks.avroReplaySink3.channel = replayChannel
> agent1.sinks.avroReplaySink3.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroReplaySink3.port = 4547
> agent1.sinks.avroReplaySink3.connect-timeout = 300000
> agent1.sinks.avroReplaySink3.batch-size = 2000
>
> agent1.sinks.avroMainSink4.type = avro
> agent1.sinks.avroMainSink4.channel = mainChannel
> agent1.sinks.avroMainSink4.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroMainSink4.port = 4548
> agent1.sinks.avroMainSink4.connect-timeout = 30000
> agent1.sinks.avroMainSink4.request-timeout = 20000
> agent1.sinks.avroMainSink4.batch-size = 200
>
> agent1.sinks.avroReplaySink4.type = avro
> agent1.sinks.avroReplaySink4.channel = replayChannel
> agent1.sinks.avroReplaySink4.hostname = flumefs-v01-00a.bento.btrll.com
> agent1.sinks.avroReplaySink4.port = 4548
> agent1.sinks.avroReplaySink4.connect-timeout = 300000
> agent1.sinks.avroReplaySink4.batch-size = 2000
>
>
> agent1.sinkgroups.mainSinks.sinks = avroMainSink1 avroMainSink2
> avroMainSink3 avroMainSink4
> agent1.sinkgroups.mainSinks.processor.type = load_balance
> agent1.sinkgroups.mainSinks.processor.selector = random
> agent1.sinkgroups.mainSinks.processor.maxTimeOut = 1000
> agent1.sinkgroups.mainSinks.processor.backoff = true
>
> agent1.sinkgroups.replaySinks.sinks = avroReplaySink1 avroReplaySink2
> avroReplaySink3 avroReplaySink4
> agent1.sinkgroups.replaySinks.processor.type = load_balance
> agent1.sinkgroups.replaySinks.processor.selector = random
> agent1.sinkgroups.replaySinks.processor.maxTimeOut = 1000
> agent1.sinkgroups.replaySinks.processor.backoff = true
>
> agent1.channels = mainChannel replayChannel
> agent1.sinkgroups = mainSinks replaySinks
> agent1.sources = netcat spool
> agent1.sinks = avroMainSink1 avroReplaySink1 avroMainSink2 avroReplaySink2
> avroMainSink3 avroReplaySink3 avroMainSink4 avroReplaySink4
>
>
>
>
>

[Attachment #3 (text/html)]

<div dir="ltr">Sink Groups are designed to operate such that only one sink is chosen \
at any time out of the configured sinks in the group, to process data out of the \
channel. So this is the expected behavior. As you had noted, removing the sink group  \
will result in each sink processing the data out of the channel simultaneously.<div \
class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div \
dir="ltr"><div style="font-family:arial;font-size:small">Thanks,</div><div \
style="font-family:arial;font-size:small">Rufus</div></div></div></div> <br><div \
class="gmail_quote">On Thu, Apr 16, 2015 at 3:30 PM, Rahul Ravindran <span \
dir="ltr">&lt;<a href="mailto:rahulrv@yahoo.com" \
target="_blank">rahulrv@yahoo.com</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div><div \
style="color:#000;background-color:#fff;font-family:HelveticaNeue,Helvetica \
Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"><div \
dir="ltr"><span>Looking  further into jstack, it looks like in the default \
configuration (without sink groups), there is a thread per sink, while there is only \
one thread when using the sink group which would explain the drop in throughput when \
using sink groups. Am I missing something?</span></div><span class="HOEnZb"><font \
color="#888888"><div dir="ltr"><span><br></span></div><div \
dir="ltr"><span>~Rahul.</span></div></font></span><div><div class="h5">  \
<br><div><br><br></div><div style="display:block"> <div \
style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida \
Grande,sans-serif;font-size:16px"> <div style="font-family:HelveticaNeue,Helvetica \
Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div dir="ltr"> <font \
size="2" face="Arial"> On Thursday, April 16, 2015 12:47 PM, Rahul Ravindran &lt;<a \
href="mailto:rahulrv@yahoo.com" target="_blank">rahulrv@yahoo.com</a>&gt; wrote:<br> \
</font> </div>  <br><br> <div><div><div><div \
style="color:#000;background-color:#fff;font-family:HelveticaNeue,Helvetica \
Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Hi,</span></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"> \
Below is my flume config and I am attempting to get Load Balancing sink group to LB \
across multiple machines. I see only 2 threads created for the entire sink group when \
using load balancing sink group and see the below message in the logs(and I see no \
throughput on draining events from the channel). On the other hand, if I comment out \
the sink group definition from the flume config and thus use the \
DefaultSinkProcessor, I see a lot more threads and events draining a lot faster. I \
suspect this is a problem with my config, but I could not find anything obvious. \
Could anyone here help?</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><br></span></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:rgb(0,0,0);background-color:transparent; \
font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Flume \
log output:</b></span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">flume.log:16 \
Apr 2015 17:18:07,549 INFO  [main] \
(org.apache.flume.node.Application.startAllComponents:138)  - Starting new \
configuration:{ sourceRunners:{netcat=EventDrivenSourceRunner: { \
source:org.apache.flume.source.NetcatSource{name:netcat,state:IDLE} }, \
spool=EventDrivenSourceRunner: { \
source:org.apache.flume.source.SpoolDirectorySource{name:spool,state:IDLE} }} \
sinkRunners:{mainSinks=SinkRunner: { \
policy:org.apache.flume.sink.LoadBalancingSinkProcessor@15f66cff counterGroup:{ \
name:null counters:{} } }, replaySinks=SinkRunner: { \
policy:org.apache.flume.sink.LoadBalancingSinkProcessor@656de49c counterGroup:{ \
name:null counters:{} } }} \
channels:{mainChannel=org.apache.flume.channel.MemoryChannel{name: mainChannel}, \
replayChannel=org.apache.flume.channel.MemoryChannel{name: replayChannel}} \
}<br></span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><br></span></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:rgb(0,0,0);background-color:transparent; \
font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Flume \
config:</b></span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.channels.mainChannel.type \
= MEMORY</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.channels.mainChannel.capacity \
= 150000</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-al \
ign:baseline;white-space:pre-wrap">agent1.channels.mainChannel.transactionCapacity = \
10000</span></div><div dir="ltr"><b style="font-weight:normal"><br></b></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.channels.replayChannel.type \
= MEMORY</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.channels.replayChannel.capacity \
= 50000</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-al \
ign:baseline;white-space:pre-wrap">agent1.channels.replayChannel.transactionCapacity \
= 5000</span></div><div dir="ltr"><b style="font-weight:normal"><br></b></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"># \
netcat source</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.netcat.channels \
= mainChannel</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.netcat.type= \
netcat</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.netcat.bind \
= 127.0.0.1</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.netcat.port \
= 44444</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.netcat.ack-every-event \
= false</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.netcat.max-line-length \
= 8192</span></div><div dir="ltr"><b style="font-weight:normal"><br></b></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"># \
spool directory source</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.channels \
= replayChannel</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.type \
= spooldir</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.bufferMaxLineLength \
= 8192</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.bufferMaxLines \
= 1000</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.batchSize \
= 1000</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.spoolDir \
= /br/agent_aud/replay</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.inputCharset \
= ISO-8859-1</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">#Label \
the event as a replayed event</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sources.spool.interceptors \
= staticInterceptor</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-al \
ign:baseline;white-space:pre-wrap">agent1.sources.spool.interceptors.staticInterceptor.type \
= static</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-al \
ign:baseline;white-space:pre-wrap">agent1.sources.spool.interceptors.staticInterceptor.key \
= t</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-al \
ign:baseline;white-space:pre-wrap">agent1.sources.spool.interceptors.staticInterceptor.value \
= r</span></div><div dir="ltr"><b style="font-weight:normal"><br><br></b></div><div \
dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sinks.avroMainSink1.type \
= avro</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sinks.avroMainSink1.channel \
= mainChannel</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sinks.avroMainSink1.hostname \
= <a href="http://flumefs-v01-00a.bento.btrll.com" \
target="_blank">flumefs-v01-00a.bento.btrll.com</a></span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \
t-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">agent1.sinks.avroMainSink1.port \
= 4545</span></div><div dir="ltr" \
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span \
style="font-size:15px;font-family:Arial;color:#000000;background-color:transparent;fon \



[prev in list] [next in list] [prev in thread] [next in thread]
Configure | About | News | Add a list | Sponsored by KoreLogic