[prev in list] [next in list] [prev in thread] [next in thread] 

List:       flume-user
Subject:    Re: Custom sink/source
From:       Jeff Lord <jlord () cloudera ! com>
Date:       2014-07-21 19:54:50
Message-ID: CAJmzdX=4YxTLXeG5ZbEgRdeSeshx6=6cAEEYpCvg_At1asUyEg () mail ! gmail ! com
[Download RAW message or body]

We should fix the docs
Would you be able to create a jira for that?

On Monday, July 21, 2014, Sharninder <sharninder@gmail.com> wrote:

> I did look at the developer guide and was a little confused since there
> seem to be a couple of omissions in it. In particular, the even based
> source isn't explained very well. I'm new to Java (and flume) so maybe
> that's just me.
>
> Your explanation helps.
>
> --
> Sharninder
>
> On 21-Jul-2014, at 8:33 pm, Jeff Lord <jlord@cloudera.com
> <javascript:_e(%7B%7D,'cvml','jlord@cloudera.com');>> wrote:
>
> start() is called when the agent is started and the sink component is then
> started.
> calling process() will take a batch of events off the channel and send to
> the next hop or terminal location.
> stop() is called when the agent is shutdown and the sink component
> resources are unloaded.
> Have you seen the developer guide?
> https://flume.apache.org/FlumeDeveloperGuide.html#sink
>
>
> On Mon, Jul 21, 2014 at 5:26 AM, Sharninder <sharninder@gmail.com
> <javascript:_e(%7B%7D,'cvml','sharninder@gmail.com');>> wrote:
>
>> Hey,
>>
>> I'm trying to write a new custom source/sink for flume and was going
>> through the source of some of the existing sinks. Essentially to write a
>> sink, I have to implement a start(), stop() and process().
>>
>> Now, my question is if I initiate a connection in start(), send an event
>> in process, will I be opening another connection again for the second
>> event? When is stop() called?
>>
>> Has anyone implemented a websocket sink that I could take a look at?
>>
>> --
>> Sharninder
>>
>>
>>
>>
>>
>

[Attachment #3 (text/html)]

We should fix the docs<div>Would you be able to create a jira for \
that?<span></span><br><br>On Monday, July 21, 2014, Sharninder &lt;<a \
href="mailto:sharninder@gmail.com">sharninder@gmail.com</a>&gt; wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"> <div dir="auto"><div>I did look at the developer guide and \
was a little confused since there seem to be a couple of omissions in it. In \
particular, the even based source isn&#39;t explained very well. I&#39;m new to Java \
(and flume) so maybe that&#39;s just me.  </div> <div><br></div><div>Your explanation \
helps.  <br><br>--</div><div>Sharninder</div><div><br>On 21-Jul-2014, at 8:33 pm, \
Jeff Lord &lt;<a href="javascript:_e(%7B%7D,&#39;cvml&#39;,&#39;jlord@cloudera.com&#39;);" \
target="_blank">jlord@cloudera.com</a>&gt; wrote:<br> <br></div><blockquote \
type="cite"><div><div dir="ltr">start() is called when the agent is started and the \
sink component is then started.<div>calling process() will take a batch of events off \
the channel and send to the next hop or terminal location.</div> <div>
stop() is called when the agent is shutdown and the sink component resources are \
unloaded.</div><div>Have you seen the developer guide?</div><div><a \
href="https://flume.apache.org/FlumeDeveloperGuide.html#sink" \
target="_blank">https://flume.apache.org/FlumeDeveloperGuide.html#sink</a><br>

</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Jul 21, \
2014 at 5:26 AM, Sharninder <span dir="ltr">&lt;<a \
href="javascript:_e(%7B%7D,&#39;cvml&#39;,&#39;sharninder@gmail.com&#39;);" \
target="_blank">sharninder@gmail.com</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr"><div>Hey,<br><br>I&#39;m trying to write a new \
custom source/sink for flume and was going through the source of some of the existing \
sinks. Essentially to write a sink, I have to implement a start(), stop() and \
process().<br>


<br>Now, my question is if I initiate a connection in start(), send an event in \
process, will I be opening another connection again for the second event? When is \
stop() called?<br><br></div><div>Has anyone implemented a websocket sink that I could \
take a look at?<br>


<br>--<br></div><div>Sharninder<br><br></div><br><div><div><div><br><br></div></div></div></div>
 </blockquote></div><br></div>
</div></blockquote></div></blockquote></div>



[prev in list] [next in list] [prev in thread] [next in thread]