[prev in list] [next in list] [prev in thread] [next in thread] 

List:       flume-user
Subject:    Re: S3 source
From:       Mubarak Seyed <seyed () apple ! com>
Date:       2012-08-24 0:50:08
Message-ID: 94144403-4780-49E1-AE7C-8B34B6679F35 () apple ! com
[Download RAW message or body]

There is a related discussion at

http://mail-archives.apache.org/mod_mbox/flume-user/201208.mbox/%3C3D87E13A11A14E238634A857125CB33C@cloudera.com%3E



Thanks,
Mubarak
On Aug 23, 2012, at 5:44 PM, Mike Percy wrote:

> Roman,
> I haven't seen an implementation floating around, but I would love to get support \
> for an S3 Source into Flume! 
> Regards,
> Mike
> 
> On Thu, Aug 23, 2012 at 5:06 PM, Roman Shaposhnik <rvs@apache.org> wrote:
> Hi!
> 
> I have, what I would imagine, is a pretty common use case -- a bunch of S3
> buckets with access logging enabled. S3 is nice in a sense that the logging
> for the bucket all goes back to a bucket of your choice, but of course, I really
> want this data in HDFS so I can analyze it.
> 
> Is there a flume source that can help me here? I couldn't find one.
> 
> Thanks,
> Roman.
> 


[Attachment #3 (text/html)]

<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; \
-webkit-line-break: after-white-space; ">There is a related discussion \
at<div><br></div><div><a \
href="http://mail-archives.apache.org/mod_mbox/flume-user/201208.mbox/&lt;3D87E13A11A1 \
4E238634A857125CB33C@cloudera.com&gt;">http://mail-archives.apache.org/mod_mbox/flume- \
user/201208.mbox/%3C3D87E13A11A14E238634A857125CB33C@cloudera.com%3E</a></div><div><br></div><div><br></div><div>Thanks,</div><div>Mubarak<br><div><div>On \
Aug 23, 2012, at 5:44 PM, Mike Percy wrote:</div><br \
class="Apple-interchange-newline"><blockquote type="cite">Roman,<div>I haven't seen \
an implementation floating around, but I would love to get support for an S3 Source \
into Flume!<div><br></div><div>Regards,</div><div>Mike<br><br><div \
class="gmail_quote">On Thu, Aug 23, 2012 at 5:06 PM, Roman Shaposhnik <span \
dir="ltr">&lt;<a href="mailto:rvs@apache.org" \
target="_blank">rvs@apache.org</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">Hi!<br> <br>
I have, what I would imagine, is a pretty common use case -- a bunch of S3<br>
buckets with access logging enabled. S3 is nice in a sense that the logging<br>
for the bucket all goes back to a bucket of your choice, but of course, I really<br>
want this data in HDFS so I can analyze it.<br>
<br>
Is there a flume source that can help me here? I couldn't find one.<br>
<br>
Thanks,<br>
Roman.<br>
</blockquote></div><br></div></div>
</blockquote></div><br></div></body></html>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic