[prev in list] [next in list] [prev in thread] [next in thread] 

List:       flume-user
Subject:    Questions about using Cloudera Flume to move data
From:       jia jimin <jiajimin () gmail ! com>
Date:       2012-11-28 7:44:14
Message-ID: CAA7wKAC=1+85gd+Yehds08OkW+mbsZjtDRSN5Q2_QTWrLE3n-g () mail ! gmail ! com
[Download RAW message or body]

Hi there,

We'd like to upload data from a client to Hadoop using Cloudera Flume.  But
we have some questions about it :

1.  If our client and server machine are both installed on windows, will
Flume works well ?   Any windows installer on both client and server side ?
 We have hadoop installed on windows.

2.  We want to collect event logs such as perf counter data which is not in
a file format,  Is there anyway to upload this kind of format data to HDFS
?

3.  Our client machine changes dynamically every day (recycle old machine
or add new machines),  How to let master know the client node has changed ?
 Are there any configurations we can change dynamically ?

Thanks very much for looking at these !

Regards
Benjamin

[Attachment #3 (text/html)]

<span style="font-family:arial,sans-serif;font-size:13px">Hi there,  </span><div \
style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">We&#39;d like to upload data from \
a client to Hadoop using Cloudera Flume.  But we have some questions about it : \
</div> <div style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">1.  If our client and server \
machine are both installed on windows, will Flume works well ?   Any windows \
installer on both client and server side ?  We have hadoop installed on \
windows.</div> <div style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">2.  We want to collect event logs \
such as perf counter data which is not in a file format,  Is there anyway to upload \
this kind of format data to HDFS ?  </div> <div \
style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">3.  Our client machine changes \
dynamically every day (recycle old machine or add new machines),  How to let master \
know the client node has changed ?  Are there any configurations we can change \
dynamically ? </div> <div \
style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">Thanks very much for looking at \
these !</div><div style="font-family:arial,sans-serif;font-size:13px"> <br></div><div \
style="font-family:arial,sans-serif;font-size:13px">Regards</div><div \
style="font-family:arial,sans-serif;font-size:13px">Benjamin</div>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic