[prev in list] [next in list] [prev in thread] [next in thread]
List: flume-user
Subject: Questions about using Cloudera Flume to move data
From: jia jimin <jiajimin () gmail ! com>
Date: 2012-11-28 7:44:14
Message-ID: CAA7wKAC=1+85gd+Yehds08OkW+mbsZjtDRSN5Q2_QTWrLE3n-g () mail ! gmail ! com
[Download RAW message or body]
Hi there,
We'd like to upload data from a client to Hadoop using Cloudera Flume. But
we have some questions about it :
1. If our client and server machine are both installed on windows, will
Flume works well ? Any windows installer on both client and server side ?
We have hadoop installed on windows.
2. We want to collect event logs such as perf counter data which is not in
a file format, Is there anyway to upload this kind of format data to HDFS
?
3. Our client machine changes dynamically every day (recycle old machine
or add new machines), How to let master know the client node has changed ?
Are there any configurations we can change dynamically ?
Thanks very much for looking at these !
Regards
Benjamin
[Attachment #3 (text/html)]
<span style="font-family:arial,sans-serif;font-size:13px">Hi there, </span><div \
style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">We'd like to upload data from \
a client to Hadoop using Cloudera Flume. But we have some questions about it : \
</div> <div style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">1. If our client and server \
machine are both installed on windows, will Flume works well ? Any windows \
installer on both client and server side ? We have hadoop installed on \
windows.</div> <div style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">2. We want to collect event logs \
such as perf counter data which is not in a file format, Is there anyway to upload \
this kind of format data to HDFS ? </div> <div \
style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">3. Our client machine changes \
dynamically every day (recycle old machine or add new machines), How to let master \
know the client node has changed ? Are there any configurations we can change \
dynamically ? </div> <div \
style="font-family:arial,sans-serif;font-size:13px"><br></div><div \
style="font-family:arial,sans-serif;font-size:13px">Thanks very much for looking at \
these !</div><div style="font-family:arial,sans-serif;font-size:13px"> <br></div><div \
style="font-family:arial,sans-serif;font-size:13px">Regards</div><div \
style="font-family:arial,sans-serif;font-size:13px">Benjamin</div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic