[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    log4j logging for mapreduce
From:       Aji Janis <aji1705 () gmail ! com>
Date:       2013-06-25 12:47:37
Message-ID: CANrNQ6-zdqKHM1=duq2anQyhHuAo47PGFbBzW4OoSwB6hNKtyQ () mail ! gmail ! com
[Download RAW message or body]

I know hadoop uses log4 for logging and I was able to view the properties
in conf/log4j.properties to figure out where the existing log files are.
However, is there a way for me to direct the logs from a (hbase) mapreduce
job to a completely new file? Idea being, I have a job scheduled to run
nightly and I like to be able to log to /var/log/myjob.log for just this
job so that I can check that file for any errors/exceptions instead of
having to go through the jotrackter UI. Is this possible? If so, how? Also,
since the job will be submitted to the cluster so please advice if the log
file needs to be on HDFS or the regular (linux) platform. If on Linux then
should it be on all nodes or just the hadoop master?

Hadoop version in use: 0.20.2-cdh3u5,
30233064aaf5f2492bc687d61d72956876102109

Thank you for any suggestions.

[Attachment #3 (text/html)]

<div dir="ltr"><span style="color:rgb(0,0,0);font-family:Arial,&#39;Liberation \
Sans&#39;,&#39;DejaVu Sans&#39;,sans-serif;font-size:14px;line-height:18px">I know \
hadoop uses log4 for logging and I was able to view the properties in \
conf/log4j.properties to figure out where the existing log files are. However, is \
there a way for me to direct the logs from a (hbase) mapreduce job to a completely \
new file? Idea being, I have a job scheduled to run nightly and I like to be able to \
log to /var/log/myjob.log for just this job so that I can check that file for any \
errors/exceptions instead of having to go through the jotrackter UI. Is this \
possible? If so, how? Also, since the job will be submitted to the cluster so please \
advice if the log file needs to be on HDFS or the regular (linux) platform. If on \
Linux then should it be on all nodes or just the hadoop master?</span><br> <div><span \
style="color:rgb(0,0,0);font-family:Arial,&#39;Liberation Sans&#39;,&#39;DejaVu \
Sans&#39;,sans-serif;font-size:14px;line-height:18px"><br></span></div><div \
style><span style="color:rgb(0,0,0);font-family:Arial,&#39;Liberation \
Sans&#39;,&#39;DejaVu Sans&#39;,sans-serif;font-size:14px;line-height:18px">Hadoop \
version in use: </span><span \
style="color:rgb(0,0,0);font-family:sans-serif;font-size:11.199999809265137px;line-height:17px">0.20.2-cdh3u5, \
30233064aaf5f2492bc687d61d72956876102109</span></div> <br \
style="color:rgb(0,0,0);font-family:sans-serif;font-size:11.199999809265137px;line-height:17px"><div \
style>Thank you for any suggestions.</div></div>



[prev in list] [next in list] [prev in thread] [next in thread]