[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: Get M/R Job info from Job History Server
From:       Mihir Monani <mmonani () salesforce ! com>
Date:       2018-09-24 8:55:46
Message-ID: CAPznFOfVw0-1n5aCOL81-s_eJPmZvjRyTSD+cROTpgB+t4H9+w () mail ! gmail ! com
[Download RAW message or body]

I know common-dev is not supposed to be use for End-User questions. But can
someone help me ?

I know i can do this task with "curl" or UI but it won't be useful for 100s
of job per day.

On Sun, Sep 23, 2018 at 4:13 PM Or Raz <razo@post.bgu.ac.il> wrote:

> If you are trying to use the Job History Server then I would suggest you
> follow the next two links on how to activate and enter the UI.
>
> https://stackoverflow.com/questions/42884289/job-history-server-in-hadoop-2-7-1-is-not-working
>
>
> https://stackoverflow.com/questions/50200130/hadoop-cant-access-tracking-url
>
>
>
> On 2018/09/19 10:43:05, Mihir Monani <m...@salesforce.com> wrote:
>
> > Hi,>
>
> >
>
> > How do i access MR Job Info (like total num of Map/Reduce, Avg
> Map/Reduce>
>
> > Time, Shuffle time etc) from Job History Server with JAVA Program ?>
>
> >
>
> > I was trying to use HistoryViewer.AnalyzedJob and
> HistoryViewer.SummarizedJob>
>
> > classes but HisotryViewer is marked as InterfaceAudience.Private.>
>
> >
>
> > Is there any other way to get this info from Job History Server ?>
>
> >
>
> >
>
> > -- >
>
> > Thanks>
>
> > Mihir Monani>
>
> >
>
> Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for
> Windows 10
>
>
>


-- 
Thanks
Mihir Monani

[Attachment #3 (text/html)]

<div dir="ltr">I know common-dev is not supposed to be use for End-User questions. \
But can someone help me ?<div><br></div><div>I know i can do this task with \
&quot;curl&quot; or UI but it won&#39;t be useful for 100s of job per day.  \
</div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Sep 23, 2018 at 4:13 \
PM Or Raz &lt;<a href="mailto:razo@post.bgu.ac.il">razo@post.bgu.ac.il</a>&gt; \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" \
vlink="#954F72"><div class="m_2548638114918764827WordSection1"><p \
class="MsoNormal">If you are trying to use the Job History Server then I would \
suggest you follow the next two links on how to activate and enter the UI.<br><a \
href="https://stackoverflow.com/questions/42884289/job-history-server-in-hadoop-2-7-1-is-not-working" \
target="_blank">https://stackoverflow.com/questions/42884289/job-history-server-in-hadoop-2-7-1-is-not-working</a></p><p \
class="MsoNormal"><a \
href="https://stackoverflow.com/questions/50200130/hadoop-cant-access-tracking-url" \
target="_blank">https://stackoverflow.com/questions/50200130/hadoop-cant-access-tracking-url</a></p><p \
class="MsoNormal"><u></u>  <u></u></p><p class="MsoNormal">On 2018/09/19 10:43:05, \
Mihir Monani &lt;<a href="mailto:m...@salesforce.com" \
target="_blank">m...@salesforce.com</a>&gt; wrote: </p><p class="MsoNormal">&gt; \
Hi,&gt; </p><p class="MsoNormal">&gt; </p><p class="MsoNormal">&gt; How do i access \
MR Job Info (like total num of Map/Reduce, Avg Map/Reduce&gt; </p><p \
class="MsoNormal">&gt; Time, Shuffle time etc) from Job History Server with JAVA \
Program ?&gt; </p><p class="MsoNormal">&gt; </p><p class="MsoNormal">&gt; I was \
trying to use HistoryViewer.AnalyzedJob and HistoryViewer.SummarizedJob&gt; </p><p \
class="MsoNormal">&gt; classes but HisotryViewer is marked as \
InterfaceAudience.Private.&gt; </p><p class="MsoNormal">&gt; </p><p \
class="MsoNormal">&gt; Is there any other way to get this info from Job History \
Server ?&gt; </p><p class="MsoNormal">&gt; </p><p class="MsoNormal">&gt; </p><p \
class="MsoNormal">&gt; -- &gt; </p><p class="MsoNormal">&gt; Thanks&gt; </p><p \
class="MsoNormal">&gt; Mihir Monani&gt; </p><p class="MsoNormal">&gt; </p><p \
class="MsoNormal">Sent from <a href="https://go.microsoft.com/fwlink/?LinkId=550986" \
target="_blank">Mail</a> for Windows 10</p><p class="MsoNormal"><u></u>  \
<u></u></p></div></div></blockquote></div><br clear="all"><div><br></div>-- <br><div \
dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div \
dir="ltr">Thanks<div>Mihir Monani</div></div></div>



[prev in list] [next in list] [prev in thread] [next in thread]