'Measuring Hadoop Execution time automatically'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Measuring Hadoop Execution time automatically
From:       Or Raz <razo () post ! bgu ! ac ! il>
Date:       2018-10-19 14:14:39
Message-ID: CACZ1Ads=uhyzWOQa7wndjUGyG+m8s3AVxqfb2_2Fq0DxeN1aVg () mail ! gmail ! com
[Download RAW message or body]

I am writing a MapReduce Job using Hadoop natively and I want to measure
the execution time of the job and I am collecting it using Date (I know
that also in the UI I can see the execution time). In order to find the
correct execution time I am running this job 3 times (using one hadoop jar
and a for loop that call the job) and I am getting very strange results.

It seems like the first run has much shorter time than the others and I get
the same output (I know that the location of the containers might be the
reason for the change of execution time but I am not sure why the first run
is always the fastest). An example of the code of what I am using

public int run (String[] args ) throws Exception {Configuration conf =
getConf();
conf.set(...)...for (int i = 0; i < 3; i++){Job job
=job.getInstance(conf, "OR-MR");...if (!job.waitForCompletion(true))
  {
    System.exit(1);
  }}//for}//run

By the way, if I am running the job 3 times (one per hadoop command) than I
get the fast execution time.

Is there any other way to do measure the execution time without running it
manually three times?

[Attachment #3 (text/html)]

<div dir="rtl"><p style="margin:0px 0px \
1em;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;font-family:Arial,&quot;Helvetica \
Neue&quot;,Helvetica,sans-serif;font-size:15px;vertical-align:baseline;box-sizing:inherit;clear:both;color:rgb(36,39,41)" \
dir="ltr">I am writing a MapReduce Job using Hadoop natively and I want to measure \
the execution time of the job and I am collecting it using Date (I know that also in \
the UI I can see the execution time). In order to find the correct execution time I \
am running this job 3 times (using one hadoop jar and a for loop that call the job) \
and I am getting very strange results.</p><p style="margin:0px 0px \
1em;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;font-family:Arial,&quot;Helvetica \
Neue&quot;,Helvetica,sans-serif;font-size:15px;vertical-align:baseline;box-sizing:inherit;clear:both;color:rgb(36,39,41)" \
dir="ltr">It seems like the first run has much shorter time than the others and I get \
the same output (I know that the location of the containers might be the reason for \
the change of execution time but I am not sure why the first run is always the \
fastest). An example of the code of what I am using</p><pre class="gmail-lang-java \
gmail-prettyprint gmail-prettyprinted" \
style="margin-top:0px;margin-bottom:1em;padding:5px;border:0px;font-variant-numeric:in \
herit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;font-family:Consolas,Menlo,Monaco,&quot;Lucida \
Console&quot;,&quot;Liberation Mono&quot;,&quot;DejaVu Sans \
Mono&quot;,&quot;Bitstream Vera Sans Mono&quot;,&quot;Courier \
New&quot;,monospace,sans-serif;font-size:13px;vertical-align:baseline;box-sizing:inher \
it;width:auto;max-height:600px;overflow:auto;background-color:rgb(239,240,241);color:rgb(57,51,24)" \
dir="ltr"><code style="margin:0px;padding:0px;border:0px;font-style:inherit;font-varia \
nt:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:Consolas,Menlo,Monaco,&quot;Lucida \
Console&quot;,&quot;Liberation Mono&quot;,&quot;DejaVu Sans \
Mono&quot;,&quot;Bitstream Vera Sans Mono&quot;,&quot;Courier \
New&quot;,monospace,sans-serif;vertical-align:baseline;box-sizing:inherit;white-space:inherit"><span \
class="gmail-kwd" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">public</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-kwd" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">int</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
run </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(</span><span \
class="gmail-typ" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(43,145,175)">String</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">[]</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
args </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">)</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-kwd" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">throws</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-typ" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(43,145,175)">Exception</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">{</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-typ" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-a \
lign:baseline;box-sizing:inherit;color:rgb(43,145,175)">Configuration</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
conf </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">=</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
getConf</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">();</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 conf</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">set</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(...)</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-kwd" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">for</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(</span><span \
class="gmail-kwd" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">int</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
i </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">=</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-lit" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(125,39,39)">0</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">;</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
i </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">&lt;</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-lit" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(125,39,39)">3</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">;</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
i</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">++)</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">{</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-typ" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(43,145,175)">Job</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
job </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">=</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">job</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">getInstance</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">conf</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">,</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-str" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-a \
lign:baseline;box-sizing:inherit;color:rgb(125,39,39)">&quot;OR-MR&quot;</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">);</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-kwd" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">if</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
</span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(!</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">job</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">waitForCompletion</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(</span><span \
class="gmail-kwd" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(16,16,148)">true</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">))</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
  </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">{</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)"> \
  </span><span class="gmail-typ" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(43,145,175)">System</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">.</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">exit</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">(</span><span \
class="gmail-lit" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(125,39,39)">1</span><span \
class="gmail-pun" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">);</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
  </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">}</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">}</span><span \
class="gmail-com" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(133,140,147)">//for</span><span \
class="gmail-pln" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">
 </span><span class="gmail-pun" \
style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font- \
weight:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(48,51,54)">}</span><span \
class="gmail-com" style="margin:0px;padding:0px;border:0px;font-style:inherit;font-var \
iant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;font-family: \
inherit;vertical-align:baseline;box-sizing:inherit;color:rgb(133,140,147)">//run</span></code></pre><p \
style="margin:0px 0px \
1em;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;font-family:Arial,&quot;Helvetica \
Neue&quot;,Helvetica,sans-serif;font-size:15px;vertical-align:baseline;box-sizing:inherit;clear:both;color:rgb(36,39,41)" \
dir="ltr">By the way, if I am running the job 3 times (one per hadoop command) than I \
get the fast execution time.</p><p style="margin:0px 0px \
1em;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;font-family:Arial,&quot;Helvetica \
Neue&quot;,Helvetica,sans-serif;font-size:15px;vertical-align:baseline;box-sizing:inherit;clear:both;color:rgb(36,39,41)" \
dir="ltr">Is there any other way to do measure the execution time without running it \
manually three times?</p></div>



[prev in list] [next in list] [prev in thread] [next in thread]
Configure | About | News | Add a list | Sponsored by KoreLogic