[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: Re: hadoop yarn
From: Oleg Zhurakousky <oleg.zhurakousky () gmail ! com>
Date: 2015-01-22 22:30:53
Message-ID: CA+POG06DTsMkr1OVsT1CtSqVzyFgBqkpqBUTs_wjB-Ep5SCKFg () mail ! gmail ! com
[Download RAW message or body]
To benefit from YARN I'd suggest to use Apache Tez (application framework
that sits on top of YARN) - http://tez.apache.org/
Then you can see a big difference in how WordCount and other type jobs
could be simplified.
https://github.com/apache/tez/blob/master/tez-examples/src/main/java/org/ap=
ache/tez/examples/WordCount.java
On Tue, Jan 20, 2015 at 2:21 AM, Drake=EB=AF=BC=EC=98=81=EA=B7=BC <drake.mi=
n@nexr.com> wrote:
> Hi siva,
>
> MR program is almost same for both MR1 or MR2. Just another framework
> needed to run the program. If your previous program was written with new
> API(org.apache.hadoop.mapreduce packages), just re-complie with hadoop 2
> libs. Maybe some errors/depricated methods are popped up, but not critica=
l.
>
> Wish your luck.
>
> Thanks.
> Drake Min
>
> Drake =EB=AF=BC=EC=98=81=EA=B7=BC Ph.D
>
> On Tue, Jan 20, 2015 at 4:09 PM, siva kumar <siva165755@gmail.com> wrote:
>
>> Thanks Rohit. Do we have any examples on MR2 other than wordcount, bcoz =
i
>> dnt find much difference for word count example for both MR1 and MR2. Im
>> new to yarn, so if you suggest me any example programs on MR2 it could h=
elp
>> me out in a better way.
>>
>> Thanks and regards,
>> siva
>> On Tue, Jan 20, 2015 at 11:45 AM, Rohith Sharma K S <
>> rohithsharmaks@huawei.com> wrote:
>>
>>> Refer below link,
>>>
>>>
>>> http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/Writ=
ingYarnApplications.html
>>>
>>>
>>>
>>> Thanks & Regards
>>>
>>> Rohith Sharma K S
>>>
>>>
>>>
>>> *From:* siva kumar [mailto:siva165755@gmail.com]
>>> *Sent:* 20 January 2015 11:24
>>> *To:* user@hadoop.apache.org
>>> *Subject:* hadoop yarn
>>>
>>>
>>>
>>> Hi All,
>>>
>>> Can anyone suggest me few links for writing MR2 program on
>>> Yarn ?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Thanks and regrads,
>>>
>>> siva
>>>
>>
>>
>
[Attachment #3 (text/html)]
<div dir="ltr">To benefit from YARN I'd suggest to use Apache Tez (application \
framework that sits on top of YARN) - <a \
href="http://tez.apache.org/">http://tez.apache.org/</a><div>Then you can see a big \
difference in how WordCount and other type jobs could be simplified. </div><div><a \
href="https://github.com/apache/tez/blob/master/tez-examples/src/main/java/org/apache/ \
tez/examples/WordCount.java">https://github.com/apache/tez/blob/master/tez-examples/src/main/java/org/apache/tez/examples/WordCount.java</a><br></div></div><div \
class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 20, 2015 at 2:21 AM, \
Drake민영근 <span dir="ltr"><<a href="mailto:drake.min@nexr.com" \
target="_blank">drake.min@nexr.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Hi siva,<div><br></div><div>MR program is \
almost same for both MR1 or MR2. Just another framework needed to run the program. If \
your previous program was written with new API(org.apache.hadoop.mapreduce packages), \
just re-complie with hadoop 2 libs. Maybe some errors/depricated methods are popped \
up, but not critical.</div><div><br></div><div>Wish your \
luck.</div><div><br></div><div>Thanks.</div><div>Drake Min</div></div><div \
class="gmail_extra"><br clear="all"><div><div><div dir="ltr">Drake 민영근 \
Ph.D</div></div></div><div><div class="h5"> <br><div class="gmail_quote">On Tue, Jan \
20, 2015 at 4:09 PM, siva kumar <span dir="ltr"><<a \
href="mailto:siva165755@gmail.com" \
target="_blank">siva165755@gmail.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div>Thanks Rohit. Do we have any examples on MR2 other than \
wordcount, bcoz i dnt find much difference for word count example for both MR1 and \
MR2. Im new to yarn, so if you suggest me any example programs on MR2 it could help \
me out in a better way.</div> <div> </div>
<div>Thanks and regards,</div>
<div>siva <br></div><div><div>
<div class="gmail_quote">On Tue, Jan 20, 2015 at 11:45 AM, Rohith Sharma K S <span \
dir="ltr"><<a href="mailto:rohithsharmaks@huawei.com" \
target="_blank">rohithsharmaks@huawei.com</a>></span> wrote:<br> <blockquote \
style="BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PADDING-LEFT:1ex" \
class="gmail_quote"> <div lang="EN-US" vlink="purple" link="blue">
<div>
<p class="MsoNormal">Refer below link,<u></u><u></u></p>
<p class="MsoNormal"><a \
href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html" \
target="_blank">http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html</a><span \
style="FONT-FAMILY:'Calibri','sans-serif';COLOR:#1f497d;FONT-SIZE:11pt"><u></u><u></u></span></p>
<p class="MsoNormal"><span \
style="FONT-FAMILY:'Calibri','sans-serif';COLOR:#1f497d;FONT-SIZE:11pt"><u></u> \
<u></u></span></p> <p class="MsoNormal"><span \
style="FONT-FAMILY:'Calibri','sans-serif';COLOR:#1f497d;FONT-SIZE:11pt">Thanks \
& Regards<u></u><u></u></span></p> <p class="MsoNormal"><span \
style="FONT-FAMILY:'Calibri','sans-serif';COLOR:#1f497d;FONT-SIZE:11pt">Rohith \
Sharma K S<u></u><u></u></span></p> <p class="MsoNormal"><span \
style="FONT-FAMILY:'Calibri','sans-serif';COLOR:#1f497d;FONT-SIZE:11pt"><u></u> \
<u></u></span></p> <div style="BORDER-BOTTOM:medium none;BORDER-LEFT:medium \
none;PADDING-BOTTOM:0cm;PADDING-LEFT:0cm;PADDING-RIGHT:0cm;BORDER-TOP:#b5c4df 1pt \
solid;BORDER-RIGHT:medium none;PADDING-TOP:3pt"> <p class="MsoNormal"><b><span \
style="FONT-FAMILY:'Tahoma','sans-serif';FONT-SIZE:10pt">From:</span></b><span \
style="FONT-FAMILY:'Tahoma','sans-serif';FONT-SIZE:10pt"> siva kumar \
[mailto:<a href="mailto:siva165755@gmail.com" \
target="_blank">siva165755@gmail.com</a>] <br><b>Sent:</b> 20 January 2015 \
11:24<br><b>To:</b> <a href="mailto:user@hadoop.apache.org" \
target="_blank">user@hadoop.apache.org</a><br><b>Subject:</b> hadoop \
yarn<u></u><u></u></span></p></div> <div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Hi All,<u></u><u></u></p></div>
<div>
<p class="MsoNormal"> Can anyone suggest me few links for \
writing MR2 program on Yarn ?<u></u><u></u></p></div> <div>
<p class="MsoNormal"> <u></u><u></u></p></div>
<div>
<p class="MsoNormal"> <u></u><u></u></p></div>
<div>
<p class="MsoNormal"> <u></u><u></u></p></div>
<div>
<p class="MsoNormal"> <u></u><u></u></p></div>
<div>
<p class="MsoNormal"> <u></u><u></u></p></div>
<div>
<p class="MsoNormal">Thanks and regrads,<u></u><u></u></p></div>
<div>
<p class="MsoNormal">siva<u></u><u></u></p></div></div></div></div></div></blockquote></div><br>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic