[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: why to force a single reduce task for Local Runner?
From:       "Feng Jiang" <feng.a.jiang () gmail ! com>
Date:       2006-11-08 1:50:16
Message-ID: 6b8917290611071750y3ab563dyc3b9a76873806324 () mail ! gmail ! com
[Download RAW message or body]


Thanks for your answer.:)

Feng

On 11/8/06, Owen O'Malley <owen@yahoo-inc.com> wrote:
>
>
> On Nov 7, 2006, at 5:48 AM, Feng Jiang wrote:
>
> > look at the code:
> >
> > job.setNumReduceTasks(1);                 // force a single reduce
> > task
> >
> > why? Is there any difficulty there to allow multiple reduce tasks?
>
> There is not a good reason and a long standing bug to fix it:
>
> http://issues.apache.org/jira/browse/HADOOP-206
>
> Fixing it would allow a lot more of the framework code to be
> exercised in local runner mode.
>
> -- Owen
>


[prev in list] [next in list] [prev in thread] [next in thread]