[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: hadoop 0.15.3 r612257 freezes on reduce task
From:       "Bradford Stephens" <bradfordstephens () gmail ! com>
Date:       2008-03-28 22:51:38
Message-ID: 860544ed0803281551g68ff52f4pac796bed095c4eff () mail ! gmail ! com
[Download RAW message or body]

Thanks for the hint, Deveraj! I was using paths for the
mapred.local.dir that was based on ~/, so I gave it an absolute path
instead. Also, the directory for hadoop.tmp.dir did not exist on one
machine :)


On Fri, Mar 28, 2008 at 2:00 PM, Devaraj Das <ddas@yahoo-inc.com> wrote:
> Hi Bradford,
>  Could you please check what your mapred.local.dir is set to?
>  Devaraj.
>
>
>
>  > -----Original Message-----
>  > From: Bradford Stephens [mailto:bradfordstephens@gmail.com]
>  > Sent: Saturday, March 29, 2008 1:54 AM
>  > To: core-user@hadoop.apache.org
>  > Cc: bstephens@visibletechnologies.com
>  > Subject: Re: hadoop 0.15.3 r612257 freezes on reduce task
>  >
>  > Hey everyone,
>  >
>  > I'm having a similar problem:
>  >
>  > "Map output lost, rescheduling:
>  > getMapOutput(task_200803281212_0001_m_000000_2,0) failed :
>  > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could
>  > not find task_200803281212_0001_m_000000_2/file.out.index in
>  > any of the configured local directories"
>  >
>  > Then it fails in about 10 minutes. I'm just trying to grep
>  > some etexts.
>  >
>  > New HDFS installation on 2 nodes (one master, one slave).
>  > Ubuntu Linux, Dell Core 2 Duo processors, Java 1.5.0.
>  >
>  > I have a feeling its a configuration issue. Anyone else run into it?
>  >
>  >
>  > On Tue, Jan 29, 2008 at 11:08 AM, Jason Venner
>  > <jason@attributor.com> wrote:
>  > > We are running under linux with dfs on GiGE lans,  kernel
>  > > 2.6.15-1.2054_FC5smp, with a variety of xeon steppings for
>  > our processors.
>  > >  Our replacation factor was set to 3
>  > >
>  > >
>  > >
>  > >  Florian Leibert wrote:
>  > >  > Maybe it helps to know that we're running Hadoop inside
>  > amazon's EC2...
>  > >  >
>  > >  > Thanks,
>  > >  > Florian
>  > >  >
>  > >
>  > >  --
>  > >  Jason Venner
>  > >  Attributor - Publish with Confidence <http://www.attributor.com/>
>  > > Attributor is hiring Hadoop Wranglers, contact if interested
>  > >
>  >
>
>
[prev in list] [next in list] [prev in thread] [next in thread]