[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    RE: Grep example won't terminate on "virtual" cluster (using xen)
From:       "Richard Yang" <richardyang () richardyang ! net>
Date:       2007-03-21 16:58:27
Message-ID: CYRUShIos8NU1egxdnx00000006 () cyrus ! richardyang ! net
[Download RAW message or body]


Just to share experiences, I tried to use VMWare setting up a 2-node
cluster. The errors showing up were java.io.* related errors. There was
still a 20% chance finishing the job, such as sample Grep, randomwriter,
sort.

Best Regards
 
Richard Yang
richardyang@richardyang.net
kusanagiyang@gmail.com
 
 
-----Original Message-----
From: Maximilian Schöfmann [mailto:schoefmann@googlemail.com] 
Sent: Wednesday, March 21, 2007 8:30 AM
To: hadoop-user@lucene.apache.org
Subject: Re: Grep example won't terminate on "virtual" cluster (using xen)

> > I was playing around with the latest hadoop (0.12.1) on a virtual
> > "cluster"
> > (4 nodes, one as namenode and jobtracker) using Xen. Each node runs the
> > current Xen kernel (2.6.16.33-xen) with 192 MB Ram and JDK 1.5.0_11.
> > Running the grep example in standalone mode works fine, but it won't
> > terminate in distributed mode:
> >
>
> Maybe 192MB of RAM for each nodes is not enough ?


Memory usage is well below 110 MB for each node. I've also tried using a
completely virtually switched network -- with the same results..



[prev in list] [next in list] [prev in thread] [next in thread]