[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: =?utf-8?Q?=E7=AD=94=E5=A4=8D:_Can_Pseudo-Distributed_Mode_take_advantage_?= =?utf-8?Q?of_multi-core_
From: Xuzhan Sun <sunxuzhan () outlook ! com>
Date: 2015-03-24 17:27:58
Message-ID: BAY404-EAS235E6A7A20FD46474521DCDA40A0 () phx ! gbl
[Download RAW message or body]
So I can set up the pseudo distributed mode without virtual machine and get the same \
performance? Am I right?
Sent from my Windows Phone
________________________________
发件人: Michael Segel<mailto:msegel_hadoop@hotmail.com>
发送时间: 2015/3/25 1:17
收件人: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
主题: Re: Can Pseudo-Distributed Mode take advantage of multi-core structure?
Short answer yes.
> On Mar 24, 2015, at 11:53 AM, Xuzhan Sun <sunxuzhan@outlook.com> wrote:
>
> Hello,
>
> I want to do some test on my single node cluster for Speed. I know it is easy to \
> set up the Pseudo-Distributed Mode, and Hadoop will start one Java process for each \
> single map/reduce.
> My question is: is it parallel enough on multi-core CPU? I mean if I have 4 mappers \
> at the same time while my CPU have 4 cores, will the 4 mappers be running on \
> different cores at the same time?
> I know another way to simulate a Hadoop cluster with one machine is to use virtual \
> machine software such as VMware to simulate multiple machines and set up a cluster \
> upon these virtual machines. What's the difference between the two methods for \
> SPEED and PARALLEL on multi-core structure?
> Thanks,
>
> Xuzhan
[Attachment #3 (unknown)]
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div>
<div style="font-family: Calibri,sans-serif; font-size: 11pt;">So I can set up the \
pseudo distributed mode without virtual machine and get the same performance? Am I \
right?<br> <br>
Sent from my Windows Phone</div>
</div>
<div dir="ltr">
<hr>
<span style="font-family: Calibri,sans-serif; font-size: 11pt; font-weight: \
bold;">发件人: </span><span style="font-family: Calibri,sans-serif; font-size: \
11pt;"><a href="mailto:msegel_hadoop@hotmail.com">Michael Segel</a></span><br> <span \
style="font-family: Calibri,sans-serif; font-size: 11pt; font-weight: \
bold;">发送时间: </span><span style="font-family: Calibri,sans-serif; font-size: \
11pt;">2015/3/25 1:17</span><br> <span style="font-family: \
Calibri,sans-serif; font-size: 11pt; font-weight: bold;">收件人: </span><span \
style="font-family: Calibri,sans-serif; font-size: 11pt;"><a \
href="mailto:user@hadoop.apache.org">user@hadoop.apache.org</a></span><br> <span \
style="font-family: Calibri,sans-serif; font-size: 11pt; font-weight: bold;">主题: \
</span><span style="font-family: Calibri,sans-serif; font-size: 11pt;">Re: Can \
Pseudo-Distributed Mode take advantage of multi-core structure?</span><br> <br>
</div>
<div class="" style="word-wrap:break-word">Short answer yes.<br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Mar 24, 2015, at 11:53 AM, Xuzhan Sun <<a \
href="mailto:sunxuzhan@outlook.com" class="">sunxuzhan@outlook.com</a>> \
wrote:</div> <br class="x_Apple-interchange-newline">
<div class="">
<div dir="ltr" class="" style="font-family:Calibri; font-size:16px; \
font-style:normal; font-variant:normal; font-weight:normal; letter-spacing:normal; \
line-height:normal; orphans:auto; text-align:start; text-indent:0px; \
text-transform:none; white-space:normal; widows:auto; word-spacing:0px"> Hello,
<div dir="ltr" class=""></div>
<div class=""><br class="">
</div>
<div class="">I want to do some test on my single node cluster for Speed. I know it \
is easy to set up the Pseudo-Distributed Mode, and Hadoop will start one Java process \
for each single map/reduce. </div> <div class=""><br class="">
</div>
<div class="">My question is: is it parallel enough on multi-core CPU? I mean if I \
have 4 mappers at the same time while my CPU have 4 cores, will the 4 mappers be \
running on different cores at the same time?</div> <div class=""><br class="">
</div>
<div class="">I know another way to simulate a Hadoop cluster with one machine is to \
use virtual machine software such as VMware to simulate multiple machines and set up \
a cluster upon these virtual machines. What's the difference between the two methods \
for SPEED and PARALLEL on multi-core structure?</div>
<div class=""><br class="">
</div>
<div class="">Thanks,</div>
<div class=""><br class="">
</div>
<div class="">Xuzhan</div>
</div>
</div>
</blockquote>
</div>
<br class="">
<br class="">
</div>
</body>
</html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic