[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: Re: issue about enable UseNUMA flag in hadoop framework
From: "Grant Overby (groverby)" <groverby () cisco ! com>
Date: 2015-09-21 15:18:11
Message-ID: D22597C2.1E583%groverby () cisco ! com
[Download RAW message or body]
UseNUMA isn't supported by all garbage collectors.
CMS is not supported
G1 is supported
Not sure about others
[http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726]
Grant Overby
Software Engineer
Cisco.com<http://www.cisco.com/>
groverby@cisco.com<mailto:groverby@cisco.com>
Mobile: 865 724 4910
[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print.
This email may contain confidential and privileged material for the sole use of the \
intended recipient. Any review, use, distribution or disclosure by others is strictly \
prohibited. If you are not the intended recipient (or authorized to receive for the \
recipient), please contact the sender by reply email and delete all copies of this \
message.
Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> \
for Company Registration Information.
From: Zhudacai <zhudacai@hisilicon.com<mailto:zhudacai@hisilicon.com>>
Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" \
<user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Date: Saturday, September 19, 2015 at 4:42 AM
To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" \
<user@hadoop.apache.org<mailto:user@hadoop.apache.org>>, \
"general@hadoop.apache.org<mailto:general@hadoop.apache.org>" \
<general@hadoop.apache.org<mailto:general@hadoop.apache.org>>, \
"common-issues@hadoop.apache.org<mailto:common-issues@hadoop.apache.org>" \
<common-issues@hadoop.apache.org<mailto:common-issues@hadoop.apache.org>>, \
"yarn-issues@hadoop.apache.org<mailto:yarn-issues@hadoop.apache.org>" \
<yarn-issues@hadoop.apache.org<mailto:yarn-issues@hadoop.apache.org>>, \
"mapreduce-issues@hadoop.apache.org<mailto:mapreduce-issues@hadoop.apache.org>." \
<mapreduce-issues@hadoop.apache.org<mailto:mapreduce-issues@hadoop.apache.org>>
Cc: "dongbo (E)" <dongbo4@huawei.com<mailto:dongbo4@huawei.com>>, Zhanweitao \
<zhanweitao@hisilicon.com<mailto:zhanweitao@hisilicon.com>>
Subject: issue about enable UseNUMA flag in hadoop framework
Hi,ALL
We get a problem about enable UseNUMA flag for my hadoop framework.
We've tried to specify JVM flags during hadoop daemon's starts,
e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote \
$HADOOP_NAMENODE_OPTS", export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA \
-Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc. But the ratio \
between local and remote memory access is 2:1, just remains as same as before.
Then we find that hadoop MapReduce start child JVM processes to run task in \
containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter \
child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), \
seems that hadoop does not support this JVM parameter.
What should we do to enable UseNUMA flag for my hadoop? Or what should we do to \
decrease the local/remote memory access in NUMA framework? Should we just change \
Hadoop script or resorts to source code? And how to do it?
The hadoop version is 2.6.0.
Best Regards.
Dacai
[Attachment #3 (text/html)]
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: \
after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, \
sans-serif;"> <div>
<div>
<div>UseNUMA isn’t supported by all garbage collectors.</div>
<div><br>
</div>
<div>CMS is not supported</div>
<div>G1 is supported</div>
<div>Not sure about others</div>
<div><br>
</div>
<div>
<div>
<table border="0" cellpadding="0" cellspacing="0" width="543">
<tbody>
<tr>
<td>
<table border="0" cellpadding="0" cellspacing="0" width="543">
<tbody>
<tr>
<td colspan="3"><img \
src="http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726" \
height="73" width="110"></td> </tr>
<tr>
<td align="left" nowrap="nowrap" valign="top" style="padding-left: 24px; \
padding-bottom: 0px;"> <p style="font-family: Arial, Helvetica, sans-serif; \
font-size: 11px; color: rgb(102, 102, 102);"> <strong>Grant Overby</strong><br>
Software Engineer<br>
<a href="http://www.cisco.com/" style="white-space: normal; color: rgb(102, 102, \
102);">Cisco.com</a><br> <a href="mailto:groverby@cisco.com" style="color: rgb(102, \
102, 102); text-decoration: none;">groverby@cisco.com</a><br> \
Mobile: <strong>865 724 4910</strong><br> </p>
</td>
<td valign="top" width="50%" style="padding-left: 20px; padding-bottom: 10px; \
padding-top: 15px;"> <p style="font-family: Arial, Helvetica, sans-serif; font-size: \
11px; color: rgb(102, 102, 102);"> <strong></strong><br>
<br>
</p>
</td>
</tr>
<tr>
<td colspan="3"></td>
</tr>
</tbody>
</table>
<table border="0" cellpadding="0" cellspacing="0" width="400">
<tbody>
<tr>
<td style="font-family: Arial, Helvetica, sans-serif; font-size: 10px; padding: 5px \
20px 0px 24px; color: rgb(0, 153, 0);"> <img \
src="http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif" alt=""> Think \
before you print.</td> </tr>
<tr>
<td style="font-family: Arial, Helvetica, sans-serif; font-size: 10px; color: \
rgb(153, 153, 153); padding: 7px 20px 6px 24px;"> <p>This email may contain \
confidential and privileged material for the sole use of the intended recipient. Any \
review, use, distribution or disclosure by others is strictly prohibited. If you are \
not the intended recipient (or authorized to receive for the recipient), please \
contact the sender by reply email and delete all copies of this message.</p> \
<p>Please <a href="http://www.cisco.com/web/about/doing_business/legal/cri/index.html" \
title="Legal Information" style="color: rgb(14, 88, 160);">click here</a> for \
Company Registration Information.</p> <p></p>
</td>
</tr>
</tbody>
</table>
<br>
</td>
</tr>
</tbody>
</table>
</div>
<br>
</div>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; \
BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; \
PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: \
medium none; PADDING-TOP: 3pt"> <span style="font-weight:bold">From: </span>Zhudacai \
<<a href="mailto:zhudacai@hisilicon.com">zhudacai@hisilicon.com</a>><br> <span \
style="font-weight:bold">Reply-To: </span>"<a \
href="mailto:user@hadoop.apache.org">user@hadoop.apache.org</a>" <<a \
href="mailto:user@hadoop.apache.org">user@hadoop.apache.org</a>><br> <span \
style="font-weight:bold">Date: </span>Saturday, September 19, 2015 at 4:42 AM<br> \
<span style="font-weight:bold">To: </span>"<a \
href="mailto:user@hadoop.apache.org">user@hadoop.apache.org</a>" <<a \
href="mailto:user@hadoop.apache.org">user@hadoop.apache.org</a>>, "<a \
href="mailto:general@hadoop.apache.org">general@hadoop.apache.org</a>" <<a \
href="mailto:general@hadoop.apache.org">general@hadoop.apache.org</a>>, "<a \
href="mailto:common-issues@hadoop.apache.org">common-issues@hadoop.apache.org</a>" \
<<a href="mailto:common-issues@hadoop.apache.org">common-issues@hadoop.apache.org</a>>, \
"<a href="mailto:yarn-issues@hadoop.apache.org">yarn-issues@hadoop.apache.org</a>"
<<a href="mailto:yarn-issues@hadoop.apache.org">yarn-issues@hadoop.apache.org</a>>, \
"<a href="mailto:mapreduce-issues@hadoop.apache.org">mapreduce-issues@hadoop.apache.org</a>." \
<<a href="mailto:mapreduce-issues@hadoop.apache.org">mapreduce-issues@hadoop.apache.org</a>><br>
<span style="font-weight:bold">Cc: </span>"dongbo (E)" <<a \
href="mailto:dongbo4@huawei.com">dongbo4@huawei.com</a>>, Zhanweitao <<a \
href="mailto:zhanweitao@hisilicon.com">zhanweitao@hisilicon.com</a>><br> <span \
style="font-weight:bold">Subject: </span>issue about enable UseNUMA flag in hadoop \
framework<br> </div>
<div><br>
</div>
<div xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <meta name="Generator" content="Microsoft \
Word 12 (filtered medium)"> <style><!--
/* Font Definitions */
@font-face
{font-family:\5B8B\4F53;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@\5B8B\4F53";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
text-align:justify;
text-justify:inter-ideograph;
font-size:10.5pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"\7EAF\6587\672C Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.5pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.Char
{mso-style-name:"\7EAF\6587\672C Char";
mso-style-priority:99;
mso-style-link:\7EAF\6587\672C;
font-family:"Calibri","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;}
/* Page Definitions */
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div lang="ZH-CN" link="blue" vlink="purple" style="text-justify-trim:punctuation">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi,ALL <o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US">We get a problem about enable UseNUMA flag \
for my hadoop framework.<o:p></o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US">We've tried to specify JVM flags during hadoop daemon's starts, \
<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US">e.g. export \
HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote \
$HADOOP_NAMENODE_OPTS", <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">export \
HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote \
$HADOOP_SECONDARYNAMENODE_OPTS", etc. <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">But the ratio between local and remote memory \
access is 2:1, just remains as same as before.<o:p></o:p></span></p> <p \
class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p> <p \
class="MsoNormal"><span lang="EN-US">Then we find that hadoop MapReduce start child \
JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set \
theting configuration parameter child.java.opts. But hadoop starts to throw \
ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM \
parameter.<o:p></o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US">What should we do to enable UseNUMA flag for my hadoop? Or what should \
we do to decrease the local/remote memory access in NUMA framework? Should we just \
change Hadoop script or resorts to source code? And how to do it? \
<o:p></o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US">The \
hadoop version is 2.6.0.<o:p></o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US">Best Regards.<o:p></o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span \
lang="EN-US">Dacai<o:p></o:p></span></p> </div>
</div>
</div>
</span>
</body>
</html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic