[prev in list] [next in list] [prev in thread] [next in thread]
List: mesos-user
Subject: Fwd: Crashed when configure Hadoop on Mesos
From: Azuryy Yu <azuryyyu () gmail ! com>
Date: 2013-12-11 8:11:53
Message-ID: CALr1C9r-Vs+QwCV5vrkrUg7zLNUHC603dmn2OwBaPhY76qdaEQ () mail ! gmail ! com
[Download RAW message or body]
Hi,
I download hadoop-mesos from here:
https://github.com/mesos/hadoop
I changed mesos.version to <mesos.version>0.14.2</mesos.version> in the
pom.xml, then build successful.
then I download mesos-0.14.2, and build successfully, I can start mesos
cluster successfully with 3 nodes. I can see all nodes on the webUI.
but when I start jobTracker strictly follow
https://github.com/mesos/hadoop/blob/master/README.md
JobTracker cannot start and throw Exceptions:
13/12/11 15:07:55 INFO mapred.MesosScheduler: Starting MesosScheduler
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007febaee37d09, pid=14013, tid=140650221684480
#
# JRE version: Java(TM) SE Runtime Environment (7.0_45-b18) (build
1.7.0_45-b18)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.45-b08 mixed mode
linux-amd64 compressed oops)
# Problematic frame:
# V [libjvm.so+0x632d09] jni_GetByteArrayElements+0x89
#
# Failed to write core dump. Core dumps have been disabled. To enable core
dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /home/hadoop/hadoop-1.2.1/logs/jt_error_gc.log
#
# If you would like to submit a bug report, please visit:
# http://bugreport.sun.com/bugreport/crash.jsp
*It seems JVM crashed during JNI calling. but who can tell me how to fix
it. Thanks.*
My Java version: 1.7.0_45
hadoop-core : build from the 2.2.0
HDFS is started with HA,
My mapred-site.xml:
<property>
<name>mapred.jobtracker.taskScheduler</name>
<value>org.apache.hadoop.mapred.MesosScheduler</value>
</property>
<property>
<name>mapred.mesos.taskScheduler</name>
<value>org.apache.hadoop.mapred.FairScheduler</value>
</property>
<property>
<name>mapred.mesos.master</name>
<value>webdm.test.com:5050</value>
</property>
<property>
<name>mapred.mesos.executor.uri</name>
<value>hdfs://webdm-cluster/data/mesos/hadoop-2.2.0.tar.gz</value>
</property>
[Attachment #3 (text/html)]
<div dir="ltr"><div class="gmail_quote"><div dir="ltr">Hi, <div>I download \
hadoop-mesos from here:</div><div><a href="https://github.com/mesos/hadoop" \
target="_blank">https://github.com/mesos/hadoop</a><br></div><div><br></div> <div>I \
changed mesos.version to <mesos.version>0.14.2</mesos.version> in the \
pom.xml, then build successful.</div> <div><br></div><div>then I download \
mesos-0.14.2, and build successfully, I can start mesos cluster successfully with 3 \
nodes. I can see all nodes on the webUI.</div><div><br></div><div>but when I start \
jobTracker strictly follow <a \
href="https://github.com/mesos/hadoop/blob/master/README.md" \
target="_blank">https://github.com/mesos/hadoop/blob/master/README.md</a></div>
<div>JobTracker cannot start and throw Exceptions:</div><div><div>13/12/11 15:07:55 \
INFO mapred.MesosScheduler: Starting MesosScheduler</div><div>#</div><div># A fatal \
error has been detected by the Java Runtime Environment:</div>
<div>#</div><div># SIGSEGV (0xb) at pc=0x00007febaee37d09, pid=14013, \
tid=140650221684480</div><div>#</div><div># JRE version: Java(TM) SE Runtime \
Environment (7.0_45-b18) (build 1.7.0_45-b18)</div><div># Java VM: Java HotSpot(TM) \
64-Bit Server VM (24.45-b08 mixed mode linux-amd64 compressed oops)</div>
<div># Problematic frame:</div><div># V [libjvm.so+0x632d09] \
jni_GetByteArrayElements+0x89</div><div>#</div><div># Failed to write core dump. Core \
dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" \
before starting Java again</div>
<div>#</div><div># An error report file with more information is saved \
as:</div><div># /home/hadoop/hadoop-1.2.1/logs/jt_error_gc.log</div><div>#</div><div># \
If you would like to submit a bug report, please visit:</div><div>
# <a href="http://bugreport.sun.com/bugreport/crash.jsp" \
target="_blank">http://bugreport.sun.com/bugreport/crash.jsp</a></div></div><div><br></div><div><b>It \
seems JVM crashed during JNI calling. but who can tell me how to fix it. \
Thanks.</b></div>
<div>My Java version: 1.7.0_45</div><div>hadoop-core : build from the \
2.2.0</div><div>HDFS is started with HA,</div><div><br></div><div>My \
mapred-site.xml:</div><div><div> <property></div><div> \
<name>mapred.jobtracker.taskScheduler</name></div>
<div> <value>org.apache.hadoop.mapred.MesosScheduler</value></div><div> \
</property></div><div> <property></div><div> \
<name>mapred.mesos.taskScheduler</name></div><div> \
<value>org.apache.hadoop.mapred.FairScheduler</value></div>
<div> </property></div><div> <property></div><div> \
<name>mapred.mesos.master</name></div><div> <value><a \
href="http://webdm.test.com:5050" \
target="_blank">webdm.test.com:5050</a></value></div> <div>
</property></div><div> <property></div><div> \
<name>mapred.mesos.executor.uri</name></div><div> \
<value>hdfs://webdm-cluster/data/mesos/hadoop-2.2.0.tar.gz</value></div><div> \
</property></div>
</div><div><br></div></div>
</div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic