[prev in list] [next in list] [prev in thread] [next in thread]
List: npaci-rocks-discussion
Subject: Re: [Rocks-Discuss]"not" shared libraries?
From: Larry Baker <baker () usgs ! gov>
Date: 2006-03-29 21:44:19
Message-ID: 06F7A573-1CCC-4474-AF0A-12ADCF22D3B5 () usgs ! gov
[Download RAW message or body]
On Mar 29, 2006, at 12:28 PM, Chuming Chen wrote:
> This is the way I handled my non-roll, non-rpm software packages.
> Which file is a good place to add those local customized
> configuration on the frontend node? so when a new node is built,
> they are automatically set up.
>
> - Chuming
>
Below are the last set of instructions I wrote to distribute the
Intel compiler shared libraries (from /opt/intel/...) and shell
initialization scripts (from /etc/profile.d/) from the front end to
the compute nodes. You could use similar instructions for the run-
time components of any package. I made use of the /share/apps file
system which is already shared by the front end to all the compute
nodes during the node installation process. I manually created tar
"distribution kits" under /share/apps/intel/fc and /share/apps/intel/
cc for the Fortran and C/C++ files, respectively, when I installed
the compilers. Then I created a custom /home/install/site-profiles/
4.1/nodes/extend-compute.xml to setup the run-time environment for
the Intel compilers on each compute node using those tar files.
After that, any time a compute node is reinstalled, the Intel run-
time environment gets automatically set up again.
Larry Baker
US Geological Survey
650-329-5608
baker@usgs.gov
Make copies of the Intel shared run-time libraries and login shell
scripts for the compute nodes:
# mkdir –p /share/apps/intel/fc
# cd /opt/intel/fc
# tar –czf /share/apps/intel/fc/libs.tar.gz */lib/*.so*
# tar –czf /share/apps/intel/fc/vars.tar.gz */bin/ifortvars.*
# cd /etc/profile.d
# tar –czf /share/apps/intel/fc/profiles.tar.gz ifort.*
# mkdir –p /share/apps/intel/cc
# cd /opt/intel/cc
# tar –czf /share/apps/intel/cc/libs.tar.gz */lib/*.so*
# tar –czf /share/apps/intel/cc/vars.tar.gz */bin/iccvars.*
# cd /etc/profile.d
# tar –czf /share/apps/intel/cc/profiles.tar.gz icc.*
Setup the Rocks compute node configuration to install the Intel
shared run-time libraries and login shell scripts (assuming /state/
partition1/apps is automounted as /share/apps):
# cd /home/install/site-profiles/4.1/nodes
# cp skeleton.xml extend-compute.xml
# vi extend-compute.xml
:
<post>
<!-- Intel Compilers Setup -->
/bin/mount –t nfs –r \
<var name=” Kickstart_PrivateAddress”/>:/state/partition1 /mnt
/bin/mkdir –p /opt/intel/fc
cd /opt/intel/fc ; /bin/tar –xzpf /mnt/apps/intel/fc/libs.tar.gz
cd /opt/intel/fc ; /bin/tar –xzpf /mnt/apps/intel/fc/vars.tar.gz
cd /etc/profile.d ; /bin/tar –xzpf /mnt/apps/intel/fc/profiles.tar.gz
/bin/mkdir –p /opt/intel/cc
cd /opt/intel/cc ; /bin/tar –xzpf /mnt/apps/intel/cc/libs.tar.gz
cd /opt/intel/cc ; /bin/tar –xzpf /mnt/apps/intel/cc/vars.tar.gz
cd /etc/profile.d ; /bin/tar –xzpf /mnt/apps/intel/cc/profiles.tar.gz
/bin/umount /mnt
</post>
:
# cd /home/install
# rocks-dist dist
Reinstall the compute nodes.
[Attachment #3 (unknown)]
<HTML><BODY style="word-wrap: break-word; -khtml-nbsp-mode: space; -khtml-line-break: \
after-white-space; "><DIV><DIV>On Mar 29, 2006, at 12:28 PM, Chuming Chen \
wrote:</DIV><BR class="Apple-interchange-newline"><BLOCKQUOTE type="cite"><DIV \
style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; \
">This is the way I handled my non-roll, non-rpm software packages. Which file is a \
good place to add those local customized configuration on the frontend node? so when \
a new node is built, they are automatically set up.</DIV><DIV style="margin-top: 0px; \
margin-right: 0px; margin-bottom: 0px; margin-left: 0px; min-height: 14px; \
"><BR></DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; \
margin-left: 0px; ">- Chuming</DIV><DIV style="margin-top: 0px; margin-right: 0px; \
margin-bottom: 0px; margin-left: 0px; min-height: 14px; "><BR></DIV> <BLOCKQUOTE \
type="cite"></BLOCKQUOTE></BLOCKQUOTE><DIV><BR \
class="khtml-block-placeholder"></DIV>Below are the last set of instructions I wrote \
to distribute the Intel compiler shared libraries (from /opt/intel/...) and shell \
initialization scripts (from /etc/profile.d/) from the front end to the compute \
nodes. You could use similar instructions for the run-time components of any \
package. I made use of the /share/apps file system which is already shared by the \
front end to all the compute nodes during the node installation process. I manually \
created tar "distribution kits" under /share/apps/intel/fc and /share/apps/intel/cc \
for the Fortran and C/C++ files, respectively, when I installed the compilers. Then \
I created a custom /home/install/site-profiles/4.1/nodes/extend-compute.xml to setup \
the run-time environment for the Intel compilers on each compute node using those tar \
files. After that, any time a compute node is reinstalled, the Intel run-time \
environment gets automatically set up again.<BR><BR></DIV><DIV \
class="MsoNormal"><DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: \
0px; margin-left: 0px; ">Larry Baker</DIV><DIV style="margin-top: 0px; margin-right: \
0px; margin-bottom: 0px; margin-left: 0px; ">US Geological Survey</DIV><DIV \
style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; \
">650-329-5608</DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: \
0px; margin-left: 0px; "><A href="mailto:baker@usgs.gov">baker@usgs.gov</A></DIV><DIV \
style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; \
"><BR class="khtml-block-placeholder"></DIV></DIV></DIV><DIV class="MsoNormal"><FONT \
class="Apple-style-span" face="Geneva" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><BR \
class="khtml-block-placeholder"></SPAN></FONT></DIV><DIV class="MsoNormal"><SPAN \
style=""><FONT class="Apple-style-span" face="Geneva" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;">Make copies of the Intel \
shared run-time libraries and login shell scripts for the compute \
nodes:</SPAN></FONT><FONT class="Apple-style-span" face="Geneva" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><DIV class="MsoNormal"><SPAN \
style=""><FONT class="Apple-style-span" face="Geneva" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;"> </SPAN></FONT><FONT \
class="Apple-style-span" face="Geneva" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># mkdir –p /share/apps/intel/fc</SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># cd /opt/intel/fc</SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># tar –czf /share/apps/intel/fc/libs.tar.gz \
*/lib/*.so*</SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># tar –czf \
/share/apps/intel/fc/vars.tar.gz */bin/ifortvars.*</SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># cd /etc/profile.d</SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># tar –czf /share/apps/intel/fc/profiles.tar.gz \
ifort.*</SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># mkdir –p \
/share/apps/intel/cc</SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># cd \
/opt/intel/cc</SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># tar –czf \
/share/apps/intel/cc/libs.tar.gz */lib/*.so*</SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># tar –czf /share/apps/intel/cc/vars.tar.gz \
*/bin/iccvars.*</SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># cd \
/etc/profile.d</SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># tar –czf \
/share/apps/intel/cc/profiles.tar.gz icc.*</SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><DIV \
class="MsoNormal"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><DIV class="MsoNormal"><SPAN \
style=""><FONT class="Apple-style-span" face="Geneva" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;">Setup the Rocks compute node \
configuration to install the Intel shared run-time libraries and login shell scripts \
(assuming</SPAN></FONT><SPAN style="mso-spacerun: yes"><FONT class="Apple-style-span" \
face="Geneva" size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT></SPAN></SPAN><SPAN style=""><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;">/state/partition1/apps</SPAN></FONT></SPAN><SPAN style=""><FONT \
class="Apple-style-span" face="Geneva" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"> is automounted as</SPAN></FONT></SPAN><SPAN \
style=""><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;"> \
/share/apps</SPAN></FONT></SPAN><SPAN style=""><FONT class="Apple-style-span" \
face="Geneva" size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;">):</SPAN></FONT><FONT class="Apple-style-span" face="Geneva" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><DIV class="MsoNormal"><SPAN \
style=""><FONT class="Apple-style-span" face="Geneva" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;"> </SPAN></FONT><FONT \
class="Apple-style-span" face="Geneva" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><P \
class="MsoNormal" style="margin-left:.5in"><SPAN style=""><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"># cd \
/home/install/site-profiles/4.1/nodes</SPAN></FONT><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># cp \
skeleton.xml extend-compute.xml</SPAN></FONT><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"># vi \
extend-compute.xml</SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;">:</SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><post></SPAN></FONT><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><P class="MsoNormal" \
style="margin-left:.5in"><SPAN style=""><FONT class="Apple-style-span" face="Courier" \
size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></P><DIV style="margin-top: 0in; \
margin-right: -1in; margin-left: 0.5in; margin-bottom: 0.0001pt; "><SPAN \
style=""><SPAN style="mso-spacerun: yes"><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT></SPAN><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;"><!-- Intel Compilers Setup \
--></SPAN></FONT><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><DIV style="margin-top: 0in; \
margin-right: -1in; margin-left: 0.5in; margin-bottom: 0.0001pt; "><SPAN \
style=""><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;"> </SPAN></FONT><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><DIV \
style="margin-top: 0in; margin-right: -1in; margin-left: 0.5in; margin-bottom: \
0.0001pt; "><SPAN style=""><SPAN style="mso-spacerun: yes"><FONT \
class="Apple-style-span" face="Courier" size="4"><SPAN class="Apple-style-span" \
style="font-size: 13.3333px;"> </SPAN></FONT></SPAN><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;">/bin/mount –t nfs –r \</SPAN></FONT><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: \
13.3333px;"><O:P></O:P></SPAN></FONT></SPAN></DIV><DIV style="margin-top: 0in; \
margin-right: -0.5in; margin-left: 0.5in; margin-bottom: 0.0001pt; "><SPAN \
style=""><SPAN style="mso-spacerun: yes"><FONT class="Apple-style-span" \
face="Courier" size="4"><SPAN class="Apple-style-span" style="font-size: 13.3333px;"> \
</SPAN></FONT></SPAN><FONT class="Apple-style-span" face="Courier" size="4"><SPAN \
class="Apple-style-span" style="font-size: 13.3333px;"><var \
name=”</SPAN></FONT></SPAN> <SPAN style=""><FONT class="Apple-style-span" \
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic