[prev in list] [next in list] [prev in thread] [next in thread] 

List:       grid-engine-users
Subject:    ClearCase&SGE:  How to optimize a clearcase build by SGE's qmake ?
From:       "T.J. Yang" <tj_yang () hotmail ! com>
Date:       2003-03-31 2:22:18
Message-ID: F47yKKcY3sS0DPwtUHP000249e4 () hotmail ! com
[Download RAW message or body]

1. here is a clearcase make job running in SGE queue.
y17438@tt2001> qstat -f
queuename            qtype used/tot. load_avg arch      states
----------------------------------------------------------------------------
liad9233.q           BIP   0/4       0.04     solaris64
----------------------------------------------------------------------------
liad9238.q           BIP   0/4       0.01     solaris64
----------------------------------------------------------------------------
liad9239.q           BIP   0/4       1.00     solaris64
----------------------------------------------------------------------------
tr222.q              BIP   0/4       0.02     solaris
----------------------------------------------------------------------------
tt2001.q             BIP   1/8       0.10     solaris
    134     0 ed.ksh     y17438       r     03/30/2003 18:34:55 MASTER
y17438@tt2001>

As you can see it only using 1 of 8 CPUs, and job 134 only has the load_avg 
as 0.10.

2. the job was sumbitted by following ed.ksh script.

y17438-tjyang@tt2001> cat ed.ksh
#!/bin/ksh
#$ -S /bin/ksh
#$ -o /home/y17438/sgetest/ed.ksh.stdout -e 
/home/y17438/sgetest/ed.ksh.stderr
if [ "$1" != "view_set" ]; then
   /usr/atria/bin/cleartool setview -exec '/home/y17438/sgetest/ed.ksh 
view_set' y17438_tt223_1_sol.view
else
     cd /vobs/mz.pr/make.su/obj
     /usr/atria/bin/clearmake -dOVv all
fi
y17438-tjyang@tt2001>

3. What about if I replace clearmake with qmake to have qmake
   parse the Makefile and distribute the independent tasks
   to be run a 8 CPUs at the same time ?

4. here is the modified ed.ksh using  qmake  instead of clearmake.

y17438@tt2001> cat ed.ksh
#!/bin/ksh
#$ -S /bin/ksh
#$ -o /home/y17438/sgetest/ed.ksh.stdout -e 
/home/y17438/sgetest/ed.ksh.stderr
#export SGE_ROOT=/opt/sge

if [ "$1" != "view_set" ]; then
   /usr/atria/bin/cleartool setview -exec '/home/y17438/sgetest/ed.ksh 
view_set' y17438_tt223_1_sol.view
else
     cd /vobs/mz.pr/make.su/obj
#     /usr/atria/bin/clearmake -dOVv all
    export  ARCH=solaris;/opt/sge/solaris/qmake -q tt2001.q -cwd -v PATH -pe 
make 8 -- all
fi
y17438@tt2001>

5. Unfortunately, I am running into stty problem again. I believe I already
   did the "stty fix" in my .profile already.
   Went on to google and fount this link  about "stty: No such device or 
address".

   
http://216.239.53.100/search?q=cache:l3HzUfiiIQwC:www.netsys.com/sunmgr/1997-01/msg00187.html+stty:+:+No+such+device+or+address&hl=en&ie=UTF-8


   Later  I even take out all
   the stty command in ~/.profile !!

y17438@tt2001> grep stty ~/.profile
y17438@tt2001>

6. Here is the error message from std* log files.
y17438@tt2001> more ed.ksh.std*
> > > > > > > > > > > > > > 
ed.ksh.stderr
> > > > > > > > > > > > > > 
stty: : No such device or address <--- where is stty problem coming from ?
Your "qrsh" request could not be scheduled, try again later.
> > > > > > > > > > > > > > 
ed.ksh.stdout
> > > > > > > > > > > > > > 
Sun Microsystems Inc.   SunOS 5.6       Generic August 1997

Running .profile...

TERM = sun
running . /opt/sge/settings.sh for SGE
Logged out at Sun Mar 30 19:38:18 CST 2003
y17438@tt2001>


T.J. Yang




_________________________________________________________________
Add photos to your messages with MSN 8. Get 2 months FREE*.  
http://join.msn.com/?page=features/featuredemail


[prev in list] [next in list] [prev in thread] [next in thread]