[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lustre-announce
Subject:    RE: [Lustre-discuss] Handbook && "No space left on device"
From:       "Mc Carthy, Fergal" <fergal.mccarthy () hp ! com>
Date:       2005-03-23 9:43:19
Message-ID: 575D0CDD99F591478ADD639EF4E36E7E017D2EA1 () iloexc01 ! emea ! cpqcorp ! net
[Download RAW message or body]

Alessandro,

If you check the recent archives for this mailing list you should find a
mail that asks similar questions which was responded to with useful
info. That would be a good place to start for looking into the ratios.

One thing to consider is adding the "-T news" (or "-i 4096") string as
an mkfsoptions setting to the MDS device. This will cause the device
formatting to allocate many more inodes (1 for every 4k of disk space)
in the MDS device.

Fergal.

--

Fergal.McCarthy@HP.com

(The contents of this message and any attachments to it are confidential
and may be legally privileged. If you have received this message in
error you should delete it from your system immediately and advise the
sender. To any recipient of this message within HP, unless otherwise
stated, you should consider this message and attachments as "HP
CONFIDENTIAL".)


-----Original Message-----
From: lustre-discuss-admin@lists.clusterfs.com
[mailto:lustre-discuss-admin@lists.clusterfs.com] On Behalf Of
Alessandro
Sent: 22 March 2005 16:17
To: lustre-discuss@lists.clusterfs.com
Subject: Re: [Lustre-discuss] Handbook && "No space left on device"

Thanks for  your attention.
Now it seems it's all OK (...)
Do you know which is the ratio between MDS storage space and OST storage

space?
With some tests, it seems to be 1:20 (I need 1GB for the size of the MDS

device to storage 20GB of file data in OST device)
Perhaps it depends by dir structures? Or not?
Where can I find this info? (I think there are not many 'technical-low
level 
document' about Lustre)

----- Original Message ----- 
Subject: RE: [Lustre-discuss] Handbook && "No space left on device"


Alessandro,

I suspect the problem may be the declaration of your MDS device. You
have only allocated 50000k for the size of the MDS loopback device.

As a quick way to verify this, what does df -i say for the Lustre file
system? If it says that there are no free inodes, then that is the
problem.

I would recommend using a larger MDS loopback device.

As for other information sources, I would recommend checking out the
Lustre Wiki (https://wiki.clusterfs.com/lustre) for more info that may
be of help.

Fergal.

--

Fergal.McCarthy@HP.com

(The contents of this message and any attachments to it are confidential
and may be legally privileged. If you have received this message in
error you should delete it from your system immediately and advise the
sender. To any recipient of this message within HP, unless otherwise
stated, you should consider this message and attachments as "HP
CONFIDENTIAL".)


-----Original Message-----
From: lustre-discuss-admin@lists.clusterfs.com
[mailto:lustre-discuss-admin@lists.clusterfs.com] On Behalf Of
Alessandro
Sent: 22 March 2005 13:14
To: lustre-discuss@lists.clusterfs.com
Subject: [Lustre-discuss] Handbook && "No space left on device"

Hi to all,
I use a real disk (a single partition as /dev/sdc1)  as an EXT3 storage
filesystem (about 200GByte).
When I mount to /mnt/lustre, I can copy only a part of what I want, then
I
have a lot of messages:
(example: 'cp -rfv /usr /mnt/lustre')

cp: cannot create directory `/mnt/lustre/usr/libexec': No space left on
device
cp: cannot create directory `/mnt/lustre/usr/sbin': No space left on
device
cp: cannot create directory `/mnt/lustre/usr/share': No space left on
device
cp: cannot create directory `/mnt/lustre/usr/X11R6': No space left on
device
cp: cannot create directory `/mnt/lustre/usr/dict': No space left on
device
cp: cannot create directory `/mnt/lustre/usr/etc': No space left on
device
cp: cannot create directory `/mnt/lustre/usr/games': No space left on
device
.
but df says me I wrote only 1% of /mnt/lustre

Why I cannot write to 50%(for example) of /mnt/lustre?
Which parameters must I configure?
Where can I find an handbook  useful in providing an in-depth
understanding
of Lustre?
 http://www.lustre.org/docs/lustre.pdf  doesn't work!!!

Useful info:
Lustre 1.2.4
Red Hat 9 (kernel Vanilla 2.4.24)

My configuration script:

lmc -o ale.xml --add node --node server_cvs
lmc -m ale.xml --add net --node server_cvs --nid server_cvs --nettype
tcp

# Configure MDS

lmc -m ale.xml --add mds --node server_cvs --mds mds-test --fstype
ext3 --dev /tmp/mds-test --size 50000

# Configure OST

lmc -m ale.xml --add ost --node server_cvs --ost ost1-test --fstype
ext3 --dev /dev/sdc1

# Configure client

lmc -m ale.xml --add mtpt --node server_cvs --path /mnt/lustre --mds
mds-test --ost ost1-test



Ale
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss@lists.clusterfs.com
https://lists.clusterfs.com/mailman/listinfo/lustre-discuss
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss@lists.clusterfs.com
https://lists.clusterfs.com/mailman/listinfo/lustre-discuss
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss@lists.clusterfs.com
https://lists.clusterfs.com/mailman/listinfo/lustre-discuss
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss@lists.clusterfs.com
https://lists.clusterfs.com/mailman/listinfo/lustre-discuss

[prev in list] [next in list] [prev in thread] [next in thread]

Configure | About | News | Add a list | Sponsored by KoreLogic