[prev in list] [next in list] [prev in thread] [next in thread] 

List:       freebsd-fs
Subject:    Re: fsck on big UFS filesystems (>100TB)
From:       Stefan Esser <se () freebsd ! org>
Date:       2020-10-14 16:55:11
Message-ID: 1998de69-b381-4258-2654-47fd439c402c () freebsd ! org
[Download RAW message or body]

[Attachment #2 (multipart/mixed)]

[Attachment #4 (multipart/mixed)]


Am 14.10.20 um 18:19 schrieb Nikita Grechikhin:
> Hi, everyone.
> 
> I have several servers with large UFS partitions (>100TB).
> Physically it is RAID-6 on MegaRaid 9361.
> 
> If i try to run fsck on them, i get same error on all servers:
> 
> Code:
> 
> ** Phase 5 - Check Cyl groups
> fsck_ffs: inoinfo: inumber 18446744071562087424 out of range

This number is near minus 2^31 - without having looked at the
code this smells like an integer overflow.
> inumber is exact same on all servers.
> tested on clean and drity filesystems with same result.
> 
> And without succsessful run of fsck i can't remove dirty flag from filesystem
> 
> This is a fresh install of FreeBSD 12.1 and filesystem created in 12.1 from scratch \
> with default options.

The default options assume an average file size of just a few KB,
and I severely doubt you are going to fill 100 TB with small files.

> This is file storage for videoproduction. So, there is not too much files and they \
> is relatively big. 
> Code:
> 
> # find . -type f -print | wc -l
> 251485
> 
> # find . -type d -print | wc -l
> 48351

What fraction of the storage is filled?

You may need to recreate the file system with an appropriate
value if "-i", the number of bytes per inode.

If your files are generally in the order of 1 GB, then you
should try -i 100000000 (i.e. 100 mio to allow for up to
1 million files to have some slack).

> Maybe i doing something wrong?
> 
> Code:
> 
> # uname -a
> FreeBSD *** 12.1-RELEASE FreeBSD 12.1-RELEASE r354233 GENERIC  amd64
> 
> # gpart show mfid3
> => 40  250031243184  mfid3  GPT  (116T)
> 40  250031243184      1  freebsd-ufs  (116T)
> 
> # df -i /mnt/data2
> Filesystem      Size    Used   Avail Capacity iused ifree %iused  Mounted on
> /dev/mfid3p1    116T     15T     91T    14%    300k  3.9G    0%   /mnt/data2

Yes, way too many inodes (4G) - you are wasting space and run
into the fsck issue due to them ...

Regards, STefan


["OpenPGP_signature.asc" (application/pgp-signature)]

[prev in list] [next in list] [prev in thread] [next in thread]