[prev in list] [next in list] [prev in thread] [next in thread] 

List:       freebsd-fs
Subject:    Re: ZFS:dmu_objset_find_dp_impl() - panic: vm_fault: fault on nofault entry, addr: fffffe0094653000
From:       Fabian Keil <freebsd-listen () fabiankeil ! de>
Date:       2015-12-23 9:58:37
Message-ID: 20151223105837.53b2c1ae () fabiankeil ! de
[Download RAW message or body]


Fabian Keil <freebsd-listen@fabiankeil.de> wrote:

> Using a kernel based on r292334, I got this panic while importing
> a ZFS pool with vfs.zfs.spa_load_verify_data and
> vfs.zfs.spa_load_verify_metadata set to 0.
> 
> I've not been able to reproduce it yet and the changed sysctl's above
> may not actually matter (but I usually use the defaults).

I unintentionally reproduced it yesterday with the same kernel
using the default values for the sysctls above.

> The pool has a single leaf vdev that is backed by ggatec which transfers the
> data over a slow and easily saturated connection (< ~120 kB/s up). Graph:
> https://www.fabiankeil.de/talks/versteckter-block-speicher/mgp00030.html
> 
> fk@r500 /usr/crash $kgdb /usr/lib/debug/boot/kernel/kernel.debug vmcore.2 
> [...]
> Unread portion of the kernel message buffer:
> [11912] panic: vm_fault: fault on nofault entry, addr: fffffe0094653000
> [11912] cpuid = 0
> [11912] KDB: stack backtrace:
> [...]
> #0  doadump (textdump=0) at pcpu.h:221
> 221	pcpu.h: No such file or directory.
> 	in pcpu.h
> (kgdb) where
> #0  doadump (textdump=0) at pcpu.h:221
> #1  0xffffffff8031752b in db_dump (dummy=<value optimized out>, dummy2=false, \
> dummy3=0, dummy4=0x0) at /usr/src/sys/ddb/db_command.c:533 #2  0xffffffff8031731e \
> in db_command (cmd_table=0x0) at /usr/src/sys/ddb/db_command.c:440 #3  \
> 0xffffffff803170b4 in db_command_loop () at /usr/src/sys/ddb/db_command.c:493 #4  \
> 0xffffffff80319bbb in db_trap (type=<value optimized out>, code=0) at \
> /usr/src/sys/ddb/db_main.c:251 #5  0xffffffff805e2dc3 in kdb_trap (type=3, code=0, \
> tf=<value optimized out>) at /usr/src/sys/kern/subr_kdb.c:654 #6  \
> 0xffffffff8087f207 in trap (frame=0xfffffe0094f8f220) at \
> /usr/src/sys/amd64/amd64/trap.c:549 #7  0xffffffff808641b7 in calltrap () at \
> /usr/src/sys/amd64/amd64/exception.S:234 #8  0xffffffff805e24ab in kdb_enter \
> (why=0xffffffff8097216b "panic", msg=0x32 <Address 0x32 out of bounds>) at \
> cpufunc.h:63 #9  0xffffffff8059ea4f in vpanic (fmt=<value optimized out>, ap=<value \
> optimized out>) at /usr/src/sys/kern/kern_shutdown.c:750 #10 0xffffffff8059e8a3 in \
> panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:688 #11 0xffffffff80835650 in \
> vm_fault_hold (map=<value optimized out>, vaddr=<value optimized out>, \
> fault_type=<value optimized out>, fault_flags=<value optimized out>, m_hold=<value \
> optimized out>) at /usr/src/sys/vm/vm_fault.c:332
> #12 0xffffffff808332f8 in vm_fault (map=0xfffff80002000000, vaddr=<value optimized \
> out>, fault_type=1 '\001', fault_flags=0) at /usr/src/sys/vm/vm_fault.c:277 #13 \
> 0xffffffff8087f97a in trap_pfault (frame=0xfffffe0094f8f8d0, usermode=0) at \
> /usr/src/sys/amd64/amd64/trap.c:734 #14 0xffffffff8087f21e in trap \
> (frame=0xfffffe0094f8f8d0) at /usr/src/sys/amd64/amd64/trap.c:435 #15 \
> 0xffffffff808641b7 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:234 #16 \
> 0xffffffff81900c9a in dmu_objset_find_dp_impl (dcp=0xfffff80078cb0200) at \
> /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1630 #17 \
> 0xffffffff81901189 in dmu_objset_find_dp_cb (arg=0xfffff80078cb0200) at \
> /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1746
[...]
> Given the location of the trap, this could be a regression caused
> by the import of illumos #5269 (zpool import slow) in r286686:
> https://svnweb.freebsd.org/base?view=revision&revision=r286686

On the other hand I've never seen the issue with previous kernels
and two times with the one based on r292334.

I've updated to a kernel based on r292616 to see if it makes a difference
(there were quite a few vm changes).

Fabian


[Attachment #3 (application/pgp-signature)]

[prev in list] [next in list] [prev in thread] [next in thread]