Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 23 Jan 2001 13:41:37 +0000 (GMT)
From:      Andrew Gordon <arg@arg1.demon.co.uk>
To:        freebsd-stable@freebsd.org
Subject:   softupdates/NFS/vinum(?) panics
Message-ID:  <Pine.BSF.4.21.0101231328300.32276-100000@server.arg.sj.co.uk>

next in thread | raw e-mail | index | archive | help

I have been getting frequent panics:

   softdep_lock: locking against myself

These have been occurring since an incident on 16th January, where the
SCSI cable was accidentally unplugged on a running system, and vinum had
trouble recovering.  That incident almost certainly caused some arbitrary
corruption to the filesystem; however, there is no obvious vinum
involvement in the more recent panics (except that the filesystem in
question is almost certainly the vinum one, as the other filesystems on
this machine are almost unused).

This suggests either:

1) The big crash left some corruption that fsck can't see but causes
   subsequent problems.
2) There is some vinum interaction that happens to have been arisen
   around this time (the filesystem has been growing gradually from
   25% full when the system was commissioned in November to 50% now)
3) There is some softupdates problem unrelated to vinum.

For most of the period, the system has been running a kernel built from
-stable as at 1st January; over the weekend I upgraded to -stable (cvsup
on Friday 19th), but we've had 3 crashes this morning so that doesn't
appear to have helped.

All the dumps are rather similar, apparently serving an NFS write; here's
the latest one, and an older one:


IdlePTD 3162112
initial pcb at 2838e0
panicstr: softdep_lock: locking against myself
panic messages:
---
panic: allocdirect_check: old 59099240 != new 59099240 || lbn 1 >= 12

(kgdb) where
#0  dumpsys () at ../../kern/kern_shutdown.c:469
#1  0xc014ea8b in boot (howto=260) at ../../kern/kern_shutdown.c:309
#2  0xc014ee08 in poweroff_wait (junk=0xc02545c0, howto=-1025022464)
    at ../../kern/kern_shutdown.c:556
#3  0xc01e7cf1 in acquire_lock (lk=0xc0277fdc)
    at ../../ufs/ffs/ffs_softdep.c:263
#4  0xc01ebac4 in softdep_update_inodeblock (ip=0xc2e76600, bp=0xc7bf59b0, 
    waitfor=0) at ../../ufs/ffs/ffs_softdep.c:3643
#5  0xc01e6fed in ffs_update (vp=0xcfbabe00, waitfor=0)
    at ../../ufs/ffs/ffs_inode.c:106
#6  0xc01eed50 in ffs_sync (mp=0xc28da400, waitfor=2, cred=0xc0a3b900, 
    p=0xc0297c20) at ../../ufs/ffs/ffs_vfsops.c:987
#7  0xc017c587 in sync (p=0xc0297c20, uap=0x0) at ../../kern/vfs_syscalls.c:545
#8  0xc014e85e in boot (howto=256) at ../../kern/kern_shutdown.c:233
#9  0xc014ee08 in poweroff_wait (junk=0xc0254be0, howto=59099240)
    at ../../kern/kern_shutdown.c:556
#10 0xc01e8eff in allocdirect_merge (adphead=0xc2f04c44, newadp=0xc2cc7f80, 
    oldadp=0xc2cd3200) at ../../ufs/ffs/ffs_softdep.c:1323
#11 0xc01ebc7d in merge_inode_lists (inodedep=0xc2f04c00)
    at ../../ufs/ffs/ffs_softdep.c:3718
#12 0xc01ebb43 in softdep_update_inodeblock (ip=0xc2eb3d00, bp=0xc7b9fee4, 
    waitfor=1) at ../../ufs/ffs/ffs_softdep.c:3665
#13 0xc01e6fed in ffs_update (vp=0xcfbe9600, waitfor=1)
    at ../../ufs/ffs/ffs_inode.c:106
#14 0xc01efcde in ffs_write (ap=0xcfb3bc88)
    at ../../ufs/ufs/ufs_readwrite.c:544
#15 0xc01b09f4 in nfsrv_write (nfsd=0xc2eb3a00, slp=0xc2ce3200, 
    procp=0xce781400, mrq=0xcfb3bdfc) at vnode_if.h:363
#16 0xc01c7c9a in nfssvc_nfsd (nsd=0xcfb3be5c, argp=0x807c4a0 "", p=0xce781400)
    at ../../nfs/nfs_syscalls.c:602
#17 0xc01c75ef in nfssvc (p=0xce781400, uap=0xcfb3bf80)
    at ../../nfs/nfs_syscalls.c:306
#18 0xc022cb31 in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47, 
      tf_edi = 0, tf_esi = 0, tf_ebp = -1077936788, tf_isp = -810303532, 
      tf_ebx = 4, tf_edx = 1, tf_ecx = -3, tf_eax = 155, tf_trapno = 12, 
      tf_err = 2, tf_eip = 134518292, tf_cs = 31, tf_eflags = 647, 
      tf_esp = -1077937216, tf_ss = 47}) at ../../i386/i386/trap.c:1150
#19 0xc0221995 in Xint0x80_syscall ()
#20 0x8048135 in ?? ()
(kgdb) 


Sample dump from January 1st kernel:

IdlePTD 3158016
initial pcb at 2823c0
panicstr: softdep_lock: locking against myself
panic messages:
---
panic: allocdirect_check: old 36273280 != new 36273280 || lbn 4 >= 12

syncing disks... panic: softdep_lock: locking against myself

(kgdb) where
#0  dumpsys () at ../../kern/kern_shutdown.c:469
#1  0xc014db3f in boot (howto=260) at ../../kern/kern_shutdown.c:309
#2  0xc014debc in poweroff_wait (junk=0xc0253200, howto=0)
    at ../../kern/kern_shutdown.c:556
#3  0xc01e6b2d in acquire_lock (lk=0xc0276a7c)
    at ../../ufs/ffs/ffs_softdep.c:263
#4  0xc01eade6 in softdep_fsync_mountdev (vp=0xce77a3c0)
    at ../../ufs/ffs/ffs_softdep.c:3846
#5  0xc01eeef2 in ffs_fsync (ap=0xcfb39a80) at ../../ufs/ffs/ffs_vnops.c:134
#6  0xc01edbfa in ffs_sync (mp=0xc29d7000, waitfor=2, cred=0xc0a3b900, 
    p=0xc02966c0) at vnode_if.h:537
#7  0xc017b41f in sync (p=0xc02966c0, uap=0x0) at ../../kern/vfs_syscalls.c:545
#8  0xc014d91a in boot (howto=256) at ../../kern/kern_shutdown.c:233
#9  0xc014debc in poweroff_wait (junk=0xc0253820, howto=36273280)
    at ../../kern/kern_shutdown.c:556
#10 0xc01e7d3b in allocdirect_merge (adphead=0xc2b30244, newadp=0xc305c100, 
    oldadp=0xc305c580) at ../../ufs/ffs/ffs_softdep.c:1323
#11 0xc01eaab9 in merge_inode_lists (inodedep=0xc2b30200)
    at ../../ufs/ffs/ffs_softdep.c:3718
#12 0xc01ea97f in softdep_update_inodeblock (ip=0xc305fb00, bp=0xc7b80088, 
    waitfor=1) at ../../ufs/ffs/ffs_softdep.c:3665
#13 0xc01e5e29 in ffs_update (vp=0xcfdaecc0, waitfor=1)
    at ../../ufs/ffs/ffs_inode.c:106
#14 0xc01eeb1a in ffs_write (ap=0xcfb39c88)
    at ../../ufs/ufs/ufs_readwrite.c:542
#15 0xc01af86c in nfsrv_write (nfsd=0xc3020e00, slp=0xc2b1e900, 
    procp=0xce77f400, mrq=0xcfb39dfc) at vnode_if.h:363
#16 0xc01c6b12 in nfssvc_nfsd (nsd=0xcfb39e5c, argp=0x807c4a0 "", p=0xce77f400)
    at ../../nfs/nfs_syscalls.c:602
#17 0xc01c6467 in nfssvc (p=0xce77f400, uap=0xcfb39f80)
    at ../../nfs/nfs_syscalls.c:306
#18 0xc022b909 in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47, 
      tf_edi = 0, tf_esi = 0, tf_ebp = -1077936788, tf_isp = -810311724, 
      tf_ebx = 4, tf_edx = 1, tf_ecx = -3, tf_eax = 155, tf_trapno = 12, 
      tf_err = 2, tf_eip = 134518292, tf_cs = 31, tf_eflags = 647, 
      tf_esp = -1077937216, tf_ss = 47}) at ../../i386/i386/trap.c:1150
#19 0xc0220775 in Xint0x80_syscall ()
#20 0x8048135 in ?? ()
(kgdb)



To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-stable" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?Pine.BSF.4.21.0101231328300.32276-100000>