Date: Thu, 28 Apr 2005 00:37:02 +0200 From: Rene Ladan <r.c.ladan@student.tue.nl> To: stable@freebsd.org Subject: Re: new fxp lor Message-ID: <20050427223701.GA69786@82-168-79-254-bbxl.xdsl.tiscali.nl> In-Reply-To: <20050427180127.GA15351@82-168-79-254-bbxl.xdsl.tiscali.nl> References: <20050427180127.GA15351@82-168-79-254-bbxl.xdsl.tiscali.nl>
next in thread | previous in thread | raw e-mail | index | archive | help
--nFreZHaLTZJo0R7j
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Wed, Apr 27, 2005 at 08:01:28PM +0200, Rene Ladan wrote:
> Hi,
>=20
> I experienced this new fxp LOR (probably when ntpd started during boot):
[snip 2 LORs]
> The box panics with automatic dump and reboot:
>=20
> KDB: enter: witness_checkorder
> panic: blockable sleep lock (sleep mutex) tty @ /usr/src/sys/kern/kern_ev=
ent.c:1495
> KDB: stack backtrace:
> Uptime: 15m33s
> Dumping 191 MB
> 16 32 48 64 80 96 112 128 144 160 176
> Dump complete
Some dump analysis (especially frames 34 and 35 look interesting):
[GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so:=
Undefined symbol "ps_pglobal_lookup"]=0D
GNU gdb 6.1.1 [FreeBSD]=0D
Copyright 2004 Free Software Foundation, Inc.=0D
GDB is free software, covered by the GNU General Public License, and you ar=
e=0D
welcome to change it and/or distribute copies of it under certain condition=
s.=0D
Type "show copying" to see the conditions.=0D
There is absolutely no warranty for GDB. Type "show warranty" for details.=
=0D
This GDB was configured as "i386-marcel-freebsd".=0D
#0 doadump () at pcpu.h:159=0D
159 pcpu.h: No such file or directory.=0D
in pcpu.h=0D
(kgdb) bt f=0D
#0 doadump () at pcpu.h:159=0D
No locals.=0D
#1 0xc04948aa in boot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:4=
10=0D
first_buf_printf =3D 1=0D
#2 0xc0494c18 in panic (=0D
fmt=3D0xc05fcf6f "blockable sleep lock (%s) %s @ %s:%d")=0D
at /usr/src/sys/kern/kern_shutdown.c:566=0D
td =3D (struct thread *) 0xc13e7180=0D
bootopt =3D 256=0D
newpanic =3D 1=0D
ap =3D 0xc9be56a8 "{=C2=B2`=C3=80=C3=98=C3=8C_=C3=80~l_=C3=80=C3=97\005"=0D
buf =3D "blockable sleep lock (sleep mutex) tty @ /usr/src/sys/kern/kern_e=
vent.c:1495", '\0' <repeats 179 times>=0D
#3 0xc04bb5ae in witness_checkorder (lock=3D0xc158c510, flags=3D9, =0D
file=3D0xc05f6c7e "/usr/src/sys/kern/kern_event.c", line=3D1495)=0D
at /usr/src/sys/kern/subr_witness.c:709=0D
lock_list =3D (struct lock_list_entry **) 0x15=0D
lle =3D (struct lock_list_entry *) 0xc9be56fc=0D
lock1 =3D (struct lock_instance *) 0xc13e7180=0D
lock2 =3D (struct lock_instance *) 0x0=0D
class =3D (struct lock_class *) 0xc0620ffc=0D
w =3D (struct witness *) 0xc0649468=0D
w1 =3D (struct witness *) 0x20=0D
td =3D (struct thread *) 0xc13e7180=0D
---Type <return> to continue, or q <return> to quit---=0D
i =3D 1923=0D
j =3D -1066895508=0D
__func__ =3D "witness_checkorder"=0D
#4 0xc048a95a in _mtx_lock_flags (m=3D0xc158c510, opts=3D0, =0D
file=3D0xc05f6c7e "/usr/src/sys/kern/kern_event.c", line=3D1495)=0D
at /usr/src/sys/kern/kern_mutex.c:271=0D
No locals.=0D
#5 0xc0476ff5 in knote (list=3D0xc158c498, hint=3D0, islocked=3D0)=0D
at /usr/src/sys/kern/kern_event.c:1495=0D
kq =3D (struct kqueue *) 0xc158c438=0D
kn =3D (struct knote *) 0xc158c400=0D
#6 0xc04c98ae in ttwwakeup (tp=3D0xc158c400) at /usr/src/sys/kern/tty.c:23=
98=0D
No locals.=0D
#7 0xc05baf21 in scstart (tp=3D0xc158c400)=0D
at /usr/src/sys/dev/syscons/syscons.c:1369=0D
rbp =3D (struct clist *) 0xc158c438=0D
len =3D 0=0D
buf =3D "lwh=C3=80\204\a\000\000\000p\000\000`wh=C3=80=E2=82=ACW=C5=B8=C3=
=89Bk[=C3=80lwh=C3=80\204\a\000\000 \000\000\000\000p\000\000BK\000 \224W=
=C5=B8=C3=89\032\205[=C3=80 =C2=AAh=C3=80lwh=C3=80`wh=C3=80\000\017\000\000=
=C3=8CW=C5=B8=C3=89ul[=C3=80`wh=C3=80\204\a\000\000 \000\000\000\000\017\00=
0\000\000\000\000\000`wh=C3=80`wh=C3=80 =C2=AAh=C3=80=C3=ACW=C5=B8=C3=89=C3=
=AE=C3=8C[=C3=80`wh=C3=80\204\a\000\000\000\000\000"=0D
scp =3D (scr_stat *) 0xc0687760=0D
#8 0xc05be305 in scgetc (sc=3D0xc068aa20, flags=3D3)=0D
at /usr/src/sys/dev/syscons/syscons.c:3211=0D
---Type <return> to continue, or q <return> to quit---=0D
scp =3D (scr_stat *) 0xc0687760=0D
tp =3D (struct tty *) 0x0=0D
c =3D 6=0D
this_scr =3D -910272488=0D
f =3D 0=0D
i =3D 0=0D
#9 0xc05bb379 in sccngetch (flags=3D2)=0D
at /usr/src/sys/dev/syscons/syscons.c:1555=0D
fkey =3D {str =3D '\0' <repeats 15 times>, len =3D 0 '\0'}=0D
fkeycp =3D 0=0D
scp =3D (scr_stat *) 0xc0687760=0D
p =3D (u_char *) 0x0=0D
cur_mode =3D 1=0D
c =3D -1067201760=0D
#10 0xc05bb1c2 in sccncheckc (cd=3D0xc06350e0)=0D
at /usr/src/sys/dev/syscons/syscons.c:1478=0D
No locals.=0D
#11 0xc04cc1f8 in cncheckc () at /usr/src/sys/kern/tty_cons.c:567=0D
cnd =3D (struct cn_device *) 0xc066d0e0=0D
cn =3D (struct consdev *) 0x0=0D
c =3D 0=0D
#12 0xc04cc1a5 in cngetc () at /usr/src/sys/kern/tty_cons.c:548=0D
c =3D 0=0D
#13 0xc042a765 in db_readline (lstart=3D0xc063cb20 "c\n", lsize=3D120)=0D
---Type <return> to continue, or q <return> to quit---=0D
at /usr/src/sys/ddb/db_input.c:324=0D
No locals.=0D
#14 0xc042a8aa in db_read_line () at /usr/src/sys/ddb/db_lex.c:55=0D
i =3D 0=0D
#15 0xc0428fc1 in db_command_loop () at /usr/src/sys/ddb/db_command.c:453=0D
No locals.=0D
#16 0xc042b125 in db_trap (type=3D3, code=3D0) at /usr/src/sys/ddb/db_main.=
c:221=0D
jb =3D {{_jb =3D {-910272284, -910272312, -910272232, -1052872320, 0, =0D
-1069371194, 0, 0, 0, 0, -910272232, -1068823136}}}=0D
prev_jb =3D (void *) 0x0=0D
bkpt =3D 0=0D
#17 0xc04b0e27 in kdb_trap (type=3D0, code=3D0, tf=3D0xc9be5978)=0D
at /usr/src/sys/kern/subr_kdb.c:418=0D
handled =3D -910272136=0D
#18 0xc05d9428 in trap (frame=3D=0D
{tf_fs =3D -1051983848, tf_es =3D 16, tf_ds =3D -910295024, tf_edi =
=3D 9, tf_esi =3D -1051950492, tf_ebp =3D -910272064, tf_isp =3D -910272092=
, tf_ebx =3D -1067004164, tf_edx =3D 1, tf_ecx =3D -1056878592, tf_eax =3D =
31, tf_trapno =3D 3, tf_err =3D 0, tf_eip =3D -1068823776, tf_cs =3D 8, tf_=
eflags =3D 646, tf_esp =3D -1067468212, tf_ss =3D -1067537639}) at /usr/src=
/sys/i386/i386/trap.c:576=0D
td =3D (struct thread *) 0xc13e7180=0D
p =3D (struct proc *) 0xc13e654c=0D
sticks =3D 0=0D
i =3D 0=0D
---Type <return> to continue, or q <return> to quit---=0D
ucode =3D 0=0D
type =3D 3=0D
code =3D 0=0D
eva =3D 0=0D
#19 0xc05c880a in calltrap () at /usr/src/sys/i386/i386/exception.s:140=0D
No locals.=0D
#20 0xc14c0018 in ?? ()=0D
No symbol table info available.=0D
#21 0x00000010 in ?? ()=0D
No symbol table info available.=0D
#22 0xc9be0010 in ?? ()=0D
No symbol table info available.=0D
#23 0x00000009 in ?? ()=0D
No symbol table info available.=0D
#24 0xc14c8264 in ?? ()=0D
No symbol table info available.=0D
#25 0xc9be59c0 in ?? ()=0D
No symbol table info available.=0D
#26 0xc9be59a4 in ?? ()=0D
No symbol table info available.=0D
#27 0xc066cefc in w_locklistdata ()=0D
No symbol table info available.=0D
#28 0x00000001 in ?? ()=0D
No symbol table info available.=0D
---Type <return> to continue, or q <return> to quit---=0D
#29 0xc1015000 in ?? ()=0D
No symbol table info available.=0D
#30 0x0000001f in ?? ()=0D
No symbol table info available.=0D
#31 0x00000003 in ?? ()=0D
No symbol table info available.=0D
#32 0x00000000 in ?? ()=0D
No symbol table info available.=0D
#33 0xc04b0b20 in kdb_enter (msg=3D0x0) at cpufunc.h:56=0D
No locals.=0D
#34 0xc04bbbab in witness_checkorder (lock=3D0xc14c8264, flags=3D9, =0D
file=3D0xc06fe7bd "/usr/src/sys/modules/fxp/../../dev/fxp/if_fxp.c", =0D
line=3D1232) at /usr/src/sys/kern/subr_witness.c:946=0D
lock_list =3D (struct lock_list_entry **) 0xc13e71f0=0D
lle =3D (struct lock_list_entry *) 0xc066cef8=0D
lock1 =3D (struct lock_instance *) 0xc066cefc=0D
lock2 =3D (struct lock_instance *) 0x0=0D
class =3D (struct lock_class *) 0xc0620ffc=0D
w =3D (struct witness *) 0xc0649530=0D
w1 =3D (struct witness *) 0xc064a778=0D
td =3D (struct thread *) 0xc066cefc=0D
i =3D -1=0D
j =3D 0=0D
__func__ =3D "witness_checkorder"=0D
---Type <return> to continue, or q <return> to quit---=0D
#35 0xc048a95a in _mtx_lock_flags (m=3D0xc14c8264, opts=3D0, =0D
file=3D0xc06fe7bd "/usr/src/sys/modules/fxp/../../dev/fxp/if_fxp.c", =0D
line=3D1232) at /usr/src/sys/kern/kern_mutex.c:271=0D
No locals.=0D
#36 0xc06fbdc7 in ?? ()=0D
No symbol table info available.=0D
#37 0xc14c8264 in ?? ()=0D
No symbol table info available.=0D
#38 0x00000000 in ?? ()=0D
No symbol table info available.=0D
#39 0xc06fe7bd in ?? ()=0D
No symbol table info available.=0D
#40 0x000004d0 in ?? ()=0D
No symbol table info available.=0D
#41 0xc14c8000 in ?? ()=0D
No symbol table info available.=0D
#42 0xc14c8000 in ?? ()=0D
No symbol table info available.=0D
#43 0xc9be5a70 in ?? ()=0D
No symbol table info available.=0D
#44 0xc050b1c9 in if_start (ifp=3D0xc14c8264) at /usr/src/sys/net/if.c:1959=
=0D
No locals.=0D
Previous frame identical to this frame (corrupt stack?)=0D
(kgdb) frame 33=0D
#33 0xc04b0b20 in kdb_enter (msg=3D0x0) at cpufunc.h:56=0D
56 cpufunc.h: No such file or directory.=0D
in cpufunc.h=0D
(kgdb) frame 34=0D
#34 0xc04bbbab in witness_checkorder (lock=3D0xc14c8264, flags=3D9, =0D
file=3D0xc06fe7bd "/usr/src/sys/modules/fxp/../../dev/fxp/if_fxp.c", =0D
line=3D1232) at /usr/src/sys/kern/subr_witness.c:946=0D
946 kdb_enter(__func__);=0D
(kgdb) frame 35=0D
#35 0xc048a95a in _mtx_lock_flags (m=3D0xc14c8264, opts=3D0, =0D
file=3D0xc06fe7bd "/usr/src/sys/modules/fxp/../../dev/fxp/if_fxp.c", =0D
line=3D1232) at /usr/src/sys/kern/kern_mutex.c:271=0D
271 WITNESS_CHECKORDER(&m->mtx_object, opts | LOP_NEWORDER | LOP_EXCLUSIVE=
,=0D
(kgdb) print *m=0D
$1 =3D {mtx_object =3D {lo_class =3D 0xc0620ffc, lo_name =3D 0xc14a57e0 "fx=
p0", =0D
lo_type =3D 0xc06fe820 "network driver", lo_flags =3D 196608, lo_list =
=3D {=0D
tqe_next =3D 0xc14c8208, tqe_prev =3D 0xc14bf010}, =0D
lo_witness =3D 0xc0649530}, mtx_lock =3D 4, mtx_recurse =3D 0}=0D
(kgdb) q=0D
I still have this dump (~65MB uncompressed) available.
> This is on:
>=20
> FreeBSD 5.4-STABLE #0: Tue Apr 26 07:30:25 CEST 2005 root@82-168-79-2=
54-bbxl.xdsl.tiscali.nl:/usr/obj/usr/src/sys/RENE=20
>=20
Regards,
Rene=09
--=20
"It won't fit on the line."
-- me, 2001
--nFreZHaLTZJo0R7j
Content-Type: application/pgp-signature
Content-Disposition: inline
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (FreeBSD)
iD8DBQFCcBQNvz70qa4zXcwRAlevAJ9HKj6kTJ2787//o0heghNYcLG5vACeMMWD
qxohsODyPsEPTk/7+X97NIY=
=9k6C
-----END PGP SIGNATURE-----
--nFreZHaLTZJo0R7j--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20050427223701.GA69786>