Date: Mon, 05 May 2014 11:46:12 -0700 From: Sean Bruno <sbruno@ignoranthack.me> To: John Baldwin <jhb@freebsd.org> Cc: freebsd-stable@freebsd.org Subject: Re: stable/10 panic Message-ID: <1399315572.77984.2.camel@powernoodle.corp.yahoo.com> In-Reply-To: <201405051348.13320.jhb@freebsd.org> References: <1398097892.1101.6.camel@powernoodle.corp.yahoo.com> <201405051348.13320.jhb@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--=-hjN9NQlpexWndlBgxY0R
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
On Mon, 2014-05-05 at 13:48 -0400, John Baldwin wrote:
> On Monday, April 21, 2014 12:31:32 pm Sean Bruno wrote:
> > We're seeing this *a lot* on our qmail based hosts during our stable/10
> > rollout. We're running stable/10 from around svn rev 261579 (mid
> > february) with one or two patches strewn in.
> >=20
> > sean
> >=20
> >=20
> > GNU gdb 6.1.1 [FreeBSD]
> > Copyright 2004 Free Software Foundation, Inc.
> > GDB is free software, covered by the GNU General Public License, and yo=
u are
> > welcome to change it and/or distribute copies of it under certain condi=
tions.
> > Type "show copying" to see the conditions.
> > There is absolutely no warranty for GDB. Type "show warranty" for deta=
ils.
> > This GDB was configured as "amd64-marcel-freebsd"...
> >=20
> > Unread portion of the kernel message buffer:
> > panic: page fault
> > cpuid =3D 5
> > KDB: stack backtrace:
> > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe048=
b9b12a0
> > kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe048b9b1350
> > vpanic() at vpanic+0x126/frame 0xfffffe048b9b1390
> > panic() at panic+0x43/frame 0xfffffe048b9b13f0
> > trap_fatal() at trap_fatal+0x3a2/frame 0xfffffe048b9b1450
> > trap_pfault() at trap_pfault+0x22f/frame 0xfffffe048b9b14f0
> > trap() at trap+0x670/frame 0xfffffe048b9b1710
> > calltrap() at calltrap+0x8/frame 0xfffffe048b9b1710
> > --- trap 0xc, rip =3D 0xffffffff805e759b, rsp =3D 0xfffffe048b9b17d0, r=
bp =3D 0xfffffe048b9b17e0 ---
> > __mtx_assert() at __mtx_assert+0x3b/frame 0xfffffe048b9b17e0
> > knote() at knote+0x39/frame 0xfffffe048b9b1830
> > pipeclose() at pipeclose+0xbe/frame 0xfffffe048b9b1860
>=20
> Can you show which line this is via kgdb? Can you also 'p *cpipe'
> and 'p *ppipe'?
>=20
Looks like its in here:
(kgdb) whe
#0 doadump (textdump=3D1) at pcpu.h:219
#1 0xffffffff805fb2a7 in kern_reboot (howto=3D260)
at ../../../kern/kern_shutdown.c:452
#2 0xffffffff805fb7b5 in vpanic (fmt=3D<value optimized out>, ap=3D<value
optimized out>) at ../../../kern/kern_shutdown.c:759
#3 0xffffffff805fb803 in panic (fmt=3D<value optimized out>)
at ../../../kern/kern_shutdown.c:688
#4 0xffffffff80977852 in trap_fatal (frame=3D<value optimized out>,
eva=3D<value optimized out>) at ../../../amd64/amd64/trap.c:882
#5 0xffffffff80977a8f in trap_pfault (frame=3D0x0, usermode=3D<value
optimized out>) at ../../../amd64/amd64/trap.c:699
#6 0xffffffff809772a0 in trap (frame=3D0xfffffe048c3df6e0)
at ../../../amd64/amd64/trap.c:463
#7 0xffffffff8095c7e2 in calltrap ()
at ../../../amd64/amd64/exception.S:232
#8 0xffffffff805e759b in __mtx_assert (c=3D0x18, what=3D4,
file=3D0xffffffff80ca0bcb "../../../kern/kern_event.c", line=3D1960)
at ../../../kern/kern_mutex.c:791
#9 0xffffffff805c2099 in knote (list=3D0xfffff8003498aae0, hint=3D0,
lockflags=3D1) at ../../../kern/kern_event.c:1822
#10 0xffffffff806510fe in pipeclose (cpipe=3D0xfffff8003498aa18)
at ../../../kern/sys_pipe.c:1655
#11 0xffffffff80651019 in pipe_dtor (dpipe=3D<value optimized out>)
at ../../../kern/sys_pipe.c:395
#12 0xffffffff80559924 in fifo_close (ap=3D<value optimized out>)
at ../../../fs/fifofs/fifo_vnops.c:115
#13 0xffffffff80a6ba6a in VOP_CLOSE_APV (vop=3D<value optimized out>,
a=3D<value optimized out>) at vnode_if.c:535
#14 0xffffffff806acc09 in vn_close (vp=3D0xfffff8032000cce8, flags=3D6,
file_cred=3D0xfffff8040400d200, td=3D0xfffff804044f9490) at vnode_if.h:225
#15 0xffffffff806abad8 in vn_closefile (fp=3D0xfffff803b2f3c410,
td=3D0xfffff804044f9490) at ../../../kern/vfs_vnops.c:1481
#16 0xffffffff805b8789 in _fdrop (fp=3D0xfffff803b2f3c410, td=3D0x4) at
file.h:342
#17 0xffffffff805bb0e1 in closef (fp=3D0xfffff803b2f3c410,
td=3D0xfffff804044f9490) at ../../../kern/kern_descrip.c:2415
#18 0xffffffff805b8bf0 in closefp (fdp=3D0xfffff800263f5000, fd=3D<value
optimized out>, fp=3D0xfffff803b2f3c410, td=3D0xfffff804044f9490,
holdleaders=3D<value optimized out>) at ../../../kern/kern_descrip.c:1257
#19 0xffffffff80a332b5 in ia32_syscall (frame=3D0xfffffe048c3dfbc0) at
subr_syscall.c:135
#20 0xffffffff8095cdc5 in Xint0x80_syscall () at ia32_exception.S:73
#21 0x00000000210f7804 in ?? ()
Previous frame inner to this frame (corrupt stack?)
Current language: auto; currently minimal
----------------
(kgdb) f 10
#10 0xffffffff806510fe in pipeclose (cpipe=3D0xfffff8003498aa18)
at ../../../kern/sys_pipe.c:1655
1655 ../../../kern/sys_pipe.c: No such file or directory.
in ../../../kern/sys_pipe.c
(kgdb) p *cpipe
$1 =3D {pipe_buffer =3D {cnt =3D 0, in =3D 0, out =3D 0, size =3D 0, buffer=
=3D 0x0},
pipe_map =3D {cnt =3D 0, pos =3D 0, npages =3D 0, ms =3D {0x0 <repeats 17
times>}}, pipe_sel =3D {si_tdlist =3D {tqh_first =3D 0x0, tqh_last =3D 0x0}=
,
si_note =3D {kl_list =3D {
slh_first =3D 0x0}, kl_lock =3D 0, kl_unlock =3D 0, kl_assert_locke=
d =3D
0xffffffff805c25c0 <knlist_mtx_assert_locked>, kl_assert_unlocked =3D
0xffffffff805c25e0 <knlist_mtx_assert_unlocked>, kl_lockarg =3D 0x0},
si_mtx =3D 0x0},=20
pipe_atime =3D {tv_sec =3D 1399120887, tv_nsec =3D 0}, pipe_mtime =3D {tv=
_sec
=3D 1399120887, tv_nsec =3D 0}, pipe_ctime =3D {tv_sec =3D 1399120887, tv_n=
sec =3D
0}, pipe_sigio =3D 0x0, pipe_peer =3D 0xfffff8003498a8b8, pipe_pair =3D
0xfffff8003498a8b8,=20
pipe_state =3D 2432, pipe_busy =3D 0, pipe_present =3D 3, pipe_wgen =3D 0=
,
pipe_ino =3D 4294967295}
(kgdb) p *ppipe
$2 =3D {pipe_buffer =3D {cnt =3D 0, in =3D 0, out =3D 0, size =3D 0, buffer=
=3D 0x0},
pipe_map =3D {cnt =3D 0, pos =3D 0, npages =3D 0, ms =3D {0x0 <repeats 17
times>}}, pipe_sel =3D {si_tdlist =3D {tqh_first =3D 0x0, tqh_last =3D 0x0}=
,
si_note =3D {kl_list =3D {
slh_first =3D 0x0}, kl_lock =3D 0, kl_unlock =3D 0, kl_assert_locke=
d =3D
0xffffffff805c25c0 <knlist_mtx_assert_locked>, kl_assert_unlocked =3D
0xffffffff805c25e0 <knlist_mtx_assert_unlocked>, kl_lockarg =3D 0x0},
si_mtx =3D 0x0},=20
pipe_atime =3D {tv_sec =3D 1399120887, tv_nsec =3D 0}, pipe_mtime =3D {tv=
_sec
=3D 1399120887, tv_nsec =3D 0}, pipe_ctime =3D {tv_sec =3D 1399120887, tv_n=
sec =3D
0}, pipe_sigio =3D 0x0, pipe_peer =3D 0xfffff8003498a8b8, pipe_pair =3D
0xfffff8003498a8b8,=20
pipe_state =3D 2432, pipe_busy =3D 0, pipe_present =3D 3, pipe_wgen =3D 0=
,
pipe_ino =3D 4294967295}
-----
--=-hjN9NQlpexWndlBgxY0R
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
iQEcBAABAgAGBQJTZ9xpAAoJEBkJRdwI6BaHkigH/RGXmS3u/i2Zzq5k5eHnuPgX
G02vWfLmQSjJEsSuGmGX76EvRVhjVs+j820f+xW5C0l7l7bjMOZUysFPoMJiOQY5
Piw5tQZjY4zlRryGiIpbnZ/oyiA2KNN1R4OBG7O87YSqNs32hKrlgBVxwuvYuorH
y7lb62ne0eb/utv0klhLfH72w7S8Peok9jxtBKC7xZMFTqFoOA/EVRMPLm+KVVEa
NAatFDt/ozy3N1zm8Q+VuZehgqpt1JXjlJUBB2gQceOol2cW1PSj6gHQAOoLCevH
SbJgOXyBzyKtZDFUFOa8ffPKiUk7/b/egAvtYQynmUsXKeHAzrBuLJepEACLXgU=
=Gb+9
-----END PGP SIGNATURE-----
--=-hjN9NQlpexWndlBgxY0R--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1399315572.77984.2.camel>