From owner-freebsd-stable@FreeBSD.ORG Mon May 5 18:46:18 2014 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5BCFD420; Mon, 5 May 2014 18:46:18 +0000 (UTC) Received: from mail.ignoranthack.me (ujvl.x.rootbsd.net [199.102.79.106]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 380F8114E; Mon, 5 May 2014 18:46:17 +0000 (UTC) Received: from [10.73.160.242] (nat-dip7.cfw-a-gci.corp.yahoo.com [209.131.62.116]) (using SSLv3 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: sbruno@ignoranthack.me) by mail.ignoranthack.me (Postfix) with ESMTPSA id 0FE251928E4; Mon, 5 May 2014 18:46:16 +0000 (UTC) Subject: Re: stable/10 panic From: Sean Bruno Reply-To: sbruno@freebsd.org To: John Baldwin In-Reply-To: <201405051348.13320.jhb@freebsd.org> References: <1398097892.1101.6.camel@powernoodle.corp.yahoo.com> <201405051348.13320.jhb@freebsd.org> Content-Type: multipart/signed; micalg="pgp-sha1"; protocol="application/pgp-signature"; boundary="=-hjN9NQlpexWndlBgxY0R" Date: Mon, 05 May 2014 11:46:12 -0700 Message-ID: <1399315572.77984.2.camel@powernoodle.corp.yahoo.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 May 2014 18:46:18 -0000 --=-hjN9NQlpexWndlBgxY0R Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, 2014-05-05 at 13:48 -0400, John Baldwin wrote: > On Monday, April 21, 2014 12:31:32 pm Sean Bruno wrote: > > We're seeing this *a lot* on our qmail based hosts during our stable/10 > > rollout. We're running stable/10 from around svn rev 261579 (mid > > february) with one or two patches strewn in. > >=20 > > sean > >=20 > >=20 > > GNU gdb 6.1.1 [FreeBSD] > > Copyright 2004 Free Software Foundation, Inc. > > GDB is free software, covered by the GNU General Public License, and yo= u are > > welcome to change it and/or distribute copies of it under certain condi= tions. > > Type "show copying" to see the conditions. > > There is absolutely no warranty for GDB. Type "show warranty" for deta= ils. > > This GDB was configured as "amd64-marcel-freebsd"... > >=20 > > Unread portion of the kernel message buffer: > > panic: page fault > > cpuid =3D 5 > > KDB: stack backtrace: > > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe048= b9b12a0 > > kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe048b9b1350 > > vpanic() at vpanic+0x126/frame 0xfffffe048b9b1390 > > panic() at panic+0x43/frame 0xfffffe048b9b13f0 > > trap_fatal() at trap_fatal+0x3a2/frame 0xfffffe048b9b1450 > > trap_pfault() at trap_pfault+0x22f/frame 0xfffffe048b9b14f0 > > trap() at trap+0x670/frame 0xfffffe048b9b1710 > > calltrap() at calltrap+0x8/frame 0xfffffe048b9b1710 > > --- trap 0xc, rip =3D 0xffffffff805e759b, rsp =3D 0xfffffe048b9b17d0, r= bp =3D 0xfffffe048b9b17e0 --- > > __mtx_assert() at __mtx_assert+0x3b/frame 0xfffffe048b9b17e0 > > knote() at knote+0x39/frame 0xfffffe048b9b1830 > > pipeclose() at pipeclose+0xbe/frame 0xfffffe048b9b1860 >=20 > Can you show which line this is via kgdb? Can you also 'p *cpipe' > and 'p *ppipe'? >=20 Looks like its in here: (kgdb) whe #0 doadump (textdump=3D1) at pcpu.h:219 #1 0xffffffff805fb2a7 in kern_reboot (howto=3D260) at ../../../kern/kern_shutdown.c:452 #2 0xffffffff805fb7b5 in vpanic (fmt=3D, ap=3D) at ../../../kern/kern_shutdown.c:759 #3 0xffffffff805fb803 in panic (fmt=3D) at ../../../kern/kern_shutdown.c:688 #4 0xffffffff80977852 in trap_fatal (frame=3D, eva=3D) at ../../../amd64/amd64/trap.c:882 #5 0xffffffff80977a8f in trap_pfault (frame=3D0x0, usermode=3D) at ../../../amd64/amd64/trap.c:699 #6 0xffffffff809772a0 in trap (frame=3D0xfffffe048c3df6e0) at ../../../amd64/amd64/trap.c:463 #7 0xffffffff8095c7e2 in calltrap () at ../../../amd64/amd64/exception.S:232 #8 0xffffffff805e759b in __mtx_assert (c=3D0x18, what=3D4, file=3D0xffffffff80ca0bcb "../../../kern/kern_event.c", line=3D1960) at ../../../kern/kern_mutex.c:791 #9 0xffffffff805c2099 in knote (list=3D0xfffff8003498aae0, hint=3D0, lockflags=3D1) at ../../../kern/kern_event.c:1822 #10 0xffffffff806510fe in pipeclose (cpipe=3D0xfffff8003498aa18) at ../../../kern/sys_pipe.c:1655 #11 0xffffffff80651019 in pipe_dtor (dpipe=3D) at ../../../kern/sys_pipe.c:395 #12 0xffffffff80559924 in fifo_close (ap=3D) at ../../../fs/fifofs/fifo_vnops.c:115 #13 0xffffffff80a6ba6a in VOP_CLOSE_APV (vop=3D, a=3D) at vnode_if.c:535 #14 0xffffffff806acc09 in vn_close (vp=3D0xfffff8032000cce8, flags=3D6, file_cred=3D0xfffff8040400d200, td=3D0xfffff804044f9490) at vnode_if.h:225 #15 0xffffffff806abad8 in vn_closefile (fp=3D0xfffff803b2f3c410, td=3D0xfffff804044f9490) at ../../../kern/vfs_vnops.c:1481 #16 0xffffffff805b8789 in _fdrop (fp=3D0xfffff803b2f3c410, td=3D0x4) at file.h:342 #17 0xffffffff805bb0e1 in closef (fp=3D0xfffff803b2f3c410, td=3D0xfffff804044f9490) at ../../../kern/kern_descrip.c:2415 #18 0xffffffff805b8bf0 in closefp (fdp=3D0xfffff800263f5000, fd=3D, fp=3D0xfffff803b2f3c410, td=3D0xfffff804044f9490, holdleaders=3D) at ../../../kern/kern_descrip.c:1257 #19 0xffffffff80a332b5 in ia32_syscall (frame=3D0xfffffe048c3dfbc0) at subr_syscall.c:135 #20 0xffffffff8095cdc5 in Xint0x80_syscall () at ia32_exception.S:73 #21 0x00000000210f7804 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal ---------------- (kgdb) f 10 #10 0xffffffff806510fe in pipeclose (cpipe=3D0xfffff8003498aa18) at ../../../kern/sys_pipe.c:1655 1655 ../../../kern/sys_pipe.c: No such file or directory. in ../../../kern/sys_pipe.c (kgdb) p *cpipe $1 =3D {pipe_buffer =3D {cnt =3D 0, in =3D 0, out =3D 0, size =3D 0, buffer= =3D 0x0}, pipe_map =3D {cnt =3D 0, pos =3D 0, npages =3D 0, ms =3D {0x0 }}, pipe_sel =3D {si_tdlist =3D {tqh_first =3D 0x0, tqh_last =3D 0x0}= , si_note =3D {kl_list =3D { slh_first =3D 0x0}, kl_lock =3D 0, kl_unlock =3D 0, kl_assert_locke= d =3D 0xffffffff805c25c0 , kl_assert_unlocked =3D 0xffffffff805c25e0 , kl_lockarg =3D 0x0}, si_mtx =3D 0x0},=20 pipe_atime =3D {tv_sec =3D 1399120887, tv_nsec =3D 0}, pipe_mtime =3D {tv= _sec =3D 1399120887, tv_nsec =3D 0}, pipe_ctime =3D {tv_sec =3D 1399120887, tv_n= sec =3D 0}, pipe_sigio =3D 0x0, pipe_peer =3D 0xfffff8003498a8b8, pipe_pair =3D 0xfffff8003498a8b8,=20 pipe_state =3D 2432, pipe_busy =3D 0, pipe_present =3D 3, pipe_wgen =3D 0= , pipe_ino =3D 4294967295} (kgdb) p *ppipe $2 =3D {pipe_buffer =3D {cnt =3D 0, in =3D 0, out =3D 0, size =3D 0, buffer= =3D 0x0}, pipe_map =3D {cnt =3D 0, pos =3D 0, npages =3D 0, ms =3D {0x0 }}, pipe_sel =3D {si_tdlist =3D {tqh_first =3D 0x0, tqh_last =3D 0x0}= , si_note =3D {kl_list =3D { slh_first =3D 0x0}, kl_lock =3D 0, kl_unlock =3D 0, kl_assert_locke= d =3D 0xffffffff805c25c0 , kl_assert_unlocked =3D 0xffffffff805c25e0 , kl_lockarg =3D 0x0}, si_mtx =3D 0x0},=20 pipe_atime =3D {tv_sec =3D 1399120887, tv_nsec =3D 0}, pipe_mtime =3D {tv= _sec =3D 1399120887, tv_nsec =3D 0}, pipe_ctime =3D {tv_sec =3D 1399120887, tv_n= sec =3D 0}, pipe_sigio =3D 0x0, pipe_peer =3D 0xfffff8003498a8b8, pipe_pair =3D 0xfffff8003498a8b8,=20 pipe_state =3D 2432, pipe_busy =3D 0, pipe_present =3D 3, pipe_wgen =3D 0= , pipe_ino =3D 4294967295} ----- --=-hjN9NQlpexWndlBgxY0R Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAABAgAGBQJTZ9xpAAoJEBkJRdwI6BaHkigH/RGXmS3u/i2Zzq5k5eHnuPgX G02vWfLmQSjJEsSuGmGX76EvRVhjVs+j820f+xW5C0l7l7bjMOZUysFPoMJiOQY5 Piw5tQZjY4zlRryGiIpbnZ/oyiA2KNN1R4OBG7O87YSqNs32hKrlgBVxwuvYuorH y7lb62ne0eb/utv0klhLfH72w7S8Peok9jxtBKC7xZMFTqFoOA/EVRMPLm+KVVEa NAatFDt/ozy3N1zm8Q+VuZehgqpt1JXjlJUBB2gQceOol2cW1PSj6gHQAOoLCevH SbJgOXyBzyKtZDFUFOa8ffPKiUk7/b/egAvtYQynmUsXKeHAzrBuLJepEACLXgU= =Gb+9 -----END PGP SIGNATURE----- --=-hjN9NQlpexWndlBgxY0R--