From owner-freebsd-stable@FreeBSD.ORG Sat Feb 18 01:27:55 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B5731106564A for ; Sat, 18 Feb 2012 01:27:55 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id 376828FC08 for ; Sat, 18 Feb 2012 01:27:54 +0000 (UTC) Received: from skuns.kiev.zoral.com.ua (localhost [127.0.0.1]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id q1I1RmQC032868 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 18 Feb 2012 03:27:48 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5) with ESMTP id q1I1RlQf028215; Sat, 18 Feb 2012 03:27:47 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5/Submit) id q1I1RlW2028214; Sat, 18 Feb 2012 03:27:47 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 18 Feb 2012 03:27:47 +0200 From: Konstantin Belousov To: Paul Mather Message-ID: <20120218012746.GA3283@deviant.kiev.zoral.com.ua> References: <20120215004753.GQ3283@deviant.kiev.zoral.com.ua> <8F48D496-59BD-431D-B7F1-962A79C7ACC5@gromit.dlib.vt.edu> <20120216154932.GM3283@deviant.kiev.zoral.com.ua> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="QJ8Fh8pYRWS0QZcB" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-3.9 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: stable@freebsd.org Subject: Re: ZFS + nullfs + Linuxulator = panic? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2012 01:27:55 -0000 --QJ8Fh8pYRWS0QZcB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Feb 16, 2012 at 12:07:46PM -0500, Paul Mather wrote: > On Feb 16, 2012, at 10:49 AM, Konstantin Belousov wrote: >=20 > > On Thu, Feb 16, 2012 at 10:09:27AM -0500, Paul Mather wrote: > >> On Feb 14, 2012, at 7:47 PM, Konstantin Belousov wrote: > >>=20 > >>> On Tue, Feb 14, 2012 at 09:38:18AM -0500, Paul Mather wrote: > >>>> I have a problem with RELENG_8 (FreeBSD/amd64 running a GENERIC kern= el, last built 2012-02-08). It will panic during the daily periodic script= s that run at 3am. Here is the most recent panic message: > >>>>=20 > >>>> Fatal trap 9: general protection fault while in kernel mode > >>>> cpuid =3D 0; apic id =3D 00 > >>>> instruction pointer =3D 0x20:0xffffffff8069d266 > >>>> stack pointer =3D 0x28:0xffffff8094b90390 > >>>> frame pointer =3D 0x28:0xffffff8094b903a0 > >>>> code segment =3D base 0x0, limit 0xfffff, type 0x1b > >>>> =3D DPL 0, pres 1, long 1, def32 0, gran 1 > >>>> processor eflags =3D resume, IOPL =3D 0 > >>>> current process =3D 72566 (ps) > >>>> trap number =3D 9 > >>>> panic: general protection fault > >>>> cpuid =3D 0 > >>>> KDB: stack backtrace: > >>>> #0 0xffffffff8062cf8e at kdb_backtrace+0x5e > >>>> #1 0xffffffff805facd3 at panic+0x183 > >>>> #2 0xffffffff808e6c20 at trap_fatal+0x290 > >>>> #3 0xffffffff808e715a at trap+0x10a > >>>> #4 0xffffffff808cec64 at calltrap+0x8 > >>>> #5 0xffffffff805ee034 at fill_kinfo_thread+0x54 > >>>> #6 0xffffffff805eee76 at fill_kinfo_proc+0x586 > >>>> #7 0xffffffff805f22b8 at sysctl_out_proc+0x48 > >>>> #8 0xffffffff805f26c8 at sysctl_kern_proc+0x278 > >>>> #9 0xffffffff8060473f at sysctl_root+0x14f > >>>> #10 0xffffffff80604a2a at userland_sysctl+0x14a > >>>> #11 0xffffffff80604f1a at __sysctl+0xaa > >>>> #12 0xffffffff808e62d4 at amd64_syscall+0x1f4 > >>>> #13 0xffffffff808cef5c at Xfast_syscall+0xfc > >>>=20 > >>> Please look up the line number for the fill_kinfo_thread+0x54. > >>=20 > >>=20 > >> Is there a way for me to do this from the above information? As > >> I said in the original message, I failed to get a crash dump after > >> reboot (because, it turns out, I hadn't set up my gmirror swap device > >> properly). Alas, with the latest panic, it appears to have hung[1] > >> during the "Dumping" phase, so it looks like I won't get a saved crash > >> dump this time, either. :-( > >=20 > > Load the kernel.debug into kgdb, and from there do > > "list *fill_kinfo_thread+0x54". >=20 >=20 > gromit# kgdb /usr/obj/usr/src/sys/GENERIC/kernel.debug > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you = are > welcome to change it and/or distribute copies of it under certain conditi= ons. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for detail= s. > This GDB was configured as "amd64-marcel-freebsd"... > (kgdb) list *fill_kinfo_thread+0x54 > 0xffffffff805ee034 is in fill_kinfo_thread (/usr/src/sys/kern/kern_proc.c= :854). > 849 thread_lock(td); > 850 if (td->td_wmesg !=3D NULL) > 851 strlcpy(kp->ki_wmesg, td->td_wmesg, sizeof(kp->ki= _wmesg)); > 852 else > 853 bzero(kp->ki_wmesg, sizeof(kp->ki_wmesg)); > 854 strlcpy(kp->ki_ocomm, td->td_name, sizeof(kp->ki_ocomm)); > 855 if (TD_ON_LOCK(td)) { > 856 kp->ki_kiflag |=3D KI_LOCKBLOCK; > 857 strlcpy(kp->ki_lockname, td->td_lockname, > 858 sizeof(kp->ki_lockname)); > (kgdb)=20 This is indeed strange. It can only occur if td pointer is damaged. Please, try to get a core and at least print the content of *td in this cas= e. --QJ8Fh8pYRWS0QZcB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iEYEARECAAYFAk8+/pIACgkQC3+MBN1Mb4h16QCeNKaul23WwziJMvi+WuqkPZD4 K64AoL3+hOqkdstuY7NUqWCmYeEkfgrq =W/BX -----END PGP SIGNATURE----- --QJ8Fh8pYRWS0QZcB--