From owner-freebsd-net@freebsd.org Wed Aug 19 18:58:57 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6C1669BEC14 for ; Wed, 19 Aug 2015 18:58:57 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4D4E41846 for ; Wed, 19 Aug 2015 18:58:57 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 4AA2E9BEC11; Wed, 19 Aug 2015 18:58:57 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 303749BEC10; Wed, 19 Aug 2015 18:58:57 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F06A81845; Wed, 19 Aug 2015 18:58:56 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igxp17 with SMTP id p17so112743126igx.1; Wed, 19 Aug 2015 11:58:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=rOZAtgpPO8xS7uVnQoHJEBkLTFsEgT4USulqOUNeF3Y=; b=BEtCxkJfo8H18LstSn18JcrSYHDE8mm/MjoYU0CZALr932hkAvzlxtUzgbVCPj6far Pn+BRuEjiqKDby1uqXr8Is0h2NP1KYyprNlK95KJwW9jlACZo9vyAoTK2OXOAOmR0wRL FK1nD5BQncEfd+TZDdLV2LWt8DsZDIePp9QlMIu5ZBnHADekycHw9FBMQSWA51IjLOOf Cqj6y3AXnahZx2bLssbxkE783fjB+kb4h/70mwr+pRgM4jz0T3DavkvLVKe6SsPueeUV wNPa6wsGfQnxEchunXOzbQNyzWADntWs741oj+PaHtSiearCnHEkzAnj1aBlQi5hC28x qeHQ== MIME-Version: 1.0 X-Received: by 10.50.43.227 with SMTP id z3mr28127613igl.22.1440010736374; Wed, 19 Aug 2015 11:58:56 -0700 (PDT) Received: by 10.36.38.133 with HTTP; Wed, 19 Aug 2015 11:58:56 -0700 (PDT) In-Reply-To: <20150819160716.GK63584@albert.catwhisker.org> References: <20150818232007.GN1189@albert.catwhisker.org> <20150819160716.GK63584@albert.catwhisker.org> Date: Wed, 19 Aug 2015 11:58:56 -0700 Message-ID: Subject: Re: Panic [page fault] in _ieee80211_crypto_delkey(): stable/10/amd64 @r286878 From: Adrian Chadd To: David Wolfskill , "stable@freebsd.org" , "net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Aug 2015 18:58:57 -0000 hi, you'll have to do some debugging. it looks like it's some kind of odd race - line 461 is _ieee80211_crypto_delkey(); line 105 is cipher_detach() and it blows up there. Try "wlandebug +crypto" during your next boot and let's see what it logs for the key. If you can 'print *key' in kgdb on the core at some frame then we should get some useful information. -a On 19 August 2015 at 09:07, David Wolfskill wrote: > On Tue, Aug 18, 2015 at 04:20:07PM -0700, David Wolfskill wrote: >> I was minding my own business in a staff meeting this afternoon, and my >> laptop rebooted; seems it got a panic. I've copied the core.txt.0 file >> to , along with a >> verbose dmesg.boot from this morning and output of "pciconf -l -v". >> >> This was running: >> FreeBSD localhost 10.2-STABLE FreeBSD 10.2-STABLE #122 r286878M/286880:1002500: Tue Aug 18 04:06:33 PDT 2015 root@g1-252.catwhisker.org:/common/S1/obj/usr/src/sys/CANARY amd64 >> .... > > And this morning (just after I got in to work, and was trying (and > trying) to get re-associated with the AP at work), I had another one. > > I've copied the resulting core.txt.1 over to > http://www.cawhisker.org:~david/FreeBSD/stable_10/ as well; here are > excerpts from a unidiff between core.txt.{0,1}: > > --- core.txt.0 2015-08-18 15:39:05.232251000 -0700 > +++ core.txt.1 2015-08-19 08:56:37.686238000 -0700 > @@ -1,8 +1,8 @@ > -localhost dumped core - see /var/crash/vmcore.0 > +localhost dumped core - see /var/crash/vmcore.1 > > -Tue Aug 18 15:39:02 PDT 2015 > +Wed Aug 19 08:56:35 PDT 2015 > > -FreeBSD localhost 10.2-STABLE FreeBSD 10.2-STABLE #122 r286878M/286880:1002500: Tue Aug 18 04:06:33 PDT 2015 root@g1-252.catwhisker.org:/common/S1/obj/usr/src/sys/CANARY amd64 > +FreeBSD localhost 10.2-STABLE FreeBSD 10.2-STABLE #123 r286912M/286918:1002500: Wed Aug 19 04:05:06 PDT 2015 root@g1-252.catwhisker.org:/common/S1/obj/usr/src/sys/CANARY amd64 > > panic: page fault > > @@ -16,7 +16,7 @@ > > Unread portion of the kernel message buffer: > panic: page fault > -cpuid = 2 > +cpuid = 1 > KDB: stack backtrace: > #0 0xffffffff80946e00 at kdb_backtrace+0x60 > #1 0xffffffff8090a9e6 at vpanic+0x126 > @@ -34,8 +34,8 @@ > #13 0xffffffff8095e9f0 at sys_ioctl+0x140 > #14 0xffffffff80c84f97 at amd64_syscall+0x357 > #15 0xffffffff80c6a49b at Xfast_syscall+0xfb > -Uptime: 9h45m0s > -Dumping 625 out of 8095 MB:..3%..11%..21%..31%..41%..52%..62%..72%..82%..93% > +Uptime: 3h16m49s > +Dumping 584 out of 8095 MB:..3%..11%..22%..31%..42%..53%..61%..72%..83%..91% > > Reading symbols from /boot/kernel/geom_eli.ko.symbols...done. > Loaded symbols for /boot/kernel/geom_eli.ko.symbols > @@ -81,32 +81,32 @@ > at /usr/src/sys/kern/kern_shutdown.c:687 > #4 0xffffffff80c8467b in trap_fatal (frame=, > eva=) at /usr/src/sys/amd64/amd64/trap.c:851 > -#5 0xffffffff80c8497d in trap_pfault (frame=0xfffffe060d88b510, > +#5 0xffffffff80c8497d in trap_pfault (frame=0xfffffe060d5ea510, > usermode=) at /usr/src/sys/amd64/amd64/trap.c:674 > -#6 0xffffffff80c8401a in trap (frame=0xfffffe060d88b510) > +#6 0xffffffff80c8401a in trap (frame=0xfffffe060d5ea510) > at /usr/src/sys/amd64/amd64/trap.c:440 > #7 0xffffffff80c6a1b2 in calltrap () > at /usr/src/sys/amd64/amd64/exception.S:236 > #8 0xffffffff809f003a in _ieee80211_crypto_delkey () > at /usr/src/sys/net80211/ieee80211_crypto.c:105 > -#9 0xffffffff809eff5e in ieee80211_crypto_delkey (vap=0xfffffe03d9070000, > - key=0xfffffe03d9070800) at /usr/src/sys/net80211/ieee80211_crypto.c:461 > -#10 0xffffffff80a04d45 in ieee80211_ioctl_delkey (vap=0xfffffe03d9070000, > +#9 0xffffffff809eff5e in ieee80211_crypto_delkey (vap=0xfffffe03dd31a000, > + key=0xfffffe03dd31a800) at /usr/src/sys/net80211/ieee80211_crypto.c:461 > +#10 0xffffffff80a04d45 in ieee80211_ioctl_delkey (vap=0xfffffe03dd31a000, > ireq=) > at /usr/src/sys/net80211/ieee80211_ioctl.c:1252 > #11 0xffffffff80a03bd2 in ieee80211_ioctl_set80211 () > at /usr/src/sys/net80211/ieee80211_ioctl.c:2814 > #12 0xffffffff80a2c323 in in_control (so=, > - cmd=9214790412651315593, data=0xfffffe060d88bb80 "", ifp=0x3, > + cmd=9214790412651315593, data=0xfffffe060d5eab80 "", ifp=0x3, > td=) at /usr/src/sys/netinet/in.c:308 > -#13 0xffffffff809cd57b in ifioctl (so=0xfffffe03d9070800, cmd=2149607914, > - data=0xfffffe060d88b8e0 "wlan0", td=0xfffff80170abb940) > +#13 0xffffffff809cd57b in ifioctl (so=0xfffffe03dd31a800, cmd=2149607914, > + data=0xfffffe060d5ea8e0 "wlan0", td=0xfffff800098b5940) > at /usr/src/sys/net/if.c:2770 > -#14 0xffffffff8095ecf5 in kern_ioctl (td=0xfffff80170abb940, > - fd=, com=18446741891212314624) at file.h:320 > -#15 0xffffffff8095e9f0 in sys_ioctl (td=0xfffff80170abb940, > - uap=0xfffffe060d88ba40) at /usr/src/sys/kern/sys_generic.c:718 > -#16 0xffffffff80c84f97 in amd64_syscall (td=0xfffff80170abb940, traced=0) > +#14 0xffffffff8095ecf5 in kern_ioctl (td=0xfffff800098b5940, > + fd=, com=18446741891282216960) at file.h:320 > +#15 0xffffffff8095e9f0 in sys_ioctl (td=0xfffff800098b5940, > + uap=0xfffffe060d5eaa40) at /usr/src/sys/kern/sys_generic.c:718 > +#16 0xffffffff80c84f97 in amd64_syscall (td=0xfffff800098b5940, traced=0) > at subr_syscall.c:134 > #17 0xffffffff80c6a49b in Xfast_syscall () > at /usr/src/sys/amd64/amd64/exception.S:396 > @@ -118,305 +118,301 @@ > ------------------------------------------------------------------------ > .... > > > So it looks to me to be quite similar to the previous one. > > I've also copied the kernel config file ("CANARY") to the above-cited > Web page. > > Anything else I can do to help nail this? > > Peace, > david > -- > David H. Wolfskill david@catwhisker.org > Those who would murder in the name of God or prophet are blasphemous cowards. > > See http://www.catwhisker.org/~david/publickey.gpg for my public key.