From owner-freebsd-current@freebsd.org Fri Oct 30 18:27:02 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2A960458A02 for ; Fri, 30 Oct 2020 18:27:02 +0000 (UTC) (envelope-from aaronfarias@att.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4CN9ks5kscz4Kpr for ; Fri, 30 Oct 2020 18:27:01 +0000 (UTC) (envelope-from aaronfarias@att.net) Received: by mailman.nyi.freebsd.org (Postfix) id C2FBC458A01; Fri, 30 Oct 2020 18:27:01 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C2B854586E5 for ; Fri, 30 Oct 2020 18:27:01 +0000 (UTC) (envelope-from aaronfarias@att.net) Received: from sonic312-27.consmr.mail.gq1.yahoo.com (sonic312-27.consmr.mail.gq1.yahoo.com [98.137.69.208]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CN9ks1kFLz4L9n for ; Fri, 30 Oct 2020 18:27:00 +0000 (UTC) (envelope-from aaronfarias@att.net) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1604082419; bh=qaF4CBqtJY2eyCLqTGrVG26Ih/jOUw+i4Ud3dsBwX0D=; h=Subject:From:To:Date; b=QeTYfI8xlQatN4CedtoY7mRpcy21Ubx1yDEpUX2qFez9H/6HzcQXIn6b5z+lh9rQx0z1B9YhoudO3Pqe+K+JWI/VdZatOZtw6dSwI0Begpvt1gG9gFdgXG0QYCSo89NDwas6GqLppQ216D+DjmZTrfgXvXTKBp8UYNa1EQS6gWxy4PvoPl0CPAzDeJkdeEquaqpEsODs1hcBDYU4KPecR/3W+l79kZbAiPupDuySyDJICbhXmBPHGPJ0zr5p64AWYBJgJPaGE1MMs2lyS10WFKHnBryWUXa2WXiKBhUcOd8jY4OOdIR6piG7PSko9p4MwRcuWiwbevWh/CfguExMnA== X-YMail-OSG: cokQiKcVM1nOxlDcb27k5TLIcUBWani7rqbYgcuA5gQD1KOpnd2f7x1Y7mNrkPK r.FSZl1M4bePoil64nisN78oSLZk6TgyN353YGH0MY9ZchuFKE_9iaE18rhqWiADgSCqk4sUfrRh vjc3mzpY67iExHtbjUYIJESUrzcnsMhV2VSFAOXwwUoagCCP1bPiJbI_4Gmh2NyyHDyZ9rxnjYD8 q0QNbU0pMb.p6xMWNKC1e41GQIIiqLG9xw9jmKQcdqkrVgZ3bc0q2XPw4O4Xx_aVq0v5.MJnxwYI C5hWrZHHwv9W7ACfphRZL.F8BFgMVvCjigXZFbmk.OB3cNVl7.DL4RbOps1OX2JWOFA.Dp.culgX b3gHmQja9K00vHWHPrgjuDm3b7jW6yDOyFG5A7ubMcEfuXgjc0D79Le5Ul3ntos6wYfnPdqmSBD0 GTpMh459VCVJSV69cmb_lHbSVkKxNMqQLCgErRARP5VCsteATvoyfc1pTSY60mm7T9RryI_OkgY8 QKIUZf5NPaM7OdtJ5eOZNK4Jm0RxOCVQzfQN9l2PQc3NsAZ.C6ZRAmdxsLji2pssBdXSPx1xVJU5 RYTGVH0xavQtVHYA_VgFunpOubWyOqRf88MzRw1xWzESO1klaFhsJ1IXy53tbbWgY5r2MPvYb8I7 mJzX05MTpXi8RoFYat9f5FMk5MjKzYmDOFtKrwqkD4BKVpBGGKcS0QHo5f6dHj6Aru8_iu79RAF1 F9y2BfhLVRJvAQL_Lg6KfufVNZL.qtszxhiqiEXHYpt1b7xc3p5tmA5XG7zb7anIeJ7iNWqszwMq B9Z5D8Ikv1hBHVGCZtMEczogrkLSOp.oSktp7rdm4QEot8jJFQR7sfo3CYF8NA_kPgs43hJPbLz5 eG5tTt4vCfYaYzAFzrId_V3SA1.MxVUrVn4NLVC2hig8A_M13OMtO3TLG5sQ78otd7UxOaeiTGxo m9yLgeej2UdI2M3KLVlR12amPZz5qhdSh22a6aKyzVN5t7u2MfMjM3LbIJ1dpvOvr5Tm0ATK6k.b qffMKOLasq_kz.cxUKqWBI9pGj3ByHlCPqgGaZfPAxNgGKDyH2tV8gLPqvh0g6U7dFcSPsh9bTZA OlXnV285mRVlFPyxu3xjVcbEyQm329xbu6mQA3gzcT2DJstp9M8rvzFgLSkporF4nMgdjGmer45X kIR06uvn0b067peTijzccEMDfxIfFsfH.NuPJXu2bE.9TbAfQ8FdZCvmv3dsx9ox11HQkf2u5dag 2ljsd1zkn1cGMkABsfKZ_kOvCnJomGfWESVTqCAeDh7yJeImVp.Z0yMGkv5VlI0IM50_ULim1t0n U_ltGXMQ5Y64tRWdiaoj_5dlxsA4r83Togx_Y4dRhgAmQ2qlzmoiPA6HNHgyxF5DCuFhpRm.G8gj ZkKOaF7HPkz0Frx8prLwpbUdkIXuRHH2L5xmlVJKvxDl5JpOpVCgLVH1Cl7oDxKdSy2NXPL4kJfe HFUZes3D34YmDK0Wb7mlQwU9nzUekDVW8Um7qfxMIxjA7AKMp1.R2pAFpIK1mE.uorxXH9ah8yT_ iIMAOOWLOtfCCCJ5XDot1O48_PKv7HKHVnhTabSbv1uDAlRA_F0AjAaBjQnBjsgxeMHCxyZOOIqE 9bqVlGClwjmDyF6hgnUoBVjEHKoc3HKyQouoOWD0MIC.qoQF0zjv63cGtD_Feq8XnDfoU0TjUqXP 9OWUYRo5PmGyBy2RQPiVtFY8ECdAUYOewPMVkKBrY6FSgPvMEri6Cr9aCJXNJHsyZoZNJFCZ_YFm UPMjkFxfm945LwFPgXEtiUXy0HCYu7qhvUG1DtXvIAztzWYLfMVFCSBFXJw3GmS6UtoxTwDx6_HQ MClT0deK8jhbz7n_MBcl2jwD0vpvBmrssKKjmL1kvt3_ahs0fqTIqSXeSqm.BczWQtE.f.J369ts 7UByQQSJ9mDwUXKGblNhFpdhgpxKwnep1Nt.NZCuLSA3F64ufhxN8FREMXanZ677Ep54Bx0VRNQz OvHE8EJBArxZw9WQwHiVdet5TLrlqdc7jsS6twtiDddAhlwhTDbKao8Ngz77.zkkNegboh85BH2D uroHF0WHMOsO4q6N_erqR5Nd8rjc5Mth8MGtTPRkUrQY4zScGcYRAO0FBGsL9Cb7YwWPV69EdoJU kahQzYfGy1.EGW07TGwcq2uhbjnfqG0C_7uLFPUC1n8c3AHwpnBEaEfEhgCF7U.dLhpqhcN3dv9R kvQlmLfvM7I3FLeExmzjkMFbHHVFOlay1guy4XRlezE4eH82FEgeWT_GnL_X3GCtBoLRe3FDIROg bbmx_nRqiDwKByzD9jMzVawFz0doqmsvzM8MkWO0rWgA30aL3SoS7lrADAAogkdc4k.Tdsvniw2M B2bRbIr5aZ8bCaa1Y3lpmdagQDBHpAGf8Fs8DrsRNbXyC6hnWMc_bWJtFmVQmVKHlIp9hdpNbZLe tnDaAJuLuaX_Sreq5_sHje4OFgVHeajRG2qYnSwnhd27ayUzNjhrz_Dj6758231cvQMTeroXtptE SBwt3rbX0u_xOonI8gujixjlq8mlgpSd29teIhhRpLR8q_MLYkd8SY3rp_zUXDbMcp3d99yu5w3. 25rI6.5U.3c6xPEMI2xNa Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Fri, 30 Oct 2020 18:26:59 +0000 Received: by smtp403.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 955b8e3e7c52467939857e66857a7bf4; Fri, 30 Oct 2020 18:26:55 +0000 (UTC) Message-ID: <503577abda2d455126c6639de9c5faea88bc413d.camel@ubuntu.com> Subject: Re: "panic: page fault" in iwn signal handler(?) at r367127 From: Aaron H Farias Martinez To: current@freebsd.org Date: Fri, 30 Oct 2020 14:26:53 -0400 In-Reply-To: <20201030123744.GT1430@albert.catwhisker.org> References: <20201030123744.GT1430@albert.catwhisker.org> Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.38.0 FreeBSD GNOME Team MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Mailer: WebService/1.1.16944 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo Apache-HttpAsyncClient/4.1.4 (Java/11.0.7) X-Rspamd-Queue-Id: 4CN9ks1kFLz4L9n X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Oct 2020 18:27:02 -0000 On Fri, 2020-10-30 at 05:37 -0700, David Wolfskill wrote: > I've copied the dump and core.txt files to > http://www.catwhisker.org/~david/FreeBSD/head/r367127/ >=20 > Here's a copy/paste of the stack trace (from the core.txt.3 file): > p 12: page fault while in kernel mode > cpuid =3D 4; apic id =3D 04 > fault virtual address =3D 0xfffff80840000000 > fault code=C2=A0 =3D supervisor read data, page not present > instruction pointer =3D 0x20:0xffffffff80495f03 > stack pointer=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D 0x0:0xf= fffffff8241d748 > frame pointer=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D 0x0:0xf= fffffff8241d7a0 > code segment=C2=A0 =3D base 0x0, limit 0xfffff, type 0x1b > =C2=A0=C2=A0 =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process=C2=A0 =3D 12 (irq36: iwn0) > trap number=C2=A0 =3D 12 > panic: page fault > cpuid =3D 4 > time =3D 1604056852 > KDB: stack backtrace: > db_trace_self_wrapper() at 0xffffffff804a69db =3D > db_trace_self_wrapper+0x2b/frame 0xffffffff8241d3f0 > vpanic() at 0xffffffff80baf802 =3D vpanic+0x182/frame > 0xffffffff8241d440 > panic() at 0xffffffff80baf5c3 =3D panic+0x43/frame 0xffffffff8241d4a0 > trap_fatal() at 0xffffffff8102c2f7 =3D trap_fatal+0x387/frame > 0xffffffff8241d500 > trap_pfault() at 0xffffffff8102c397 =3D trap_pfault+0x97/frame > 0xffffffff8241d560 > trap() at 0xffffffff8102b98b =3D trap+0x2ab/frame 0xffffffff8241d670 > calltrap() at 0xffffffff80fffa08 =3D calltrap+0x8/frame > 0xffffffff8241d670 > --- trap 0xc, rip =3D 0xffffffff80495f03, rsp =3D 0xffffffff8241d748, rbp > =3D 0xffffffff8241d7a0 --- > rijndaelEncrypt() at 0xffffffff80495f03 =3D rijndaelEncrypt+0x233/frame > 0xffffffff8241d7a0 > ccmp_decap() at 0xffffffff80d08bc1 =3D ccmp_decap+0x421/frame > 0xffffffff8241d8b0 > ieee80211_crypto_decap() at 0xffffffff80d07955 =3D > ieee80211_crypto_decap+0x125/frame 0xffffffff8241d900 > sta_input() at 0xffffffff80d41dec =3D sta_input+0x43c/frame > 0xffffffff8241d9a0 > iwn_notif_intr() at 0xffffffff8069949c =3D iwn_notif_intr+0x137c/frame > 0xffffffff8241dab0 > iwn_intr() at 0xffffffff8068f4f8 =3D iwn_intr+0x2b8/frame > 0xffffffff8241db20 > ithread_loop() at 0xffffffff80b6dbb9 =3D ithread_loop+0x279/frame > 0xffffffff8241dbb0 > fork_exit() at 0xffffffff80b6a690 =3D fork_exit+0x80/frame > 0xffffffff8241dbf0 > fork_trampoline() at 0xffffffff81000a5e =3D fork_trampoline+0xe/frame > 0xffffffff8241dbf0 > --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- > KDB: enter: panic >=20 > __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 > 55=C2=A0 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(struct pc= pu, > (kgdb) #0=C2=A0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:5= 5 > #1=C2=A0 doadump (textdump=3D0) at /usr/src/sys/kern/kern_shutdown.c:394 > #2=C2=A0 0xffffffff804a3cea in db_dump (dummy=3D,=20 > =C2=A0=C2=A0=C2=A0 dummy2=3D, dummy3=3D, > dummy4=3D) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/ddb/db_command.c:575 > #3=C2=A0 0xffffffff804a3ab0 in db_command (last_cmdp=3D,= =20 > =C2=A0=C2=A0=C2=A0 cmd_table=3D, dopager=3D1) at > /usr/src/sys/ddb/db_command.c:482 > #4=C2=A0 0xffffffff804a380d in db_command_loop () > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/ddb/db_command.c:535 > #5=C2=A0 0xffffffff804a6b26 in db_trap (type=3D, > code=3D) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/ddb/db_main.c:270 > #6=C2=A0 0xffffffff80bfb5c4 in kdb_trap (type=3D3, code=3D0, tf=3D out>) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/kern/subr_kdb.c:699 > #7=C2=A0 0xffffffff8102be9e in trap (frame=3D0xffffffff8241d320) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/amd64/amd64/trap.c:576 > #8=C2=A0 > #9=C2=A0 kdb_enter (why=3D0xffffffff8120d701 "panic", msg=3D) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/kern/subr_kdb.c:486 > #10 0xffffffff80baf81e in vpanic (fmt=3D, ap=3D out>) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/kern/kern_shutdown.c:901 > #11 0xffffffff80baf5c3 in panic ( > =C2=A0=C2=A0=C2=A0 fmt=3D0xffffffff81c79aa8 > "\362\357\034\201\377\377\377\377") > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/kern/kern_shutdown.c:838 > #12 0xffffffff8102c2f7 in trap_fatal (frame=3D0xffffffff8241d680,=20 > =C2=A0=C2=A0=C2=A0 eva=3D18446735313050009600) at /usr/src/sys/amd64/amd6= 4/trap.c:915 > #13 0xffffffff8102c397 in trap_pfault (frame=3D0xffffffff8241d680,=20 > =C2=A0=C2=A0=C2=A0 usermode=3D, signo=3D, u= code=3D out>) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/amd64/amd64/trap.c:732 > #14 0xffffffff8102b98b in trap (frame=3D0xffffffff8241d680) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/amd64/amd64/trap.c:398 > #15 > #16 rijndaelEncrypt (rk=3D, Nr=3D,=20 > =C2=A0=C2=A0=C2=A0 pt=3D,=20 > =C2=A0=C2=A0=C2=A0 ct=3D0xffffffff8241d830 > "\277\243\ff\211\335\330\v5\234\035{\210\330\320\327Fe\235>\226\026\0 > 25c\266n\325\305\205]\251%\001\002\004\030\326!\"\037") > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/crypto/rijndael/rijndael-alg-fst.c:100= 0 > #17 0xffffffff80d08bc1 in ccmp_decrypt (key=3D0xfffffe106978a160, > pn=3D25627,=20 > =C2=A0=C2=A0=C2=A0 m=3D0xfffff8010ffc9b00, hdrlen=3D) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/net80211/ieee80211_crypto_ccmp.c:623 > #18 ccmp_decap (k=3D, m=3D, > hdrlen=3D) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/net80211/ieee80211_crypto_ccmp.c:284 > #19 0xffffffff80d07955 in ieee80211_crypto_decap (ni=3D, > =C2=A0=C2=A0=C2=A0 m=3D0xfffff8010ffc9b00, hdrlen=3D26, key=3D0xffffffff8= 241d920) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/net80211/ieee80211_crypto.c:684 > #20 0xffffffff80d41dec in sta_input (ni=3D,=20 > =C2=A0=C2=A0=C2=A0 m=3D0xfffff8010ffc9b00, rxs=3D, rssi=3D= ,=20 > =C2=A0=C2=A0=C2=A0 nf=3D) at /usr/src/sys/net80211/ieee802= 11_sta.c:773 > #21 0xffffffff8069949c in iwn_rx_done (sc=3D0xfffffe1033319000,=20 > =C2=A0=C2=A0=C2=A0 desc=3D, data=3D) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/dev/iwn/if_iwn.c:3191 > #22 iwn_notif_intr (sc=3D) at > /usr/src/sys/dev/iwn/if_iwn.c:4018 > #23 0xffffffff8068f4f8 in iwn_intr (arg=3D0xfffffe1033319000) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/dev/iwn/if_iwn.c:4337 > #24 0xffffffff80b6dbb9 in intr_event_execute_handlers (p=3D out>,=20 > =C2=A0=C2=A0=C2=A0 ie=3D0xfffff8000c52b300) at /usr/src/sys/kern/kern_int= r.c:1168 > #25 ithread_execute_handlers (p=3D, > ie=3D0xfffff8000c52b300) > =C2=A0=C2=A0=C2=A0 at /usr/src/sys/kern/kern_intr.c:1181 > #26 ithread_loop (arg=3D) at > /usr/src/sys/kern/kern_intr.c:1269 > #27 0xffffffff80b6a690 in fork_exit ( > =C2=A0=C2=A0=C2=A0 callout=3D0xffffffff80b6d940 , > arg=3D0xfffff8000d18ef00,=20 > =C2=A0=C2=A0=C2=A0 frame=3D0xffffffff8241dc00) at /usr/src/sys/kern/kern_= fork.c:1052 > #28 > (kgdb)=20 >=20 >=20 > This happened while my laptop was running: > FreeBSD g1-55.catwhisker.org 13.0-CURRENT FreeBSD 13.0-CURRENT #43 > r367127M/367127: Thu Oct 29 05:52:40 PDT 2020=C2=A0=C2=A0=C2=A0=C2=A0 > root@g1-55.catwhisker.org:/common/S4/obj/usr/src/amd64.amd64/sys/CANA > RY=C2=A0 amd64 1300123 1300123 >=20 > during the "make buildkernel" phase of an in-place source update to > r367160. >=20 > As often happens while I'm running head, there was an "iwn firmware > panic" (see, e.g., > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D214435); record of > it > may be found in /var/log/messages, starting around: >=20 > <2>1 2020-10-30T11:05:07.327958+00:00 g1-55.catwhisker.org kernel - - > - Expensive timeout(9) function: > 0xffffffff80d8d2f0(0xfffffe1067a408f0) 0.840172647 s > <2>1 2020-10-30T11:07:36.367805+00:00 g1-55.catwhisker.org kernel - - > - iwn0: iwn_intr: fatal firmware error > <2>1 2020-10-30T11:07:36.367830+00:00 g1-55.catwhisker.org kernel - - > - firmware error log: > <2>1 2020-10-30T11:07:36.367839+00:00 g1-55.catwhisker.org kernel - - > -=C2=A0=C2=A0 error type=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D "UNKNOWN" (0x0= 000001D) >=20 >=20 > and the "WiFi" LED on the laptop went dark.=C2=A0 As I was trying to do > some work on another machine (while logged in to that machine from > the > laptop), the loss of connectivity was ... disruptive.=C2=A0 While I was > mildly gratified that (this time) the "make buildkernel" appeared to > be > proceeding despite the iwn(4) issue(s), I also wanted to get back to > what I was doing. >=20 > So after a few minutes -- when it became apparent that the link > wasn't > being recovered on its own -- I switched from X11 to vty1 (to leave > vty0 > for console messages), logged in as root, and issued: >=20 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0service netif restart wla= n0 >=20 > after a couple of minutes (during which the "make buildkernel" was > continuing), the "service netif restart wlan0" had not yet completed, > so > I sent it a SIGNIFO (via ^T), and (as I recall), it indocated that > the > process was invoking ifconfig, and there was some mention of a > function > whose name included "epoch". >=20 > I resumed waiting; after another minute or so, I trued ^T again, and > there appeared to be no progress. >=20 > After waiting another 30 seconds or so, I tried to bail out via ^C; > that > appeared to be ineffective.=C2=A0 So after waiting another 10 - 15 second= s > or > so, I tried backgrounding (^Z), followed by "kill %1". >=20 > It was shortly after that the panic occurred.=C2=A0 Which may well -- to > some > extent -- have been self-inflicted.=C2=A0 That said, the iwn firmware > panics > are not something I can control (as far as I know -- please let me > know > how I can control them if I'm incoorrect on that score).=C2=A0 For that > matter, I have no particular attachment to this NIC -- I'm open to a > suggestion for any NIC with the same (miniPCI) form factor that will > work well with FreeBSD. >=20 > Peace, > david I got the same issue.