From owner-freebsd-current@freebsd.org Mon Sep 21 12:16:32 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B76553F034D for ; Mon, 21 Sep 2020 12:16:32 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-qk1-x741.google.com (mail-qk1-x741.google.com [IPv6:2607:f8b0:4864:20::741]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bw3MN1PYqz4Ckp for ; Mon, 21 Sep 2020 12:16:31 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-qk1-x741.google.com with SMTP id f142so14613736qke.13 for ; Mon, 21 Sep 2020 05:16:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=Rw9Gf5xYiNPhq8LTZ+rCOgD5/rYC82FQXp6QiNV5J0Y=; b=RznYZFcVEImGZ44zpdQ3dVjnf1TPkPWAcPn332g5OLdQmbnExoTyEc1FpPq6sALUFr OAAzSHpKgn44dLRGcYslv0vUmof6AxAl+lkOoDbOsXmDXzmlHP6X0WGXjl3+8ow7grv0 zjhyUM1kBRnTYxN5XMudPpVYjy4wfaxp2hZQMDNDkX5irNj1SQb8LsZu3t8FDu6QWal2 IiyqIaCRhvpvCHDLZAzmCDVAC21SeoYBgJyOseELPbBV9QCWmaKyNn5+JsJ3CvDdvVHQ S+/l2m8yaRK6RxIxZwHAnGKg+7ogd4PevrRuCw94EAdIc+51ZSAZyNc7gADwvUYIYY4k RYkg== X-Gm-Message-State: AOAM532u4Co5AmCD49rXFsoVYSvdfU8iojp8Kyb2JcTTvM02xYr9eqEm PpR31somY0xg/DgeouBRs7e/+g== X-Google-Smtp-Source: ABdhPJzrdxHJDpOe2j6fWUBeA3NULG59FcExviMfmmZCZCtHke5TI9DG9lvsIgY4FPL6mRsBxZ0R2w== X-Received: by 2002:a37:4cc9:: with SMTP id z192mr18406683qka.364.1600690591091; Mon, 21 Sep 2020 05:16:31 -0700 (PDT) Received: from mutt-hbsd (75-148-2-186-WashingtonDC.hfc.comcastbusiness.net. [75.148.2.186]) by smtp.gmail.com with ESMTPSA id c13sm9663303qtq.5.2020.09.21.05.16.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 21 Sep 2020 05:16:30 -0700 (PDT) Date: Mon, 21 Sep 2020 08:16:27 -0400 From: Shawn Webb To: Kristof Provost Cc: FreeBSD Current Subject: Re: iflib/bridge kernel panic Message-ID: <20200921121627.3dovpumnl6xub3kn@mutt-hbsd> X-Operating-System: FreeBSD mutt-hbsd 13.0-CURRENT-HBSD FreeBSD 13.0-CURRENT-HBSD X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0xFF2E67A277F8E1FA References: <58CADEBB-64FD-414E-AB19-E4F8D3CABCA5@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="mv567ducpuubc3ie" Content-Disposition: inline In-Reply-To: <58CADEBB-64FD-414E-AB19-E4F8D3CABCA5@FreeBSD.org> X-Rspamd-Queue-Id: 4Bw3MN1PYqz4Ckp X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.81 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[hardenedbsd.org:s=google]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.02)[-1.021]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[hardenedbsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[hardenedbsd.org:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::741:from]; NEURAL_HAM_SHORT(-0.71)[-0.706]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Sep 2020 12:16:32 -0000 --mv567ducpuubc3ie Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Sep 21, 2020 at 09:57:40AM +0200, Kristof Provost wrote: > On 21 Sep 2020, at 2:52, Shawn Webb wrote: > >> From latest HEAD on a Dell Precision 7550 laptop: > > > > https://gist.github.com/lattera/a0803f31f58bcf8ead51ac1ebbc447e2 > > > > The last working boot environment was 14 Aug 2020. If I get some time to > > bisect commits, I'll try to figure out the culprit. > > > Try https://reviews.freebsd.org/D26418 That seems to fix the kernel panic. dmesg gets spammed with a freak ton of these LOR messages now: =3D=3D=3D=3D BEGIN LOG 01 =3D=3D=3D=3D Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] Sleeping on "e1000_delay" with = the following non-sleepable locks held: Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] exclusive sleep mutex if_bridge= (if_bridge) r =3D 0 (0xfffff8001ea07218) locked @ /usr/src/sys/net/if_brid= ge.c:827 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] stack backtrace: Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #0 0xffffffff80c6c4a1 at witnes= s_debugger+0x71 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #1 0xffffffff80c6d5bd at witnes= s_warn+0x40d Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #2 0xffffffff80c09b8b at _sleep= +0x5b Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #3 0xffffffff80c0a38e at pause_= sbt+0xfe Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #4 0xffffffff80652b2d at e1000_= write_phy_reg_mdic+0xed Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #5 0xffffffff80656bde at __e100= 0_write_phy_reg_hv+0x1ce Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #6 0xffffffff80640ea9 at e1000_= lv_jumbo_workaround_ich8lan+0x799 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #7 0xffffffff8062329e at em_if_= init+0x151e Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #8 0xffffffff80d347a9 at iflib_= init_locked+0x2d9 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #9 0xffffffff80d36b08 at iflib_= if_ioctl+0x1b8 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #10 0xffffffff83c582ac at bridg= e_set_ifcap+0x8c Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #11 0xffffffff83c544c8 at bridg= e_ioctl_add+0x4c8 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #12 0xffffffff83c560ff at bridg= e_ioctl+0x2df Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #13 0xffffffff80d9f1a1 at in_co= ntrol+0x341 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #14 0xffffffff80d16266 at ifioc= tl+0x766 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #15 0xffffffff80c715a0 at kern_= ioctl+0x290 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #16 0xffffffff80c71267 at sys_i= octl+0x127 Sep 21 08:08:28 hbsd-laptop-02 kernel: [25] #17 0xffffffff8122bf4c at amd64= _syscall+0x14c =3D=3D=3D=3D END LOG 01 =3D=3D=3D=3D =3D=3D=3D=3D BEGIN LOG 02 =3D=3D=3D=3D Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] lock order reversal: (sleepable= after non-sleepable) Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] 1st 0xfffff800374616a0 ure0 (u= re0, sleep mutex) @ /usr/src/sys/dev/usb/usb_request.c:714 Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] 2nd 0xffffffff81eb1ab8 sysctl = lock (sysctl lock, sleepable rm) @ /usr/src/sys/kern/kern_sysctl.c:837 Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] lock order ure0 -> sysctl lock = attempted at: Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #0 0xffffffff80c6c1dc at witnes= s_checkorder+0xdcc Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #1 0xffffffff80bf76bb at _rm_wl= ock_debug+0x6b Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #2 0xffffffff80c0c7a6 at sysctl= _add_oid+0x46 Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #3 0xffffffff83c64ea1 at ure_at= tach_post+0x1a91 Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #4 0xffffffff83c6a1af at ue_att= ach_post_task+0x2f Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #5 0xffffffff80a2b749 at usb_pr= ocess+0xf9 Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #6 0xffffffff80bb9fe5 at fork_e= xit+0x85 Sep 21 08:08:28 hbsd-laptop-02 kernel: [29] #7 0xffffffff81200a9e at fork_t= rampoline+0xe =3D=3D=3D=3D END LOG 02 =3D=3D=3D=3D At work, I have two ethernet interfaces: the onboard em0 and a usb ethernet= dongle. Thanks, --=20 Shawn Webb Cofounder / Security Engineer HardenedBSD GPG Key ID: 0xFF2E67A277F8E1FA GPG Key Fingerprint: D206 BB45 15E0 9C49 0CF9 3633 C85B 0AF8 AB23 0FB2 https://git-01.md.hardenedbsd.org/HardenedBSD/pubkeys/src/branch/master/Sha= wn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc --mv567ducpuubc3ie Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEA6TL67gupaZ9nzhT/y5nonf44foFAl9omZgACgkQ/y5nonf4 4foACA//VxJhoEI6+Xl1rzpn3tkP3SwYPnrtk3cuxZsUJSHT0/jqZqiw5BGs/v7n qNx9Gs7/yf5uesGVRqB695F5e6EcE+MR8IlN+462dqCnUEga3gfwjWZ5XQrxklmv gS79tfAlkTIe3iZhdMbEEOIL7UhrB89hL01tzPSqQ6b0FNAlxBn0ML6us6qOuv7h JLX4VIcZBESoN3oR/UrDz2XyjI1T8JwVzy06PhqwMtcP3fgFpw9S714kbuzsyoR9 SSEj4B6LU6hBNZmRvfY0QXDSpvq/CGRZievdXH+yzqyDdMVjucyYHZQqKCZog8Me XZwK1YbNoe40qTybPr6VzMydXMNFhNitVaYQb3JSlYOPMfaCtOGQAgIXqEkxfEl/ A/LawNfop/js1nIeD+ZaYm6pzMIE43+VtQdcnZjC91w7k7AKmlQrHEgOcG/qDxBO kCtwnrtZ5vArflGC7PQuj2LlzJXIu4l5DAfkJ1NnNvuZCXLdLTysSL7iy/gfKKYw 9N4f5YZStrW4nYKl0V6lr03/sk0bRLkmth2KtEW8ub6einll2b5ZJxbgpqvNAZI4 gF2bpSSj6zppNFMtx6UgO+yV4unbk5cNp61GxpIvOoK1jSqc4XK7NWiw+Qg5Ae6E TKtDOWEXwSLEjIoDUq8Wv1Xgh9ayVzB/t99OSPPg7GDIlRd5sXk= =FvwT -----END PGP SIGNATURE----- --mv567ducpuubc3ie--