From owner-freebsd-net@freebsd.org Fri Sep 11 16:51:15 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2080C3E006D for ; Fri, 11 Sep 2020 16:51:15 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp1wy6D4qz4Ypy for ; Fri, 11 Sep 2020 16:51:14 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: by mailman.nyi.freebsd.org (Postfix) id D54E83E0088; Fri, 11 Sep 2020 16:51:14 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D4FEC3DFF25; Fri, 11 Sep 2020 16:51:14 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from wout4-smtp.messagingengine.com (wout4-smtp.messagingengine.com [64.147.123.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp1wx73M2z4Ymd; Fri, 11 Sep 2020 16:51:13 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id C3B6B71B; Fri, 11 Sep 2020 12:45:12 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Fri, 11 Sep 2020 12:45:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mm.st; h=subject :to:cc:references:from:message-id:date:mime-version:in-reply-to :content-type:content-transfer-encoding; s=fm1; bh=/O8r4nMkoBJn7 pZuShBzIDZh7lv9zUSptLpl4gdOAek=; b=W5Tlk1pMKPNlEQKMVftB73zT9BDVN 6J/oPVcLtoPyFpZwPdrJTVWRcoA5k3uvqi+MIx8QF2DB+I91mOKEGnfTYpL2QhSr 9zt3JBjtHRwssr/9gfawwb1DMHltFNDs9xL3xyoGjCCiWw3r+POppqkRU/7nPXjz z3X0vrsprwCS4TCKbvMcLFNXXc/FVmxIs4BlBtsy632BiDEdDBs1Zz71TSRXxONI 54AfgMlPOOpERrLb/UcMDMNVF8izUUIlFk9UeFk7GXwEVkBCF4IhJFgp+xc233G6 1OWs2vvf/Wf/QPgQ7zKkQfc9uaAguXVLM4xwrzc4nUWrZOa21gcRhDEgg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=/O8r4nMkoBJn7pZuShBzIDZh7lv9zUSptLpl4gdOA ek=; b=qQsuSjM1ZLqxwskAb/w6HB8BLm4ykCCrDqHg4oUWH6WPGfbibRvX4ufc1 3i6k8FZ/7lg6mdkGVpSbKaH9kjpcZWyIrb4WSxSgtSE3YSxTLbdns9uwwT/ZvL0g a9ApIgXyfp7bAhRX3QeOps/qpBSODrBmjXX1crPkenaVdqTHkRdKIrBue8zpihQQ N9sk70CQ6gWtXZD+b83mAQvmheHJqnuny2NcDJ2rnF0rbXvU3ZMrAf5OSSFoG+QU SlnscBVKdnc31zC5m+XH6YDp8vMWAMxj2BZHMmrQikhGHiFhuvF1QjkDoim4lXGb oQoT4WzBsNo2Q0+Dtpkg5KDsVfvWg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudehledguddtiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepuffvfhfhkffffgggjggtgfesth ejredttdefheenucfhrhhomhepgihtohhuqhhhsehmmhdrshhtnecuggftrfgrthhtvghr nhepvdeihfeigeeitddtjeeihfetkeeghfduhfetueejueekjeefleduveffheevuefhne cukfhppeeluddrvdegtddruddvgedrudeltdenucfuphgrmhfkphfpvghtfihorhhkpeel uddrvdegtddruddvgedrudeltdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmh epmhgrihhlfhhrohhmpeigthhouhhqhhesmhhmrdhsth X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id A14783280064; Fri, 11 Sep 2020 12:45:11 -0400 (EDT) Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited To: Gleb Smirnoff Cc: current@freebsd.org, net@freebsd.org References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <20200911161148.GP1269@FreeBSD.org> From: xtouqh@mm.st Message-ID: Date: Fri, 11 Sep 2020 19:45:09 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <20200911161148.GP1269@FreeBSD.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bp1wx73M2z4Ymd X-Spamd-Bar: +++++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mm.st header.s=fm1 header.b=W5Tlk1pM; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=qQsuSjM1; dmarc=pass (policy=none) header.from=mm.st; spf=pass (mx1.freebsd.org: domain of xtouqh@mm.st designates 64.147.123.20 as permitted sender) smtp.mailfrom=xtouqh@mm.st X-Spamd-Result: default: False [11.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.20:c]; FREEMAIL_FROM(0.00)[mm.st]; RWL_MAILSPIKE_GOOD(0.00)[64.147.123.20:from]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[mm.st:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(0.00)[mm.st,none]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.20:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[mm.st]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.190:received]; R_DKIM_ALLOW(0.00)[mm.st:s=fm1,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RECEIVED_SPAMHAUS_CSS(4.00)[91.240.124.190:received]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.53)[0.533]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_MEDIUM(1.05)[1.054]; BAD_REP_POLICIES(0.10)[]; NEURAL_SPAM_LONG(1.01)[1.012]; FROM_NO_DN(0.00)[]; GREYLIST(0.00)[pass,body]; MAILMAN_DEST(0.00)[current,net] X-Spam: Yes X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 16:51:15 -0000 Gleb Smirnoff wrote: > Hi, > > can you please try out this patch? This is configuration event > and we should use sleepable lock to synchronize, not epoch. It didn't help, though I guess my problem is in if_bridge, not if_lagg which the patch modifies? > On Fri, Sep 11, 2020 at 10:47:41AM +0300, xtouqh@mm.st wrote: > x> Updating from latest CURRENT snapshot > x> (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the > x> bridges with igb (I350-T2) for me. Booting to kernel.old and/or > x> commenting the entries in rc.conf helps. > x> > x> rc.conf: > x> ---- > x> cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" > x> ifconfig_em0="inet ..." > x> ifconfig_igb0="up" > x> ifconfig_igb1="up" > x> ifconfig_bridge0="addm igb0 addm tap0 addm tap1" > x> ifconfig_bridge1="addm igb1 addm tap2 addm tap3" > x> ---- > x> > x> NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): > x> ---- > x> em0: mem 0x92d00000-0x92d1ffff at > x> device 31.6 numa-domain 0 on pci0 > x> em0: Using 1024 TX descriptors and 1024 RX descriptors > x> em0: Using an MSI interrupt > x> em0: Ethernet address: e0:d5:5e:6c:aa:36 > x> em0: netmap queues/slots: TX 1/1024, RX 1/1024 > x> igb0: mem > x> 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain 0 > x> on pci16 > x> igb0: Using 1024 TX descriptors and 1024 RX descriptors > x> igb0: Using 8 RX queues 8 TX queues > x> igb0: Using MSI-X interrupts with 9 vectors > x> igb0: Ethernet address: a0:36:9f:0a:cf:42 > x> igb0: netmap queues/slots: TX 8/1024, RX 8/1024 > x> igb1: mem > x> 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain 0 > x> on pci16 > x> igb1: Using 1024 TX descriptors and 1024 RX descriptors > x> igb1: Using 8 RX queues 8 TX queues > x> igb1: Using MSI-X interrupts with 9 vectors > x> igb1: Ethernet address: a0:36:9f:0a:cf:43 > x> igb1: netmap queues/slots: TX 8/1024, RX 8/1024 > x> ---- > x> > x> panic: > x> ---- > x> panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan > x> 0xffffffff8157d9a0 with sleeping prohibited > x> cpuid = 16 > x> time = 1599808542 > x> KDB: stack backtrace: > x> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > x> 0xfffffe01ba658c40 > x> vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 > x> panic() at panic+0x43/frame 0xfffffe01ba658cf0 > x> sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 > x> _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 > x> pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 > x> e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame > x> 0xfffffe01ba658e60 > x> em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 > x> iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 > x> iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 > x> bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 > x> bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 > x> bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 > x> in_control() at in_control+0x322/frame 0xfffffe01ba659180 > x> ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 > x> kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 > x> sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 > x> amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 > x> fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ba6594b0 > x> --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = > x> 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- > x> Uptime: 14s > x> Dumping 3794 out of 97961 > x> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% > x> ----