From owner-freebsd-bugs@freebsd.org Tue Jul 31 12:18:34 2018 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 094CD1058920 for ; Tue, 31 Jul 2018 12:18:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8414988459 for ; Tue, 31 Jul 2018 12:18:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 42A52105891E; Tue, 31 Jul 2018 12:18:33 +0000 (UTC) Delivered-To: bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2098A105891D for ; Tue, 31 Jul 2018 12:18:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 93B0788457 for ; Tue, 31 Jul 2018 12:18:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E1E3EE98E for ; Tue, 31 Jul 2018 12:18:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w6VCIVPl044386 for ; Tue, 31 Jul 2018 12:18:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w6VCIVw3044377 for bugs@FreeBSD.org; Tue, 31 Jul 2018 12:18:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 230235] ixl: hangs when adding it to a bridge or enabling iovctl VFs (SR-IOV) Date: Tue, 31 Jul 2018 12:18:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ixbug@riseup.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2018 12:18:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230235 Bug ID: 230235 Summary: ixl: hangs when adding it to a bridge or enabling iovctl VFs (SR-IOV) Product: Base System Version: 11.2-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: ixbug@riseup.net this is with driver version v1.9.5 (for v1.9.13: see the next section): when adding ixl1 to a bridge the interface hangs: # vm switch create public # vm switch add public ixl1=20 /var/log/messages: hh:39:49 kernel: bridge0: Ethernet address: ... hh:39:49 kernel: bridge0: changing name to 'vm-public' hh:40:12 kernel: ixl1: RX queue 3 still enabled! hh:40:12 kernel: vm-public: link state changed to UP hh:40:12 kernel: ixl1: promiscuous mode enabled hh:40:12 kernel: ixl1: Malicious Driver Detection event 2 on TX queue 773,= pf number 1 hh:40:12 kernel: ixl1: MDD TX event is for this function! hh:40:12 kernel: ixl1: Malicious Driver Detection event 2 on TX queue 774,= pf number 1 hh:40:12 kernel: ixl1: MDD TX event is for this function! hh:40:12 kernel: ixl1: Malicious Driver Detection event 2 on TX queue 772,= pf number 1 hh:40:12 kernel: ixl1: MDD TX event is for this function! hh:40:23 kernel: ixl1: WARNING: queue 7 appears to be hung! hh:40:24 kernel: ixl1: WARNING: queue 6 appears to be hung! hh:40:30 kernel: ixl1: WARNING: queue 4 appears to be hung! hh:40:34 kernel: ixl1: WARNING: queue 5 appears to be hung! -> rebooted to recover --------- Since the bridge interface does not work I tried SR-IOV (this is with driver version v1.9.13 after the reboot) log when booting up: kernel: ixl1: mem 0xf8800000-0xf8ffffff,0xf9800000-0xf9807fff irq 32 at device 0.1 numa-domain 0 on pci3 kernel: ixl1: using 1024 tx descriptors and 1024 rx descriptors kernel: ixl1: fw 6.0.48442 api 1.7 nvm 6.01 etid 800035cf oem 1.262.0 kernel: ixl1: PF-ID[1]: VFs 64, MSIX 129, VF MSIX 5, QPs 768, I2C kernel: ixl1: Using MSIX interrupts with 9 vectors kernel: ixl1: Allocating 8 queues for PF LAN VSI; 8 queues active kernel: ixl1: Ethernet address: ... kernel: ixl1: PCI Express Bus: Speed 8.0GT/s Width x8 kernel: ixl1: SR-IOV ready kernel: ixl1: netmap queues/slots: TX 8/1024, RX 8/1024 kernel: ixl1: The device is not iWARP enabled /etc/iov/ixl1.conf --- PF { device : "ixl1"; num_vfs : 2; } DEFAULT { passthrough : true; } -- starting iovctl caused it to hang again: # service iovctl start logs: /var/log/messages: hh:mm:19 kernel: NMI ISA 38, EISA 0 hh:mm:19 kernel: NMI/cpu10 ... going to debugger hh:mm:21 kernel: ixl1: RX queue 0 still enabled! hh:mm:21 kernel: ixl1: RX queue 1 still enabled! hh:mm:21 kernel: ixl1: RX queue 2 still enabled! hh:mm:21 kernel: pci3: at device 0.80 (no driver attac= hed) hh:mm:21 kernel: pci3: at device 0.81 (no driver attac= hed) hh:mm:30 kernel: ixl1: WARNING: queue 0 appears to be hung! hh:mm:30 kernel: ixl1: WARNING: queue 1 appears to be hung! hh:mm:30 kernel: ixl1: WARNING: queue 2 appears to be hung! hh:mm:30 kernel: ixl1: WARNING: queue 3 appears to be hung! -> to recover I disabled iovctl in rc.conf and rebooted there is about 1Gbps of network traffic when we invoked these commands. I found similar errors here: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221919 but I'm running a newer driver version than 1.9.9-k I did not try to disable TSO. Is there anything else I can provide you with to help solving this? --=20 You are receiving this mail because: You are the assignee for the bug.=