From owner-freebsd-bugs@freebsd.org Wed Oct 11 19:27:07 2017 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55F54E34D57 for ; Wed, 11 Oct 2017 19:27:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 43AE474292 for ; Wed, 11 Oct 2017 19:27:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v9BJR7fp094874 for ; Wed, 11 Oct 2017 19:27:07 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 222937] [byhve] Severe RAM corruption after PciPassThrough-guest shutdown Date: Wed, 11 Oct 2017 19:27:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: bugzilla.freebsd@omnilan.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Oct 2017 19:27:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222937 Bug ID: 222937 Summary: [byhve] Severe RAM corruption after PciPassThrough-guest shutdown Product: Base System Version: 11.1-STABLE Hardware: Any OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: bugzilla.freebsd@omnilan.de Created attachment 187086 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D187086&action= =3Dedit /etc/rc.d/pciptdetach: Work around RAM corruption at guest shutdown Various different panics will happen after shutting down a bhyve guest with PCIe passthrough NICs if some conditions are met. This can lead to completely destroyed zpools, like I found out after some dozend not so impacting crashes... Quoting jhb@: I suspect what is happening is that the PCI devices are still issuing DMAs after the guest has been shutdown which end up trashing other parts of host memory. This may somewhat be my fault as I made a change which moves the device back into the host domain after FLR during guest shutdown. I should perhaps leave the device disabled in the DMAR table instead if the FLR doesn't succeed. (We could also add some other forms of reset for devices not supporting FLR.) Since I don't have the skills to help fixing the root cause, I wrote a litt= le workaround in form of a rc(8) script (to be copied to /etc/rc.d) which shou= ld protect against accidental crashes and data losses, by bringing the PciPassThrough devices down before shutting down, which prevents DMA writes from the card after moving it back into host domain. -harry --=20 You are receiving this mail because: You are the assignee for the bug.=