From owner-freebsd-virtualization@freebsd.org Fri Mar 4 20:51:17 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D416A09CAF for ; Fri, 4 Mar 2016 20:51:17 +0000 (UTC) (envelope-from ehrmann@gmail.com) Received: from mail-io0-x231.google.com (mail-io0-x231.google.com [IPv6:2607:f8b0:4001:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3A310E8 for ; Fri, 4 Mar 2016 20:51:17 +0000 (UTC) (envelope-from ehrmann@gmail.com) Received: by mail-io0-x231.google.com with SMTP id n190so75250946iof.0 for ; Fri, 04 Mar 2016 12:51:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to; bh=fg98ow6vJjlle3G3MHFl6cvcvwnSJ+j6Fzkvlc5dSYQ=; b=WFBk9dcrv3hHRzHbQYT+CHh6o93KScuEbYrYhWZaiQ6pA/50RB+YX8Tt7BYpXedg55 m0yMEfDEiI2ZplEIVH6/Caf1Qrp1FeLcyg5PN+sgJk70Y4B8T/gmEJxDMixZBr2dQcI3 eSSUbcJ2ru59dI7a6ZAyXHZ2NSNRjTvumDEWY0pw76/bqW4CJK1MUtdHlyTP7P/Fse3f XzKtCApuiPHbU33BYtskNsqTGc6hwqt9Vc8F+L3dct04+P1qDLYhDYFM2sUuAhT9vut0 K+DgQsFEF9IetEy8ooYuAGWgiSeot/W/k0KWRsgxx/uWz6nbDkhycl63IpGFFfHZqfos 3Qsg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=fg98ow6vJjlle3G3MHFl6cvcvwnSJ+j6Fzkvlc5dSYQ=; b=mj3fhKphvCm24/gCv6+jvQ95x12u/p3cYG/nGUe59r5ZhVskPthtVJ88oCEo7FsAGJ tiAf3ifdJ8wl/7rgJeciQjO1sMrEnWT3rEe1YdQdBPdD4pZgcGcVwitdMA38uiSgdo8b so7AzyYscV72B+xJX0K9uwbbKLfkJrV7rlMFKjpoDhK1kt/Hyc1EQxgAaDoNxlSozGzH WcqQOLWBX0KocnEL54P1m6gQF48wdaSz0XEQGQcPCgdIwuImWfK5tTLHiiNJQ689KlBz NSoPaErG09aQ1vscY11FsgfzlvaspM6VcWQRPiRCyPN8MqMrmlbB20ChFyXE0FaumHDT 2N3g== X-Gm-Message-State: AD7BkJK67APpEC/fwQxL0xNMQA3jTZjHjkwEUDIWc9j6eLpz0zUH8xuZ8GKKuQieoyQPA4G4vOXliRuJIJmGMg== MIME-Version: 1.0 X-Received: by 10.107.162.148 with SMTP id l142mr9756951ioe.196.1457124676284; Fri, 04 Mar 2016 12:51:16 -0800 (PST) Received: by 10.50.200.41 with HTTP; Fri, 4 Mar 2016 12:51:16 -0800 (PST) Date: Fri, 4 Mar 2016 12:51:16 -0800 Message-ID: Subject: PCI passthrough causes Skylake/Z170 system not to boot From: David Ehrmann To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 20:51:17 -0000 I opened a but for this already[1], but I figured I'd ask here to see if anyone's encountered it before. I have a FreeBSD 10.3-BETA2 system with a Skylake CPU and a Z170 motherboard that stops booting when I try to use PCI passthrough. After the boot loarder runs, but before root is mounted, an interrupt storm causes controllers/devices (including the root disk) to be disconnected and reconnected. Then, the system isn't able to mount the root disk, and the boot fails. Disabling VT-d, removing vmm_load from loader.conf, and removing pptdevs from loader.conf all fix the booting issue, but those are all needed for PCI passthrough. I've reproduced this with different devices, but the report is PCI passthrough of the onboard ethernet controller. [1]: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=207602