From owner-freebsd-virtualization@freebsd.org Mon Nov 7 13:41:15 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DECE9C359D2 for ; Mon, 7 Nov 2016 13:41:15 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x22f.google.com (mail-pf0-x22f.google.com [IPv6:2607:f8b0:400e:c00::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AEDD18E4 for ; Mon, 7 Nov 2016 13:41:15 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x22f.google.com with SMTP id d2so91677162pfd.0 for ; Mon, 07 Nov 2016 05:41:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=9OhNB62nEmyERh2PTcQPpPOdw683B8ntZLLyumluL84=; b=GuPq+lk7ezjJ76c88W+AmyOejlhYAmZ+ugwdLfWYRrMJJfQ1sP78sdUzkCd0wNpcIR Vk3sVi6a+Z3sV/xRpIdm5u0VUditpmUKb20jLBmg/ZEy1lomiIkUXUPhBGN3k9MFTubK gdc+ztK8tcGPpwv/Z093+3vLnq4UAa+vySesP0CPzf3itzJJa6bO8UwFqllsCLn4l6fK /1AKHcTx6zcHZV0DaiI1iXzuKaZWuzfb25rEEvsN6Wo0ClNIZDXSgSFUupSL87dk9xyK BewNkDjS4gCfFZv+nSNBY8m42ykRncBEB1e+l706D7kPECZHMkad1TnCF9eWsJvYpoNo Peuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=9OhNB62nEmyERh2PTcQPpPOdw683B8ntZLLyumluL84=; b=EYgp+ZMgxuBdMOzSAl5CfIfmDoOyOxl9NJFVhTYFpN0I1tj8E+jE+81DtLJsbvX1eG n0axQpER6yF419TPcZxT1ZDr8+AhSCE7UIhTEVdDLAbGOW0Hcmqkunv2pkHmPwXUHvk7 bfnrvUa5kc4cwlgL5ph/ts+TboBUxYl4beULkzFDvHdX6mFwWAwMl11ILPzJBb7M0QjO DBXQD1mRwcmGr3VbYrcomin/0BoJ31r+U4WuH8PlD628dXiXZGQYnZpsrLC1DTF0vvGu nPDnrqt4AHeGL/NcNVLc9VikcFVzqf58lwi6R7SD2S/IPb0NidDHMC4YDe0cL1boIKGV YCCw== X-Gm-Message-State: ABUngveXKOHXMHiHuo0/7wHC0Oe0+Nla+HC+LvY0yZfGhkGAwoEqGGxpPLIJLz8cJx6VVw== X-Received: by 10.98.163.71 with SMTP id s68mr13587349pfe.60.1478526075086; Mon, 07 Nov 2016 05:41:15 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id p14sm40850745par.25.2016.11.07.05.41.13 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Nov 2016 05:41:14 -0800 (PST) Subject: Re: bhyve, ixgbe and debian 8 To: freebsd-virtualization@FreeBSD.org References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> From: Rajil Saraswat Message-ID: <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> Date: Mon, 7 Nov 2016 07:41:09 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 13:41:16 -0000 On 11/07/2016 07:08 AM, Rajil Saraswat wrote: > Hello, > > I have PCI passthrough working now for the Intel X540-AT2 NIC and is > seen inside debian 8 vm. > > # lspci > > 00:00.0 Host bridge: Network Appliance Corporation Device 1275 > 00:04.0 SCSI storage controller: Red Hat, Inc Virtio block device > 00:05.0 Ethernet controller: Red Hat, Inc Virtio network device > 00:06.0 Ethernet controller: Intel Corporation Ethernet Controller > 10-Gigabit X540-AT2 (rev 01) > 00:1f.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] > > > However, on loading the module the kernel gives the error > > #modprobe ixgbe > > [ 34.929546] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - > version 3.19.1-k > [ 34.929549] ixgbe: Copyright (c) 1999-2014 Intel Corporation. > [ 34.929706] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 34.929708] ixgbe 0000:00:06.0: PCI INT A: no GSI > [ 34.930354] ixgbe 0000:00:06.0: Adapter removed > [ 34.931710] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 34.931717] ixgbe: probe of 0000:00:06.0 failed with error -5 > > Any idea what could be the issue? > > Thanks, > > Rajil > I tried with the second onboard NIC and it worked the first time. iperf showed 10g speeds. After restarting the VM, i get an error for both NICs. This a dual CPU motherboard Supermicro X10DriT with a pair of onboard NICs. [ 0.628758] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 3.19.1-k [ 0.628760] ixgbe: Copyright (c) 1999-2014 Intel Corporation. [ 0.628899] ixgbe 0000:00:06.0: can't derive routing for PCI INT A [ 0.628901] ixgbe 0000:00:06.0: PCI INT A: no GSI [ 0.629519] ixgbe 0000:00:06.0: Adapter removed [ 0.630143] ixgbe 0000:00:06.0: can't derive routing for PCI INT A [ 0.630147] ixgbe: probe of 0000:00:06.0 failed with error -5 [ 0.630199] ixgbe 0000:00:06.1: can't derive routing for PCI INT B [ 0.630200] ixgbe 0000:00:06.1: PCI INT B: no GSI [ 0.630789] ixgbe 0000:00:06.1: Adapter removed [ 0.639469] ixgbe 0000:00:06.1: can't derive routing for PCI INT B [ 0.639473] ixgbe: probe of 0000:00:06.1 failed with error -5