From owner-freebsd-net@freebsd.org  Sat Jan 14 18:57:37 2017
Return-Path: <owner-freebsd-net@freebsd.org>
Delivered-To: freebsd-net@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 72423CAF120
 for <freebsd-net@mailman.ysv.freebsd.org>;
 Sat, 14 Jan 2017 18:57:37 +0000 (UTC)
 (envelope-from kevin.bowling@kev009.com)
Received: from mail-ot0-x22c.google.com (mail-ot0-x22c.google.com
 [IPv6:2607:f8b0:4003:c0f::22c])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 3C9D61926
 for <freebsd-net@freebsd.org>; Sat, 14 Jan 2017 18:57:37 +0000 (UTC)
 (envelope-from kevin.bowling@kev009.com)
Received: by mail-ot0-x22c.google.com with SMTP id 65so21851710otq.2
 for <freebsd-net@freebsd.org>; Sat, 14 Jan 2017 10:57:37 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google;
 h=mime-version:from:date:message-id:subject:to;
 bh=cwNmzRB77B9Ltv3faQgYyadD6ALvLBESf12XFheXg2E=;
 b=L8yJUdl2vrwiA2i5TWCjBfRXBASVzbdI+CAxL1cFFfOw+2w+StJmr6p/Ppm04EJ8rD
 VQ8QZKxNE6hz0xewwHIPWjBPcB5xT1ymxq4B442QDWAPXW6b9FrCkl2vESYniazCr7Kp
 +nsuW6wzcLHEpMvz1r/k5kUIuxmdC6S8wycCU=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
 bh=cwNmzRB77B9Ltv3faQgYyadD6ALvLBESf12XFheXg2E=;
 b=leawSCR9q2lfxWV5NvpLWMpnBPqvRUAQmYuFocenSSBlrd9SsZt8YxhTk6Aoo5q986
 +g/EZ8WUJoiRNbhubr6LcXFUqNhwIOmOh/Ny4vHrA0ENNDntBX4VQkJ6CzFkLqyfVmAG
 Y2csPE1dDMZsxwWXaDFxYRRYKt4Dr2v0YlXydkrq0gIJ0pL8PKT5kJiV1xtYwVe1P92a
 GD/St5mvsO0W5Nu5MIpnzUCUBxdBJ1uLaye8zbQ0dwdHGX6FjWmg5RXYAhA/2SVwwzqH
 VjoUSKKlc4E9q4rAECABZWfkGtI9o8RXDbNbDYint8Q3CyOSBzPKZUoAXVRnp4Hnidm6
 tRGg==
X-Gm-Message-State: AIkVDXJ2k8n+jHlOL7aEkLrbFzHNZllFdjVONPdAzO2xJqONjRhjuS3IxZwug+YUst+0miweAr7vNeRMY5fKuA==
X-Received: by 10.157.19.117 with SMTP id q50mr13410896otq.54.1484420256435;
 Sat, 14 Jan 2017 10:57:36 -0800 (PST)
MIME-Version: 1.0
Received: by 10.157.23.208 with HTTP; Sat, 14 Jan 2017 10:57:36 -0800 (PST)
From: Kevin Bowling <kevin.bowling@kev009.com>
Date: Sat, 14 Jan 2017 11:57:36 -0700
Message-ID: <CAK7dMtBc_gNMPc-anizx1kdb-vAHShu-+SkM=Rv9VnnpJCDD-A@mail.gmail.com>
Subject: ixgbe PF and ixv driver
To: freebsd-net@freebsd.org
Content-Type: text/plain; charset=UTF-8
X-Content-Filtered-By: Mailman/MimeDel 2.1.23
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 14 Jan 2017 18:57:37 -0000

Hi,

I've been trying to test SR-IOV on -CURRENT and 11.0-RELEASE.

Physical NIC is an X552.  The ixgbe PF has to be limited to 1-4 queues in
order to create VFs or you will get ENOSPC from iovctl.

Either letting ixv try to attach on the host, or creating a passthrough and
allowing pfsense 2.4.0 beta to try to attach yields this failure to attach:
m 0xc0104000-0xc0107fff,0xc0108000-0xc010bfff at device 7.0 on pci0
ixv0: Using MSIX interrupts with 2 vectors
ixv0: ixgbe_reset_hw() failed with error -10
device_attach: ixv0 attach returned 5

Another issue, the PF is unable to pass traffic after creating a VF.
'iovctl -D -d ix0; service netif restart; service routing restart' will
restore connectivity.

Regards,
Kevin