From owner-freebsd-xen@FreeBSD.ORG Wed Dec 4 18:21:03 2013 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 63D40CF0; Wed, 4 Dec 2013 18:21:03 +0000 (UTC) Received: from mail-ve0-x236.google.com (mail-ve0-x236.google.com [IPv6:2607:f8b0:400c:c01::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EF6B0153A; Wed, 4 Dec 2013 18:21:02 +0000 (UTC) Received: by mail-ve0-f182.google.com with SMTP id jy13so12765193veb.27 for ; Wed, 04 Dec 2013 10:21:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=fdQv6jzgUPak/d+fNJ6bq5rblaG+DulSB71pFBX1vKE=; b=FK8aXIKkcbLrTqwigcyMeBteejuTjaMlapC7PkRfKrEA0sAsYRN2Qjyi0+rTVBqefb pkz3GjhN+97/TUAtgLfDCUPsyP3Q2mTtXBEJ386x86sx8C0O2hqO7eqvySwhPJq3sVAH XPDOOJ06i9a31Ja9SLki2xNP/xaZWlB8sYzVn2Qd6NAgo3cBZJe4QJ5pQ0OqJpasjI4v MihLNBddXPiwyiwORLh6c/x/GSbl1g/AILWZ3gFxRwf1dwWeQgS9IuFxzASOLHfnhvNl i4kpjUTu/u6g5cWKymi3pfP8GCJwyNY6xE3wLWoy8cxrHN+d2QIp0tioi5QmDGNmfIL2 EMPA== MIME-Version: 1.0 X-Received: by 10.52.164.16 with SMTP id ym16mr1641859vdb.39.1386181262139; Wed, 04 Dec 2013 10:21:02 -0800 (PST) Received: by 10.220.155.147 with HTTP; Wed, 4 Dec 2013 10:21:02 -0800 (PST) In-Reply-To: <529C0827.4020003@freebsd.org> References: <529C0827.4020003@freebsd.org> Date: Wed, 4 Dec 2013 10:21:02 -0800 Message-ID: Subject: Re: Is ixgbe usable with SR-IOV? From: Jack Vogel To: Colin Percival Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: Jack F Vogel , "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Dec 2013 18:21:03 -0000 Yes, the ixv code was specifically written to work in a guest with SRIOV, however our internal testing did not use DHCP, what if you assign it an address, will it work then? Jack On Sun, Dec 1, 2013 at 8:10 PM, Colin Percival wrote: > Hi Xen people & jfv, > > Amazon's new "C3" instance type has support for SR-IOV using ixgbe > hardware; > our driver looks like it should support this, but when I turn it on it > doesn't > seem to work. Boot dmesg: http://pastebin.com/1Kkpfzbi > > The virtual hardware is recognized: > > ix0: 1.1.4> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0 > > ix0: Using MSIX interrupts with 2 vectors > > ix0: Ethernet address: 02:91:23:76:38:77 > > And we seem to be able to send packets, but never see any responses: > > ix0: link state changed to UP > > Starting Network: lo0 ix0. > > lo0: flags=8049 metric 0 mtu 16384 > > options=600003 > > inet6 ::1 prefixlen 128 > > inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 > > inet 127.0.0.1 netmask 0xff000000 > > nd6 options=21 > > ix0: flags=8843 metric 0 mtu 1500 > > > options=401bb > > ether 02:91:23:76:38:77 > > nd6 options=29 > > media: Ethernet autoselect > > status: active > > Starting devd. > > Starting dhclient. > > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 8 > > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 12 > > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 12 > > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 9 > > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 10 > > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 10 > > No DHCPOFFERS received. > > Under exactly the same Xen configuration except with SR-IOV turned off and > EC2 presenting a Xen netback to us instead, the DHCP works just fine. > > Has anyone managed to use {FreeBSD, SR-IOV, ixgbe, Xen}? Was any magic > necessary in order to make it work? > > -- > Colin Percival > Security Officer Emeritus, FreeBSD | The power to serve > Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid >