Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 24 Oct 2012 09:49:44 +0200
From:      Harald Schmalzbauer <h.schmalzbauer@omnilan.de>
To:        Jack Vogel <jfvogel@gmail.com>
Cc:        FreeBSD Stable <freebsd-stable@freebsd.org>
Subject:   Re: msi-x enabled igb works only if module loaded twice [Was: Re: kldload if_igb twice needed to bring nic into operation]
Message-ID:  <50879D98.40006@omnilan.de>
In-Reply-To: <CAFOYbcmz90bHTfD7Qqgkb_aHRHHu43Cm4ZUKpYiizooRSp%2Bs4A@mail.gmail.com>
References:  <50859F7F.2080308@omnilan.de> <5085A323.8030501@omnilan.de> <50866839.5090204@omnilan.de> <20121023211205.GA21019@alchemy.franken.de> <CAFOYbcmz90bHTfD7Qqgkb_aHRHHu43Cm4ZUKpYiizooRSp%2Bs4A@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enig494CE36577E2065D27EAD157
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

 schrieb Jack Vogel am 23.10.2012 23:25 (localtime):
> LOL, wow this is interesting. When I first was developing the VF suppor=
t,

Well, in fact I choose 'kawela' (82576) because I originally wanted to
use VFs. But I can't get SR-IOV working with ESXi5.1.
I'm using async-drivers, and I have option "max_vfs" available and
enabled, also at boot time ESXi detects SR-IOV:
    cpu0:4096)PCI: 5327: 00:02:00.0: Found Single Root I/O
Virtualization support
But later on, I get this error:
    cpu0:4573)<6>igb: : igb_validate_option: max_vfs - SR-IOV VF devices
set to 4
    cpu0:4573)<4>igb 0000:02:00.0: Failed to initialize SR-IOV
virtualization

Since I have no VMware support contract and found absoluetly no
documentation, I gave up and plugged in a second kawela for passing
through into my iSCSI-target-guest.
I found some hints that SR-IOV needs additional BIOS features besides
VT-x and VT-d, because SR-IOV cards need to allocate additional address
space. But that's beyond my PCI knowledge, and my BearTooth board
doesn't have such SR-IOV switches, so I'm trying to forget that I've
ever heard of SR-IOV :-(

Btw, are there plans to support IPSec offload for kawela?

=2E..
> There is nothing you can do about this because the issue is in the host=
,
> not the guest,
> well getting the host code fixed is the solution :)
>
> Hope this helps,

Thanks a lot, VMware has to fix more passthrough issues, since 5.1
crashes easily with passthrough-setups and many people report PODs (pink
screen of death; I've first seen that with 5.1)
But unfortunately there's no way for me to get in contact with VMWare to
raise this MSI-X-passthrough topic. This would porbably also fix the
mps-msix-problems, but disabling MSI-X for mps doesn't cost that much
interrupts. With igb I see 25k irq/s difference between MSI and MSI-X. I
don't understand why, but it's too expensive for my single-socket system.=


Thanks a lot,

-Harry



--------------enig494CE36577E2065D27EAD157
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.18 (FreeBSD)

iEYEARECAAYFAlCHnZ4ACgkQLDqVQ9VXb8i0/gCffArtvym6VL2JDh1Qey5yLQ9u
PggAoKe6Z+WqXaAydtPL7m3/AC9Olm1R
=llqr
-----END PGP SIGNATURE-----

--------------enig494CE36577E2065D27EAD157--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?50879D98.40006>