From owner-freebsd-net@freebsd.org Sat Sep 19 01:44:41 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2B44D3F74D9 for ; Sat, 19 Sep 2020 01:44:41 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BtYRC5wl0z4RG4; Sat, 19 Sep 2020 01:44:39 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 08J1iLYW019322 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 19 Sep 2020 01:44:23 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: root@trevelian.de Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.16.1/8.16.1) with ESMTPS id 08J1iNnG087953 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Sat, 19 Sep 2020 08:44:23 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: BCM57810 networkd card with SR-IOV : No driver detected To: Trevelian , freebsd-net@freebsd.org References: <1ee9ee29-54a7-c0b7-cb72-eb8ade52b94a@trevelian.de> Cc: davidch@freebsd.org From: Eugene Grosbein Message-ID: <51775d42-9045-91b8-405b-ba92762a410a@grosbein.net> Date: Sat, 19 Sep 2020 08:44:17 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <1ee9ee29-54a7-c0b7-cb72-eb8ade52b94a@trevelian.de> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.2 required=5.0 tests=BAYES_00,LOCAL_FROM, NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * 2.6 LOCAL_FROM From my domains * -0.1 NICE_REPLY_A Looks like a legit reply (A) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 4BtYRC5wl0z4RG4 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-1.92 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eugen]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.89)[-0.887]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; NEURAL_HAM_MEDIUM(-0.97)[-0.972]; NEURAL_SPAM_SHORT(0.03)[0.035]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Sep 2020 01:44:41 -0000 19.09.2020 5:10, Trevelian wrote: > I have a HP network card "533FLR-T" its based on "NetXtreme II BCM57810" > This card is capable to be used with SR-IOV, so I can have 64 NIC on each physical port that I can passthrough from my Linux hypervisor to my Linux and BSD guest VM. > > On Linux guest VM no problem I see the NIC on my VM and I can use it : > > |# lspci 01:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function| > > On BSD guest VM (I tested 11.3 and 12.1) the card seems to be not detected : > > |# dmesg pci0: at device 8.0 (no driver attached) # pciconf -lv none0@pci0:0:8:0: class=0x020000 card=0x3382103c chip=0x16af14e4 rev=0x00 hdr=0x00 vendor = 'Broadcom Inc. and subsidiaries' device = 'NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function' class = network subclass = ethernet ||# kldload if_bxe kldload: can't load if_bxe: module already loaded or in kernel| > || > > I try to force the driver with : > > |#devctl set driver pci0:0:8:0 bxe| > | > | > But it don't gave me any new network interface. > > Do you have any idea if its possible to make it work or the BXE driver is just not compatible with the Virtual Function of this card ? It seems bxe(4) does not implement attaching to Virtual Function. Can't tell if it's by mistake or intentionally. CC'ing author of the driver davidch@