Date: Fri, 25 Oct 2024 21:21:47 +0100 From: Lexi Winter <lexi@le-fay.org> To: Navdeep Parhar <nparhar@gmail.com> Cc: freebsd-net@freebsd.org Subject: Re: Chelsio / cxlv(4): strange messages, SR-IOV interface does not work Message-ID: <b3c7ab9f-20ce-4434-85af-31396873741a@le-fay.org> In-Reply-To: <CAPFoGT-Nptqhmb=VY7LGPPgqFqESuUD%2BpoxLMWuxz2xrw9zvGg@mail.gmail.com> References: <f2972877-4ec5-49f5-a335-99c28aab58a8@le-fay.org> <CAPFoGT-Nptqhmb=VY7LGPPgqFqESuUD%2BpoxLMWuxz2xrw9zvGg@mail.gmail.com>
index | next in thread | previous in thread | raw e-mail
On 24/10/2024 00:43, Navdeep Parhar wrote:
> On Tue, Oct 22, 2024 at 11:21 PM Lexi Winter <lexi@le-fay.org
> <mailto:lexi@le-fay.org>> wrote:
> however, trying to assign an IP address causes immediate problems:
>
> root@lily:~ # ifconfig cxlv0 inet6 2001:8b0:aab5:7::10/64
> root@lily:~ # Oct 23 06:16:07 lily kernel: cxlv0: a looped back NS
> message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another
> DAD probes are being sent.
> You can disable IPv6 DAD as a workaround for this issue. The problem is
> that the VF's multicast tx is getting reflected back to it by the
> internal switch when it shouldn't.
>
> # sysctl net.inet6.ip6.dad_count=0
thanks Navdeep, after enabling this, networking is working in the VM.
however, i can't tell if VLAN filtering is supposed to be working for VF
interfaces. from looking at src, it seems like after a couple of recent
commits (c57c261790 and 1389314d5) this should be supported. so i
configured a VLAN restriction in the iovctl.conf:
PF {
device : "cxl3";
num_vfs : 16;
}
DEFAULT {
passthrough : true;
vlan : 111;
}
VF-0 {
passthrough : true;
vlan : 111;
mac-addr : "06:00:00:00:05:a0"
}
configuring cxlv0.111 in the VM works and the VM can communicate on VLAN
111, but if i look at tcpdump inside the VM, i also see untagged traffic
on the host port:
21:16:23.874161 74:4d:28:08:81:f6 > 01:80:c2:00:00:0e, ethertype LLDP
(0x88cc), length 177: LLDP, length 163: c1.i.lfns.org.uk
as well as traffic for VLAN 3003, which is the bhyve host's VLAN:
21:14:28.550117 06:00:00:00:06:01 > 01:00:5e:00:00:0d, ethertype 802.1Q
(0x8100), length 72: vlan 3003, p 0, ethertype IPv4 (0x0800),
172.22.0.37 > 224.0.0.13: PIMv2, Hello, length 34
so, it seems like there's no actual VLAN filtering happening in the
hardware. is there a sysctl that needs to be enabled to work this? (i
did have a quick look through the hw.cxgbe MIB but didn't see anything
obvious.)
or is this only supported for T4 ASICs, not T5?
help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?b3c7ab9f-20ce-4434-85af-31396873741a>