From nobody Mon Mar 17 14:32:34 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZGcrh0nydz5qgdJ for ; Mon, 17 Mar 2025 14:32:52 +0000 (UTC) (envelope-from bchesneau@icloud.com) Received: from qs51p00im-qukt01071901.me.com (qs51p00im-qukt01071901.me.com [17.57.155.8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZGcrg0wJMz3G3v for ; Mon, 17 Mar 2025 14:32:50 +0000 (UTC) (envelope-from bchesneau@icloud.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=icloud.com header.s=1a1hai header.b=qmwY3VOE; dmarc=pass (policy=quarantine) header.from=icloud.com; spf=pass (mx1.freebsd.org: domain of bchesneau@icloud.com designates 17.57.155.8 as permitted sender) smtp.mailfrom=bchesneau@icloud.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=1a1hai; bh=9KotKPQc/yvCPfxqELuWSM50jYEKdvZXD2R81sxiak8=; h=From:Content-Type:Mime-Version:Subject:Message-Id:Date:To:x-icloud-hme; b=qmwY3VOE2oq8QrhtvnmvYnBrmbq7jCiHgmDE+pHwYeTnWOGUcPb5O/1Nw0O0v2xr/ qGMDN1wzAjdSB7DDZPF+a3RahHExzZeCFIHfPbtIhG/r1iSV4RALvu/6BmqibUwvpg ThVfYCx9fwYllts3yR26NIu75Cz0sR17fL3Esfm3x7t+4iA2O5p6CbDwabhazsJIjZ dv2BONZ52UDyJO3hVup5LhJeBsp7HRNO2BJmNw90TOa8BxbGQLEMlFOkFb/XrsWDbC Xam226qCSOEPlvs2CxeeFrHXhhmcs/9Nccyll/iBvILwNK/Tr/9tJNvL6I65put9Xs zpQIYH+55l36w== Received: from smtpclient.apple (qs51p00im-dlb-asmtp-mailmevip.me.com [17.57.155.28]) by qs51p00im-qukt01071901.me.com (Postfix) with ESMTPSA id E4A8A6280505 for ; Mon, 17 Mar 2025 14:32:46 +0000 (UTC) From: Benoit Chesneau Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.400.131.1.6\)) Subject: issue while bridging VF on mellanox Message-Id: Date: Mon, 17 Mar 2025 15:32:34 +0100 To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3826.400.131.1.6) X-Proofpoint-GUID: IkYYAMmFzrwhuiCOB-j5tOAnZig0L9B4 X-Proofpoint-ORIG-GUID: IkYYAMmFzrwhuiCOB-j5tOAnZig0L9B4 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1093,Hydra:6.0.680,FMLib:17.12.68.34 definitions=2025-03-17_05,2025-03-17_01,2024-11-22_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 bulkscore=0 suspectscore=0 malwarescore=0 mlxscore=0 clxscore=1015 adultscore=0 spamscore=0 phishscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2411120000 definitions=main-2503170106 X-Spamd-Result: default: False [-4.14 / 15.00]; WHITELIST_SPF_DKIM(-3.00)[icloud.com:d:+,icloud.com:s:+]; RBL_SENDERSCORE_REPUT_9(-1.00)[17.57.155.8:from]; NEURAL_HAM_MEDIUM(-0.64)[-0.636]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[icloud.com,quarantine]; NEURAL_SPAM_SHORT(0.49)[0.492]; NEURAL_SPAM_LONG(0.40)[0.403]; ONCE_RECEIVED(0.20)[]; R_DKIM_ALLOW(-0.20)[icloud.com:s=1a1hai]; R_SPF_ALLOW(-0.20)[+ip4:17.57.155.0/24]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[17.57.155.8:from]; ARC_NA(0.00)[]; FREEMAIL_FROM(0.00)[icloud.com]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[icloud.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[icloud.com:+]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[17.57.155.8:from]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:714, ipnet:17.57.155.0/24, country:US]; DWL_DNSWL_NONE(0.00)[icloud.com:dkim] X-Rspamd-Queue-Id: 4ZGcrg0wJMz3G3v X-Spamd-Bar: ---- Hi all, I'm trying to make some kind of cross connect between a vlan and a = vxlan, but as far as I understand the mac address are not learnt from = the vlan When I listen using tcpdump on the vlan i can see the arp = request but not in the in the vxlan. ANy idea how should I fix this? Is = there any other way to do a cross conect or shoud I go back to not use = sriov when i need to build bridges?=20 Any idea is welcome. Benoit More details follow The vlan is created over a VF device in a bhyve vm: vlan601: = flags=3D1008943 = metric 0 mtu 1356 options=3D18080000 ether 4a:75:f1:f5:a5:0a inet6 fe80::4875:f1ff:fef5:a50a%vlan601 prefixlen 64 scopeid 0x5 groups: vlan vlan: 601 vlanproto: 802.1q vlanpcp: 0 parent interface: mce0 media: Ethernet 25GBase-SR status: active nd6 options=3D23 The vxlan is=20 vxlan0: flags=3D1008903 = metric 0 mtu 1356 options=3D80020 ether 58:9c:fc:10:12:01 inet6 fe80::5a9c:fcff:fe10:1201%vxlan0 prefixlen 64 tentative = scopeid 0x7 groups: vxlan vxlan vni 400 local [2001:db8:1000::1]:4789 remote = [2001:db8:1000::2]:4789 media: Ethernet autoselect (autoselect ) status: active nd6 options=3D23 And the bridge: # ifconfig bridge0 bridge0: = flags=3D1028943 metric 0 mtu 1356 options=3D0 ether 58:9c:fc:10:ff:d3 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: vlan601 flags=3D143 ifmaxaddr 0 port 5 priority 128 path cost 800 member: vxlan0 flags=3D143 ifmaxaddr 0 port 7 priority 128 path cost 55 groups: bridge nd6 options=3D3 The PF on the machine is a Mellanox [ConnectX-4 Lx # pciconf -lvbce mlx5_core0 mlx5_core0@pci0:17:0:0: class=3D0x020000 rev=3D0x00 hdr=3D0x00 = vendor=3D0x15b3 device=3D0x1015 subvendor=3D0x1590 subdevice=3D0x00d4 vendor =3D 'Mellanox Technologies' device =3D 'MT27710 Family [ConnectX-4 Lx]' class =3D network subclass =3D ethernet bar [10] =3D type Prefetchable Memory, range 64, base 0xe4000000, = size 33554432, enabled cap 10[60] =3D PCI-Express 2 endpoint max data 256(512) FLR RO NS max read 4096 link x8(x8) speed 8.0(8.0) ASPM L1(L1) cap 03[48] =3D VPD cap 11[9c] =3D MSI-X supports 64 messages, enabled Table in map 0x10[0x2000], PBA in map 0x10[0x3000] cap 09[c0] =3D vendor (length 24) cap 01[40] =3D powerspec 3 supports D0 D3 current D0 ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 1 corrected ecap 000e[150] =3D ARI 1 ecap 0010[180] =3D SR-IOV 1 IOV enabled, Memory Space enabled, ARI = enabled 8 VFs configured out of 16 supported First VF RID Offset 0x0002, VF RID Stride 0x0001 VF Device ID 0x1016 Page Sizes: 4096 (enabled), 8192, 16384, 32768, = 65536, 131072, 262144, 524288, 1048576, 2097152, 4194304 iov bar [1a4] =3D type Prefetchable Memory, range 64, base = 0xc7ffe000000, size 1048576, enabled ecap 0019[1c0] =3D PCIe Sec 1 lane errors 0 ecap 000d[230] =3D ACS 1 Source Validation unavailable, Translation = Blocking unavailable P2P Req Redirect unavailable, P2P Cmpl Redirect = unavailable P2P Upstream Forwarding unavailable, P2P Egress = Control unavailable P2P Direct Translated unavailable, Enhanced = Capability unavailable PCI-e errors =3D Correctable Error Detected Unsupported Request Detected Corrected =3D Advisory Non-Fatal Error Other side is the same except that the card is an intel one: # pciconf -lvbce ixl0 ixl0@pci0:23:0:0: class=3D0x020000 rev=3D0x02 hdr=3D0x00 = vendor=3D0x8086 device=3D0x1572 subvendor=3D0x15d9 subdevice=3D0x093b vendor =3D 'Intel Corporation' device =3D 'Ethernet Controller X710 for 10GbE SFP+' class =3D network subclass =3D ethernet bar [10] =3D type Prefetchable Memory, range 64, base 0xc4800000, = size 8388608, enabled bar [1c] =3D type Prefetchable Memory, range 64, base 0xc5808000, = size 32768, enabled cap 01[40] =3D powerspec 3 supports D0 D3 current D0 cap 05[50] =3D MSI supports 1 message, 64 bit, vector masks cap 11[70] =3D MSI-X supports 129 messages, enabled Table in map 0x1c[0x0], PBA in map 0x1c[0x1000] cap 10[a0] =3D PCI-Express 2 endpoint max data 256(2048) FLR RO max read 512 link x8(x8) speed 8.0(8.0) cap 03[e0] =3D VPD ecap 0001[100] =3D AER 2 0 fatal 0 non-fatal 1 corrected ecap 0003[140] =3D Serial 1 b8f678ffff55c27c ecap 000e[150] =3D ARI 1 ecap 0010[160] =3D SR-IOV 1 IOV enabled, Memory Space enabled, ARI = enabled 16 VFs configured out of 64 supported First VF RID Offset 0x0010, VF RID Stride 0x0001 VF Device ID 0x154c Page Sizes: 4096 (enabled), 8192, 65536, 262144, = 1048576, 4194304 iov bar [184] =3D type Prefetchable Memory, range 64, base = 0xc5000000, size 65536, enabled iov bar [190] =3D type Prefetchable Memory, range 64, base = 0xc5100000, size 16384, enabled ecap 0017[1a0] =3D TPH Requester 1 ecap 000d[1b0] =3D ACS 1 Source Validation unavailable, Translation = Blocking unavailable P2P Req Redirect unavailable, P2P Cmpl Redirect = unavailable P2P Upstream Forwarding unavailable, P2P Egress = Control unavailable P2P Direct Translated unavailable, Enhanced = Capability unavailable ecap 0019[1d0] =3D PCIe Sec 1 lane errors 0 PCI-e errors =3D Correctable Error Detected Unsupported Request Detected Corrected =3D Advisory Non-Fatal Error=