From nobody Tue Dec 5 20:02:11 2023 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SlBK91Jwgz53P4b for ; Tue, 5 Dec 2023 20:02:37 +0000 (UTC) (envelope-from benoitc@enki-multimedia.eu) Received: from mail-4323.proton.ch (mail-4323.proton.ch [185.70.43.23]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SlBK86J0Zz4Llv for ; Tue, 5 Dec 2023 20:02:36 +0000 (UTC) (envelope-from benoitc@enki-multimedia.eu) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=enki-multimedia.eu; s=protonmail; t=1701806553; x=1702065753; bh=4Gm4CbdlQ5Tp/2QQkPIdOPKzS30Y7RqITXniHBWpsMY=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=C9Xcof4nxspssB7B4DFiKvYlKQAwF4L7O4H577wHG20yfCr32OGErewaTx8O2tbfi gXf6i1OQjddPaAxkuG3rfmGWOEO1dTR6GAPHq7X5f8JTN43pfa2wi1ibvmI2X3qkAg Vw1uJ8Oo5A8tUB/QNPSLdN2lQiMjIqPq3NGpIBurxd42TdOq9ilZeBhiRGV29Ar67M 74HGJKGvIDm++kgZkDHFt6wzd3cnKLPeC9C5hfz3zjiu/HL49RVmaR7w5pP9CZkACC vnH9CuGHt60Ypnw8aAsDadpr9wmeCu+S9boICnnlWbR66wFe6ZqqxdgoJ6zvivG4Tw fC/nuO0gWKZqQ== Date: Tue, 05 Dec 2023 20:02:11 +0000 To: Kristof Provost From: Benoit Chesneau Cc: freebsd-net@freebsd.org Subject: Re: vxlan with IPv6 underlay ? Message-ID: In-Reply-To: <3E2D29F7-2B64-45DD-A13B-7BEB799AF9BA@FreeBSD.org> References: <793EA8DF-BD26-414A-A12D-866356D339DB@FreeBSD.org> <3E2D29F7-2B64-45DD-A13B-7BEB799AF9BA@FreeBSD.org> Feedback-ID: 9066678:user:proton List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4SlBK86J0Zz4Llv OK Thanks for the answer. I will create a ticket. Found that the option `vx= lanhwcsum` is the culprit. Beno=C3=AEt On Tuesday, December 5th, 2023 at 15:24, Kristof Provost w= rote: > On 5 Dec 2023, at 15:21, Benoit Chesneau wrote: >=20 > > Changing the mtu wasn't enough. To make it works i had to disable vxlan= offload features: > >=20 > > `ifconfig mce0 -vxlanhwcsum -vxlanhwtso` > >=20 > > Then suddenly all started to work. The card is the following: > >=20 > > `mlx5_core1@pci0:17:0:1: class=3D0x020000 rev=3D0x00 hdr=3D0x00 vendor= =3D0x15b3 device=3D0x1015 subvendor=3D0x1590 subdevice=3D0x00d4 vendor =3D = 'Mellanox Technologies' device =3D 'MT27710 Family [ConnectX-4 Lx]' class = =3D network subclass =3D ethernet PCI-e errors =3D Correctable Error Detect= ed Unsupported Request Detected Corrected =3D Advisory Non-Fatal Error` > >=20 > > Which is odd. Wonder why it's needed. Thoughts? >=20 > Driver bug? >=20 > I=E2=80=99m not familiar with the mlx5 driver (or hardware), but that= =E2=80=99d be my guess. > The first step in debugging that would be to figure out which one of thos= e offload features is responsible, and probably also capturing traffic (out= side of this machine) to see if anything is sent and if so how it=E2=80= =99s broken. >=20 > Best regards, > Kristof