From nobody Thu Aug 10 17:51:32 2023 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RMDxw4BwZz4pq3x for ; Thu, 10 Aug 2023 17:51:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RMDxw131Mz4RBL for ; Thu, 10 Aug 2023 17:51:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691689892; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=pSM55OmDLVi6T4Gtixmspgaa2jE4dpmfu2ZRORRQa+I=; b=soMOWP1Ba6ososi+GZrcN7fbWf3iXjTRdSQK7VFokDf3uSoVyTAE1QUbgCTXy6APFvSA8L KzmUwIgbvPgqnkbBgZVlV+hXMX7YBS2o3jyK1q+UUTsHgNy3uG50G3qjTEFkchhE/fzOx3 LlokJfyixROEODlDGq7X/Lvk+gfF0NYv4q5g3EskjdyPqXETmgbJXp40lNcpY6H9Km1mxc teG+gqZ4ZwN+BneXjcY6SfLVAzzEJWxWKnD0iLXaJ+wCP78DrwfV+jc6Wske9Wq8H6Koho 6MzqjHCe9E3GDoaEGpstlkt61jOQ/dQrKeRJZyrkwKBBaoqfuRDpCbma1MCGEQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691689892; a=rsa-sha256; cv=none; b=jbdQPJcDU/Bu0WeQD+kxFa7vGuTtBoY5wB+E8E5BbIjiSMSUYfXfZ8sb1JlmXvjHuFzhBY F/S2QPMWwIHigEASqTDvqYrDjRNwjEeW5H5NISSL4rCE6MWlQWAwzg9UgU4Zs9Tbc3zVQl TF+gWUjT9hogEbg59VtG2fK12yKcINMfhbyaz4oLrRvGgZb1Fe/LYprdEh+ZDGmQUvrK86 xUt8lLJRrY/CxtDHHZ2STClODHw2v89nkGwsC94nvItb0pYl+y8ohaNAeKprE9QLTwyTT3 HvpiCqIeftLfftCjm1n/GvVf52XZsEG/GgdmZJm6eom1kI7L6JdbVsiB4YBFyw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RMDxw082Sz15jk for ; Thu, 10 Aug 2023 17:51:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37AHpVnD029204 for ; Thu, 10 Aug 2023 17:51:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37AHpVKI029203 for bugs@FreeBSD.org; Thu, 10 Aug 2023 17:51:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 273051] ofed: ibv pingpongs not connecting through ipv4 Date: Thu, 10 Aug 2023 17:51:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rafal.michna@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273051 Bug ID: 273051 Summary: ofed: ibv pingpongs not connecting through ipv4 Product: Base System Version: CURRENT Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: rafal.michna@gmail.com The fix for ibv pingpongs on ipv6 broke the functionality on ipv4. https://reviews.freebsd.org/D37196 Easiest way to verify is to use an OS version which doesn't include the fix, such as 13.1. CURRENT, 13.2 and 12.4 show the same behavior as 13.1 after patching. 13.1 before applying the patch: ipv4: server # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dirdma-ice0 --rx-depth=3D5= 00 --iters=3D1 --size=3D1024 local address: LID 0x0001, QPN 0x000004, PSN 0x7a529b, GID 1234::89 remote address: LID 0x0001, QPN 0x000004, PSN 0x130fe2, GID 1234::90 2048 bytes in 0.00 seconds =3D 5.83 Mbit/sec 1 iters in 0.00 seconds =3D 2811.00 usec/iter client # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dirdma-ice0 --rx-depth=3D5= 00 --iters=3D1 --size=3D1024 100.0.0.89 local address: LID 0x0001, QPN 0x000004, PSN 0x130fe2, GID 1234::90 remote address: LID 0x0001, QPN 0x000004, PSN 0x7a529b, GID 1234::89 2048 bytes in 0.00 seconds =3D 420.10 Mbit/sec 1 iters in 0.00 seconds =3D 39.00 usec/iter ipv6: server # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dirdma-ice0 --rx-depth=3D5= 00 --iters=3D1 --size=3D1024 local address: LID 0x0001, QPN 0x000005, PSN 0xaaf56a, GID 1234::89 ^C client # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dirdma-ice0 --rx-depth=3D5= 00 --iters=3D1 --size=3D1024 1234::89 local address: LID 0x0001, QPN 0x000005, PSN 0x29b905, GID 1234::90 Couldn't connect to 1234::89:18515 After applying the patch: client # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dirdma-ice0 --rx-depth=3D5= 00 --iters=3D1 --size=3D1024 100.0.0.89 local address: LID 0x0001, QPN 0x000006, PSN 0x1607d8, GID 1234::90 Couldn't connect to 100.0.0.89:18515 client # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dirdma-ice0 --rx-depth=3D5= 00 --iters=3D1 --size=3D1024 1234::89 local address: LID 0x0001, QPN 0x000007, PSN 0x82bbce, GID 1234::90 remote address: LID 0x0001, QPN 0x000006, PSN 0x680d13, GID 1234::89 2048 bytes in 0.00 seconds =3D 356.17 Mbit/sec 1 iters in 0.00 seconds =3D 46.00 usec/iter Same behavior is present with mlx cards, so it's not a driver issue: client # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dmlx5_0 --rx-depth=3D500 -= -iters=3D1 --size=3D1024 200.0.0.89 local address: LID 0x0000, QPN 0x000193, PSN 0xe6daae, GID ::ffff:200.0.= 0.90 Couldn't connect to 200.0.0.89:18515 client # ibv_rc_pingpong --gid-idx=3D2 --ib-dev=3Dmlx5_0 --rx-depth=3D500 -= -iters=3D1 --size=3D1024 200::89 local address: LID 0x0000, QPN 0x000194, PSN 0x047cf8, GID ::ffff:200.0.= 0.90 remote address: LID 0x0000, QPN 0x000193, PSN 0x0054f6, GID ::ffff:200.0.= 0.89 2048 bytes in 0.00 seconds =3D 364.09 Mbit/sec 1 iters in 0.00 seconds =3D 45.00 usec/iter Using different GIDs doesn't make a difference. On the working ip version, = with irdma any GID works and with mlx, only GID 2 does. --=20 You are receiving this mail because: You are the assignee for the bug.=