From owner-freebsd-transport@freebsd.org Wed Dec 19 21:22:01 2018 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B827613489C3 for ; Wed, 19 Dec 2018 21:22:01 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM02-BL2-obe.outbound.protection.outlook.com (mail-bl2nam02on0630.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe46::630]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 013816FDB3 for ; Wed, 19 Dec 2018 21:21:59 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=cLXq9d1JVlsT6C5zyM48O3sDw2xmmmbp7vo5gbjO8UA=; b=ahXbzd7jiun0tgZ2/TX/oaSQEBGbIia/SAHL+NzeKBCh7FqX+xeB7SgqKW1KLI6amtAQu+cFIsZA7jkeUsO+cCgw34rzZur8y8MTL7km5gxVsCrfC8Vx/fB2vc8TQKdLqGCMs1dpOCV+fpAFbw3Sc89IQoS7GN5CZ5F2/CN7C2s= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.142.14) by SN4PR0601MB3679.namprd06.prod.outlook.com (10.167.141.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1425.19; Wed, 19 Dec 2018 21:21:58 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011%3]) with mapi id 15.20.1425.024; Wed, 19 Dec 2018 21:21:58 +0000 From: "Scheffenegger, Richard" To: "hiren@strugglingcoder.info" CC: "freebsd-transport@freebsd.org" Subject: possible RFC6675 compute_pipe counting issue. Thread-Topic: possible RFC6675 compute_pipe counting issue. Thread-Index: AdSX4N6w97YTgpFvSAejfVrdpCcUng== Date: Wed, 19 Dec 2018 21:21:57 +0000 Message-ID: Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy0xYzdjNmVjYi0wM2Q0LTExZTktYjVlNi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcMWM3YzZlY2MtMDNkNC0xMWU5LWI1ZTYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSIxODUwIiB0PSIxMzE4OTcyODExNjg0NjEwMDAiIGg9IjUxcVpHcnNKOE5oMWxNclU3QnQ5MkZyTm9JST0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [213.143.121.76] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; SN4PR0601MB3679; 6:LTf/qOS1G+BfV2qhTA1c4r6uza2JK+ioJg7y6cNjP087ILlron2/WigvDwEFgB3dK7mkcKTWUCcYfzjHQ4lxZE2v+Ha8vfMzVdMyQtXlaRv4v4nw1cY8b56/UDtjz7mc8y40F3gz9y0WVQkPSCK+uBi+biFiBdO9aao6fR+6HGdiwvpONREFn9xc8civzoZ95qGNmq6i6GKpPVgwMruAcgfspPp2wpqw+YNLKcSygO92qsJ2l11wwI3pN9LnlwTzp/7w4WrQXrmk8DcBOGw0qkBhJXr3uyxIXeysr3Maa988j/DpQuZOeWAm75PFRliNFbGhwdx/P5bG6g6Fder6FxaksLeOdVwhX0Jr4q8eDiZ/x+839Zlish5b6cjnzCSEDJVJchSNhgv7qmpCkIcVwP0ouhyjKJrcMdQ7ToU19JblpD+ytNDTeiPuGFtb9xb0YLmaUjJ5Qq1chC03Rcy98A==; 5:mN7e6p3eOQCJJnHB76vwWQI5APPqfmijyU6VGpxc2IHQ82eUt4VEAGTxz+vvb5nPQk2YxUhac5Q1EEc3VebRJwYQmhvZ3DypnM4rP1hFlE9UDOsZnmDm/E9B7puwwsYlTtIckYn1jBbDEcXIKBzSW9JAhFgcYnaFP0HlhXSnD/E=; 7:DR3hKbbwS6Ye5gi2V5RxZHl3IdANkKgKtkDPJer+Ixkdt6JGnGLTj2wSCYtKzC/etgwukmv0t7a25KSOTqb8mXANmS0TkXcY2yzUTmSFX659eFtBolJFF8cDikIH6ElRQGgtswadx1oDZZ6fY6mm+w== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: b0f41480-a983-49e1-95b9-08d665f80212 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7193020); SRVR:SN4PR0601MB3679; x-ms-traffictypediagnostic: SN4PR0601MB3679: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(3230021)(999002)(5005023)(6040522)(2401047)(8121501046)(10201501046)(3002001)(3231475)(944501520)(52105112)(93006095)(93001095)(6055026)(149066)(150057)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123564045)(20161123562045)(20161123560045)(20161123558120)(201708071742011)(7699051)(76991095); SRVR:SN4PR0601MB3679; BCL:0; PCL:0; RULEID:; SRVR:SN4PR0601MB3679; x-forefront-prvs: 0891BC3F3D x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(376002)(346002)(39860400002)(136003)(396003)(189003)(199004)(4326008)(6506007)(102836004)(256004)(14444005)(7696005)(72206003)(2501003)(966005)(478600001)(25786009)(14454004)(33656002)(2906002)(476003)(486006)(2351001)(6436002)(8676002)(1730700003)(81166006)(81156014)(8936002)(105586002)(106356001)(5660300001)(68736007)(66066001)(3846002)(316002)(99286004)(74316002)(5640700003)(55016002)(71190400001)(86362001)(575784001)(71200400001)(7736002)(305945005)(186003)(6306002)(9686003)(26005)(6916009)(97736004)(53936002)(6116002); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3679; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: m0nBLPKAHOaiyQE5A6ycDS/Mk4BCD3TR9mZWmdxfSdxseofj1aqqCjnvvdwZ2StAX7/Iq+sMiungVF3d3VsCKWAMe78OMK+z8NQtWIcwI6CJw1hYRlt8Ash8b/2WE/ZpSfnoN+KYa/Z2rU/S8oISmjhwuzLP/fCeOLnGskc3a+Ib/g7J8CSLQ6JxXKRgqsyTrnSRWCTBHNfveIzpNUr2xf2NrG9/JpU5dccHfZp9KNTS+bSQKL+76/40MMnNsSaYHc+rM4QDEYenxj7dbw+frMLzPEh3saKG9I+OJSf3RyuukcB7xkr79xS1RGUuCboY spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: b0f41480-a983-49e1-95b9-08d665f80212 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Dec 2018 21:21:57.9164 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3679 X-Rspamd-Queue-Id: 013816FDB3 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=ahXbzd7j; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 2a01:111:f400:fe46::630 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-2.96 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.966,0]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; NEURAL_HAM_LONG(-0.80)[-0.801,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[0.3.6.0.0.0.0.0.0.0.0.0.0.0.0.0.6.4.e.f.0.0.4.f.1.1.1.0.1.0.a.2.list.dnswl.org : 127.0.3.0]; MX_GOOD(-0.01)[mx63.netapp.com,mx61.netapp.com,mx143.netapp.com,mx1.netapp.iphmx.com,mx144.netapp.com,mx2.netapp.iphmx.com,mx141.netapp.com,mx65.netapp.com,mx142.netapp.com,mx62.netapp.com,mx63.netapp.com,mx61.netapp.com,mx143.netapp.com,mx1.netapp.iphmx.com,mx144.netapp.com,mx2.netapp.iphmx.com,mx141.netapp.com,mx65.netapp.com,mx142.netapp.com,mx62.netapp.com]; TO_DN_EQ_ADDR_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.68)[-0.685,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Dec 2018 21:22:02 -0000 Hi Hiren, I'm trying to reactivate my old Lost Retransmission Detection patch. And I found your 2015 patch around sacked_bytes (RFC6675) here https://github.com/rscheff/freebsd/commit/d3c29dd43ff23e293d5988258493015fb= 4a072ba (The line ~389 in tcp_sack.c) But I think the code is problematic in two reasons: a) very thin clients, which may only send SACK deltas instead of full excer= pts of the scoreboard (e.g. only a sack block covering the most recent rece= ived data) b) whenever the receiver scoreboard has more discontinuous entries than wha= t a single ACK can carry as SACK fields (typically 3, possibly 4 or as litt= le as one). However, these will overestimate the outstanding data (pipe). (a) A cheating receiver sending multiple, identical sack blocks could game = the sender, though, as the check is done on a ack sack block by block check= , rather than when the scoreboard is updated... Reason: Your patch only looks at the SACK data contained in the most recent= ACK, rather than proper accounting of the non-sack holes in the scoreboard= . When I improved Aris PRR code, I did the accounting when the scoreboard is = being updated; sacked_bytes need to exclude any snd.una move to the right, = but should be similar: https://github.com/rscheff/freebsd/commit/4a4877478fe55e8ebdfa0daf9a2be4b21= 2d07cde As PRR needs a proper value for the delivered delta bytes per ACK, it shoul= d be simple to keep track of the correct value for the SACKed bytes (not ho= les) in the scoreboard too... Obviously, this can not be that much of an issue, as RFC6675 pipe is disabl= ed by default, and would underestimate the number of sacked bytes at the re= ceiver, unless the receiver has malicious intent... Any thoughts? Best regards, Richard =20 From owner-freebsd-transport@freebsd.org Thu Dec 20 08:35:02 2018 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6F2A7133C0E5 for ; Thu, 20 Dec 2018 08:35:02 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM02-BL2-obe.outbound.protection.outlook.com (mail-eopbgr750079.outbound.protection.outlook.com [40.107.75.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D76AD6D1A4; Thu, 20 Dec 2018 08:35:00 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ACwWU/sb3nYA93A9X0j1swXbaYfGsUuk4kR75f2hdgk=; b=qO3jMNaSV7A50L/9SljN2K3suZmAN9DpztbDM4QtOqjHXKQv+qaFvP3+Cf4t1Gv450k2zN1+F5CRSLn/LDDyBunvRvp6quGJvepbnYnrfh2S+4s+DKAbbs/ZPm7uNfUra00nqWu39zEYhKW01v1Mai0n0JEFg4dMppM6CkdXm8Q= Received: from CY4PR0601MB3715.namprd06.prod.outlook.com (52.132.101.140) by CY4PR0601MB3682.namprd06.prod.outlook.com (52.132.101.33) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1425.22; Thu, 20 Dec 2018 08:34:59 +0000 Received: from CY4PR0601MB3715.namprd06.prod.outlook.com ([fe80::dcfd:3b72:902e:9f8c]) by CY4PR0601MB3715.namprd06.prod.outlook.com ([fe80::dcfd:3b72:902e:9f8c%2]) with mapi id 15.20.1425.023; Thu, 20 Dec 2018 08:34:59 +0000 From: "Scheffenegger, Richard" To: "hiren@strugglingcoder.info" , "jtl@FreeBSD.org" CC: "freebsd-transport@freebsd.org" Subject: RE: possible RFC6675 compute_pipe counting issue. Thread-Topic: possible RFC6675 compute_pipe counting issue. Thread-Index: AdSX4N6w97YTgpFvSAejfVrdpCcUngAECEYAABM/p3A= Date: Thu, 20 Dec 2018 08:34:58 +0000 Message-ID: References: <20181219231724.GJ75110@strugglingcoder.info> In-Reply-To: <20181219231724.GJ75110@strugglingcoder.info> Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy0yMWQ3NzdjMS0wNDMyLTExZTktYjVlNi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcMjFkNzc3YzItMDQzMi0xMWU5LWI1ZTYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSIzODUwIiB0PSIxMzE4OTc2ODQ5ODQ5OTIxNzYiIGg9IndoSEp3MFhkbnRnMkxDM1RBVVBDUXJFNjhQST0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [213.143.121.76] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; CY4PR0601MB3682; 6:Odx4hQJ6hXXCnCUnYc7XKIRceUFK9nCoDTCnfeCEb7k4sChhmn4JStnH4BEt0Ijk9NgDrs1aE6eQQzODUL2TX+QAXvFGwYhswbuGlmDlfIduBGmX9zZpoQTw2JtmsmPFkZExH5bRvTK5MUpsXvyxI9d1o0CVKrSyRl6GcFV4SctMWv0DhiesjK+D9sn99LOmNXWRdUBGGXq2yWciRhpe2L5xK189RlrRY93P/dTFH2zl7LZz8IrbHrSjw2SaQ8bxQzU+s696u5qmWxnruk/yVvUBBlGcmkDsB61KiUeczTGCswSN4KP22SNuPBI5y59vO8GIQ411fFgi/4nnGQJ92rAUhVddaUcT9Op71RTT5VVDS0NT9M71nQmqvP1coi2HLYcArfEINDUvrVo8kajYOFFI3XUX4a1fvpZcRDsMv9AOdI5VZ5YFUAulVWSwLpICj2fHeuLdSAZZT1NaQ9f7AQ==; 5:UuBYRbxTS2gtsJDMComYuLEaBZzctdiB4GFAku4TaamLdxp+gwdm7R1YbAPsHrXot1yB9pGQkQ0In3QpPnnEq87SaSanhFTBeEo3LpSKDvFUUr/O+BuBS/Rf2Y5M5zqBlCDT/tJLhX9b8I8yYOrloMZA4kkTA9txs/pzY4GKs2k=; 7:GE6pjQxnVUjIclAz2p5fNso8ByYWEuLaVJxHD/l6FwfySbyxe72wmPEQPCQ9sab8mFS1RjvnzF9tOhtj4jgeFjdvg2xyAxE0cVLvl/yegtVYBkt3HfdzpcdCueVxSLVcxHDSVbVvOkHv04RqzEB0xg== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: b83142bc-6f05-486a-98c3-08d6665606ff x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7193020); SRVR:CY4PR0601MB3682; x-ms-traffictypediagnostic: CY4PR0601MB3682: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(3230021)(999002)(5005026)(6040522)(2401047)(8121501046)(3231475)(944501520)(52105112)(93006095)(93001095)(3002001)(10201501046)(6055026)(149066)(150057)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123560045)(20161123562045)(20161123564045)(201708071742011)(7699051)(76991095); SRVR:CY4PR0601MB3682; BCL:0; PCL:0; RULEID:; SRVR:CY4PR0601MB3682; x-forefront-prvs: 0892FA9A88 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(39860400002)(396003)(376002)(136003)(366004)(13464003)(55674003)(189003)(199004)(2906002)(105586002)(97736004)(99286004)(6246003)(106356001)(14444005)(256004)(33656002)(4326008)(53936002)(68736007)(55016002)(305945005)(26005)(7736002)(74316002)(6306002)(186003)(25786009)(6506007)(66066001)(6436002)(9686003)(966005)(76176011)(53546011)(476003)(478600001)(446003)(11346002)(72206003)(8936002)(229853002)(486006)(81166006)(81156014)(8676002)(2501003)(110136005)(71190400001)(71200400001)(5660300001)(316002)(7696005)(3846002)(6116002)(14454004)(86362001)(575784001)(102836004)(6606295002); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR0601MB3682; H:CY4PR0601MB3715.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: EJHyDPLO3hNf5TWo+QI3oAM3S6vqAXujj2GNZtjZd45BSQPtTmZQ5qCbrc+bWTygl0F8P6dv8VIKzVzF97I2wvqqvfhhucP3rlJIa6hG7I+SYohHn6wDhe5I5wBr1NQWb4Xast4Y5vBoSfzf9NtRvWEqQOJOLj08TBfFMXmNR4pgjOs8yTPgdZl/xhxAbWj9Gm54L5rkEBoKrMFoLffgLzqvzmep471ITbKBkQ4EaGIVhMm3qf1PN23x+ml1sluXaSC1IZsYCYJCrcOUTWhZDrOs7sRwPOH82dHTZuw/kSdbqdnHKMLOqdPglS7JGBxy spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: b83142bc-6f05-486a-98c3-08d6665606ff X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Dec 2018 08:34:58.8419 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR0601MB3682 X-Rspamd-Queue-Id: D76AD6D1A4 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=qO3jMNaS; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.75.79 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-1.78 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.90)[-0.900,0]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; NEURAL_HAM_LONG(-0.61)[-0.613,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_SPAM_SHORT(0.24)[0.238,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx63.netapp.com]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCVD_IN_DNSWL_NONE(0.00)[79.75.107.40.list.dnswl.org : 127.0.3.0]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2018 08:35:02 -0000 Hi Hiren, Jonathan, > As your patch also touches tcpcb, it needs more eyes. NF may have a bunch= of changes here so best to coordinate with them. Sure; I still have to work a bit on the PRR patch - I don't like replicatin= g the mechanism in two places, and outside of the normal SACK procedures, w= hen PRR really is an improvement upon 3517. As 6675 pipe (and entering loss= recovery) would also be bundled up there, may take me some time too, to ge= t all that in a nice, concise patch. =20 > I guess you can open a phabricator review request and go from there? Surely, once I believe the code is ready. In the meantime, still looking fo= r reviewers for this simple one=20 https://reviews.freebsd.org/D17614 I recently added two packetdrill scripts to demonstrate the (timing) differ= ent w/o (std) and with that patch. Potentially, these scripts can be added = to Michaels collection of FreeBSd network unit test scripts:=20 https://github.com/freebsd-net/tcp-testsuite/ Best regards, Richard -----Original Message----- From: hiren@strugglingcoder.info =20 Sent: Donnerstag, 20. Dezember 2018 00:17 To: Scheffenegger, Richard ; jtl@FreeBSD.= org Cc: freebsd-transport@freebsd.org Subject: Re: possible RFC6675 compute_pipe counting issue. On 12/19/18 at 09:21P, Scheffenegger, Richard wrote: > Hi Hiren, Hi Richard, (I may not get time to look at this soon but responding right now before I = forget :-)) >=20 > I'm trying to reactivate my old Lost Retransmission Detection patch. >=20 > And I found your 2015 patch around sacked_bytes (RFC6675) here >=20 > https://github.com/rscheff/freebsd/commit/d3c29dd43ff23e293d5988258493 > 015fb4a072ba >=20 > (The line ~389 in tcp_sack.c) >=20 > But I think the code is problematic in two reasons: >=20 > a) very thin clients, which may only send SACK deltas instead of full=20 > excerpts of the scoreboard (e.g. only a sack block covering the most=20 > recent received data) > b) whenever the receiver scoreboard has more discontinuous entries than w= hat a single ACK can carry as SACK fields (typically 3, possibly 4 or as li= ttle as one). >=20 > However, these will overestimate the outstanding data (pipe). >=20 > (a) A cheating receiver sending multiple, identical sack blocks could gam= e the sender, though, as the check is done on a ack sack block by block che= ck, rather than when the scoreboard is updated... >=20 >=20 > Reason: Your patch only looks at the SACK data contained in the most rece= nt ACK, rather than proper accounting of the non-sack holes in the scoreboa= rd. Yes, you are right. And I tried to note this in code/commitlog/code-review = somewhere. >=20 > When I improved Aris PRR code, I did the accounting when the scoreboard i= s being updated; sacked_bytes need to exclude any snd.una move to the right= , but should be similar: >=20 > https://github.com/rscheff/freebsd/commit/4a4877478fe55e8ebdfa0daf9a2b > e4b212d07cde >=20 >=20 > As PRR needs a proper value for the delivered delta bytes per ACK, it sho= uld be simple to keep track of the correct value for the SACKed bytes (not = holes) in the scoreboard too... >=20 > Obviously, this can not be that much of an issue, as RFC6675 pipe is disa= bled by default, and would underestimate the number of sacked bytes at the = receiver, unless the receiver has malicious intent... >=20 > Any thoughts? I'll try to look at the patch as time permits and it may take a long time. = I am ccing Jonathan who was involved iirc in the discussion of better 6675 = support. As your patch also touches tcpcb, it needs more eyes. NF may have a bunch o= f changes here so best to coordinate with them. I guess you can open a phabricator review request and go from there? Cheers, Hiren From owner-freebsd-transport@freebsd.org Thu Dec 20 16:41:52 2018 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AFC0C134C962 for ; Thu, 20 Dec 2018 16:41:52 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM01-SN1-obe.outbound.protection.outlook.com (mail-eopbgr820080.outbound.protection.outlook.com [40.107.82.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0310F8825A; Thu, 20 Dec 2018 16:41:49 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=2kBAKeyso+SZPruDg42UicQbnVQR3GGyVmN9sJ5clAc=; b=MMlLJ32zgh7A3kPbOrSlX84/23zL7a+lfDJhpKP7+8d1vgi8sz7HOn1FTYPMgyB+VQDewLPCDzgCN6nSJ0KeBOhRgSu9gaFy1DsjfQSRX7D1C0zDTB2BkwYJ+fLoTyT1W0kS/J6SIXDOf36ILBFFjdfGKOwU9Axku+kxZKMolo8= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.142.14) by SN4PR0601MB3679.namprd06.prod.outlook.com (10.167.141.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1446.21; Thu, 20 Dec 2018 16:41:48 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011%4]) with mapi id 15.20.1446.020; Thu, 20 Dec 2018 16:41:48 +0000 From: "Scheffenegger, Richard" To: Lawrence Stewart CC: "freebsd-transport@freebsd.org" , "hiren@strugglingcoder.info" , "jtl@FreeBSD.org" Subject: RE: possible RFC6675 compute_pipe counting issue. Thread-Topic: possible RFC6675 compute_pipe counting issue. Thread-Index: AdSX4N6w97YTgpFvSAejfVrdpCcUngAECEYAACQgVHA= Date: Thu, 20 Dec 2018 16:41:47 +0000 Message-ID: References: <20181219231724.GJ75110@strugglingcoder.info> In-Reply-To: <20181219231724.GJ75110@strugglingcoder.info> Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy0yMmM5MjUxNi0wNDc2LTExZTktYjVlNi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcMjJjOTI1MTctMDQ3Ni0xMWU5LWI1ZTYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSI0MTk2IiB0PSIxMzE4OTc5NzcwNTg5NTM2NTMiIGg9IjZpSHlNTzgzQUttTlhVbC9tU3U0S3hveFhnTT0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [217.70.210.4] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; SN4PR0601MB3679; 6:GS7C/nXylnwiiTdW5DKKqgpzBDUu42QkX5d0Sc/o69RHylx6XUyI2PB4MpW5FKNMkMVh6Tjh2/bq/yPetgHqmadwkIV/xnH5CfOX6CLOI/VzojuwFzdAuPA/hH2lpn0YF4G0HxsdvPCL486DIbHyUGfgH4MaM1sU9O33NhKX81Tmjpalw348Wg8D3iCVb8wH5XZCgTUgovPjv3dWiYgu9zT7sUYGuuPo0Qtv/nwZ8x96fwroB6PTpsRiqSX6+Ab4oKFPG8V4cyiHSwEzbnIZDhxwtPc1q5MbEjgG48pXOImUXhxnrMbzVF+lxKcSa2uKZBtVvN48+U9+0/aaEQU2FPWEQhxaSWCppNSo0aBMm7r6KE2v39et/XQpqZaXFdcM/KyH66KbALMPYZSip5ozcGftNuN9y1SY3wRym9vfPHQTvIeRyJNeMtoSNS1ccaEttn0tboywZ7CqTczzwXJIRQ==; 5:4XP7xpOOaxWl6CyeTpMP/fxzg9YxtisvXMJTysSHpC67hD2DEyjoRR222iinA6K1Qazk6NyFa9jCLIJA13r2TrFEjikPZd8dSSaK7L7ksG7g/vCoXQEpMcc+tRC+3coQHE9eU65gNSIBkBJjw53/rjRXw42jKyKstmzLQTyV0Yg=; 7:qKwngdvVx+xPTo06nzsdxMVpWamQzd8ImBfBUUaVFntFi94SjJi2y8nmmi4pgad1482fH7KQ0EFLwwTffXETqGL0O1wNxCzoRlfL5ja3IB4waGc6xUQtj4SLyLh6voKo7dW2FjNSkC71dqXZoFfxAA== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: f29b7f4f-e285-47ba-7ae1-08d6669a08f6 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7193020); SRVR:SN4PR0601MB3679; x-ms-traffictypediagnostic: SN4PR0601MB3679: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(3230021)(999002)(5005026)(6040522)(2401047)(8121501046)(10201501046)(3002001)(93006095)(93001095)(3231475)(944501520)(52105112)(6055026)(149066)(150057)(6041310)(20161123558120)(20161123562045)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(201708071742011)(7699051)(76991095); SRVR:SN4PR0601MB3679; BCL:0; PCL:0; RULEID:; SRVR:SN4PR0601MB3679; x-forefront-prvs: 0892FA9A88 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(39860400002)(346002)(366004)(136003)(376002)(396003)(13464003)(189003)(199004)(476003)(575784001)(86362001)(66066001)(11346002)(446003)(76176011)(7696005)(186003)(478600001)(102836004)(6506007)(2906002)(7736002)(305945005)(97736004)(8676002)(8936002)(81156014)(5660300001)(74316002)(229853002)(6436002)(6916009)(106356001)(105586002)(33656002)(53546011)(14444005)(316002)(99286004)(54906003)(3846002)(6116002)(81166006)(256004)(486006)(55016002)(6306002)(9686003)(72206003)(53936002)(68736007)(6246003)(25786009)(71200400001)(71190400001)(4326008)(26005)(14454004)(966005)(6606295002); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3679; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: o0qJW4LPVzUpW6ZVsDsWcyJXzOUiMY2LoyZOsR/oaBY/a2UzHvD7Y0/CGPntGr9eNUonJn3IbkY38NVC+KPPKhYsmuJ5+8LGFFdla/K81NLQbA2OZLaIpQyNQ331v2SOBlo6o1PTSIv/BtB/GoMFCTkcabZLAhkSkKFfyy26aoP8i762KLqDCw7L/rXHKDTz9+fMFQfcYlsZk9Ia0IWL676Jg+eW/ujImObLaaEIevfi/4uT6Th02etczjKm2fxLFKMWcUvy+RhEzrg+V7dEnjBlNc+nngVcYuKb9jaKJC2635IaQ90JbiRI7RAoNMRC spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: f29b7f4f-e285-47ba-7ae1-08d6669a08f6 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Dec 2018 16:41:47.9240 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3679 X-Rspamd-Queue-Id: 0310F8825A X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=MMlLJ32z; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.82.80 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-4.19 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx63.netapp.com]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCVD_IN_DNSWL_NONE(0.00)[80.82.107.40.list.dnswl.org : 127.0.3.0]; NEURAL_HAM_SHORT(-0.94)[-0.940,0]; MIME_BASE64_TEXT(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; IP_SCORE(-0.84)[ipnet: 40.64.0.0/10(-2.06), asn: 8075(-2.03), country: US(-0.08)] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2018 16:41:52 -0000 U29ycnkgdG8gYm90aGVyIGFsbCBvZiB5b3UgYWdhaW4sDQoNClVuZm9ydHVuYXRlbHksIEkgdGhp bmsgSSBmb3VuZCBhbm90aGVyIGxvZ2ljYWwgZXJyb3IgaW4gdGhlIGdlbmVyYWwgU0FDSyBhbmQg cmVsYXRlZCBjb2RlLCBidXQgYWdhaW4sIHdvdWxkIGxpa2UgdG8gY2hlY2sgd2l0aCB5b3UgZmly c3QgKGFzIGl0J3MgbW9yZSBsaWtlbHkgdGhhdCBJIGFtIGp1c3QgbWlzdGFrZW4pOg0KDQpJIGxv b2tlZCBhdCBzYWNraGludC5sYXN0X3NhY2tfYWNrLCB3aGF0IHRoaXMgaXMgdXNlZCBmb3IuDQoN CkFuZCBJIGZvdW5kLCB0aGF0IExhd3JlbmNlIHVzZXMgdGhpcyBpbiB0aGUga2hlbHAvaF9lcnR0 LmMgY29kZSwgdG8gYXJyaXZlIGF0IGEgYmV0dGVyIFJUVCBwcm9iZSBkdXJpbmcgbG9zcyByZWNv dmVyeS4NCg0KQnV0IHRoZSBxdWVzdGlvbiBJIGhhdmUgaXMgdGhlIGZvbGxvd2luZzoNCg0KQSBy ZWNlaXZlciBpcyBleHBlY3RlZCwgdG8gcmV0dXJuIHRoZSBtb3N0IHJlY2VudCBjaGFuZ2UgaW4g dGhlIDFzdCBTQUNLIG9wdGlvbiBibG9jay4gDQoNCkJ1dCBpbiB0Y3Bfc2Fjay5jLCB3ZSBmaXJz dCAgbWFuZ2xlIHRoZSBvcmRlcmluZyBvZiB0aGUgcmVjZWl2ZWQgU0FDSyBvcHRpb24gYmxvY2tz LCB0byBiZWNvbWUgY29uc2VjdXRpdmUgaW5jcmVhc2luZyBpbiBzZXF1ZW5jZSBzcGFjZSwgdG8g ZmFjaWxpdGF0ZSBzaW5nbGUtcGFzcyB1cGRhdGUgb2YgdGhlIHNjb3JlYm9hcmQsIGFuZCBvbmx5 IHRoZW4gdGhlIHRvcG1vc3QgKGhpZ2hlc3QpIFNBQ0sgYmxvY2sgaXMgcGlja2VkIGZvciB0aGUg ZXJ0dCBjYWxjdWxhdGlvbi4NCg0KVGhpcyBpcyBmaW5lLCBhcyBsb25nIGFzIHBhY2tldHMgYXJl IHNlbnQgaW4gc2VxdWVudGlhbCBvcmRlciAoY29tbW9uIPCfmIopLCBhbmQgbm90IHJlb3JkZXJl ZCBkdXJpbmcgZGVsaXZlcnkgKGhtbSksIGFuZCB0aGUgQUNLIHJldHVybiBwYXRoIGRvZXNuJ3Qg ZG8gYW55IHJlb3JkZXJpbmcsIGFuZCB3ZSBkb24ndCB3YW50IHRvIHVzZSBhbnkgU0FDSyByZXRy YW5zbWl0dGVkIHBhY2tldHMgZm9yIGZ1cnRoZXIgUlRUIHVwZGF0ZXMuLi4NCg0KDQpMb25nIHN0 b3J5IHNob3J0OiBTaG91bGRuJ3QgInNhY2toaW50Lmxhc3Rfc2Fja19hY2siIGJlIHNldCB0byB0 aGUgZW5kIG9mIHRoZSAxc3QgU0FDSyBibG9jayByZWNlaXZlZCwgcmF0aGVyIHRoZW4gdGhlIGxh c3QsIG9yZGVyZWQgU0FDSyBibG9jaywgdG8geWllbGQgdGhlIHByb3BlciBSVFQgdGltaW5nIGlu Zm9ybWF0aW9uPw0KDQooSSBhZG1pdCB0byBoYXZlIG5vdCBzdHVkaWVkIHRoZSBoX2VydHQgY29k ZSBpbiBkZXRhaWwpLg0KDQpCZXN0IHJlZ2FyZHMsDQogICBSaWNoYXJkDQoNCg0KLS0tLS1Pcmln aW5hbCBNZXNzYWdlLS0tLS0NCkZyb206IGhpcmVuQHN0cnVnZ2xpbmdjb2Rlci5pbmZvIDxoaXJl bkBzdHJ1Z2dsaW5nY29kZXIuaW5mbz4gDQpTZW50OiBEb25uZXJzdGFnLCAyMC4gRGV6ZW1iZXIg MjAxOCAwMDoxNw0KVG86IFNjaGVmZmVuZWdnZXIsIFJpY2hhcmQgPFJpY2hhcmQuU2NoZWZmZW5l Z2dlckBuZXRhcHAuY29tPjsganRsQEZyZWVCU0Qub3JnDQpDYzogZnJlZWJzZC10cmFuc3BvcnRA ZnJlZWJzZC5vcmcNClN1YmplY3Q6IFJlOiBwb3NzaWJsZSBSRkM2Njc1IGNvbXB1dGVfcGlwZSBj b3VudGluZyBpc3N1ZS4NCg0KT24gMTIvMTkvMTggYXQgMDk6MjFQLCBTY2hlZmZlbmVnZ2VyLCBS aWNoYXJkIHdyb3RlOg0KPiBIaSBIaXJlbiwNCg0KSGkgUmljaGFyZCwNCihJIG1heSBub3QgZ2V0 IHRpbWUgdG8gbG9vayBhdCB0aGlzIHNvb24gYnV0IHJlc3BvbmRpbmcgcmlnaHQgbm93IGJlZm9y ZSBJIGZvcmdldCA6LSkpDQo+IA0KPiBJJ20gdHJ5aW5nIHRvIHJlYWN0aXZhdGUgbXkgb2xkIExv c3QgUmV0cmFuc21pc3Npb24gRGV0ZWN0aW9uIHBhdGNoLg0KPiANCj4gQW5kIEkgZm91bmQgeW91 ciAyMDE1IHBhdGNoIGFyb3VuZCBzYWNrZWRfYnl0ZXMgKFJGQzY2NzUpIGhlcmUNCj4gDQo+IGh0 dHBzOi8vZ2l0aHViLmNvbS9yc2NoZWZmL2ZyZWVic2QvY29tbWl0L2QzYzI5ZGQ0M2ZmMjNlMjkz ZDU5ODgyNTg0OTMNCj4gMDE1ZmI0YTA3MmJhDQo+IA0KPiAoVGhlIGxpbmUgfjM4OSBpbiB0Y3Bf c2Fjay5jKQ0KPiANCj4gQnV0IEkgdGhpbmsgdGhlIGNvZGUgaXMgcHJvYmxlbWF0aWMgaW4gdHdv IHJlYXNvbnM6DQo+IA0KPiBhKSB2ZXJ5IHRoaW4gY2xpZW50cywgd2hpY2ggbWF5IG9ubHkgc2Vu ZCBTQUNLIGRlbHRhcyBpbnN0ZWFkIG9mIGZ1bGwgDQo+IGV4Y2VycHRzIG9mIHRoZSBzY29yZWJv YXJkIChlLmcuIG9ubHkgYSBzYWNrIGJsb2NrIGNvdmVyaW5nIHRoZSBtb3N0IA0KPiByZWNlbnQg cmVjZWl2ZWQgZGF0YSkNCj4gYikgd2hlbmV2ZXIgdGhlIHJlY2VpdmVyIHNjb3JlYm9hcmQgaGFz IG1vcmUgZGlzY29udGludW91cyBlbnRyaWVzIHRoYW4gd2hhdCBhIHNpbmdsZSBBQ0sgY2FuIGNh cnJ5IGFzIFNBQ0sgZmllbGRzICh0eXBpY2FsbHkgMywgcG9zc2libHkgNCBvciBhcyBsaXR0bGUg YXMgb25lKS4NCj4gDQo+IEhvd2V2ZXIsIHRoZXNlIHdpbGwgb3ZlcmVzdGltYXRlIHRoZSBvdXRz dGFuZGluZyBkYXRhIChwaXBlKS4NCj4gDQo+IChhKSBBIGNoZWF0aW5nIHJlY2VpdmVyIHNlbmRp bmcgbXVsdGlwbGUsIGlkZW50aWNhbCBzYWNrIGJsb2NrcyBjb3VsZCBnYW1lIHRoZSBzZW5kZXIs IHRob3VnaCwgYXMgdGhlIGNoZWNrIGlzIGRvbmUgb24gYSBhY2sgc2FjayBibG9jayBieSBibG9j ayBjaGVjaywgcmF0aGVyIHRoYW4gd2hlbiB0aGUgc2NvcmVib2FyZCBpcyB1cGRhdGVkLi4uDQo+ IA0KPiANCj4gUmVhc29uOiBZb3VyIHBhdGNoIG9ubHkgbG9va3MgYXQgdGhlIFNBQ0sgZGF0YSBj b250YWluZWQgaW4gdGhlIG1vc3QgcmVjZW50IEFDSywgcmF0aGVyIHRoYW4gcHJvcGVyIGFjY291 bnRpbmcgb2YgdGhlIG5vbi1zYWNrIGhvbGVzIGluIHRoZSBzY29yZWJvYXJkLg0KDQpZZXMsIHlv dSBhcmUgcmlnaHQuIEFuZCBJIHRyaWVkIHRvIG5vdGUgdGhpcyBpbiBjb2RlL2NvbW1pdGxvZy9j b2RlLXJldmlldyBzb21ld2hlcmUuDQoNCj4gDQo+IFdoZW4gSSBpbXByb3ZlZCBBcmlzIFBSUiBj b2RlLCBJIGRpZCB0aGUgYWNjb3VudGluZyB3aGVuIHRoZSBzY29yZWJvYXJkIGlzIGJlaW5nIHVw ZGF0ZWQ7IHNhY2tlZF9ieXRlcyBuZWVkIHRvIGV4Y2x1ZGUgYW55IHNuZC51bmEgbW92ZSB0byB0 aGUgcmlnaHQsIGJ1dCBzaG91bGQgYmUgc2ltaWxhcjoNCj4gDQo+IGh0dHBzOi8vZ2l0aHViLmNv bS9yc2NoZWZmL2ZyZWVic2QvY29tbWl0LzRhNDg3NzQ3OGZlNTVlOGViZGZhMGRhZjlhMmINCj4g ZTRiMjEyZDA3Y2RlDQo+IA0KPiANCj4gQXMgUFJSIG5lZWRzIGEgcHJvcGVyIHZhbHVlIGZvciB0 aGUgZGVsaXZlcmVkIGRlbHRhIGJ5dGVzIHBlciBBQ0ssIGl0IHNob3VsZCBiZSBzaW1wbGUgdG8g a2VlcCB0cmFjayBvZiB0aGUgY29ycmVjdCB2YWx1ZSBmb3IgdGhlIFNBQ0tlZCBieXRlcyAobm90 IGhvbGVzKSBpbiB0aGUgc2NvcmVib2FyZCB0b28uLi4NCj4gDQo+IE9idmlvdXNseSwgdGhpcyBj YW4gbm90IGJlIHRoYXQgbXVjaCBvZiBhbiBpc3N1ZSwgYXMgUkZDNjY3NSBwaXBlIGlzIGRpc2Fi bGVkIGJ5IGRlZmF1bHQsIGFuZCB3b3VsZCB1bmRlcmVzdGltYXRlIHRoZSBudW1iZXIgb2Ygc2Fj a2VkIGJ5dGVzIGF0IHRoZSByZWNlaXZlciwgdW5sZXNzIHRoZSByZWNlaXZlciBoYXMgbWFsaWNp b3VzIGludGVudC4uLg0KPiANCj4gQW55IHRob3VnaHRzPw0KDQpJJ2xsIHRyeSB0byBsb29rIGF0 IHRoZSBwYXRjaCBhcyB0aW1lIHBlcm1pdHMgYW5kIGl0IG1heSB0YWtlIGEgbG9uZyB0aW1lLiBJ IGFtIGNjaW5nIEpvbmF0aGFuIHdobyB3YXMgaW52b2x2ZWQgaWlyYyBpbiB0aGUgZGlzY3Vzc2lv biBvZiBiZXR0ZXIgNjY3NSBzdXBwb3J0Lg0KDQpBcyB5b3VyIHBhdGNoIGFsc28gdG91Y2hlcyB0 Y3BjYiwgaXQgbmVlZHMgbW9yZSBleWVzLiBORiBtYXkgaGF2ZSBhIGJ1bmNoIG9mIGNoYW5nZXMg aGVyZSBzbyBiZXN0IHRvIGNvb3JkaW5hdGUgd2l0aCB0aGVtLg0KDQpJIGd1ZXNzIHlvdSBjYW4g b3BlbiBhIHBoYWJyaWNhdG9yIHJldmlldyByZXF1ZXN0IGFuZCBnbyBmcm9tIHRoZXJlPw0KDQpD aGVlcnMsDQpIaXJlbg0K From owner-freebsd-transport@freebsd.org Thu Dec 20 19:18:14 2018 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 963B813510BB for ; Thu, 20 Dec 2018 19:18:14 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM03-CO1-obe.outbound.protection.outlook.com (mail-eopbgr790071.outbound.protection.outlook.com [40.107.79.71]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 04CF98EDD9; Thu, 20 Dec 2018 19:18:12 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=a/rSM9hig2IXzqGzY51e7MSQEuPun1IoZeRm8ofhxMw=; b=l69YU+Mdml/OV3+zJCx+Hq6cJBP+uhJu7jjzDIbKoKxqczzWfynAMIDVuotURSbQ0LEQBZ/RzBpG+giWV74GzyZnzbLryjmuwqMCT+q35AuPtcVW4FKi3uVj4RuogAroHMJRt6dV/rl9ZG18rRgWD78XOrx4xLZNUGOIX+OTVIs= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.142.14) by SN4PR0601MB3616.namprd06.prod.outlook.com (10.167.141.138) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1425.22; Thu, 20 Dec 2018 19:18:09 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011%4]) with mapi id 15.20.1446.020; Thu, 20 Dec 2018 19:18:09 +0000 From: "Scheffenegger, Richard" To: 'Lawrence Stewart' CC: "'freebsd-transport@freebsd.org'" , "'hiren@strugglingcoder.info'" , "'jtl@FreeBSD.org'" Subject: RE: possible RFC6675 compute_pipe counting issue. Thread-Topic: possible RFC6675 compute_pipe counting issue. Thread-Index: AdSX4N6w97YTgpFvSAejfVrdpCcUngAECEYAACQgVHAABYakcA== Date: Thu, 20 Dec 2018 19:18:09 +0000 Message-ID: References: <20181219231724.GJ75110@strugglingcoder.info> In-Reply-To: Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy1mYWRjMmMxZS0wNDhiLTExZTktYjVlNi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcZmFkYzJjMWYtMDQ4Yi0xMWU5LWI1ZTYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSI0OTEzIiB0PSIxMzE4OTgwNzA4NzgxNzU0OTIiIGg9InNjWjNMZzVpUjcyYS9FME0wZTVjME9TcTJXVT0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [217.70.210.4] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; SN4PR0601MB3616; 6:GRx902Zz8c6lGyJJ1Cxp5G5wmDXiEQ0AssKOndbqz/xdulyuG7jDHRi7rrdiq99LKRfuS0f9HFNtqK0oMVpr3UayfNWsHRYgvZ5ioH6SBQ6WR5Mc9nMXTF1hphaJCIIevWVLw5fuM6qmrtl2+bIWnM82kEiB0x/IZgNjNYVgO05d5f5VC+rSOF3U1X4v9mssEoC6jBdw0qqf+WZSqC5xyu6ZBuFqNkAIpnG/5qA0LaI9BJ2+XqfUiVjnuZrOMniBMq828+CGMdSITUhdp9Bx64eyBNjx3yRFHWaKLZoO58FEUjU7KPkENYV5nC4GFfoalkTyLIkPwh5Oto8fx2t3kv4QcjMn7sfXtckORcpGZsRexNQrKOd/WS6M9mrXHNx/X8/C/KRgLivmY0GWWIsIXHX5X9NpXAJMn1d/bxX8k4Yzq6V2zxNjNrXM/TNaxOE1OjI61V2rHBlTxoMNqGtBOQ==; 5:azB0gREHSudxst9XQW8CUFam/KYc0ENa/V77W7YF6zeIdTpiZ762nqo9TTUCQM/yS1UqfmB+Ws25dQGB7J2k2YeKiSmgMF2wht4c8pTGZUqtfQkku8qXYJjTYUB7u2UzFZozuXy/W4NvcQqXktEZZKiefSjgHFDXE6xv+UH7OXE=; 7:IQogBd+Uq3VTy34/LbjlebQ3jRCTq9ObmOF7stYsGYAj3k3230DiemRsUQdaZAJkPhcHmKsWAXGw6T1NwS3tHCQllIkKbO1/6/FnSlCNfff7PP5FueFK6ZGoX8SCuDpuGvfYobl4geHvE8nsBvWRKA== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 7fa70828-7120-4af7-cf2e-08d666afe0e9 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600074)(711020)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7193020); SRVR:SN4PR0601MB3616; x-ms-traffictypediagnostic: SN4PR0601MB3616: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(3230021)(999002)(5005026)(6040522)(2401047)(8121501046)(93006095)(93001095)(3231475)(944501520)(52105112)(10201501046)(3002001)(6055026)(149066)(150057)(6041310)(20161123560045)(20161123558120)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123562045)(201708071742011)(7699051)(76991095); SRVR:SN4PR0601MB3616; BCL:0; PCL:0; RULEID:; SRVR:SN4PR0601MB3616; x-forefront-prvs: 0892FA9A88 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(136003)(39860400002)(376002)(346002)(396003)(13464003)(189003)(199004)(76176011)(74316002)(93156006)(71190400001)(71200400001)(105586002)(66066001)(6246003)(4326008)(316002)(186003)(53546011)(256004)(6506007)(14444005)(7696005)(575784001)(5660300001)(86362001)(26005)(476003)(99286004)(446003)(486006)(11346002)(54906003)(25786009)(102836004)(68736007)(478600001)(14454004)(2940100002)(6116002)(3846002)(6436002)(33656002)(6916009)(97736004)(229853002)(72206003)(966005)(81166006)(81156014)(8676002)(2906002)(7736002)(8936002)(305945005)(55016002)(9686003)(53936002)(6306002)(106356001)(6606295002); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3616; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: zkHVNNCX/z7d15b/LPdA6JSICpR6FQBIAd8HC7PxJeqsr3dPazZHo1KNw823EHqbtSEIG0+znXm1Yb8Mnpq2wNNO/SyDmwuqk7fM/RGquhH3Bu88ZgsEtDXtsORL4Dk7GtGY8yVA5qBjdtNeEaE3xMG+gfx8iZfm9FTIAiLFSMzaZ05NSqEzTDTOxsEgTseTGPn3KDDoMKJGh/2esYaHHJuQkIL+jTvQ4vDLdAq92S/72WlqZ8/670F/0SdwipVHTn6qKdTJFSXVomDxiAkQ8p4T5MOeOIa4iW0iTNpthDqZS7SIFos3SQTlpdjwBE7J spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7fa70828-7120-4af7-cf2e-08d666afe0e9 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Dec 2018 19:18:09.6401 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3616 X-Rspamd-Queue-Id: 04CF98EDD9 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=l69YU+Md; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.79.71 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-2.61 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.910,0]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; NEURAL_HAM_LONG(-0.91)[-0.913,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mx63.netapp.com]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCVD_IN_DNSWL_NONE(0.00)[71.79.107.40.list.dnswl.org : 127.0.3.0]; NEURAL_HAM_SHORT(-0.38)[-0.377,0]; MIME_BASE64_TEXT(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2018 19:18:14 -0000 DQpBZnRlciBsb29raW5nIGF0IHRoaXMgYWdhaW4sIGl0IHNlZW1zIHRvIG1lLCB3aGF0IHNhY2to aW50Lmxhc3Rfc2Fja19hY2sgaXMgdHJhY2tpbmcgcmVhbGx5IGlzIGlkZW50aWNhbCB0byB0cC0+ c25kX2ZhY2ssIGFuZCB0aGUgb25seSBwb2ludCBpcyB0byBjaGVjayBpZiB0aF9hY2sgb3IgInNu ZF9mYWNrIiBzaG91bGQgYmUgY2hlY2tlZCBhZ2FpbnN0IGZvciB0aGUgUlRUIHNhbXBsaW5nDQoN CldoeSBub3QgdXNlIHNuZF9mYWNrIGluc3RlYWQgYW5kIHNhdmUgdGhlIG1lbW9yeSBhY2Nlc3M/ DQoNCihpbiB0aGUgcmVndWxhciBBQ0sgY2FzZSwgc25kX2ZhY2sgd291bGQgaGF2ZSB0byBiZSBz ZXQgdG8gc25kX3VuYSAvIHRoX2FjaywgcHJpb3IgdG8gdGhlIGNhbGwgdG8gZXJ0dF9wYWNrZXRf bWVhc3VyZW1lbnQsIGluIHRjcF9pbnB1dCkNCg0KLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0N CkZyb206IFNjaGVmZmVuZWdnZXIsIFJpY2hhcmQgDQpTZW50OiBEb25uZXJzdGFnLCAyMC4gRGV6 ZW1iZXIgMjAxOCAxNzo0Mg0KVG86IExhd3JlbmNlIFN0ZXdhcnQgPGxzdGV3YXJ0QG5ldGZsaXgu Y29tPg0KQ2M6IGZyZWVic2QtdHJhbnNwb3J0QGZyZWVic2Qub3JnOyBoaXJlbkBzdHJ1Z2dsaW5n Y29kZXIuaW5mbzsganRsQEZyZWVCU0Qub3JnDQpTdWJqZWN0OiBSRTogcG9zc2libGUgUkZDNjY3 NSBjb21wdXRlX3BpcGUgY291bnRpbmcgaXNzdWUuDQoNClNvcnJ5IHRvIGJvdGhlciBhbGwgb2Yg eW91IGFnYWluLA0KDQpVbmZvcnR1bmF0ZWx5LCBJIHRoaW5rIEkgZm91bmQgYW5vdGhlciBsb2dp Y2FsIGVycm9yIGluIHRoZSBnZW5lcmFsIFNBQ0sgYW5kIHJlbGF0ZWQgY29kZSwgYnV0IGFnYWlu LCB3b3VsZCBsaWtlIHRvIGNoZWNrIHdpdGggeW91IGZpcnN0IChhcyBpdCdzIG1vcmUgbGlrZWx5 IHRoYXQgSSBhbSBqdXN0IG1pc3Rha2VuKToNCg0KSSBsb29rZWQgYXQgc2Fja2hpbnQubGFzdF9z YWNrX2Fjaywgd2hhdCB0aGlzIGlzIHVzZWQgZm9yLg0KDQpBbmQgSSBmb3VuZCwgdGhhdCBMYXdy ZW5jZSB1c2VzIHRoaXMgaW4gdGhlIGtoZWxwL2hfZXJ0dC5jIGNvZGUsIHRvIGFycml2ZSBhdCBh IGJldHRlciBSVFQgcHJvYmUgZHVyaW5nIGxvc3MgcmVjb3ZlcnkuDQoNCkJ1dCB0aGUgcXVlc3Rp b24gSSBoYXZlIGlzIHRoZSBmb2xsb3dpbmc6DQoNCkEgcmVjZWl2ZXIgaXMgZXhwZWN0ZWQsIHRv IHJldHVybiB0aGUgbW9zdCByZWNlbnQgY2hhbmdlIGluIHRoZSAxc3QgU0FDSyBvcHRpb24gYmxv Y2suIA0KDQpCdXQgaW4gdGNwX3NhY2suYywgd2UgZmlyc3QgIG1hbmdsZSB0aGUgb3JkZXJpbmcg b2YgdGhlIHJlY2VpdmVkIFNBQ0sgb3B0aW9uIGJsb2NrcywgdG8gYmVjb21lIGNvbnNlY3V0aXZl IGluY3JlYXNpbmcgaW4gc2VxdWVuY2Ugc3BhY2UsIHRvIGZhY2lsaXRhdGUgc2luZ2xlLXBhc3Mg dXBkYXRlIG9mIHRoZSBzY29yZWJvYXJkLCBhbmQgb25seSB0aGVuIHRoZSB0b3Btb3N0IChoaWdo ZXN0KSBTQUNLIGJsb2NrIGlzIHBpY2tlZCBmb3IgdGhlIGVydHQgY2FsY3VsYXRpb24uDQoNClRo aXMgaXMgZmluZSwgYXMgbG9uZyBhcyBwYWNrZXRzIGFyZSBzZW50IGluIHNlcXVlbnRpYWwgb3Jk ZXIgKGNvbW1vbiDwn5iKKSwgYW5kIG5vdCByZW9yZGVyZWQgZHVyaW5nIGRlbGl2ZXJ5IChobW0p LCBhbmQgdGhlIEFDSyByZXR1cm4gcGF0aCBkb2Vzbid0IGRvIGFueSByZW9yZGVyaW5nLCBhbmQg d2UgZG9uJ3Qgd2FudCB0byB1c2UgYW55IFNBQ0sgcmV0cmFuc21pdHRlZCBwYWNrZXRzIGZvciBm dXJ0aGVyIFJUVCB1cGRhdGVzLi4uDQoNCg0KTG9uZyBzdG9yeSBzaG9ydDogU2hvdWxkbid0ICJz YWNraGludC5sYXN0X3NhY2tfYWNrIiBiZSBzZXQgdG8gdGhlIGVuZCBvZiB0aGUgMXN0IFNBQ0sg YmxvY2sgcmVjZWl2ZWQsIHJhdGhlciB0aGVuIHRoZSBsYXN0LCBvcmRlcmVkIFNBQ0sgYmxvY2ss IHRvIHlpZWxkIHRoZSBwcm9wZXIgUlRUIHRpbWluZyBpbmZvcm1hdGlvbj8NCg0KKEkgYWRtaXQg dG8gaGF2ZSBub3Qgc3R1ZGllZCB0aGUgaF9lcnR0IGNvZGUgaW4gZGV0YWlsKS4NCg0KQmVzdCBy ZWdhcmRzLA0KICAgUmljaGFyZA0KDQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQpGcm9t OiBoaXJlbkBzdHJ1Z2dsaW5nY29kZXIuaW5mbyA8aGlyZW5Ac3RydWdnbGluZ2NvZGVyLmluZm8+ DQpTZW50OiBEb25uZXJzdGFnLCAyMC4gRGV6ZW1iZXIgMjAxOCAwMDoxNw0KVG86IFNjaGVmZmVu ZWdnZXIsIFJpY2hhcmQgPFJpY2hhcmQuU2NoZWZmZW5lZ2dlckBuZXRhcHAuY29tPjsganRsQEZy ZWVCU0Qub3JnDQpDYzogZnJlZWJzZC10cmFuc3BvcnRAZnJlZWJzZC5vcmcNClN1YmplY3Q6IFJl OiBwb3NzaWJsZSBSRkM2Njc1IGNvbXB1dGVfcGlwZSBjb3VudGluZyBpc3N1ZS4NCg0KT24gMTIv MTkvMTggYXQgMDk6MjFQLCBTY2hlZmZlbmVnZ2VyLCBSaWNoYXJkIHdyb3RlOg0KPiBIaSBIaXJl biwNCg0KSGkgUmljaGFyZCwNCihJIG1heSBub3QgZ2V0IHRpbWUgdG8gbG9vayBhdCB0aGlzIHNv b24gYnV0IHJlc3BvbmRpbmcgcmlnaHQgbm93IGJlZm9yZSBJIGZvcmdldCA6LSkpDQo+IA0KPiBJ J20gdHJ5aW5nIHRvIHJlYWN0aXZhdGUgbXkgb2xkIExvc3QgUmV0cmFuc21pc3Npb24gRGV0ZWN0 aW9uIHBhdGNoLg0KPiANCj4gQW5kIEkgZm91bmQgeW91ciAyMDE1IHBhdGNoIGFyb3VuZCBzYWNr ZWRfYnl0ZXMgKFJGQzY2NzUpIGhlcmUNCj4gDQo+IGh0dHBzOi8vZ2l0aHViLmNvbS9yc2NoZWZm L2ZyZWVic2QvY29tbWl0L2QzYzI5ZGQ0M2ZmMjNlMjkzZDU5ODgyNTg0OTMNCj4gMDE1ZmI0YTA3 MmJhDQo+IA0KPiAoVGhlIGxpbmUgfjM4OSBpbiB0Y3Bfc2Fjay5jKQ0KPiANCj4gQnV0IEkgdGhp bmsgdGhlIGNvZGUgaXMgcHJvYmxlbWF0aWMgaW4gdHdvIHJlYXNvbnM6DQo+IA0KPiBhKSB2ZXJ5 IHRoaW4gY2xpZW50cywgd2hpY2ggbWF5IG9ubHkgc2VuZCBTQUNLIGRlbHRhcyBpbnN0ZWFkIG9m IGZ1bGwgDQo+IGV4Y2VycHRzIG9mIHRoZSBzY29yZWJvYXJkIChlLmcuIG9ubHkgYSBzYWNrIGJs b2NrIGNvdmVyaW5nIHRoZSBtb3N0IA0KPiByZWNlbnQgcmVjZWl2ZWQgZGF0YSkNCj4gYikgd2hl bmV2ZXIgdGhlIHJlY2VpdmVyIHNjb3JlYm9hcmQgaGFzIG1vcmUgZGlzY29udGludW91cyBlbnRy aWVzIHRoYW4gd2hhdCBhIHNpbmdsZSBBQ0sgY2FuIGNhcnJ5IGFzIFNBQ0sgZmllbGRzICh0eXBp Y2FsbHkgMywgcG9zc2libHkgNCBvciBhcyBsaXR0bGUgYXMgb25lKS4NCj4gDQo+IEhvd2V2ZXIs IHRoZXNlIHdpbGwgb3ZlcmVzdGltYXRlIHRoZSBvdXRzdGFuZGluZyBkYXRhIChwaXBlKS4NCj4g DQo+IChhKSBBIGNoZWF0aW5nIHJlY2VpdmVyIHNlbmRpbmcgbXVsdGlwbGUsIGlkZW50aWNhbCBz YWNrIGJsb2NrcyBjb3VsZCBnYW1lIHRoZSBzZW5kZXIsIHRob3VnaCwgYXMgdGhlIGNoZWNrIGlz IGRvbmUgb24gYSBhY2sgc2FjayBibG9jayBieSBibG9jayBjaGVjaywgcmF0aGVyIHRoYW4gd2hl biB0aGUgc2NvcmVib2FyZCBpcyB1cGRhdGVkLi4uDQo+IA0KPiANCj4gUmVhc29uOiBZb3VyIHBh dGNoIG9ubHkgbG9va3MgYXQgdGhlIFNBQ0sgZGF0YSBjb250YWluZWQgaW4gdGhlIG1vc3QgcmVj ZW50IEFDSywgcmF0aGVyIHRoYW4gcHJvcGVyIGFjY291bnRpbmcgb2YgdGhlIG5vbi1zYWNrIGhv bGVzIGluIHRoZSBzY29yZWJvYXJkLg0KDQpZZXMsIHlvdSBhcmUgcmlnaHQuIEFuZCBJIHRyaWVk IHRvIG5vdGUgdGhpcyBpbiBjb2RlL2NvbW1pdGxvZy9jb2RlLXJldmlldyBzb21ld2hlcmUuDQoN Cj4gDQo+IFdoZW4gSSBpbXByb3ZlZCBBcmlzIFBSUiBjb2RlLCBJIGRpZCB0aGUgYWNjb3VudGlu ZyB3aGVuIHRoZSBzY29yZWJvYXJkIGlzIGJlaW5nIHVwZGF0ZWQ7IHNhY2tlZF9ieXRlcyBuZWVk IHRvIGV4Y2x1ZGUgYW55IHNuZC51bmEgbW92ZSB0byB0aGUgcmlnaHQsIGJ1dCBzaG91bGQgYmUg c2ltaWxhcjoNCj4gDQo+IGh0dHBzOi8vZ2l0aHViLmNvbS9yc2NoZWZmL2ZyZWVic2QvY29tbWl0 LzRhNDg3NzQ3OGZlNTVlOGViZGZhMGRhZjlhMmINCj4gZTRiMjEyZDA3Y2RlDQo+IA0KPiANCj4g QXMgUFJSIG5lZWRzIGEgcHJvcGVyIHZhbHVlIGZvciB0aGUgZGVsaXZlcmVkIGRlbHRhIGJ5dGVz IHBlciBBQ0ssIGl0IHNob3VsZCBiZSBzaW1wbGUgdG8ga2VlcCB0cmFjayBvZiB0aGUgY29ycmVj dCB2YWx1ZSBmb3IgdGhlIFNBQ0tlZCBieXRlcyAobm90IGhvbGVzKSBpbiB0aGUgc2NvcmVib2Fy ZCB0b28uLi4NCj4gDQo+IE9idmlvdXNseSwgdGhpcyBjYW4gbm90IGJlIHRoYXQgbXVjaCBvZiBh biBpc3N1ZSwgYXMgUkZDNjY3NSBwaXBlIGlzIGRpc2FibGVkIGJ5IGRlZmF1bHQsIGFuZCB3b3Vs ZCB1bmRlcmVzdGltYXRlIHRoZSBudW1iZXIgb2Ygc2Fja2VkIGJ5dGVzIGF0IHRoZSByZWNlaXZl ciwgdW5sZXNzIHRoZSByZWNlaXZlciBoYXMgbWFsaWNpb3VzIGludGVudC4uLg0KPiANCj4gQW55 IHRob3VnaHRzPw0KDQpJJ2xsIHRyeSB0byBsb29rIGF0IHRoZSBwYXRjaCBhcyB0aW1lIHBlcm1p dHMgYW5kIGl0IG1heSB0YWtlIGEgbG9uZyB0aW1lLiBJIGFtIGNjaW5nIEpvbmF0aGFuIHdobyB3 YXMgaW52b2x2ZWQgaWlyYyBpbiB0aGUgZGlzY3Vzc2lvbiBvZiBiZXR0ZXIgNjY3NSBzdXBwb3J0 Lg0KDQpBcyB5b3VyIHBhdGNoIGFsc28gdG91Y2hlcyB0Y3BjYiwgaXQgbmVlZHMgbW9yZSBleWVz LiBORiBtYXkgaGF2ZSBhIGJ1bmNoIG9mIGNoYW5nZXMgaGVyZSBzbyBiZXN0IHRvIGNvb3JkaW5h dGUgd2l0aCB0aGVtLg0KDQpJIGd1ZXNzIHlvdSBjYW4gb3BlbiBhIHBoYWJyaWNhdG9yIHJldmll dyByZXF1ZXN0IGFuZCBnbyBmcm9tIHRoZXJlPw0KDQpDaGVlcnMsDQpIaXJlbg0K From owner-freebsd-transport@freebsd.org Sat Dec 22 00:06:09 2018 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ABBDA1338774; Sat, 22 Dec 2018 00:06:08 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM05-CO1-obe.outbound.protection.outlook.com (mail-co1nam05on0624.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe50::624]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6966B8A421; Sat, 22 Dec 2018 00:06:06 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=G0moQyt8tmjm++7N3qo27OhQlbuPEDyqn3rB9pixfCU=; b=J+JcWTnvoaxfK/w076xw4/WXj6LCu/Pn3ePN3Xvp3Rhnr+pzXEgItCGBt7WapF0YvbDRgSJ+lw4PnnIPpgfLpgDYFXRRT1CeTWljSSUWK9cglFmOHU0LoA1THWvd/vu2ozRLSE0imyxkDYS75vKXxAyzoqdqEHnHsvwjnNJnKvM= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.142.14) by SN4PR0601MB3774.namprd06.prod.outlook.com (10.167.142.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1425.22; Sat, 22 Dec 2018 00:06:03 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8d1a:8d3a:30a:d011%4]) with mapi id 15.20.1446.022; Sat, 22 Dec 2018 00:06:03 +0000 From: "Scheffenegger, Richard" To: "freebsd-transport@freebsd.org" , "freebsd-net@freebsd.org" Subject: RFC6675 Thread-Topic: RFC6675 Thread-Index: AdSCTGIZ5XHylIM3SDapy9vpX2YRCgXPDzGQ Date: Sat, 22 Dec 2018 00:06:03 +0000 Message-ID: References: In-Reply-To: Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJyZmM2Njc1LnBuZyIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcZG9jdW1lbnRzXG5ldGFwcFxmcmVlYnNkXHJmYzY2NzUucG5nIiBzej0iNDQ0ODYiIHQ9IjEzMTg5OTEwNDkyNTYzODcwMCIgaD0icVYvd1FEeEJZZ2FOWmFSanI2UXlaZmZCeFU0PSIgaWQ9IiIgYmw9IjAiIGJvPSIwIi8+PGF0IG5tPSJyZmMzNTE3LnBuZyIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcZG9jdW1lbnRzXG5ldGFwcFxmcmVlYnNkXHJmYzM1MTcucG5nIiBzej0iMzI2MDQiIHQ9IjEzMTg5OTEwNDkyNjMyMjE1OCIgaD0iWnFXaDlhYTdrZGluOUlkeC8yTThYV0REL0Q4PSIgaWQ9IiIgYmw9IjAiIGJvPSIwIi8+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy01Y2MzZjRhMC0wNTdkLTExZTktYjVlNi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcNWNjM2Y0YTItMDU3ZC0xMWU5LWI1ZTYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSIxMDc5IiB0PSIxMzE4OTkxMDc2MDczMTg4MDkiIGg9ImorUTNGd282UlBrN3RkL2FuUjY3S0tvWEVJMD0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [213.143.121.76] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; SN4PR0601MB3774; 6:L+KKM7z1+7jQ2kKW6AN1ZSjZh9CXgsTJo/m5Y2F7ctMvTkPRdjIfjk59ShcqRAQYoHKrGb+erg/OmzT3FDAfSLS7iYEr40F9m4h+KNVxQ26+ve/Z7cO1PMpCE4PKFeE9LBuTn9W03q3kq3ntwNAwmYuHnTx0uM4lIzbky6rU6h+LHHfaGZoc4wbhzZEwgp6moybJZWK2AzF2yCR/OTueNL3YeaDIBSedieJv0+FQRPZLwYGeogHM9mo5tCK3gQyDgsf8LFX3Apl5s9+uYDhuNuynv9w7fBHtyntl20He1Hok1izo99vXZ/BTC6f6G3VUomGWrKTp70rZG/okRJPRchtRkTtkvdACXz0ZRCUOKcXyxT3IVtJnrUVHl43D71NSK9Qn+SdJDQDYZistKMKWidaq9iNSqTKoWpUSU3dylP4AKqJM4f6XHDb4iaUoSOB8VnEZS3tAUhVl5/dBjhYdwQ==; 5:ZdgW0pQPgKqpFxWAmWqDvJDBs7S12dnQx8RliWBWsCX9+Oxk8Kb0Px8TC6AcpequxOLjV6hY3B8v5s1nGolfFVQ5+5lmdoeeg3KhSLlysz25dB+R5FYUOHkd4Bse/QLPvJ6Djtp+28DbT/8N8HYtBRW3hmewqJitxlYd+2c4flA=; 7:qebvU/6KYmXn7CTkMHmet3ihjNLsIt8wEcdXT6+UEODE3OIeOjKbl8r6ua3RN49ajZYIsNH07+tAs/Nd8D2Po6kDc32tQXjAE7P1TmsN52QdPz1gofSM1V6tnXywvUd87xz04IqxW6aPBuUmMj11JQ== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: bf461164-bdb1-49b7-0c7f-08d667a1431b x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(49563074)(7193020); SRVR:SN4PR0601MB3774; x-ms-traffictypediagnostic: SN4PR0601MB3774: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(3230021)(999002)(5005026)(102415395)(6040522)(2401047)(8121501046)(10201501046)(93006095)(93001095)(3231475)(944501520)(4983020)(52105112)(3002001)(6055026)(149066)(150057)(6041310)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123562045)(20161123560045)(201708071742011)(7699051)(76991095); SRVR:SN4PR0601MB3774; BCL:0; PCL:0; RULEID:; SRVR:SN4PR0601MB3774; x-forefront-prvs: 089473E5FE x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(39860400002)(366004)(376002)(136003)(396003)(346002)(199004)(189003)(450100002)(7696005)(68736007)(7116003)(446003)(99286004)(110136005)(476003)(74316002)(8936002)(26005)(11346002)(99936001)(316002)(186003)(102836004)(76176011)(72206003)(53936002)(2906002)(5660300001)(55016002)(486006)(33656002)(7736002)(256004)(6116002)(2501003)(66066001)(14444005)(97736004)(6506007)(9686003)(3846002)(305945005)(106356001)(105586002)(71200400001)(71190400001)(25786009)(86362001)(81166006)(6436002)(478600001)(81156014)(8676002)(14454004); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3774; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: +Lj4eCl4gzhoJXbCpUlwni5PzYpIop8WPvFoa0Ye9oHbIWYd7BoEBR+Z9Zv/Pky53ipigYPyh0U/oXs2pLjX1XfoZJiJRIe5b8X7jyMmZAS1+kxNRAfYV/Zvg5LcJQ5b1VsFmmqpDx2lhZNkyB8zwZ38fHS4r+gPmLlB+9A1bDuWMPmM2XS1lAbqm9OQRbaMOxTlR3M1/Z0gNc+mV+nJ5TvQN3ir+Qx73vBfhp51/8fM3r+Oe4UC1NthvE2S7N3H4xSSukSzk1QE4at/cRUOjrgD2qDdijp7bBsy+LJxSYTZVDFjMLarIbMIBTgbMwkQ spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: bf461164-bdb1-49b7-0c7f-08d667a1431b X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Dec 2018 00:06:03.0984 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3774 X-Rspamd-Queue-Id: 6966B8A421 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=J+JcWTnv; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 2a01:111:f400:fe50::624 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-3.46 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.976,0]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_LONG(-0.94)[-0.939,0]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCPT_COUNT_TWO(0.00)[2]; SUBJ_ALL_CAPS(0.53)[7]; TO_DN_EQ_ADDR_ALL(0.00)[]; MX_GOOD(-0.01)[mx63.netapp.com,mx61.netapp.com,mx142.netapp.com,mx1.netapp.iphmx.com,mx144.netapp.com,mx2.netapp.iphmx.com,mx141.netapp.com,mx65.netapp.com,mx143.netapp.com,mx62.netapp.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; IP_SCORE(-0.90)[ipnet: 2a01:111:f000::/36(-2.36), asn: 8075(-2.04), country: US(-0.08)]; NEURAL_HAM_SHORT(-0.66)[-0.665,0] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2018 00:06:09 -0000 For those inclined, I have a working patch for full RFC6675 support now (ne= ed to validate pipe and behavior in various scenarios still): a) enters Loss Recovery on either Nth dupack, or when more than (N-1)*MSS b= ytes are sacked (the latter relevant for ack thinning) b) a cumulative ack below snd_max, while snd_max =3D=3D recovery_point (app= lication limited) no longer requires a lengthy RTO and slow start to recove= r from. Instead, the Rescue Retransmission mechanism is implemented. c) proper accounting for delivered_data and sacked_bytes in the single-pass= update of the scoreboard. These variables enable further mechanisms like P= roportional Rate Reduction. Also, this fixes potential exploits by maliciou= s clients, and support thin IoT clients that can store data to the right of= rcv_ack, but not keep state for a full RFC3517 compliant scoreboard. I certainly need reviewers, if you are interested please let me know so tha= t I can sign you in for it. Also, further testing would be required. Best regards, Richard