From owner-freebsd-transport@freebsd.org Sun Feb 24 12:14:34 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A28A7151D002 for ; Sun, 24 Feb 2019 12:14:34 +0000 (UTC) (envelope-from rrs@netflix.com) Received: from mail-qk1-x729.google.com (mail-qk1-x729.google.com [IPv6:2607:f8b0:4864:20::729]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AC1F36B2AD for ; Sun, 24 Feb 2019 12:14:33 +0000 (UTC) (envelope-from rrs@netflix.com) Received: by mail-qk1-x729.google.com with SMTP id p15so3755962qkl.5 for ; Sun, 24 Feb 2019 04:14:33 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=UCnTRHB0igMlqZMUZOjCJWw8kGvCwjzSbUq3OvoBcVA=; b=Kj2CO20Ppwaz2W1QSWE5JQSHerZts14/vyK16RmFVkxAJ0kdI07eaw8YmTt8K3CCV9 MiSppoytOVX6JTyKcSYzFGZq9lUjhetD8NPglzUHT+NLdxSFM5mRgXLRCmc2+V7Ok0Yd itjy7C0SEyekGb54VqN32MHGPXgE5z2Ze9NAvWBaYBehsXOg6UA8Mo52+r5EhNHoPRmc bABVoKIuiXYqSF/BXd4trRyqBzUT2a78lI2LJNqooAESCdRkRsTQOWDYPGyUDbGSAI2m ECIStLFQmCOxJdUigUmndN5n9fbyLkepV14tBg4nkRnCQSk0DPzrF68xDVeiWQmygTY3 dc7g== X-Gm-Message-State: AHQUAuasqz9Ivgy+4m5uzvJZT842EE1u+BlPkxa9wO2j6ik3Y75OE/WW pGOxHBLtHHJcP6RfzrETUuN1sA== X-Google-Smtp-Source: AHgI3IYGlFtvySxszY5Tv/D+xlqGhQmXvO7X/slo5ESO/u1wz1YeOX6zsrmmfukK/MPdQgQNpQ38uQ== X-Received: by 2002:a37:a34f:: with SMTP id m76mr9653646qke.145.1551010472878; Sun, 24 Feb 2019 04:14:32 -0800 (PST) Received: from ?IPv6:2607:fb10:7061:7fd::8fc7? ([2607:fb10:7061:7fd::8fc7]) by smtp.gmail.com with ESMTPSA id j9sm2285249qtb.30.2019.02.24.04.14.31 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 24 Feb 2019 04:14:32 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: DSACK From: Randall Stewart In-Reply-To: Date: Sun, 24 Feb 2019 07:14:30 -0500 Cc: Michael Tuexen , "freebsd-transport@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <824585F6-342D-4F7F-BB2A-FA9CA661E5D2@netflix.com> References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> To: "Scheffenegger, Richard" X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: AC1F36B2AD X-Spamd-Bar: --------------- X-Spamd-Result: default: False [-15.71 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netflix.com:+]; MX_GOOD(-0.01)[cached: alt1.aspmx.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[netflix.com,reject]; SUBJ_ALL_CAPS(0.38)[5]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[netflix.com:s=google]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-transport@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; WHITELIST_DMARC(-7.00)[netflix.com:D:+]; RCVD_IN_DNSWL_NONE(0.00)[9.2.7.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.58)[ip: (-8.20), ipnet: 2607:f8b0::/32(-2.64), asn: 15169(-2.00), country: US(-0.07)]; WHITELIST_SPF_DKIM(-3.00)[netflix.com:d:+,netflix.com:s:+] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 12:14:34 -0000 Richard: I agree it would be a nice to add thing.. I have thought about doing it for Rack and BBR, but there are so many other things that need = tending too :) As to =E2=80=9Csupport is claimed=E2=80=9D.. where is that, A simple = grep through the code for 2883 i.e. cd sys/netinet grep =E2=80=9C2883=E2=80=9D tcp* does not show anything.. is it in one of the man pages or something? Thanks R > On Feb 24, 2019, at 7:10 AM, Scheffenegger, Richard = wrote: >=20 > Well, RFC2883 support is claimed, and it may have been working = somewhat in very old code (before 2005?) incidentally... >=20 > Even though FBSD doesn't make use of DSACK information, Linux does = (unwind of spurious RTOs for example). So having minimal DSACK (again?) = is certainly good to have. >=20 > Also, I wanted to see what tcp_update_sack_list does under certain = corner cases, where we've run into issues, when not adjusting the sack = block left edge (belt + suspenders). >=20 > -----Original Message----- > From: Randall Stewart =20 > Sent: Sonntag, 24. Februar 2019 04:03 >=20 >=20 > I just don=E2=80=99t remember ever seeing code in the stack to do = DSACK. I know I have added some small bits to be aware of DSACK coming = in from other stacks in BBR and Rack, but it only does accounting and = does not use the information.. nor does it generate any.. >=20 > I have thought about doing it, but I have not placed a big priority on = it=E2=80=A6. >=20 > R >=20 >> On Feb 24, 2019, at 7:01 AM, Michael Tuexen = wrote: >>=20 >>> On 24. Feb 2019, at 12:32, Randall Stewart wrote: >>>=20 >>> I don=E2=80=99t think I have ever seen FreeBSD emit a DSACK. Now = admittedly I=20 >>> have only paid close attention in current. But that spans even back=20= >>> into 11 days I think. >>>=20 >>> Hmm wonder if I have a 10 machine I can go back and look at :) >> I tried to test on 10.4 yesterday, but packetdrill doesn't run that=20= >> well on 10.4 (missing pcap functions)... I'm not sure I want to = backport it. >>=20 >> Best regards >> Michael >>>=20 >>> R >>>=20 >>>> On Feb 23, 2019, at 5:30 AM, Michael Tuexen = wrote: >>>>=20 >>>>> On 23. Feb 2019, at 11:28, Scheffenegger, Richard = wrote: >>>>>=20 >>>>>=20 >>>>> Bin grad am flughafen und hab leider nur HEAD bei mir (und ein iso = von 10, wo ich grad versuch, das mit scapy zu checken). >>>>>=20 >>>>> Falls du schnell einen packetdrill gegen BSD11 ohne D18960 machen = kannst, und es da noch DSACKs raussendet, w=C3=A4re das toll! >>>>>=20 >>>>> Ich f=C3=BCrchte aber, das das schon l=C3=A4ngere Zeit kaputt ist = - da wir nun doch noch nicht D18960 drinnen haben, wie ich irrt=C3=BCmlich= dachte. >>>> OK. I'll take a look. >>>>=20 >>>> Have a save trip! >>>>=20 >>>> Best regards >>>> Michael >>>>>=20 >>>>>=20 >>>>>=20 >>>>> -----Original Message----- >>>>> From: Michael Tuexen >>>>> Sent: Samstag, 23. Februar 2019 11:25 >>>>> To: Scheffenegger, Richard >>>>> Cc: freebsd-transport@freebsd.org >>>>> Subject: Re: DSACK >>>>>=20 >>>>> NetApp Security WARNING: This is an external email. Do not click = links or open attachments unless you recognize the sender and know the = content is safe. >>>>>=20 >>>>>=20 >>>>>=20 >>>>>=20 >>>>>> On 23. Feb 2019, at 10:29, Scheffenegger, Richard = wrote: >>>>>>=20 >>>>>> Hi, >>>>>>=20 >>>>>> A colleague pointed me to the stack (HEAD) no longer emitting = DSACK options a few days ago... >>>>>>=20 >>>>>> I was under the impression, that older versions of FreeBSD would = send out DSACKs for spurious duplicate packets. >>>>>>=20 >>>>>> But when I try this script against HEAD, regular cumulative ACKs = without DSACK blocks are showing up. >>>>>>=20 >>>>>> Currently bandwidth starved - but was that a conscious decision? = Or was me observing DSACKs never a thing? >>>>> I would say if it is working in stable/11, but not in stable/12 = and head, it is a regression. >>>>>=20 >>>>> Best regards >>>>> Michael >>>>>>=20 >>>>>> Thanks a lot, >>>>>> Richard >>>>>>=20 >>>>>=20 >>>>=20 >>>> _______________________________________________ >>>> freebsd-transport@freebsd.org mailing list=20 >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-transport >>>> To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" >>>=20 >>> ------ >>> Randall Stewart >>> rrs@netflix.com >>>=20 >>>=20 >>>=20 >>=20 >=20 > ------ > Randall Stewart > rrs@netflix.com >=20 >=20 >=20 ------ Randall Stewart rrs@netflix.com From owner-freebsd-transport@freebsd.org Sun Feb 24 12:11:12 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8FCC6151CE4E for ; Sun, 24 Feb 2019 12:11:12 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM02-CY1-obe.outbound.protection.outlook.com (mail-cys01nam02on0608.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe45::608]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BB7066B03F; Sun, 24 Feb 2019 12:11:01 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=v0mXJsAkHfc/uCvgWC6NU3odzkDEWSWw7XKqGd1Aj0c=; b=LBg+UafOeGxsOTwZYTey3UndJyGtjoLCbnCQZqQIXxLlJSW3gFdLArgXWnvuw038WLH2oglXsKB5FXjNgy4Gea7dUXcxE8+hbGHY1KC+tTibnckE4uFEGgh6atRiDcqeRpfhc4CBLHN5D9VV+ciIUNwokO/8VSuvzAkCfod5t34= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.151.152) by SN4PR0601MB3648.namprd06.prod.outlook.com (10.167.150.147) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1643.18; Sun, 24 Feb 2019 12:10:59 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8964:7f8e:108:77a9]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8964:7f8e:108:77a9%3]) with mapi id 15.20.1643.018; Sun, 24 Feb 2019 12:10:59 +0000 From: "Scheffenegger, Richard" To: Randall Stewart , Michael Tuexen CC: "freebsd-transport@freebsd.org" Subject: RE: DSACK Thread-Topic: DSACK Thread-Index: AdTLWc4uYQf4MWyfQYim5HKMDVJsDAACEkwAAAAIW5AAACftAAA0cJuAAAEByoAAABOFAAAACHMg Date: Sun, 24 Feb 2019 12:10:58 +0000 Message-ID: References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> In-Reply-To: <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy0zYzQyZjVjZi0zODJkLTExZTktYjVlZi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcM2M0MmY1ZDAtMzgyZC0xMWU5LWI1ZWYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSIzODc4IiB0PSIxMzE5NTQ4Mzg1NTgxNTMxMTYiIGg9IjBZN251VXBWajgvUndvUSs0NlJzcG1qeHRkST0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [70.90.167.36] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 143ecb3b-fe08-4299-bec4-08d69a512338 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600110)(711020)(4605104)(2017052603328)(7193020); SRVR:SN4PR0601MB3648; x-ms-traffictypediagnostic: SN4PR0601MB3648: x-ms-exchange-purlcount: 1 x-microsoft-exchange-diagnostics: =?utf-8?B?MTtTTjRQUjA2MDFNQjM2NDg7MjM6anV6eHFUYXhIZE1TeGFxbnR1R1ZFMmZF?= =?utf-8?B?M2hlZlZRTUxqUVpDWHM4a0o3SjVGVlhINy9NcTNEbUpvbW9nek1xek90TTZo?= =?utf-8?B?d1ZlaWdONHpqMWEwaUlYUmZCYURrOXBhaGVPRjNZZUdYSytmWmhZbXNZZ3JR?= =?utf-8?B?dkF0ME9MbDhRY0JGL2pTUHQ2c2NUU1d6ZGlMYWFTNGwyTCszZ2JCbkd3RVNp?= =?utf-8?B?RVk5ZzA4QlhhelphbHhEakJEd3RXS0ZBOW13dzlQc1EwS1ZtaFY3NmtLMVJX?= =?utf-8?B?Y3BzMnh3VldaNEdHWUh2eVpMblluYTZOazhES2daL1VvMXNpWFFtdmgxanlE?= =?utf-8?B?bmN2ZU9qZ1RpN0ErVVpwMW9zTXlwYnhFczkwUGs5VUtVQmJvbUtqV0pyc3B4?= =?utf-8?B?dXJLWmh1aE9IWkliWVFxdGxGckhScXA3Z25sSFRSSytPMDR5blc1ZFNvaHZX?= =?utf-8?B?RnorSXJMNDNzWXdqa0xEVnhJbzNkWEF5Q0JscUxCOWphT1NQZWVjNWlERzNY?= =?utf-8?B?ZlBBbERLZDlxb29oTk5wU3RPMSt1Uko3V29KN3BPL1VtSklUWU1vRlR4ZGo2?= =?utf-8?B?ZG15ZktGek5nQVVjdCt5cEVEcUQ4Z29vcWU1L21DRUozbXhzbDFHejEzU2JT?= =?utf-8?B?UjYyd3FMMm1ZakRHQXh0b1dNekFqSWpmbkVlUytXKzk3dmJtdTFHMjRscXI1?= =?utf-8?B?akhLcUp2cDdjYzZMNTRJTDVXQW0zai9wVVRaUVZwcktkdnRQdFJMOVAvSjQy?= =?utf-8?B?UTRFNE53MUp6b2dTQWxQK2ZkWHYwTnMzOHh2M1k5UXhzdllqVDlmSmxUdk1i?= =?utf-8?B?YWZvRWdBdU9zeVNXbWVFYk8xbkhPSHVvcUxaTlJIUHlKMlA5ZTVUNWVEWGQ0?= =?utf-8?B?MWlFRzExM1pRQ2JwZ25VazcwYytvUnMyS0FrZ0lHR1k0RGU0NGI1UnBXYk13?= =?utf-8?B?dGZmUnM0UFh4YzNaNmZpTHdHQ0dtM0tIODBNQnR6VDFHQ0hwOGtXdnpHVlhN?= =?utf-8?B?YWNIaTlSZzExRE1Ta29TdlIyamlCb2RqNG1XcEYveE5VcXdBYnVucFhTckF0?= =?utf-8?B?WFJXL1pxUkpXSEtwL0RZaURyKzBQY040UEdIalFkTXFDVTJxUFQwTUZMM3B5?= =?utf-8?B?eHdKT2E4QlB5KzNaZkJWemlwUVl5T2l6OTdZTWJycWdEbndpNjlZTHBqVitG?= =?utf-8?B?T3QwK2FUZ1JLUFcwdVF6NmgwYmtKNnJMZUdSMkthMitRNFBLakl1aDIyWCtP?= =?utf-8?B?UzRObFA5UTBaZGFhYk5FaU9oZXkyVHJjQmhhSG1qbUNJSGw4MldsZkhRQ3dO?= =?utf-8?B?ZnN6djR0KzAwSzdJaXFjcFIvU3dOWHVBcnpJUmtwa3pjUUQ0cTRndDdpTnpK?= =?utf-8?B?TXh0cytaYUp0UCtyeE93UWdGdHF1SmNGV25Cd29Hdk9rZTdjQjJmekdlVUZt?= =?utf-8?B?Z1lXR0VaN0gzTVRBQmd5QXlOeVcxYU1DTCtoREpIejZmRUR2SDkxV0dYQVJT?= =?utf-8?B?NW5hVSt0YkU2cTBsaHRvclE4SG53NG1xYXVjRFN2dEJ5UHZzRERkL3NBT1M5?= =?utf-8?B?bkYwdEhPZkdwR01UdEJ5Qjhya2pkMnpRUGphRjIxeDlHRWlLOXpFbUZSYU0x?= =?utf-8?B?YWxLV0RHdUpTbExXa1Z1VjRLamh0NmViL1pKZFZiNGk3cDR2c2tMbGQvRkdp?= =?utf-8?B?NUptR2s1WlJmUlpFbEgyWHJIVDEyaWNZZEhhWVZ3VHpUQlpMVkdxb3htVU4y?= =?utf-8?B?c1FmTE0rRnhkOWo2TXJ6OW5FallBL0tFOW1OYnhRazVhWTlIZVRnZ2w0WTdl?= =?utf-8?B?V0lJQ0FPUVhOcyt2Zy9qTTM4UCtzWlhmeWprdnBrU0oyVEs4V0RGcUF5TWx3?= =?utf-8?B?cHlZNDZYMDlxL1hrcEJzMEEzNkp6Y0VQNFI1Y0FzV1pWS1Rld0JxSW4zQ1Jq?= =?utf-8?Q?R66hh6p4ZrHTdqyZggt7NcoHNiK8U1XY=3D?= x-microsoft-antispam-prvs: x-forefront-prvs: 09583628E0 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(376002)(136003)(39860400002)(366004)(396003)(13464003)(189003)(199004)(55016002)(6306002)(7116003)(229853002)(9686003)(186003)(316002)(110136005)(97736004)(221733001)(66066001)(305945005)(8676002)(256004)(6436002)(66574012)(81156014)(71190400001)(53936002)(7736002)(93886005)(71200400001)(5024004)(81166006)(5660300002)(14444005)(74316002)(478600001)(7696005)(26005)(3846002)(6116002)(76176011)(53546011)(8936002)(105586002)(6246003)(106356001)(966005)(72206003)(25786009)(476003)(68736007)(14454004)(86362001)(3480700005)(99286004)(102836004)(33656002)(6506007)(486006)(11346002)(446003)(2906002)(52536013)(4326008); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3648; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: pOe+TsEawKD1a3zBMmhmK2GfM1q/QKo1bFRGvozNt71dEHPQUb4XpyW6xm5I6QE8Atfyr7gBDXFxO/XjbKNgYuFjomz9s9smVsSbJxFOFWLiWp+zxwJiWEfzsYiEidwXDSucwbVB7XJ3X+UsHyjwaOnN5xzaUDxjMIcPGXDKvqxPUMVxzR43TAI63/kgelwS0E1ZzZiDYnbzgQ4ho4hRueAaBm2sqLo5U3meMyMaLZbYsZzivV31TqdNsUGU4erpthGk9/RSf64ejpOC300CB0hslV7QvdsV8HAwy/MtRfrmJ49BAAPUMHFNXGg9uwXc3gJbfEjrFRYNRjqghyt2t0j4RRN35r9EQavUrA8+hi5xZ+ecEpfOQvCFG5ba4q1CXSYWmUdvD+swWySm9QPdQvxSJn7trIwWkKsv4WhS9RY= Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 143ecb3b-fe08-4299-bec4-08d69a512338 X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Feb 2019 12:10:59.2222 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3648 X-Rspamd-Queue-Id: BB7066B03F X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=LBg+UafO; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 2a01:111:f400:fe45::608 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-3.77 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; TO_DN_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.79)[-0.787,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; MIME_BASE64_TEXT(0.10)[]; SUBJ_ALL_CAPS(0.38)[5]; MX_GOOD(-0.01)[mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; IP_SCORE(-0.95)[ipnet: 2a01:111:f000::/36(-2.48), asn: 8075(-2.20), country: US(-0.07)] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 12:11:12 -0000 V2VsbCwgUkZDMjg4MyBzdXBwb3J0IGlzIGNsYWltZWQsIGFuZCBpdCBtYXkgaGF2ZSBiZWVuIHdv cmtpbmcgc29tZXdoYXQgaW4gdmVyeSBvbGQgY29kZSAoYmVmb3JlIDIwMDU/KSBpbmNpZGVudGFs bHkuLi4NCg0KRXZlbiB0aG91Z2ggRkJTRCBkb2Vzbid0IG1ha2UgdXNlIG9mIERTQUNLIGluZm9y bWF0aW9uLCBMaW51eCBkb2VzICh1bndpbmQgb2Ygc3B1cmlvdXMgUlRPcyBmb3IgZXhhbXBsZSku IFNvIGhhdmluZyBtaW5pbWFsIERTQUNLIChhZ2Fpbj8pIGlzIGNlcnRhaW5seSBnb29kIHRvIGhh dmUuDQoNCkFsc28sIEkgd2FudGVkIHRvIHNlZSB3aGF0IHRjcF91cGRhdGVfc2Fja19saXN0IGRv ZXMgdW5kZXIgY2VydGFpbiBjb3JuZXIgY2FzZXMsIHdoZXJlIHdlJ3ZlIHJ1biBpbnRvIGlzc3Vl cywgd2hlbiBub3QgYWRqdXN0aW5nIHRoZSBzYWNrIGJsb2NrIGxlZnQgZWRnZSAoYmVsdCArIHN1 c3BlbmRlcnMpLg0KDQotLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KRnJvbTogUmFuZGFsbCBT dGV3YXJ0IDxycnNAbmV0ZmxpeC5jb20+IA0KU2VudDogU29ubnRhZywgMjQuIEZlYnJ1YXIgMjAx OSAwNDowMw0KDQoNCkkganVzdCBkb27igJl0IHJlbWVtYmVyIGV2ZXIgc2VlaW5nIGNvZGUgaW4g dGhlIHN0YWNrIHRvIGRvIERTQUNLLiBJIGtub3cgSSBoYXZlIGFkZGVkIHNvbWUgc21hbGwgYml0 cyB0byBiZSBhd2FyZSBvZiBEU0FDSyBjb21pbmcgaW4gZnJvbSBvdGhlciBzdGFja3MgaW4gQkJS IGFuZCBSYWNrLCBidXQgaXQgb25seSBkb2VzIGFjY291bnRpbmcgYW5kIGRvZXMgbm90IHVzZSB0 aGUgaW5mb3JtYXRpb24uLiBub3IgZG9lcyBpdCBnZW5lcmF0ZSBhbnkuLg0KDQpJIGhhdmUgdGhv dWdodCBhYm91dCBkb2luZyBpdCwgYnV0IEkgaGF2ZSBub3QgcGxhY2VkIGEgYmlnIHByaW9yaXR5 IG9uIGl04oCmLg0KDQpSDQoNCj4gT24gRmViIDI0LCAyMDE5LCBhdCA3OjAxIEFNLCBNaWNoYWVs IFR1ZXhlbiA8dHVleGVuQGZyZWVic2Qub3JnPiB3cm90ZToNCj4NCj4+IE9uIDI0LiBGZWIgMjAx OSwgYXQgMTI6MzIsIFJhbmRhbGwgU3Rld2FydCA8cnJzQG5ldGZsaXguY29tPiB3cm90ZToNCj4+ DQo+PiBJIGRvbuKAmXQgdGhpbmsgSSBoYXZlIGV2ZXIgc2VlbiBGcmVlQlNEIGVtaXQgYSBEU0FD Sy4gTm93IGFkbWl0dGVkbHkgSSANCj4+IGhhdmUgb25seSBwYWlkIGNsb3NlIGF0dGVudGlvbiBp biBjdXJyZW50LiBCdXQgdGhhdCBzcGFucyBldmVuIGJhY2sgDQo+PiBpbnRvIDExIGRheXMgSSB0 aGluay4NCj4+DQo+PiBIbW0gd29uZGVyIGlmIEkgaGF2ZSBhIDEwIG1hY2hpbmUgSSBjYW4gZ28g YmFjayBhbmQgbG9vayBhdCA6KQ0KPiBJIHRyaWVkIHRvIHRlc3Qgb24gMTAuNCB5ZXN0ZXJkYXks IGJ1dCBwYWNrZXRkcmlsbCBkb2Vzbid0IHJ1biB0aGF0IA0KPiB3ZWxsIG9uIDEwLjQgKG1pc3Np bmcgcGNhcCBmdW5jdGlvbnMpLi4uIEknbSBub3Qgc3VyZSBJIHdhbnQgdG8gYmFja3BvcnQgaXQu DQo+DQo+IEJlc3QgcmVnYXJkcw0KPiBNaWNoYWVsDQo+Pg0KPj4gUg0KPj4NCj4+PiBPbiBGZWIg MjMsIDIwMTksIGF0IDU6MzAgQU0sIE1pY2hhZWwgVHVleGVuIDx0dWV4ZW5AZnJlZWJzZC5vcmc+ IHdyb3RlOg0KPj4+DQo+Pj4+IE9uIDIzLiBGZWIgMjAxOSwgYXQgMTE6MjgsIFNjaGVmZmVuZWdn ZXIsIFJpY2hhcmQgPFJpY2hhcmQuU2NoZWZmZW5lZ2dlckBuZXRhcHAuY29tPiB3cm90ZToNCj4+ Pj4NCj4+Pj4NCj4+Pj4gQmluIGdyYWQgYW0gZmx1Z2hhZmVuIHVuZCBoYWIgbGVpZGVyIG51ciBI RUFEIGJlaSBtaXIgKHVuZCBlaW4gaXNvIHZvbiAxMCwgd28gaWNoIGdyYWQgdmVyc3VjaCwgZGFz IG1pdCBzY2FweSB6dSBjaGVja2VuKS4NCj4+Pj4NCj4+Pj4gRmFsbHMgZHUgc2NobmVsbCBlaW5l biBwYWNrZXRkcmlsbCBnZWdlbiBCU0QxMSBvaG5lIEQxODk2MCBtYWNoZW4ga2FubnN0LCB1bmQg ZXMgZGEgbm9jaCBEU0FDS3MgcmF1c3NlbmRldCwgd8OkcmUgZGFzIHRvbGwhDQo+Pj4+DQo+Pj4+ IEljaCBmw7xyY2h0ZSBhYmVyLCBkYXMgZGFzIHNjaG9uIGzDpG5nZXJlIFplaXQga2FwdXR0IGlz dCAtIGRhIHdpciBudW4gZG9jaCBub2NoIG5pY2h0IEQxODk2MCBkcmlubmVuIGhhYmVuLCB3aWUg aWNoIGlycnTDvG1saWNoIGRhY2h0ZS4NCj4+PiBPSy4gSSdsbCB0YWtlIGEgbG9vay4NCj4+Pg0K Pj4+IEhhdmUgYSBzYXZlIHRyaXAhDQo+Pj4NCj4+PiBCZXN0IHJlZ2FyZHMNCj4+PiBNaWNoYWVs DQo+Pj4+DQo+Pj4+DQo+Pj4+DQo+Pj4+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+Pj4+ IEZyb206IE1pY2hhZWwgVHVleGVuIDx0dWV4ZW5AZnJlZWJzZC5vcmc+DQo+Pj4+IFNlbnQ6IFNh bXN0YWcsIDIzLiBGZWJydWFyIDIwMTkgMTE6MjUNCj4+Pj4gVG86IFNjaGVmZmVuZWdnZXIsIFJp Y2hhcmQgPFJpY2hhcmQuU2NoZWZmZW5lZ2dlckBuZXRhcHAuY29tPg0KPj4+PiBDYzogZnJlZWJz ZC10cmFuc3BvcnRAZnJlZWJzZC5vcmcNCj4+Pj4gU3ViamVjdDogUmU6IERTQUNLDQo+Pj4+DQo+ Pj4+IE5ldEFwcCBTZWN1cml0eSBXQVJOSU5HOiBUaGlzIGlzIGFuIGV4dGVybmFsIGVtYWlsLiBE byBub3QgY2xpY2sgbGlua3Mgb3Igb3BlbiBhdHRhY2htZW50cyB1bmxlc3MgeW91IHJlY29nbml6 ZSB0aGUgc2VuZGVyIGFuZCBrbm93IHRoZSBjb250ZW50IGlzIHNhZmUuDQo+Pj4+DQo+Pj4+DQo+ Pj4+DQo+Pj4+DQo+Pj4+PiBPbiAyMy4gRmViIDIwMTksIGF0IDEwOjI5LCBTY2hlZmZlbmVnZ2Vy LCBSaWNoYXJkIDxSaWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbT4gd3JvdGU6DQo+Pj4+ Pg0KPj4+Pj4gSGksDQo+Pj4+Pg0KPj4+Pj4gQSBjb2xsZWFndWUgcG9pbnRlZCBtZSB0byB0aGUg c3RhY2sgKEhFQUQpIG5vIGxvbmdlciBlbWl0dGluZyBEU0FDSyBvcHRpb25zIGEgZmV3IGRheXMg YWdvLi4uDQo+Pj4+Pg0KPj4+Pj4gSSB3YXMgdW5kZXIgdGhlIGltcHJlc3Npb24sIHRoYXQgb2xk ZXIgdmVyc2lvbnMgb2YgRnJlZUJTRCB3b3VsZCBzZW5kIG91dCBEU0FDS3MgZm9yIHNwdXJpb3Vz IGR1cGxpY2F0ZSBwYWNrZXRzLg0KPj4+Pj4NCj4+Pj4+IEJ1dCB3aGVuIEkgdHJ5IHRoaXMgc2Ny aXB0IGFnYWluc3QgSEVBRCwgcmVndWxhciBjdW11bGF0aXZlIEFDS3Mgd2l0aG91dCBEU0FDSyBi bG9ja3MgYXJlIHNob3dpbmcgdXAuDQo+Pj4+Pg0KPj4+Pj4gQ3VycmVudGx5IGJhbmR3aWR0aCBz dGFydmVkIC0gYnV0IHdhcyB0aGF0IGEgY29uc2Npb3VzIGRlY2lzaW9uPyBPciB3YXMgbWUgb2Jz ZXJ2aW5nIERTQUNLcyBuZXZlciBhIHRoaW5nPw0KPj4+PiBJIHdvdWxkIHNheSBpZiBpdCBpcyB3 b3JraW5nIGluIHN0YWJsZS8xMSwgYnV0IG5vdCBpbiBzdGFibGUvMTIgYW5kIGhlYWQsIGl0IGlz IGEgcmVncmVzc2lvbi4NCj4+Pj4NCj4+Pj4gQmVzdCByZWdhcmRzDQo+Pj4+IE1pY2hhZWwNCj4+ Pj4+DQo+Pj4+PiBUaGFua3MgYSBsb3QsDQo+Pj4+PiBSaWNoYXJkDQo+Pj4+Pg0KPj4+Pg0KPj4+ DQo+Pj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCj4+ PiBmcmVlYnNkLXRyYW5zcG9ydEBmcmVlYnNkLm9yZyBtYWlsaW5nIGxpc3QgDQo+Pj4gaHR0cHM6 Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVic2QtdHJhbnNwb3J0DQo+ Pj4gVG8gdW5zdWJzY3JpYmUsIHNlbmQgYW55IG1haWwgdG8gImZyZWVic2QtdHJhbnNwb3J0LXVu c3Vic2NyaWJlQGZyZWVic2Qub3JnIg0KPj4NCj4+IC0tLS0tLQ0KPj4gUmFuZGFsbCBTdGV3YXJ0 DQo+PiBycnNAbmV0ZmxpeC5jb20NCj4+DQo+Pg0KPj4NCj4NCg0KLS0tLS0tDQpSYW5kYWxsIFN0 ZXdhcnQNCnJyc0BuZXRmbGl4LmNvbQ0KDQoNCg0K From owner-freebsd-transport@freebsd.org Sun Feb 24 12:01:23 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C94C1151C75B for ; Sun, 24 Feb 2019 12:01:23 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D7B26A992 for ; Sun, 24 Feb 2019 12:01:22 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [192.168.1.9] (p57BB4A79.dip0.t-ipconnect.de [87.187.74.121]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 27253721E2821; Sun, 24 Feb 2019 13:01:13 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: DSACK From: Michael Tuexen In-Reply-To: Date: Sun, 24 Feb 2019 13:01:11 +0100 Cc: "Scheffenegger, Richard" , "freebsd-transport@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> To: Randall Stewart X-Mailer: Apple Mail (2.3445.102.3) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 2D7B26A992 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.97 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; NEURAL_HAM_SHORT(-0.97)[-0.975,0]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 12:01:24 -0000 > On 24. Feb 2019, at 12:32, Randall Stewart wrote: >=20 > I don=E2=80=99t think I have ever seen FreeBSD emit a DSACK. Now = admittedly > I have only paid close attention in current. But that spans even back > into 11 days I think. >=20 > Hmm wonder if I have a 10 machine I can go back and look at :) I tried to test on 10.4 yesterday, but packetdrill doesn't run that well on 10.4 (missing pcap functions)... I'm not sure I want to backport = it. Best regards Michael >=20 > R >=20 >> On Feb 23, 2019, at 5:30 AM, Michael Tuexen = wrote: >>=20 >>> On 23. Feb 2019, at 11:28, Scheffenegger, Richard = wrote: >>>=20 >>>=20 >>> Bin grad am flughafen und hab leider nur HEAD bei mir (und ein iso = von 10, wo ich grad versuch, das mit scapy zu checken). >>>=20 >>> Falls du schnell einen packetdrill gegen BSD11 ohne D18960 machen = kannst, und es da noch DSACKs raussendet, w=C3=A4re das toll! >>>=20 >>> Ich f=C3=BCrchte aber, das das schon l=C3=A4ngere Zeit kaputt ist - = da wir nun doch noch nicht D18960 drinnen haben, wie ich irrt=C3=BCmlich = dachte. >> OK. I'll take a look. >>=20 >> Have a save trip! >>=20 >> Best regards >> Michael >>>=20 >>>=20 >>>=20 >>> -----Original Message----- >>> From: Michael Tuexen =20 >>> Sent: Samstag, 23. Februar 2019 11:25 >>> To: Scheffenegger, Richard >>> Cc: freebsd-transport@freebsd.org >>> Subject: Re: DSACK >>>=20 >>> NetApp Security WARNING: This is an external email. Do not click = links or open attachments unless you recognize the sender and know the = content is safe. >>>=20 >>>=20 >>>=20 >>>=20 >>>> On 23. Feb 2019, at 10:29, Scheffenegger, Richard = wrote: >>>>=20 >>>> Hi, >>>>=20 >>>> A colleague pointed me to the stack (HEAD) no longer emitting DSACK = options a few days ago... >>>>=20 >>>> I was under the impression, that older versions of FreeBSD would = send out DSACKs for spurious duplicate packets. >>>>=20 >>>> But when I try this script against HEAD, regular cumulative ACKs = without DSACK blocks are showing up. >>>>=20 >>>> Currently bandwidth starved - but was that a conscious decision? Or = was me observing DSACKs never a thing? >>> I would say if it is working in stable/11, but not in stable/12 and = head, it is a regression. >>>=20 >>> Best regards >>> Michael >>>>=20 >>>> Thanks a lot, >>>> Richard >>>>=20 >>>=20 >>=20 >> _______________________________________________ >> freebsd-transport@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-transport >> To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" >=20 > ------ > Randall Stewart > rrs@netflix.com >=20 >=20 >=20 From owner-freebsd-transport@freebsd.org Sun Feb 24 14:43:50 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 72656150003D for ; Sun, 24 Feb 2019 14:43:50 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM03-BY2-obe.outbound.protection.outlook.com (mail-eopbgr780084.outbound.protection.outlook.com [40.107.78.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D11446FCE2; Sun, 24 Feb 2019 14:43:48 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tU0KBaCviWZz1BhJmArInrZ8ru1l/BPSfU1XMypm/Ek=; b=En4t3tGCj2+CWkm5GZNU8oDlb/qOuSx9IUkV6cu65MhKb1wh/UhFSoDHQ9xNdcjitNciFu412jZuQdiR6aQ7Cs1qxKS9qcfHPBZjJ/6GtUOkKcNt6MQtKYQiTF+1e/LxIL49WETtjoRa4IjIse+0FwqfoiTf4DSnsb6t7WCMhWA= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.151.152) by SN4PR0601MB3696.namprd06.prod.outlook.com (10.167.141.158) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1643.18; Sun, 24 Feb 2019 14:43:45 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8964:7f8e:108:77a9]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8964:7f8e:108:77a9%3]) with mapi id 15.20.1643.018; Sun, 24 Feb 2019 14:43:45 +0000 From: "Scheffenegger, Richard" To: Randall Stewart CC: Michael Tuexen , "freebsd-transport@freebsd.org" Subject: RE: DSACK Thread-Topic: DSACK Thread-Index: AdTLWc4uYQf4MWyfQYim5HKMDVJsDAACEkwAAAAIW5AAACftAAA0cJuAAAEByoAAABOFAAAACHMgAABbFwAABCA/MA== Date: Sun, 24 Feb 2019 14:43:45 +0000 Message-ID: References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> <824585F6-342D-4F7F-BB2A-FA9CA661E5D2@netflix.com> In-Reply-To: <824585F6-342D-4F7F-BB2A-FA9CA661E5D2@netflix.com> Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy05NDM3NDYwNy0zODQyLTExZTktYjVlZi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcOTQzNzQ2MDgtMzg0Mi0xMWU5LWI1ZWYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSI1MzAxIiB0PSIxMzE5NTQ5MzAyMjkwNDgzMTkiIGg9Ilp5bzJmTU9DQllOTDlueVF3RmdXUnl0dy9Sdz0iIGlkPSIiIGJsPSIwIiBibz0iMSIvPjwvbWV0YT4= x-dg-rorf: x-originating-ip: [70.90.167.36] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 1ba60690-2bf6-4d54-c6ba-08d69a667ad9 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600110)(711020)(4605104)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7193020); SRVR:SN4PR0601MB3696; x-ms-traffictypediagnostic: SN4PR0601MB3696: x-ms-exchange-purlcount: 2 x-microsoft-exchange-diagnostics: =?utf-8?B?MTtTTjRQUjA2MDFNQjM2OTY7MjM6QlpDM3I5cEdrYTFNWnlOd1JqNkQvQzdX?= =?utf-8?B?VzNqRFNoRk1xTGV1MEhMN0FLaEFTSXRnRjdMUUErZDVQMVlYbnNHRllFUVFT?= =?utf-8?B?T0NnNlF6dG9GVkZhSE1VT2tQeVdsNWs3Q1JneEgyd3A5UXRoS0lsNktESnRD?= =?utf-8?B?ZExERHgwNUhhc0IvMjJjSy9INDVhWkNrNUNNem1maE5rRVBFSzlyOGFERGlY?= =?utf-8?B?eGRFWjl0RW9PNVorQ0cxdmQ0VkdBYVplbFRkYWRZMVZtSnVJcEoyTThLUWNJ?= =?utf-8?B?TW1pbW5YVERsQjFVQjR4R2hNTlc3Mmp5SG5VNlNqQS9NaW51S1QxT1AwYUFU?= =?utf-8?B?QnBnS1p5cjFxWXM2Rm9ISHlocjB4dTdkNjRWRzlJNGNnbytDblB2K0FCa2dj?= =?utf-8?B?Wk5TYlpCNWhPYkFzTXhqOEZBWWUvWDhUbjdKaFdjOGFaWElIeUNEMnBzZFdu?= =?utf-8?B?aFJIMTg2VFYrRUFqV3htZW1hWWlSR1FTZVYzMG1jOFVlTDJ0ZFNoY1JhdzFI?= =?utf-8?B?WWVKbG5FYjczWDNtUll3Z1Rvdit4d3NEQ3RuRDlvUVRCcjNmWTB5OWVFSWxD?= =?utf-8?B?ckUyWWlid0lxMVYzaVZwZWZnZnh1MFY4SHhzRmxIUktPVHdIWnNsN0RQRXR5?= =?utf-8?B?LzFnRUYyWFVYVG03Z05nTEw4cHViWFBzck45eXN0UDR6cVlKRTFlYUlabUQ5?= =?utf-8?B?NXp3NFMrYU41YUtmYjl2T3FTcHk4MjFPMkNYaUl1RHF3cjJWZzdCdm5lR2Js?= =?utf-8?B?QlpwNEJiR2ZndUJ6RTNRamVzemJsc2FxK1Jxak5BSEkzVXlORklYTXo5NUxT?= =?utf-8?B?RzljRmtzMkMrVkwrN293N1JlY2tnVDE3dGJxQmtocTlhMmhOU2Q5ak9zS3FN?= =?utf-8?B?bnNOMmdsL1RGNkgwd09MOFZZZWhpQVYwQTZMOEhRWkRsNHFYajhtUDZWVlhn?= =?utf-8?B?Y0xrbllROVoydXZKNW9kcW5xb3NjZCtXczA0MGJnTVFhSU84TmEwZm1nWHlK?= =?utf-8?B?c1JZRVVMREZjd3kxSjlhMDJpTHBDenVaZ2NkR2poYkZKVEdDenFIWW05aU5G?= =?utf-8?B?OVZyYnE0dno1QmNqSSs1OVdlaWhMOCtVeU9NeS9WOU1GUzc3NG82bHdPT25r?= =?utf-8?B?dzQwdUN2cGFJckxuSVRWU3p3M0VyMzdDTFUxR1FEa0g1TFJwVWxhTCt1UHBv?= =?utf-8?B?SFVhUjNRYlFUYUdzUmZEUmdCZWRwQmdZWlRxSFoxYmR3d1FwYUlWVXJzY2gw?= =?utf-8?B?RWdUek9zc283SVlvY0dlZXdpQzVqd01JMHBQeE9peldTdnhVMFRWdzh6Ti9I?= =?utf-8?B?ekZDMEt3cGgrYnJRcnpPVUJlakdrTHJBSndrR25aaHpBMEc0bmpFNmVTck1C?= =?utf-8?B?Szd4bUQ3dG5IOXpDVkNIM2gxSW0wM0s0bEFKNzVyU3JyaTliNitQaUxtcDd2?= =?utf-8?B?VFlKNjdSN2pNUDJkbFc0V2xvaXBDNXduV2NGdHNaaWNOQ1h0RENkN1RuS21u?= =?utf-8?B?cW96eDZoc3J2RkIycnZRYUdFQlJwam5RcVc1UXQ1VnNPMEFSZ1FTeDI4MTQ0?= =?utf-8?B?SFF3QWJ4UVNrekdNUHZPOE5UdW5Lelo1dDMxRlY4VDh5aEJpaSsvOUxabUdW?= =?utf-8?B?TENXbU9oSXFXamxaK3FJY0ZXdkYxdlN6clhXN3BUL3lPTjdaaHlXWnBxZS9m?= =?utf-8?B?anMvNnZNNmpZUTVqZThoODlBbklSWGdTS2t1M29yTlJlMWlRSE1uTDVnOXJi?= =?utf-8?B?ZGVjcnFwNnM3b3ZKZ250UHNUa0k2dnZlTHM3d1VDV1c2dnZpcnJpTm45ZkN4?= =?utf-8?B?UGEvVXNMZDlpNnRacy96UUwvNytLTnQxVlJpOW1RNytTNG5XZzRvYUtqemk4?= =?utf-8?B?dksrRE5CL25tUm9FQXByWmY2eWxQTkRDekFhZU5ybWtyNE9qaUc1eVVpelJj?= =?utf-8?B?eEkwWkxPMjdqL29hcUlpRE5Ld2dwVUNTQXN3Y0RlU1V2bkRmc252eFBzVXk3?= =?utf-8?Q?eeJHlwP/?= x-microsoft-antispam-prvs: x-forefront-prvs: 09583628E0 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(346002)(366004)(39860400002)(376002)(136003)(189003)(199004)(13464003)(6306002)(14444005)(5024004)(99286004)(305945005)(256004)(81156014)(53936002)(81166006)(55016002)(9686003)(66574012)(71190400001)(71200400001)(97736004)(74316002)(8936002)(25786009)(33656002)(2906002)(102836004)(86362001)(478600001)(53546011)(6506007)(221733001)(14454004)(66066001)(72206003)(966005)(7736002)(6436002)(8676002)(3480700005)(229853002)(4326008)(76176011)(7696005)(6246003)(486006)(93886005)(316002)(68736007)(186003)(5660300002)(11346002)(54906003)(105586002)(7116003)(52536013)(26005)(476003)(6116002)(6916009)(3846002)(106356001)(446003); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3696; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: 4MnDOq9ginv2GJ0eCOxOlBoAKFyKbl/MCPdtpNF2EnaIOHIoTM7uMHA6rGCdWPyB6kQSNZml8fx8nYvvpVronQMEStVFT+mhP6F+s4QX5Vke//uL4i/wsl8IV8rLRC4cyPneios4RxngExBl21zsWZSSkL9oezbzc5DzoY8HzyN5wXD22NVbNstKhwwUItz6sxS7kzVDOUDMVPQ7vX7Vq+R6OAMOlpLgbUmOMkU/EhZdoWmWwbaviH2cohVAkHZXcipy7XwQ5OMp/h8bdVBjcvDx//VMba/mIrvn30QmKUydR3voXAdAJvw2B7LMmEyqLnnfD3Pvckg8fF9dzW6rRDTtJKep+eW+rK4kiwXQdy7Lc3LWv6hvyRCgFToC4D2lx8xFOKAQJuRjLIGAtBbvqkdrP2HSWGRiu1QI1v0pl/s= Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1ba60690-2bf6-4d54-c6ba-08d69a667ad9 X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Feb 2019 14:43:45.6577 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3696 X-Rspamd-Queue-Id: D11446FCE2 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=En4t3tGC; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.78.84 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-0.73 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; NEURAL_HAM_LONG(-0.99)[-0.990,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_MEDIUM(-0.50)[-0.497,0]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.80)[0.796,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx1.netapp.iphmx.com]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; MIME_BASE64_TEXT(0.10)[]; SUBJ_ALL_CAPS(0.38)[5]; RCVD_IN_DNSWL_NONE(0.00)[84.78.107.40.list.dnswl.org : 127.0.3.0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 14:43:50 -0000 aHR0cHM6Ly93aWtpLmZyZWVic2Qub3JnL2FjdGlvbi9sb2dpbi9UcmFuc3BvcnRQcm90b2NvbHMv dGNwX3JmY19jb21wbGlhbmNlDQoNCkFwcGFyZW50bHksIGl0IHdhcyBhZGRlZCB0aGVyZSB3aXRo IGNoYW5nZSAjMTMJMjAxNS0wOS0yNyAwMToyMzo0MAk4OTI1CSB0byBwcmV2aW91cwlFaXRhbkFk bGVyDQoNCkl0J3Mgbm90IHVubGlrZWx5LCB0aGF0IEkgd2FzIG1pc3Rha2VuIHNlZWluZyB0aGlz IGluIHVwc3RyZWFtLCBhbmQgdGhlICJzdXBwb3J0IiBvZiBEU0FDSyBjbGFpbWVkIGhlcmUgcmVh bGx5IGlzIG9ubHkgYWJvdXQgImlnbm9yaW5nIiBpbmNvbWluZyBEU0FDSyBwYWNrZXRzLi4uDQoN CkN1cnJlbnRseSBjaGVja2luZyB0byBzZWUsIGlmIHRoaXMgY2FuIGJlIGFkZGVkIHdpdGggYSBy ZWxhdGl2ZWx5IHN0cmFpZ2h0Zm9yd2FyZCBsb2dpY2FsIGNvbmRpdGlvbiwgYW5kIGNsZWFyZWQg b24gdGhlIG5leHQgaW5jb21pbmcgc2VnbWVudCAoZGF0YSBvciBwdXJlIEFDSykuDQoNCg0KLS0t LS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZyb206IFJhbmRhbGwgU3Rld2FydCA8cnJzQG5ldGZs aXguY29tPiANClNlbnQ6IFNvbm50YWcsIDI0LiBGZWJydWFyIDIwMTkgMDQ6MTUNClRvOiBTY2hl ZmZlbmVnZ2VyLCBSaWNoYXJkIDxSaWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbT4NCkNj OiBNaWNoYWVsIFR1ZXhlbiA8dHVleGVuQGZyZWVic2Qub3JnPjsgZnJlZWJzZC10cmFuc3BvcnRA ZnJlZWJzZC5vcmcNClN1YmplY3Q6IFJlOiBEU0FDSw0KDQpSaWNoYXJkOg0KDQpJIGFncmVlIGl0 IHdvdWxkIGJlIGEgbmljZSB0byBhZGQgdGhpbmcuLiBJIGhhdmUgdGhvdWdodCBhYm91dCBkb2lu ZyBpdCBmb3IgUmFjayBhbmQgQkJSLCBidXQgdGhlcmUgYXJlIHNvIG1hbnkgb3RoZXIgdGhpbmdz IHRoYXQgbmVlZCB0ZW5kaW5nIHRvbyA6KQ0KDQpBcyB0byDigJxzdXBwb3J0IGlzIGNsYWltZWTi gJ0uLiB3aGVyZSBpcyB0aGF0LCBBIHNpbXBsZSBncmVwIHRocm91Z2ggdGhlIGNvZGUgZm9yIDI4 ODMgIGkuZS4NCg0KY2Qgc3lzL25ldGluZXQNCmdyZXAg4oCcMjg4M+KAnSB0Y3AqDQoNCmRvZXMg bm90IHNob3cgYW55dGhpbmcuLiBpcyBpdCBpbiBvbmUgb2YgdGhlIG1hbiBwYWdlcyBvciBzb21l dGhpbmc/DQoNClRoYW5rcw0KDQpSDQoNCj4gT24gRmViIDI0LCAyMDE5LCBhdCA3OjEwIEFNLCBT Y2hlZmZlbmVnZ2VyLCBSaWNoYXJkIDxSaWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbT4g d3JvdGU6DQo+DQo+IFdlbGwsIFJGQzI4ODMgc3VwcG9ydCBpcyBjbGFpbWVkLCBhbmQgaXQgbWF5 IGhhdmUgYmVlbiB3b3JraW5nIHNvbWV3aGF0IGluIHZlcnkgb2xkIGNvZGUgKGJlZm9yZSAyMDA1 PykgaW5jaWRlbnRhbGx5Li4uDQo+DQo+IEV2ZW4gdGhvdWdoIEZCU0QgZG9lc24ndCBtYWtlIHVz ZSBvZiBEU0FDSyBpbmZvcm1hdGlvbiwgTGludXggZG9lcyAodW53aW5kIG9mIHNwdXJpb3VzIFJU T3MgZm9yIGV4YW1wbGUpLiBTbyBoYXZpbmcgbWluaW1hbCBEU0FDSyAoYWdhaW4/KSBpcyBjZXJ0 YWlubHkgZ29vZCB0byBoYXZlLg0KPg0KPiBBbHNvLCBJIHdhbnRlZCB0byBzZWUgd2hhdCB0Y3Bf dXBkYXRlX3NhY2tfbGlzdCBkb2VzIHVuZGVyIGNlcnRhaW4gY29ybmVyIGNhc2VzLCB3aGVyZSB3 ZSd2ZSBydW4gaW50byBpc3N1ZXMsIHdoZW4gbm90IGFkanVzdGluZyB0aGUgc2FjayBibG9jayBs ZWZ0IGVkZ2UgKGJlbHQgKyBzdXNwZW5kZXJzKS4NCj4NCj4gLS0tLS1PcmlnaW5hbCBNZXNzYWdl LS0tLS0NCj4gRnJvbTogUmFuZGFsbCBTdGV3YXJ0IDxycnNAbmV0ZmxpeC5jb20+DQo+IFNlbnQ6 IFNvbm50YWcsIDI0LiBGZWJydWFyIDIwMTkgMDQ6MDMNCj4NCj4NCj4gSSBqdXN0IGRvbuKAmXQg cmVtZW1iZXIgZXZlciBzZWVpbmcgY29kZSBpbiB0aGUgc3RhY2sgdG8gZG8gRFNBQ0suIEkga25v dyBJIGhhdmUgYWRkZWQgc29tZSBzbWFsbCBiaXRzIHRvIGJlIGF3YXJlIG9mIERTQUNLIGNvbWlu ZyBpbiBmcm9tIG90aGVyIHN0YWNrcyBpbiBCQlIgYW5kIFJhY2ssIGJ1dCBpdCBvbmx5IGRvZXMg YWNjb3VudGluZyBhbmQgZG9lcyBub3QgdXNlIHRoZSBpbmZvcm1hdGlvbi4uIG5vciBkb2VzIGl0 IGdlbmVyYXRlIGFueS4uDQo+DQo+IEkgaGF2ZSB0aG91Z2h0IGFib3V0IGRvaW5nIGl0LCBidXQg SSBoYXZlIG5vdCBwbGFjZWQgYSBiaWcgcHJpb3JpdHkgb24gaXTigKYuDQo+DQo+IFINCj4NCj4+ IE9uIEZlYiAyNCwgMjAxOSwgYXQgNzowMSBBTSwgTWljaGFlbCBUdWV4ZW4gPHR1ZXhlbkBmcmVl YnNkLm9yZz4gd3JvdGU6DQo+Pg0KPj4+IE9uIDI0LiBGZWIgMjAxOSwgYXQgMTI6MzIsIFJhbmRh bGwgU3Rld2FydCA8cnJzQG5ldGZsaXguY29tPiB3cm90ZToNCj4+Pg0KPj4+IEkgZG9u4oCZdCB0 aGluayBJIGhhdmUgZXZlciBzZWVuIEZyZWVCU0QgZW1pdCBhIERTQUNLLiBOb3cgYWRtaXR0ZWRs eSANCj4+PiBJIGhhdmUgb25seSBwYWlkIGNsb3NlIGF0dGVudGlvbiBpbiBjdXJyZW50LiBCdXQg dGhhdCBzcGFucyBldmVuIA0KPj4+IGJhY2sgaW50byAxMSBkYXlzIEkgdGhpbmsuDQo+Pj4NCj4+ PiBIbW0gd29uZGVyIGlmIEkgaGF2ZSBhIDEwIG1hY2hpbmUgSSBjYW4gZ28gYmFjayBhbmQgbG9v ayBhdCA6KQ0KPj4gSSB0cmllZCB0byB0ZXN0IG9uIDEwLjQgeWVzdGVyZGF5LCBidXQgcGFja2V0 ZHJpbGwgZG9lc24ndCBydW4gdGhhdCANCj4+IHdlbGwgb24gMTAuNCAobWlzc2luZyBwY2FwIGZ1 bmN0aW9ucykuLi4gSSdtIG5vdCBzdXJlIEkgd2FudCB0byBiYWNrcG9ydCBpdC4NCj4+DQo+PiBC ZXN0IHJlZ2FyZHMNCj4+IE1pY2hhZWwNCj4+Pg0KPj4+IFINCj4+Pg0KPj4+PiBPbiBGZWIgMjMs IDIwMTksIGF0IDU6MzAgQU0sIE1pY2hhZWwgVHVleGVuIDx0dWV4ZW5AZnJlZWJzZC5vcmc+IHdy b3RlOg0KPj4+Pg0KPj4+Pj4gT24gMjMuIEZlYiAyMDE5LCBhdCAxMToyOCwgU2NoZWZmZW5lZ2dl ciwgUmljaGFyZCA8UmljaGFyZC5TY2hlZmZlbmVnZ2VyQG5ldGFwcC5jb20+IHdyb3RlOg0KPj4+ Pj4NCj4+Pj4+DQo+Pj4+PiBCaW4gZ3JhZCBhbSBmbHVnaGFmZW4gdW5kIGhhYiBsZWlkZXIgbnVy IEhFQUQgYmVpIG1pciAodW5kIGVpbiBpc28gdm9uIDEwLCB3byBpY2ggZ3JhZCB2ZXJzdWNoLCBk YXMgbWl0IHNjYXB5IHp1IGNoZWNrZW4pLg0KPj4+Pj4NCj4+Pj4+IEZhbGxzIGR1IHNjaG5lbGwg ZWluZW4gcGFja2V0ZHJpbGwgZ2VnZW4gQlNEMTEgb2huZSBEMTg5NjAgbWFjaGVuIGthbm5zdCwg dW5kIGVzIGRhIG5vY2ggRFNBQ0tzIHJhdXNzZW5kZXQsIHfDpHJlIGRhcyB0b2xsIQ0KPj4+Pj4N Cj4+Pj4+IEljaCBmw7xyY2h0ZSBhYmVyLCBkYXMgZGFzIHNjaG9uIGzDpG5nZXJlIFplaXQga2Fw dXR0IGlzdCAtIGRhIHdpciBudW4gZG9jaCBub2NoIG5pY2h0IEQxODk2MCBkcmlubmVuIGhhYmVu LCB3aWUgaWNoIGlycnTDvG1saWNoIGRhY2h0ZS4NCj4+Pj4gT0suIEknbGwgdGFrZSBhIGxvb2su DQo+Pj4+DQo+Pj4+IEhhdmUgYSBzYXZlIHRyaXAhDQo+Pj4+DQo+Pj4+IEJlc3QgcmVnYXJkcw0K Pj4+PiBNaWNoYWVsDQo+Pj4+Pg0KPj4+Pj4NCj4+Pj4+DQo+Pj4+PiAtLS0tLU9yaWdpbmFsIE1l c3NhZ2UtLS0tLQ0KPj4+Pj4gRnJvbTogTWljaGFlbCBUdWV4ZW4gPHR1ZXhlbkBmcmVlYnNkLm9y Zz4NCj4+Pj4+IFNlbnQ6IFNhbXN0YWcsIDIzLiBGZWJydWFyIDIwMTkgMTE6MjUNCj4+Pj4+IFRv OiBTY2hlZmZlbmVnZ2VyLCBSaWNoYXJkIDxSaWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNv bT4NCj4+Pj4+IENjOiBmcmVlYnNkLXRyYW5zcG9ydEBmcmVlYnNkLm9yZw0KPj4+Pj4gU3ViamVj dDogUmU6IERTQUNLDQo+Pj4+Pg0KPj4+Pj4gTmV0QXBwIFNlY3VyaXR5IFdBUk5JTkc6IFRoaXMg aXMgYW4gZXh0ZXJuYWwgZW1haWwuIERvIG5vdCBjbGljayBsaW5rcyBvciBvcGVuIGF0dGFjaG1l bnRzIHVubGVzcyB5b3UgcmVjb2duaXplIHRoZSBzZW5kZXIgYW5kIGtub3cgdGhlIGNvbnRlbnQg aXMgc2FmZS4NCj4+Pj4+DQo+Pj4+Pg0KPj4+Pj4NCj4+Pj4+DQo+Pj4+Pj4gT24gMjMuIEZlYiAy MDE5LCBhdCAxMDoyOSwgU2NoZWZmZW5lZ2dlciwgUmljaGFyZCA8UmljaGFyZC5TY2hlZmZlbmVn Z2VyQG5ldGFwcC5jb20+IHdyb3RlOg0KPj4+Pj4+DQo+Pj4+Pj4gSGksDQo+Pj4+Pj4NCj4+Pj4+ PiBBIGNvbGxlYWd1ZSBwb2ludGVkIG1lIHRvIHRoZSBzdGFjayAoSEVBRCkgbm8gbG9uZ2VyIGVt aXR0aW5nIERTQUNLIG9wdGlvbnMgYSBmZXcgZGF5cyBhZ28uLi4NCj4+Pj4+Pg0KPj4+Pj4+IEkg d2FzIHVuZGVyIHRoZSBpbXByZXNzaW9uLCB0aGF0IG9sZGVyIHZlcnNpb25zIG9mIEZyZWVCU0Qg d291bGQgc2VuZCBvdXQgRFNBQ0tzIGZvciBzcHVyaW91cyBkdXBsaWNhdGUgcGFja2V0cy4NCj4+ Pj4+Pg0KPj4+Pj4+IEJ1dCB3aGVuIEkgdHJ5IHRoaXMgc2NyaXB0IGFnYWluc3QgSEVBRCwgcmVn dWxhciBjdW11bGF0aXZlIEFDS3Mgd2l0aG91dCBEU0FDSyBibG9ja3MgYXJlIHNob3dpbmcgdXAu DQo+Pj4+Pj4NCj4+Pj4+PiBDdXJyZW50bHkgYmFuZHdpZHRoIHN0YXJ2ZWQgLSBidXQgd2FzIHRo YXQgYSBjb25zY2lvdXMgZGVjaXNpb24/IE9yIHdhcyBtZSBvYnNlcnZpbmcgRFNBQ0tzIG5ldmVy IGEgdGhpbmc/DQo+Pj4+PiBJIHdvdWxkIHNheSBpZiBpdCBpcyB3b3JraW5nIGluIHN0YWJsZS8x MSwgYnV0IG5vdCBpbiBzdGFibGUvMTIgYW5kIGhlYWQsIGl0IGlzIGEgcmVncmVzc2lvbi4NCj4+ Pj4+DQo+Pj4+PiBCZXN0IHJlZ2FyZHMNCj4+Pj4+IE1pY2hhZWwNCj4+Pj4+Pg0KPj4+Pj4+IFRo YW5rcyBhIGxvdCwNCj4+Pj4+PiBSaWNoYXJkDQo+Pj4+Pj4NCj4+Pj4+DQo+Pj4+DQo+Pj4+IF9f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQo+Pj4+IGZyZWVi c2QtdHJhbnNwb3J0QGZyZWVic2Qub3JnIG1haWxpbmcgbGlzdCANCj4+Pj4gaHR0cHM6Ly9saXN0 cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVic2QtdHJhbnNwb3J0DQo+Pj4+IFRv IHVuc3Vic2NyaWJlLCBzZW5kIGFueSBtYWlsIHRvICJmcmVlYnNkLXRyYW5zcG9ydC11bnN1YnNj cmliZUBmcmVlYnNkLm9yZyINCj4+Pg0KPj4+IC0tLS0tLQ0KPj4+IFJhbmRhbGwgU3Rld2FydA0K Pj4+IHJyc0BuZXRmbGl4LmNvbQ0KPj4+DQo+Pj4NCj4+Pg0KPj4NCj4NCj4gLS0tLS0tDQo+IFJh bmRhbGwgU3Rld2FydA0KPiBycnNAbmV0ZmxpeC5jb20NCj4NCj4NCj4NCg0KLS0tLS0tDQpSYW5k YWxsIFN0ZXdhcnQNCnJyc0BuZXRmbGl4LmNvbQ0KDQoNCg0K From owner-freebsd-transport@freebsd.org Sun Feb 24 14:03:30 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F1A09151FF26 for ; Sun, 24 Feb 2019 14:03:29 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 73CB96E8B0 for ; Sun, 24 Feb 2019 14:03:29 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [192.168.1.9] (p57BB4A79.dip0.t-ipconnect.de [87.187.74.121]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 343FA721E2821; Sun, 24 Feb 2019 15:03:26 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: DSACK From: Michael Tuexen In-Reply-To: <824585F6-342D-4F7F-BB2A-FA9CA661E5D2@netflix.com> Date: Sun, 24 Feb 2019 15:03:25 +0100 Cc: "Scheffenegger, Richard" , "freebsd-transport@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <7989F557-6C8E-4379-8E3C-6AADEF7CF293@freebsd.org> References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> <824585F6-342D-4F7F-BB2A-FA9CA661E5D2@netflix.com> To: Randall Stewart X-Mailer: Apple Mail (2.3445.102.3) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 73CB96E8B0 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.91 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.92)[-0.917,0]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 14:03:30 -0000 > On 24. Feb 2019, at 13:14, Randall Stewart wrote: >=20 > Richard: >=20 > I agree it would be a nice to add thing.. I have thought about doing > it for Rack and BBR, but there are so many other things that need = tending too :) >=20 > As to =E2=80=9Csupport is claimed=E2=80=9D.. where is that, A simple = grep through the code for 2883 i.e. >=20 > cd sys/netinet > grep =E2=80=9C2883=E2=80=9D tcp* >=20 > does not show anything.. is it in one of the man pages or something? I did the same... I think he is referring to https://wiki.freebsd.org/TransportProtocols/tcp_rfc_compliance Best regards Michael >=20 > Thanks >=20 > R >=20 >> On Feb 24, 2019, at 7:10 AM, Scheffenegger, Richard = wrote: >>=20 >> Well, RFC2883 support is claimed, and it may have been working = somewhat in very old code (before 2005?) incidentally... >>=20 >> Even though FBSD doesn't make use of DSACK information, Linux does = (unwind of spurious RTOs for example). So having minimal DSACK (again?) = is certainly good to have. >>=20 >> Also, I wanted to see what tcp_update_sack_list does under certain = corner cases, where we've run into issues, when not adjusting the sack = block left edge (belt + suspenders). >>=20 >> -----Original Message----- >> From: Randall Stewart =20 >> Sent: Sonntag, 24. Februar 2019 04:03 >>=20 >>=20 >> I just don=E2=80=99t remember ever seeing code in the stack to do = DSACK. I know I have added some small bits to be aware of DSACK coming = in from other stacks in BBR and Rack, but it only does accounting and = does not use the information.. nor does it generate any.. >>=20 >> I have thought about doing it, but I have not placed a big priority = on it=E2=80=A6. >>=20 >> R >>=20 >>> On Feb 24, 2019, at 7:01 AM, Michael Tuexen = wrote: >>>=20 >>>> On 24. Feb 2019, at 12:32, Randall Stewart wrote: >>>>=20 >>>> I don=E2=80=99t think I have ever seen FreeBSD emit a DSACK. Now = admittedly I=20 >>>> have only paid close attention in current. But that spans even back=20= >>>> into 11 days I think. >>>>=20 >>>> Hmm wonder if I have a 10 machine I can go back and look at :) >>> I tried to test on 10.4 yesterday, but packetdrill doesn't run that=20= >>> well on 10.4 (missing pcap functions)... I'm not sure I want to = backport it. >>>=20 >>> Best regards >>> Michael >>>>=20 >>>> R >>>>=20 >>>>> On Feb 23, 2019, at 5:30 AM, Michael Tuexen = wrote: >>>>>=20 >>>>>> On 23. Feb 2019, at 11:28, Scheffenegger, Richard = wrote: >>>>>>=20 >>>>>>=20 >>>>>> Bin grad am flughafen und hab leider nur HEAD bei mir (und ein = iso von 10, wo ich grad versuch, das mit scapy zu checken). >>>>>>=20 >>>>>> Falls du schnell einen packetdrill gegen BSD11 ohne D18960 machen = kannst, und es da noch DSACKs raussendet, w=C3=A4re das toll! >>>>>>=20 >>>>>> Ich f=C3=BCrchte aber, das das schon l=C3=A4ngere Zeit kaputt ist = - da wir nun doch noch nicht D18960 drinnen haben, wie ich irrt=C3=BCmlich= dachte. >>>>> OK. I'll take a look. >>>>>=20 >>>>> Have a save trip! >>>>>=20 >>>>> Best regards >>>>> Michael >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> -----Original Message----- >>>>>> From: Michael Tuexen >>>>>> Sent: Samstag, 23. Februar 2019 11:25 >>>>>> To: Scheffenegger, Richard >>>>>> Cc: freebsd-transport@freebsd.org >>>>>> Subject: Re: DSACK >>>>>>=20 >>>>>> NetApp Security WARNING: This is an external email. Do not click = links or open attachments unless you recognize the sender and know the = content is safe. >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>>> On 23. Feb 2019, at 10:29, Scheffenegger, Richard = wrote: >>>>>>>=20 >>>>>>> Hi, >>>>>>>=20 >>>>>>> A colleague pointed me to the stack (HEAD) no longer emitting = DSACK options a few days ago... >>>>>>>=20 >>>>>>> I was under the impression, that older versions of FreeBSD would = send out DSACKs for spurious duplicate packets. >>>>>>>=20 >>>>>>> But when I try this script against HEAD, regular cumulative ACKs = without DSACK blocks are showing up. >>>>>>>=20 >>>>>>> Currently bandwidth starved - but was that a conscious decision? = Or was me observing DSACKs never a thing? >>>>>> I would say if it is working in stable/11, but not in stable/12 = and head, it is a regression. >>>>>>=20 >>>>>> Best regards >>>>>> Michael >>>>>>>=20 >>>>>>> Thanks a lot, >>>>>>> Richard >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>>> _______________________________________________ >>>>> freebsd-transport@freebsd.org mailing list=20 >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-transport >>>>> To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" >>>>=20 >>>> ------ >>>> Randall Stewart >>>> rrs@netflix.com >>>>=20 >>>>=20 >>>>=20 >>>=20 >>=20 >> ------ >> Randall Stewart >> rrs@netflix.com >>=20 >>=20 >>=20 >=20 > ------ > Randall Stewart > rrs@netflix.com >=20 >=20 >=20 From owner-freebsd-transport@freebsd.org Sun Feb 24 11:32:25 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61A64151BE71 for ; Sun, 24 Feb 2019 11:32:25 +0000 (UTC) (envelope-from rrs@netflix.com) Received: from mail-qt1-x832.google.com (mail-qt1-x832.google.com [IPv6:2607:f8b0:4864:20::832]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F3D336A00B for ; Sun, 24 Feb 2019 11:32:23 +0000 (UTC) (envelope-from rrs@netflix.com) Received: by mail-qt1-x832.google.com with SMTP id s1so7500087qte.5 for ; Sun, 24 Feb 2019 03:32:23 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=hAjeMeiTBVvzUL0p8joE6tGLs6+VCGsqtvKCZlTyVuA=; b=XPYFX5GDFN+W92GyRRJ1GacxRGEg7RUr049JAkk625uS0Bw6SXckFG6jfrvULKB1aX ZWXG4qC0M10JA+PTvEhQ2vMU9vHMNaL+wX5ZNdL1s78LrFborqGWEALhh2uZpo7H/UVg U1Z53FP6SA/Yki2oc/ETd0sJ/BJUJYxsLxembFgdYxHviLRFsAcsnYscbFB+k0N+wVX3 ORwzkBXvwnGZuQ4ynnHJkSNJMa8WEtkgUD6yWFECouQgBrUuA4D5YXqyFRKkjAps6i76 5g9R+a40aBfdCkrW/emU06pCfKuCymolT/nX2AWqXSIn4xBcHxmE2AITA25rRWO3WrXS OAvQ== X-Gm-Message-State: AHQUAuaGbRPuEpjIuwfiKRGPU11FFQTQMunaBvBaP+VoC8MBTawwXcWI vsySwiiXeKLd7AvjJU8YoAPusw== X-Google-Smtp-Source: AHgI3Ia40We0BL/OwrrPwt3SFhw8JCwlDadI513MEor5JwL6Sphf5Ne8WW10suo0/xlTOZNiR9T/Pg== X-Received: by 2002:a0c:9368:: with SMTP id e37mr9867268qve.61.1551007943033; Sun, 24 Feb 2019 03:32:23 -0800 (PST) Received: from ?IPv6:2607:fb10:7061:7fd::8fc7? ([2607:fb10:7061:7fd::8fc7]) by smtp.gmail.com with ESMTPSA id 132sm3503356qke.0.2019.02.24.03.32.22 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 24 Feb 2019 03:32:22 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: DSACK From: Randall Stewart In-Reply-To: <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> Date: Sun, 24 Feb 2019 06:32:21 -0500 Cc: "Scheffenegger, Richard" , "freebsd-transport@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> To: Michael Tuexen X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: F3D336A00B X-Spamd-Bar: --------------- X-Spamd-Result: default: False [-15.87 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,aspmx2.googlemail.com,alt2.aspmx.l.google.com,aspmx3.googlemail.com]; DKIM_TRACE(0.00)[netflix.com:+]; DMARC_POLICY_ALLOW(-0.50)[netflix.com,reject]; SUBJ_ALL_CAPS(0.38)[5]; NEURAL_HAM_SHORT(-0.98)[-0.977,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-2.76)[ip: (-9.10), ipnet: 2607:f8b0::/32(-2.64), asn: 15169(-2.00), country: US(-0.07)]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[netflix.com:s=google]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-transport@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; WHITELIST_DMARC(-7.00)[netflix.com:D:+]; RCVD_IN_DNSWL_NONE(0.00)[2.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; WHITELIST_SPF_DKIM(-3.00)[netflix.com:d:+,netflix.com:s:+] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 11:32:25 -0000 I don=E2=80=99t think I have ever seen FreeBSD emit a DSACK. Now = admittedly I have only paid close attention in current. But that spans even back into 11 days I think. Hmm wonder if I have a 10 machine I can go back and look at :) R > On Feb 23, 2019, at 5:30 AM, Michael Tuexen = wrote: >=20 >> On 23. Feb 2019, at 11:28, Scheffenegger, Richard = wrote: >>=20 >>=20 >> Bin grad am flughafen und hab leider nur HEAD bei mir (und ein iso = von 10, wo ich grad versuch, das mit scapy zu checken). >>=20 >> Falls du schnell einen packetdrill gegen BSD11 ohne D18960 machen = kannst, und es da noch DSACKs raussendet, w=C3=A4re das toll! >>=20 >> Ich f=C3=BCrchte aber, das das schon l=C3=A4ngere Zeit kaputt ist - = da wir nun doch noch nicht D18960 drinnen haben, wie ich irrt=C3=BCmlich = dachte. > OK. I'll take a look. >=20 > Have a save trip! >=20 > Best regards > Michael >>=20 >>=20 >>=20 >> -----Original Message----- >> From: Michael Tuexen =20 >> Sent: Samstag, 23. Februar 2019 11:25 >> To: Scheffenegger, Richard >> Cc: freebsd-transport@freebsd.org >> Subject: Re: DSACK >>=20 >> NetApp Security WARNING: This is an external email. Do not click = links or open attachments unless you recognize the sender and know the = content is safe. >>=20 >>=20 >>=20 >>=20 >>> On 23. Feb 2019, at 10:29, Scheffenegger, Richard = wrote: >>>=20 >>> Hi, >>>=20 >>> A colleague pointed me to the stack (HEAD) no longer emitting DSACK = options a few days ago... >>>=20 >>> I was under the impression, that older versions of FreeBSD would = send out DSACKs for spurious duplicate packets. >>>=20 >>> But when I try this script against HEAD, regular cumulative ACKs = without DSACK blocks are showing up. >>>=20 >>> Currently bandwidth starved - but was that a conscious decision? Or = was me observing DSACKs never a thing? >> I would say if it is working in stable/11, but not in stable/12 and = head, it is a regression. >>=20 >> Best regards >> Michael >>>=20 >>> Thanks a lot, >>> Richard >>>=20 >>=20 >=20 > _______________________________________________ > freebsd-transport@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-transport > To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" ------ Randall Stewart rrs@netflix.com From owner-freebsd-transport@freebsd.org Sun Feb 24 12:03:26 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 12A29151CA4A for ; Sun, 24 Feb 2019 12:03:26 +0000 (UTC) (envelope-from rrs@netflix.com) Received: from mail-qt1-x834.google.com (mail-qt1-x834.google.com [IPv6:2607:f8b0:4864:20::834]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 10F396ACB7 for ; Sun, 24 Feb 2019 12:03:25 +0000 (UTC) (envelope-from rrs@netflix.com) Received: by mail-qt1-x834.google.com with SMTP id s1so7537501qte.5 for ; Sun, 24 Feb 2019 04:03:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=Tg8I+hAAEj2M50o0FfQw0+1kPb1CuBM/luvSvLJaGHs=; b=RTsPS1Kc6+TIJSpkyLIFZ7DnecJUrviQK2z+GqaqSJBx4brvVv7arzy8M39jelP/AQ nTFUa6a80hxpP3y8UFxpQVSmhGFSdTp8tokT7UUKwbWwsTCbuimYXITmgUR7dNDNAnkO lvD89Q68UKfVeWfL6cVDskZMYTkrK94r82UNAR9gzg5DtnM3X5FyYJ6Npc+AhrwnWURS 7H+8Bc38b2QmQXlVwfNMwR9e8XWO3Gr1kydbMzwlYS23hr727SwZ/qIMQm8b6EcdpfND BZFVeFJxo3xXeMhcBDhIk5lQPbvPDnIER4bBMTl3/8rKdrIaZcPQBIoMo9GXYep3cSiK Kb3Q== X-Gm-Message-State: AHQUAuYct4Iid7CQPc2PFnmKz8aJOqjTbAfPwXJdbb+rWs6CGg93xbqZ DF2xMw2sxXYVKApstdLmcYgytKYDnJA= X-Google-Smtp-Source: AHgI3Ia+vhsFihs2enQN93xH9768pLqMULGDXcOex/3ZLu3GIPFTqT2nyocWsx3/CAGhn4v88r0dXQ== X-Received: by 2002:a0c:86bd:: with SMTP id 58mr8236801qvf.4.1551009804303; Sun, 24 Feb 2019 04:03:24 -0800 (PST) Received: from ?IPv6:2607:fb10:7061:7fd::8fc7? ([2607:fb10:7061:7fd::8fc7]) by smtp.gmail.com with ESMTPSA id p17sm4307512qtk.39.2019.02.24.04.03.23 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 24 Feb 2019 04:03:23 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: DSACK From: Randall Stewart In-Reply-To: <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> Date: Sun, 24 Feb 2019 07:03:22 -0500 Cc: "Scheffenegger, Richard" , "freebsd-transport@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> To: Michael Tuexen X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: 10F396ACB7 X-Spamd-Bar: --------------- X-Spamd-Result: default: False [-15.81 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netflix.com:+]; MX_GOOD(-0.01)[cached: alt1.aspmx.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[netflix.com,reject]; SUBJ_ALL_CAPS(0.38)[5]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[netflix.com:s=google]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-transport@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; WHITELIST_DMARC(-7.00)[netflix.com:D:+]; RCVD_IN_DNSWL_NONE(0.00)[4.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.68)[ip: (-8.70), ipnet: 2607:f8b0::/32(-2.64), asn: 15169(-2.00), country: US(-0.07)]; WHITELIST_SPF_DKIM(-3.00)[netflix.com:d:+,netflix.com:s:+] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 12:03:26 -0000 I just don=E2=80=99t remember ever seeing code in the stack to do DSACK. I know I have added some small bits to be aware of DSACK coming in from other stacks in BBR and Rack, but it only does accounting and does not use the information.. nor does it generate any.. I have thought about doing it, but I have not placed a big priority on it=E2=80=A6. R > On Feb 24, 2019, at 7:01 AM, Michael Tuexen = wrote: >=20 >> On 24. Feb 2019, at 12:32, Randall Stewart wrote: >>=20 >> I don=E2=80=99t think I have ever seen FreeBSD emit a DSACK. Now = admittedly >> I have only paid close attention in current. But that spans even back >> into 11 days I think. >>=20 >> Hmm wonder if I have a 10 machine I can go back and look at :) > I tried to test on 10.4 yesterday, but packetdrill doesn't run that > well on 10.4 (missing pcap functions)... I'm not sure I want to = backport it. >=20 > Best regards > Michael >>=20 >> R >>=20 >>> On Feb 23, 2019, at 5:30 AM, Michael Tuexen = wrote: >>>=20 >>>> On 23. Feb 2019, at 11:28, Scheffenegger, Richard = wrote: >>>>=20 >>>>=20 >>>> Bin grad am flughafen und hab leider nur HEAD bei mir (und ein iso = von 10, wo ich grad versuch, das mit scapy zu checken). >>>>=20 >>>> Falls du schnell einen packetdrill gegen BSD11 ohne D18960 machen = kannst, und es da noch DSACKs raussendet, w=C3=A4re das toll! >>>>=20 >>>> Ich f=C3=BCrchte aber, das das schon l=C3=A4ngere Zeit kaputt ist - = da wir nun doch noch nicht D18960 drinnen haben, wie ich irrt=C3=BCmlich = dachte. >>> OK. I'll take a look. >>>=20 >>> Have a save trip! >>>=20 >>> Best regards >>> Michael >>>>=20 >>>>=20 >>>>=20 >>>> -----Original Message----- >>>> From: Michael Tuexen =20 >>>> Sent: Samstag, 23. Februar 2019 11:25 >>>> To: Scheffenegger, Richard >>>> Cc: freebsd-transport@freebsd.org >>>> Subject: Re: DSACK >>>>=20 >>>> NetApp Security WARNING: This is an external email. Do not click = links or open attachments unless you recognize the sender and know the = content is safe. >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>>> On 23. Feb 2019, at 10:29, Scheffenegger, Richard = wrote: >>>>>=20 >>>>> Hi, >>>>>=20 >>>>> A colleague pointed me to the stack (HEAD) no longer emitting = DSACK options a few days ago... >>>>>=20 >>>>> I was under the impression, that older versions of FreeBSD would = send out DSACKs for spurious duplicate packets. >>>>>=20 >>>>> But when I try this script against HEAD, regular cumulative ACKs = without DSACK blocks are showing up. >>>>>=20 >>>>> Currently bandwidth starved - but was that a conscious decision? = Or was me observing DSACKs never a thing? >>>> I would say if it is working in stable/11, but not in stable/12 and = head, it is a regression. >>>>=20 >>>> Best regards >>>> Michael >>>>>=20 >>>>> Thanks a lot, >>>>> Richard >>>>>=20 >>>>=20 >>>=20 >>> _______________________________________________ >>> freebsd-transport@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-transport >>> To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" >>=20 >> ------ >> Randall Stewart >> rrs@netflix.com >>=20 >>=20 >>=20 >=20 ------ Randall Stewart rrs@netflix.com From owner-freebsd-transport@freebsd.org Mon Feb 25 17:59:28 2019 Return-Path: Delivered-To: freebsd-transport@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 09D6A1510B8D for ; Mon, 25 Feb 2019 17:59:28 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM05-DM3-obe.outbound.protection.outlook.com (mail-dm3nam05on0608.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe51::608]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C6D5A70A15; Mon, 25 Feb 2019 17:59:26 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=wiLsI3C0wG9KBOSbW2PzziaDrgpvdQ1OYf1YvOFwcU4=; b=DcN5yaYSb+//N2FenfkcpFjSWf/cSH9HiKbkeaA7wopqnI2PnTJMwB4e/LKIULupMi0fknw/wqy5OlR5Qo2+tUDE1QEZiO41edBw6hFMmSryvPEYPWrC4wiQ5LvcpDYe4oIe8NxrWvxsIeh0qgtgIktONI2xuNPkba48aYXFcJU= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.151.152) by SN4PR0601MB3743.namprd06.prod.outlook.com (10.167.142.17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1643.15; Mon, 25 Feb 2019 17:59:24 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8964:7f8e:108:77a9]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::8964:7f8e:108:77a9%3]) with mapi id 15.20.1643.019; Mon, 25 Feb 2019 17:59:24 +0000 From: "Scheffenegger, Richard" To: hiren panchasara , Randall Stewart CC: Michael Tuexen , "freebsd-transport@freebsd.org" Subject: RE: DSACK Thread-Topic: DSACK Thread-Index: AdTLWc4uYQf4MWyfQYim5HKMDVJsDAACEkwAAAAIW5AAACftAAA0cJuAAAEByoAAABOFAAA+EBGAAACYuxA= Date: Mon, 25 Feb 2019 17:59:24 +0000 Message-ID: References: <5ACAD39A-2A77-43BB-BE93-994C1C6C93AB@freebsd.org> <5AD822A0-06D7-44DB-AFB1-2453FD59A222@freebsd.org> <58102EB5-6A5A-4BE1-ADEA-4EDCB56A39AE@freebsd.org> <328BFA58-EF05-473C-9DC0-05549E662213@netflix.com> <20190225174025.GG37064@strugglingcoder.info> In-Reply-To: <20190225174025.GG37064@strugglingcoder.info> Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: PG1ldGE+PGF0IG5tPSJib2R5LnR4dCIgcD0iYzpcdXNlcnNcc3JpY2hhcmRcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy0xMzhkMGRmMi0zOTI3LTExZTktYjVlZi0wMDE5ZDJlNGVjZDdcYW1lLXRlc3RcMTM4ZDBkZjQtMzkyNy0xMWU5LWI1ZWYtMDAxOWQyZTRlY2Q3Ym9keS50eHQiIHN6PSI4ODAiIHQ9IjEzMTk1NTkxMTYxNjU4MTgyMCIgaD0iSVBrZGRsdEYrN2xXYzUvTm9YMXI2NnFBOE5ZPSIgaWQ9IiIgYmw9IjAiIGJvPSIxIi8+PC9tZXRhPg== x-dg-rorf: x-originating-ip: [217.70.210.6] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 99411fcc-34e1-4bd0-69f0-08d69b4afa25 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(2017052603328)(7193020); SRVR:SN4PR0601MB3743; x-ms-traffictypediagnostic: SN4PR0601MB3743: x-microsoft-exchange-diagnostics: =?utf-8?B?MTtTTjRQUjA2MDFNQjM3NDM7MjM6K2cyQkQ1Z0lacHhTY21PUENPN2lGSnd5?= =?utf-8?B?VTRtU2JaRC80VTRKTk9oWkpuMGZOWnRGSy92M0doWnQzWTNybDM1RGJ3Z0tU?= =?utf-8?B?bFpPRE4xcTg3QUR1N2FqVy9BdVhBVmV4cDBtQ09Nak9uZUk2ZVpKR2FycUp2?= =?utf-8?B?MU1EQkh0Qm4yNitvNk5vQTB1em5RdUlJNXdqS0hUc3VybEhsYURlSnd2RDlD?= =?utf-8?B?YUw3YmJXdEgrS1AzOXVxL0xSN01CajdXQUdlVis2cjI2NW1mZGk5d3NobjBq?= =?utf-8?B?b0l6K3ptSEtZZjZYaDNYV1FDMW5HV2tCOERSdkVQMEkwbFN3REJxS0RLY2Qx?= =?utf-8?B?cXo0cGphbFZ3MUJkbVBvUXk2cTFxTXNVVm1CN0hZNm82V3ZHeHRIeC9uZ2h5?= =?utf-8?B?TzdPZWFhOWhKcHhEL1dIUTMxaFpjNGZoZEhMODJ4Q3k4SkI2SWpjRHlZZE5R?= =?utf-8?B?bzh4b0x2U016Qk9TbXBiWjMwd1JiUExkSWx5QmxWSHdSbmtGN1g5THYzdk4y?= =?utf-8?B?aWJJVk1sVmhDR1ZMVTFzQ1hYd1BvY3NITGhCU1puVUVKY2VoVVI5WU5vV1JG?= =?utf-8?B?OG05bHNvNC9idHVoWjJQYTdidEpWaytSRnFGOTdQYVc5ZWF0aGFpYzd0NTI3?= =?utf-8?B?bUwwTnJzcFVrZENLeG9jQWdaSUJ5ZFFmTzg0MVovNEFtSkpzT3VJNFFadUpG?= =?utf-8?B?WGdQOWkyTjc4S2tKdFFvcjByUHRRWmVMZkNQdmhSaW1PNDlMeUxmZ3pWWWlR?= =?utf-8?B?dFpRZVJYcWkwWmVwQVcxNStmMDMwSnM3dkFXYnkrL2h0N2Qza3ZhNmMwK2VB?= =?utf-8?B?ZGhuaHF5cnFVWDV2WUZSODNKaTVLTW1hZ25CeDh2MktJdHdIVGgzaEhaNDRt?= =?utf-8?B?UWV1L3dHRDBjKzY3NTMwdmVqMStQdWpGaHhtTDA4bFl1aWEvbFdlVVNXNGpR?= =?utf-8?B?MFNNcmdLdklnQ3c0T2YyQnBpZTF0Mnd0Q25nYnJ6TmFEWWNOdG1MYzVrWExj?= =?utf-8?B?VHFsdEJwTzRLaURqZ2k3ZkorajNmNURWYzJlR1JFNFEzdDVZT1grc0g4eURw?= =?utf-8?B?OHVNSWRWVlEreEphTHc3YUE4bDZseWFMUzd4VHJLM2pUbTRtUmxZYXM5Y0Rk?= =?utf-8?B?Z09QcEp5WVRzMTBqbTkxclc3eUFWbnYwWnZweS9TVFRsdHBmSnQyTUkzTHNB?= =?utf-8?B?ZUVnSm5ySzhINzlXdkNuM3BmcmpJK2Q3S0dZR0JrL2VCNnFVLzZpcTNsbmlW?= =?utf-8?B?Y2MxcUZTN05ucGxFbGVEUmFVQWtpMWZ0QzFDZGJvTThWNm5NTHdIRFhhUXha?= =?utf-8?B?Q0doMEpsc1RrdzZUaENaMmVpVFRPQ2FkYXFWNmdJRjhJWGZaTlVBVHYxLzR5?= =?utf-8?B?bUJoa1FBemM0UU5nY0c4OTNVZlJLL0FtZ1FwRDd3bXJGbjJyREJYbmpMekwz?= =?utf-8?B?bUNWUWRrbFpkS2x2NjUrTGdGMldlSWdXSEUxQXh0SSt6YVlCZ2RsVDBUNGRh?= =?utf-8?B?UVRIQk5pcDd6R0FOa05sc3lYbFRyUnV2L0N4b21LaEdDZVdYYk9ZK3VtNnBL?= =?utf-8?B?QityZk9Cc3ZoNDJqRGoyU0hEVmdMR2hiRFMvOElpdWpKL3FhdEl3MDBoZVRl?= =?utf-8?B?Y3N5aFo5cjFYb3dac1JQQWFxRFdFV25hME9VVHNHZ3gzWDZySUVmYmN0UzYx?= =?utf-8?B?MFVydHk0M0dvN09yUHAxb2xSSnRZcUgwNFhXOFB6NVZmMzh1WDgrRU1leFhR?= =?utf-8?B?bFhUUHlITWdGZjh3SnJuajA1aDk1MFp6NU9wcDM3dlU5Y25TK1F1enErV1dV?= =?utf-8?B?b0dYOG9VakRKNGNYb2VVUU9KKy9HVW1jcURRRVZsdVFmbit6REhMd001RDlD?= =?utf-8?Q?IaPeW4FuuXpuNFdT7iBPnOBtoOAbciY9Rq?= x-microsoft-antispam-prvs: x-forefront-prvs: 095972DF2F x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(366004)(39860400002)(376002)(346002)(136003)(13464003)(199004)(189003)(9686003)(4744005)(6116002)(3846002)(8936002)(53936002)(256004)(478600001)(55016002)(76176011)(72206003)(2906002)(186003)(106356001)(105586002)(3480700005)(66066001)(54906003)(7116003)(25786009)(4326008)(52536013)(97736004)(86362001)(68736007)(7696005)(6246003)(5660300002)(110136005)(53546011)(102836004)(6506007)(305945005)(93886005)(33656002)(71200400001)(71190400001)(14454004)(74316002)(316002)(486006)(229853002)(6436002)(446003)(26005)(7736002)(221733001)(11346002)(81156014)(8676002)(476003)(81166006)(99286004)(6606295002); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3743; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: P3h14el1ZNu2OEh9dJLNVU/2Zn+DNL6qnckOTSRc8DoEpGZFLbiu3DT4oZcZ7XVIJDl+lAmA0YQwNev75a4H/ZqWW9+/VK9BwS7W7aG2WYx2w5RN+xxeaQVPDEv8JRUdwLAsdgSJJGnEpk5cGJX2kbqR3VlYdXmMBm9Y5LS8kAh74I0xndcjIooYvUKAwgvLx1bzGURBNJgOsQlK5dq/Ee6abvWKbXXD2m23r9u1XrUmh81MQmXQy52ERQu0nWosnKxQMJ7doIxU4ZYeL8sxDdUGmNuvg82Lld57dU8TS31NuZes7JQ9Rxx3j85ZoukbnzmymkH8MOmGCSiQxlQc4Zp90BF1Co30wBbLCdDSzR9zMsaGd2dS5GsZ0s0ORjGMB629ONeB6kXJcPxAdju7QttXL8hsn1S51I8Jp+mLgus= Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 99411fcc-34e1-4bd0-69f0-08d69b4afa25 X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Feb 2019 17:59:24.4283 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3743 X-Rspamd-Queue-Id: C6D5A70A15 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=DcN5yaYS; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 2a01:111:f400:fe51::608 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-3.80 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_MEDIUM(-0.99)[-0.995,0]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx1.netapp.iphmx.com]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; MIME_BASE64_TEXT(0.10)[]; SUBJ_ALL_CAPS(0.38)[5]; NEURAL_HAM_SHORT(-0.82)[-0.822,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; IP_SCORE(-0.95)[ipnet: 2a01:111:f000::/36(-2.47), asn: 8075(-2.21), country: US(-0.07)] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Feb 2019 17:59:28 -0000 VGhhbmtzIEhpcmVuLA0KDQpQZXJoYXBzIGZpeCB0aGUgdGFibGUgb24gdGhhdCB3aWtpIHBhZ2Ug YXMgYSBxdWljayBpbml0aWFsIHN0ZXA/DQoNCkkgZ3Vlc3MgdGhlIGFiaWxpdHkgdG8gbm90IHJl YWN0IGluIGZ1bm55IHdheXMgb24gcmVjZWlwdCBvZiBhIERTQUNLIGJsb2NrIHdvdWxkbid0IHdh cnJhbnQgdGhlIGNsYWltIG9mIFJGQzI4ODMgY29tcGxpYW5jZSDwn5iKDQoNCkJlc3QgcmVnYXJk cywNCiAgIFJpY2hhcmQNCg0KDQoNCg0KLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZyb206 IGhpcmVuIHBhbmNoYXNhcmEgPGhpcmVuQHN0cnVnZ2xpbmdjb2Rlci5pbmZvPiANClNlbnQ6IE1v bnRhZywgMjUuIEZlYnJ1YXIgMjAxOSAwOTo0MA0KVG86IFJhbmRhbGwgU3Rld2FydCA8cnJzQG5l dGZsaXguY29tPg0KQ2M6IE1pY2hhZWwgVHVleGVuIDx0dWV4ZW5AZnJlZWJzZC5vcmc+OyBmcmVl YnNkLXRyYW5zcG9ydEBmcmVlYnNkLm9yZzsgU2NoZWZmZW5lZ2dlciwgUmljaGFyZCA8UmljaGFy ZC5TY2hlZmZlbmVnZ2VyQG5ldGFwcC5jb20+DQpTdWJqZWN0OiBSZTogRFNBQ0sNCg0KT24gMDIv MjQvMTkgYXQgMDc6MDNQLCBSYW5kYWxsIFN0ZXdhcnQgdmlhIGZyZWVic2QtdHJhbnNwb3J0IHdy b3RlOg0KPiBJIGp1c3QgZG9uP3QgcmVtZW1iZXIgZXZlciBzZWVpbmcgY29kZSBpbiB0aGUgc3Rh Y2sgdG8gZG8gRFNBQ0suDQoNCkNvbmN1ci4gSSBkb24ndCB0aGluayB3ZSBoYXZlIGhhZCAod29y a2luZykgRFNBQ0sgc3VwcG9ydCBldmVyLg0KDQpyZmMgY29tcGxpYW5jZSBsaXN0IG1pZ2h0IGJl IG1pc2xlYWRpbmcgaW4gdGhpcyBjYXNlLg0KDQpDaGVlcnMsDQpIaXJlbg0K