From owner-freebsd-transport@freebsd.org Wed Dec 4 14:11:09 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1A7001BF2FF for ; Wed, 4 Dec 2019 14:11:09 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM02-CY1-obe.outbound.protection.outlook.com (mail-eopbgr760080.outbound.protection.outlook.com [40.107.76.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47SgkL3QhQz3NDZ for ; Wed, 4 Dec 2019 14:11:06 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=FOz26bk6QbbSLAhdgF0y4WkUazWtoEmXWvrCLfHs3yZgn2Tzd2/+Xvec4nUKZVU+f/QBcrT4fwFPxT4h7qmUEtHwm3y+u+vpqToRMXiHJqrLsgyW5JWDH6V38U9Mm0NQFqwgXrf2atDVwvSiL/fOkuAZWy/lfWqY1hPW0zpKBF1PZj70QrMeJemnHm8w75QnAiMn+OJwCHJvISG8H4S827rSSBdeFbULuRsd59bRwx1Y17hFCHVvh3uZ3FVNpE63Bk10Sj8F6yiB32eRfhu6bh6ycnf4w2KSJJ7cYnEVhEE3cyO+sHmRKVg3pgpS+lSL0L8Z3S2NZDkBYGuDXQ5ZjQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1iIio9JlXzhmxWiyJumvvxxal/hAqTXJh8VZ3WlJ+PM=; b=Yum11YNXj+zSxeJFVY1xuxDtwVT++AUqkBCMaEiIGyMQXcjAzfDZ01DX99tufuhbgYtCLyEcmttkVywWmVpAgTAfvyuna9HIUYYOuCrJSw6uKPBbcKyOUoY7LrPOCiwswCSTNAuEAa6KOMLUsz47W4x3U2oCLnLvCNosTIHaR87TiIegdIi9j4/Zar1PSq6NNmpRSAoR73RFN/ILpaKa5S0xLmrCZm4M8YGubB5OMKjpPZ1BNg6XUH5BrUmpgCDQpy5pWw+DgVFu8QNrCDq+/BEOyfmyU7uHYcgoAKZ0SimU7o43oifNtGPmj26s8rf5kDTUnNrtZ+7TvCLB2DUPbA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1iIio9JlXzhmxWiyJumvvxxal/hAqTXJh8VZ3WlJ+PM=; b=b8qhYkslfrj+jlofMOO29wHWCjJs98h1nCbY/xH8ybkJNAvSKTobhFIa+sdbMG4H2nngdK1F9siVbL41cVmgFoccNNq1iAh+ronPbpDLBlt5z7w7ndKIhBFkfnY7wZ/oLLh45Z5rFESl7AjSdvrgrSi8Wg3YvdNO1Ms5x9LzHEI= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (10.167.151.152) by SN4PR0601MB3661.namprd06.prod.outlook.com (10.167.139.139) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2495.18; Wed, 4 Dec 2019 14:11:02 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::3dad:d7cf:dac4:3277]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::3dad:d7cf:dac4:3277%5]) with mapi id 15.20.2495.014; Wed, 4 Dec 2019 14:11:02 +0000 From: "Scheffenegger, Richard" To: "freebsd-transport@freebsd.org" Subject: acknow on cwr Thread-Topic: acknow on cwr Thread-Index: AdWqqzZTATkiyxP+S5KMY9Urhq3Pgg== Date: Wed, 4 Dec 2019 14:11:02 +0000 Message-ID: Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-dg-ref: =?us-ascii?Q?PG1ldGE+PGF0IG5tPSJib2R5Lmh0bWwiIHA9ImM6XHVzZXJzXHNyaWNoYXJk?= =?us-ascii?Q?XGFwcGRhdGFccm9hbWluZ1wwOWQ4NDliNi0zMmQzLTRhNDAtODVlZS02Yjg0?= =?us-ascii?Q?YmEyOWUzNWJcbXNnc1xtc2ctZTRmMzgzZDAtMTY5Zi0xMWVhLWI2MTQtMDAx?= =?us-ascii?Q?OWQyZTRlY2Q0XGFtZS10ZXN0XGU0ZjM4M2QxLTE2OWYtMTFlYS1iNjE0LTAw?= =?us-ascii?Q?MTlkMmU0ZWNkNGJvZHkuaHRtbCIgc3o9IjQ0MjIiIHQ9IjEzMjE5OTQyMjU5?= =?us-ascii?Q?NzczOTQ3NiIgaD0iRDNzcFhUWHZTaWpwYTFLMUlISlluYXBIS09VPSIgaWQ9?= =?us-ascii?Q?IiIgYmw9IjAiIGJvPSIxIiBjaT0iY0FBQUFFUkhVMVJTUlVGTkNnVUFBQ1FF?= =?us-ascii?Q?QUFEVU0zT25yS3JWQVhKZ1JKT2J5RmZuY21CRWs1dklWK2NHQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUhBQUFBQzBBd0FBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUVBQVFBQkFBQUEycGt5WlFBQUFBQUFBQUFBQUFBQUFKNEFBQUJoQUdR?= =?us-ascii?Q?QVpBQnlBR1VBY3dCekFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBRUFBQUFBQUFBQUFnQUFBQUFBbmdBQUFHTUFZd0JmQUdNQWRRQnpBSFFB?= =?us-ascii?Q?YndCdEFGOEFZUUJ1QUhrQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQVFBQUFBQUFBQUFD?= =?us-ascii?Q?QUFBQUFBQ2VBQUFBWXdCMUFITUFkQUJ2QUcwQVh3QndBR1VBY2dCekFHOEFi?= =?us-ascii?Q?Z0FBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUJBQUFBQUFBQUFBSUFBQUFBQUo0QUFBQmpB?= =?us-ascii?Q?SFVBY3dCMEFHOEFiUUJmQUhBQWFBQnZBRzRBWlFCdUFIVUFiUUJpQUdVQWNn?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFFQUFBQUFBQUFBQWdBQUFBQUFuZ0FBQUdNQWRRQnpBSFFBYndCdEFG?= =?us-ascii?Q?OEFjd0J6QUc0QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBUUFBQUFBQUFB?= =?us-ascii?Q?QUNBQUFBQUFDZUFBQUFaUUJ0QUdFQWFRQnNBRjhBWVFCa0FHUUFjZ0JsQUhN?= =?us-ascii?Q?QWN3QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFB?= =?us-ascii?Q?QUFBQUFBQUFBQUFBQUFBQUFBQUFBQkFBQUFBQUFBQUFJQUFBQUFBQT09Ii8+?= =?us-ascii?Q?PC9tZXRhPg=3D=3D?= x-originating-ip: [217.70.210.46] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: dd7cba1a-2c3a-45c0-6912-08d778c3cb63 x-ms-traffictypediagnostic: SN4PR0601MB3661: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:3826; x-forefront-prvs: 0241D5F98C x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(346002)(366004)(376002)(39860400002)(136003)(396003)(189003)(199004)(9686003)(86362001)(26005)(71200400001)(76116006)(14454004)(316002)(8676002)(5640700003)(966005)(2906002)(54896002)(66476007)(8936002)(64756008)(3480700005)(71190400001)(66446008)(66556008)(2501003)(6306002)(7696005)(7116003)(6436002)(74316002)(6116002)(99286004)(55016002)(14444005)(33656002)(6916009)(6506007)(3846002)(66946007)(102836004)(52536014)(478600001)(25786009)(5660300002)(186003)(7736002)(790700001)(2351001)(81156014)(81166006); DIR:OUT; SFP:1101; SCL:1; SRVR:SN4PR0601MB3661; H:SN4PR0601MB3728.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: nRZ8gDp/lc7mH4zolJlvgClPzl6dCMRbNA3BYe7pMVUYebRCCL8ZHeeB3ZcMyCyrPFFs5cq/Y8xrsXXSslWcwMoStI0EFCvjqzcAsKEsHYP04Kr/F7OTb/yfdi3TEg4F6khMNxsxh/PmjwTx75Uwof8A0no2aQC0qhAaWikuCEjLY2DKEi64VH8kFi411bs95lmODbSYlhbBdY6ufNiTLshcxIEhPwHoghg6rb88oDErIrSOoaw3q/YHBovTWOSqFCwJqwC8p+JyU/Iet6VyT4az0dhtiPJ7d7X131zJQsWaIRQhMewmhIOyI3OsNaqHkdRDFr8iM7BdEPwbJXTVL+joNjmVJCQI4NIPSnNUKTSFoCvHxPdb70Ru7lyf+KuvUmGeZy3ZgWYz0QVbGe5QyIB5A8iOqcEAUorlLLcN2sPA4vJhHIQwGuZ4i9hB7JkSEzB5R/cVylgqYLHRaEcvnBLQlB1lcot+6cgyt+mUdyA= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: dd7cba1a-2c3a-45c0-6912-08d778c3cb63 X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Dec 2019 14:11:02.1800 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: cndotFzupVYBx9JcQhvTlxuI6JZfSvmKeXV4U2WdG/or3G3zCnW/dbAX1nO4EkpPbINP4BtLBwlwkbDIfw8tBw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR0601MB3661 X-Rspamd-Queue-Id: 47SgkL3QhQz3NDZ X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-onmicrosoft-com header.b=b8qhYksl; dmarc=none; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.76.80 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-4.85 / 15.00]; IP_SCORE(-1.35)[ipnet: 40.64.0.0/10(-3.85), asn: 8075(-2.87), country: US(-0.05)]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-onmicrosoft-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCVD_IN_DNSWL_NONE(0.00)[80.76.107.40.list.dnswl.org : 127.0.3.0]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Dec 2019 14:11:09 -0000 Hi guys (gals?), While further looking into DCTCP bugs and oddities, I was pointed to these = two linux patches: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?= id=3D9aee40006190 https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?= id=3Dfd2123a3d7527d4c7092633d55e877c0cc1d84a3 The gist of this is as follows - and likely holds true for RFC3168 also: When a tcp sender reduces cwnd due to CE marks, it is possible to end up wi= th very small cwnd (<2 mss). When the next packet is sent, with the CWR fla= g, the receiver will often wait for another packet before sending an ACK af= ter the delack timer expires. This can effectively drive up the high-perce= ntile latency on request-response type interactions. The above was found specifically for flows using dctcp, most likely as the = cwnd in dctcp environments is more likely to collapse to very small values = - but the patch seems to be generic also for rfc3168 sessions... Any strong opinions if this fix should be specific to dctcp in fbsd, or a g= eneric ecn improvement? Note that RFC3168 is silent on this particular topic (if CWR should trigger= an immediate ACK or not). Best regards, Richard Scheffenegger From owner-freebsd-transport@freebsd.org Thu Dec 5 15:25:29 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE5771CC15A for ; Thu, 5 Dec 2019 15:25:29 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TKKh1b9Gz4K7q for ; Thu, 5 Dec 2019 15:25:27 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575559527; b=WAolVT/za15lx130vwrPCxBH2q2xMlM9KIuXi6Lo1OFJt1JP0N2NjnphqRZxLZIJmYACnv92p4 Xt/Umfyqj9WevRhyTmw0k8xqU633ovY1QLMfu4O4u2iIhm1feX73efwf/fDsePRagQcPyh9Ew3 mKc1euzVQlrlYPsWNa3REVc=; ARC-Authentication-Results: i=1; wizmail.org; iprev=pass (vgate18.wizint.net) smtp.remote-ip=2a00:1940:107::1:2f:0; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575559527; bh=E36r2uydNP3KfVCy9O01Wof1ebrhPuQDRlJNxhE+9BQ=; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Date:Message-ID:Subject: From:To:DKIM-Signature; b=pRWT+avj0UXIP3TmNse1w3meakh6ztfrlgdFyrwCmMyYcrYW2SgYbjVs3KCjIgRADqk8Ujf+Hv 1utjkm6aC8gxPnw9wer/ejzdcLq5/anDtOL5R1D8qhDJW7ZIY+UNkqsA0YxRh93VbsCv0wg8io cwuqz0b2gvxWbijwCE/2MC4=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Date: Message-ID:Subject:From:To:From:Sender:Reply-To:Subject:Date:Message-ID:To:Cc :MIME-Version:Content-Type:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=A928hk3N1r9+1KyTL93Dw7YCQsvPwYRP5XAhqmzYZsA=; b=kr5r30rrdVjyeyj1MdTVHoEg7s I4BwWi4Sgi5Q3YcOekdOMqVV8ZrtrcozmAnPwIrpPSjwsO7KfWYCadnI7MdFX5FOj98JQGTuBuyRH X2uH+5X/krXR8WQ1+ajLPrQUKokN9pybN7okcjREiITtE5u1hy2cCOsdcmcnz528yMeM=; Received: from vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1ict0Q-0000oO-Vv for freebsd-transport@freebsd.org (return-path ); Thu, 05 Dec 2019 15:25:27 +0000 To: freebsd-transport@freebsd.org From: Jeremy Harris Subject: TCP Fast Open Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> Date: Thu, 5 Dec 2019 15:25:26 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 8bit X-Pcms-Received-Sender: vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47TKKh1b9Gz4K7q X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=kr5r30rr; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-0.99)[-0.991,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 15:25:29 -0000 Hi, 12.1 kernel with TCP_RFC7413 net.inet.tcp.fastopen.server_enable: 1 net.inet.tcp.fastopen.client_enable: 1 Using code copied from https://people.freebsd.org/~pkelsey/tfo-tools/tfo-client.c I'm not seeing any TFO option on SYN. This is on a loopback connection. Also, it appears to make no difference to the success of the sendto whether or not TCP_FASTOPEN was set on the socket, adding to the confusion. What might I be doing wrong? -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Thu Dec 5 18:28:43 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 397DF1A8368 for ; Thu, 5 Dec 2019 18:28:43 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TPP70mz4z4VkL for ; Thu, 5 Dec 2019 18:28:42 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:2843:586e:a7db:468] (unknown [IPv6:2a02:8109:1140:c3d:2843:586e:a7db:468]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 4C0C372106C13; Thu, 5 Dec 2019 19:28:40 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: TCP Fast Open From: Michael Tuexen In-Reply-To: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> Date: Thu, 5 Dec 2019 19:28:12 +0100 Cc: freebsd-transport@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> To: Jeremy Harris X-Mailer: Apple Mail (2.3601.0.10) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 47TPP70mz4z4VkL X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-1.96 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-0.98)[-0.981,0]; NEURAL_HAM_LONG(-0.98)[-0.983,0]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 18:28:43 -0000 > On 5. Dec 2019, at 16:25, Jeremy Harris wrote: >=20 > Hi, >=20 > 12.1 kernel with TCP_RFC7413 > net.inet.tcp.fastopen.server_enable: 1 > net.inet.tcp.fastopen.client_enable: 1 >=20 >=20 > Using code copied from > https://people.freebsd.org/~pkelsey/tfo-tools/tfo-client.c >=20 > I'm not seeing any TFO option on SYN. This is on a loopback > connection. >=20 > Also, it appears to make no difference to the success of the > sendto whether or not TCP_FASTOPEN was set on the socket, adding to > the confusion. >=20 > What might I be doing wrong? The program works (on FreeBSD head, but I do not expect a difference to = 12.1). However, you need a server having TCP FO enabled. I would expect the TFO option being present on the first connection = attempt. If the server does not support TFO, the following attempts will not have = the option. Can you provide the output of sudo sysctl net.inet.tcp.fastopen.ccache_list after at least one attempt. On my system I see > sudo sysctl net.inet.tcp.fastopen.ccache_list net.inet.tcp.fastopen.ccache_list:=20 Local IP address Remote IP address Port MSS Disabled Cookie 127.0.0.1 127.0.0.1 80 16344 No = 4c402b8365433ca7 Whether TFO is used or not has no impact on the return value of = sendto(). Best regards Michael > --=20 > Cheers, > Jeremy > _______________________________________________ > freebsd-transport@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-transport > To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" From owner-freebsd-transport@freebsd.org Thu Dec 5 18:41:19 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 05D021A872D for ; Thu, 5 Dec 2019 18:41:19 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TPgd3P4zz4WLl for ; Thu, 5 Dec 2019 18:41:17 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575571277; b=OeRTsirFdg87bavOGEdd/nME1bDD4zvYns9weYe20heT/fBLHDy/upShxJyCW1HH7IEwyi4oQS py/FLjZp2bYKwZgUzgDer3Lx+oz+osDCkRXdwURGqQmF/jUJcOVUotYyy1w1MHfcjMKbB2UqiA 8/Hfh1xGpJZN5pZU3gLKt4w=; ARC-Authentication-Results: i=1; wizmail.org; iprev=pass (vgate18.wizint.net) smtp.remote-ip=2a00:1940:107::1:2f:0; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575571277; bh=cTDNTDrK95fRl7jxfj/WQAv7sgEyOSCMkUorlvemtFQ=; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:DKIM-Signature; b=MQ/xjmVHAb60pO9RV7nHX6EdtxDCu5xixEAL/uXLpN8pxi2rwU0cCXUxODsTmA/9zhhvvHbfhC TuRefYQm8uq7ooA9NUkgV2iV707rjVnshd1gZ/MhAH01ivbBGe14N58fDnlErgVyygKleqoxN4 wytPZHTTqDhwiOhrrfKPtpA=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Subject:From:Sender:Reply-To: Subject:Date:Message-ID:To:Cc:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=3JM+hi9YE8Apbtgxt6SKSgwcwdwywHXv5bRsQJqDObc=; b=W ahSNCfk85hiiwYB36YY0s3m+G3YZRJOEnxBFywMC57j8sHwOgZ+V2zcjiXNPEO+XI2zMSeE2LyEkL 0hWVuWeohAbrNnsnTKX53xuNt+5LEpON46ePdOxoCXsHjbpx0UHOHsrnF/YwqpCl0Dd81gC0bZ7jA 19y9B3eXnh6745w8=; Received: from vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1icw3w-0003HH-3f for freebsd-transport@freebsd.org (return-path ); Thu, 05 Dec 2019 18:41:16 +0000 Subject: Re: TCP Fast Open To: freebsd-transport@freebsd.org References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> From: Jeremy Harris Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> Date: Thu, 5 Dec 2019 18:41:15 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Pcms-Received-Sender: vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47TPgd3P4zz4WLl X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=W ahSNCf; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 18:41:19 -0000 On 05/12/2019 18:28, Michael Tuexen wrote: > sudo sysctl net.inet.tcp.fastopen.ccache_list Empty content: ----------- $ sudo sysctl net.inet.tcp.fastopen.ccache_list net.inet.tcp.fastopen.ccache_list: Local IP address Remote IP address Port MSS Disabled Cookie $ ----------- -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Thu Dec 5 19:01:29 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A9A811A8F49 for ; Thu, 5 Dec 2019 19:01:29 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TQ6x0g2nz4X9R for ; Thu, 5 Dec 2019 19:01:28 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575572488; b=UQSUjm1NXwqXlt/4gGJlalMNTZkyvzgq7KgP37Ed2gVFhS/X/8fKeN2CtEKtqUMjC0m9RoVidz zJcbZab/5lonb9cYrQS51/0jXddWFZYuOPLNAJpvqHwiXNiw3A0DxGD9Vc4qDHqe7mBY5TXSCw RgjXSPkgV2sfH5BSQyTINFY=; ARC-Authentication-Results: i=1; wizmail.org; iprev=pass (vgate18.wizint.net) smtp.remote-ip=2a00:1940:107::1:2f:0; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575572488; bh=DD6jvrrXLpNcpeGSbLjyDhbMtxrLHveZwYsY9Ct3N0Q=; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:DKIM-Signature; b=Z8nxM2r/ALJaxRcxO4PPxepbPcpdBqFtLGT92Jue18GeISO5QDHlD3EOgwHyesjTlgGtWXa9Zm G4X09y1Y5ZgKf85vL80Ehm+kVW8wheIuOhtbRKlKN+gf+Bk/NDBwkif1DjUEGSO1OWV1u36Af7 TIJ1UoC1eUOlmE39Tg+CPng=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Subject:From:Sender:Reply-To: Subject:Date:Message-ID:To:Cc:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=w5r2StoRiTbqm9Vvtrqhlbf5MHxGZDAynpwskiibjZY=; b=I 4CnKqybl1r9/mzhAphVH875teMDbG0+zdrQidAPMwcRjrK0M4jwC8QGnDw41DrekYPA+FBPpwfC9q pOL4DHApWIxFYjbPToIXPCtEAoXgJHt6ikmohRl8KZZDB1S/dyJ2riUYbgoGs/WslEMpJDSXOz/sw kF43g+3KBUd5VcMQ=; Received: from vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1icwNT-0003Wr-KB for freebsd-transport@freebsd.org (return-path ); Thu, 05 Dec 2019 19:01:27 +0000 Subject: Re: TCP Fast Open To: freebsd-transport@freebsd.org References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> From: Jeremy Harris Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: Date: Thu, 5 Dec 2019 19:01:27 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 8bit X-Pcms-Received-Sender: vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47TQ6x0g2nz4X9R X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=I 4CnKqy; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 19:01:29 -0000 On 05/12/2019 18:41, Jeremy Harris wrote: > On 05/12/2019 18:28, Michael Tuexen wrote: >> sudo sysctl net.inet.tcp.fastopen.ccache_list > > Empty content: Huh - cancel that. I re-enabled the setsockopt( TCP_FASTOPEN), and now the cookie shows up there, and in SYN options. Unsure why it wasn't there before, but never mind. Onward to looking at observability. Under linux I'm having to use getsockopt/TCP_INFO, and it doesn't quite do what I'd want... -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Thu Dec 5 19:43:38 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C73711AA4B9 for ; Thu, 5 Dec 2019 19:43:38 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TR3Z4rchz4Zv3 for ; Thu, 5 Dec 2019 19:43:38 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:ad28:4008:d34e:84f0] (unknown [IPv6:2a02:8109:1140:c3d:ad28:4008:d34e:84f0]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 195E8721BBD31; Thu, 5 Dec 2019 20:43:36 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: TCP Fast Open From: Michael Tuexen In-Reply-To: Date: Thu, 5 Dec 2019 20:43:35 +0100 Cc: freebsd-transport@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> To: Jeremy Harris X-Mailer: Apple Mail (2.3601.0.10) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 47TR3Z4rchz4Zv3 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-1.96 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-0.98)[-0.981,0]; NEURAL_HAM_LONG(-0.98)[-0.983,0]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 19:43:38 -0000 > On 5. Dec 2019, at 20:01, Jeremy Harris wrote: >=20 > On 05/12/2019 18:41, Jeremy Harris wrote: >> On 05/12/2019 18:28, Michael Tuexen wrote: >>> sudo sysctl net.inet.tcp.fastopen.ccache_list >>=20 >> Empty content: >=20 > Huh - cancel that. I re-enabled the setsockopt( TCP_FASTOPEN), > and now the cookie shows up there, and in SYN options. > Unsure why it wasn't there before, but never mind. >=20 > Onward to looking at observability. Under linux I'm having > to use getsockopt/TCP_INFO, and it doesn't quite do what I'd > want... Are you asking how to figure out whether TFO was used or not? In that case you can use=20 getsockopt(fd, IPPROTO_TCP, TCP_FASTOPEN, &on, &len); If on =3D=3D 0, TFO was not used, on !=3D 0, TFO was used. Best regards Michael > --=20 > Cheers, > Jeremy > _______________________________________________ > freebsd-transport@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-transport > To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" From owner-freebsd-transport@freebsd.org Thu Dec 5 19:58:31 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2BC811AA823 for ; Thu, 5 Dec 2019 19:58:31 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TRNj5pgBz4bHY for ; Thu, 5 Dec 2019 19:58:29 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575575909; b=UrlDFVn+BQRNpFnLKWAHuSE+Vy2dJcFRgoWquDZghokrYi7577PwFDaOsdQCw1eQtWt5qlVmBt fM1TRTeg0+H2MKFBXUxIva6BNWQlEU0XWb5tYIFXlcqQqYXw9X0teztVKR9Obz5FXqT8TFn1h1 16vh0jOlSdVw9DL1KWWVL8k=; ARC-Authentication-Results: i=1; wizmail.org; iprev=pass (vgate18.wizint.net) smtp.remote-ip=2a00:1940:107::1:2f:0; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575575909; bh=RujAYNqRGUaIw5xi1Oz1Q8vi+rtHp+tSnWqx/dVXdNM=; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:DKIM-Signature; b=w75T81kOd3StVxa7WTEdNlHpE5VUldBCtUNYndhreQWXOfjmE5RtDvMwpTO4i0Ug63nIKx3Vwd 5I8SRUt0wxQRxg3teGzHg79v8pDTrunazH3ukUSN8bGWGrs/nfozbzjw0+4GyF/oXsKVd8N8e9 Mm1McY4rdg6GsLQr41bf89A=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Subject:From:Sender:Reply-To: Subject:Date:Message-ID:To:Cc:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=iJZ4NUMwxccthmNKpV10w7UFkY7FoDAZgFE8IWaaVRo=; b=e TkC5dVCALufO679hP3FPKhyCE8H6rxCaJ0suSoOwTiM83tXSXVgSYLTwASxj4Sn6DN/DzUAe5kF2W 3GqsgkzR2kDm1Yllk3vCTaY/5GzEUnUT8CXd4emLZOiS7F4Jpvj/W8OlCZimjW9l1iSP+9vuOzcWY 08EGnNNkAbQOzmvg=; Received: from vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1icxGe-0004FF-2G for freebsd-transport@freebsd.org (return-path ); Thu, 05 Dec 2019 19:58:28 +0000 Subject: Re: TCP Fast Open To: freebsd-transport@freebsd.org References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> From: Jeremy Harris Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: Date: Thu, 5 Dec 2019 19:58:27 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Pcms-Received-Sender: vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47TRNj5pgBz4bHY X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=e TkC5dV; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 19:58:31 -0000 On 05/12/2019 19:43, Michael Tuexen wrote: > Are you asking how to figure out whether TFO was used or not? > In that case you can use > getsockopt(fd, IPPROTO_TCP, TCP_FASTOPEN, &on, &len); > If on == 0, TFO was not used, on != 0, TFO was used. I'd found that, but it's so far unclear what choices it makes among - didn't try TFO - tried TFO but the server didn't take it up - server accepted the TFO cookie, but not the data that was on the SYN - server acked the data -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Thu Dec 5 20:17:44 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BEAB91AAE6E for ; Thu, 5 Dec 2019 20:17:44 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TRpw4c83z4bts for ; Thu, 5 Dec 2019 20:17:44 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:6dcc:eed2:dd20:27f1] (unknown [IPv6:2a02:8109:1140:c3d:6dcc:eed2:dd20:27f1]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 194D47213B004; Thu, 5 Dec 2019 21:17:42 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: TCP Fast Open From: Michael Tuexen In-Reply-To: Date: Thu, 5 Dec 2019 21:17:42 +0100 Cc: freebsd-transport@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> To: Jeremy Harris X-Mailer: Apple Mail (2.3601.0.10) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 47TRpw4c83z4bts X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-1.96 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-0.98)[-0.981,0]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; NEURAL_HAM_LONG(-0.98)[-0.983,0] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 20:17:44 -0000 > On 5. Dec 2019, at 20:58, Jeremy Harris wrote: >=20 > On 05/12/2019 19:43, Michael Tuexen wrote: >> Are you asking how to figure out whether TFO was used or not? >> In that case you can use=20 >> getsockopt(fd, IPPROTO_TCP, TCP_FASTOPEN, &on, &len); >> If on =3D=3D 0, TFO was not used, on !=3D 0, TFO was used. >=20 > I'd found that, but it's so far unclear what choices it > makes among > - didn't try TFO This means it is disabled in the cookie cache or you didn't enable the = socket option. I would expect on =3D 0. > - tried TFO but the server didn't take it up I would expect on =3D 0. > - server accepted the TFO cookie, but not the data that was on the SYN I don't know. I can test it and report... > - server acked the data I would expect on =3D 1. Best regards Michael > --=20 > Cheers, > Jeremy > _______________________________________________ > freebsd-transport@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-transport > To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" From owner-freebsd-transport@freebsd.org Thu Dec 5 20:31:42 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 330421AB3EF for ; Thu, 5 Dec 2019 20:31:42 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TS713vbCz4cKK for ; Thu, 5 Dec 2019 20:31:41 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575577901; b=yPDiyBEZM6lax5ONmtxGCMn+JjrT3cKsJhJ24a223prrHi8EgjzM78NQ8OatbtTwzS+l3hi3dt HjLRoPzJDl8jlSEQNH+47+LvcfbDDxYCjVW4pfPeSyTBEaA8MWGe5btoNlsB+bE75QcKuaMv13 hniC4ScYqPRNyr1acr8Fa4U=; ARC-Authentication-Results: i=1; wizmail.org; iprev=pass (vgate18.wizint.net) smtp.remote-ip=2a00:1940:107::1:2f:0; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575577901; bh=wxEoMTzy1UdyMK9tVTpXFjU50/EMjMs3pq4Oxm1KS5Y=; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:DKIM-Signature; b=EaXZiX/pMfF1svk3HkSQNJyE/EUI98XCx2QSZ2L2y4abVbASVy+VhsYrI4Cp5hdv9tm1endARi cLcWSu+GJhNBItL2sSttuwR4xZ+Q4ZcdieIiMWgxt0FsJwa4R1W/wgk7rl5tswTZ1bXXxZmbp4 fjpgtpQdvVzjRzKPI0g7UQA=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Subject:From:Sender:Reply-To: Subject:Date:Message-ID:To:Cc:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=EkKlM5PkuXPVmdSBQ279RNLYobEFELmUHFtm7YUCHG8=; b=t 6hvhTnZk8iPv2bXl0dLISsAZg8sj8GNUTeGzcY4BtAqxIvTSE0whikOfELqU0RPCItCIwsSd/wDyy eA6wd6bWkx42r2J9oT47j2oyZAUC0JsEyQ5REll3PJ7e7J8DtaKO6BgLgQzaWR6YOtI0a2ktkkr8I 0kIwIs866rDsZw0s=; Received: from vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1icxmm-0004cI-3p for freebsd-transport@freebsd.org (return-path ); Thu, 05 Dec 2019 20:31:40 +0000 Subject: Re: TCP Fast Open To: freebsd-transport@freebsd.org References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> From: Jeremy Harris Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: <70c1649f-b3b8-3c3b-ef80-22e851461e9f@wizmail.org> Date: Thu, 5 Dec 2019 20:31:39 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Pcms-Received-Sender: vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47TS713vbCz4cKK X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=t 6hvhTn; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Dec 2019 20:31:42 -0000 On 05/12/2019 20:17, Michael Tuexen wrote: >> - tried TFO but the server didn't take it up > I would expect on = 0. Excellent; that's the most-useful one to know. >> - server accepted the TFO cookie, but not the data that was on the SYN > I don't know. I can test it and report... Many thanks. No rush on that. -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Fri Dec 6 14:23:13 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 906211CD1E0 for ; Fri, 6 Dec 2019 14:23:13 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47TvvN0Nghz4T41 for ; Fri, 6 Dec 2019 14:23:11 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575642191; b=X5aFn2cngeMtvs1Nc2b9TSAa8jnRrQdUbUiKJhaSwJVCtvYYh2as+K5F48If0UIcCnNWNscgRK Gs0tcMf4F+FN2sbGObNHVgV8LcBn9jcYVSft69E+5oupd4EQYkXOtVcETwFR57paMOg9iVeH8j CG1UkUsceKXZQl5WTkIG5W4=; ARC-Authentication-Results: i=1; wizmail.org; iprev=fail smtp.remote-ip=2a00:b900:109e:0:855c:1404:1b9d:3a94; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575642191; bh=15HqVzJkSMLji9u7Y0rCvdxZ0N3+mwuY397p7Wp+EkA=; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:DKIM-Signature; b=Jq/ZvybPdPvoPOMK1O/A54L0/wIrC5ASGYRdLoZdj5rXyfK3g27zGfXy4jT4cZjp9BVCd2xh0u 6RwvCJ+q9TCk8CM37luUlnB665q0F+KKuR/QqVr5H/ELWJF3GqpwDchhtAIehrRqiB2JRbHP3B XL8ROhpjyXOON72JtgM+lfI=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Subject:From:Sender:Reply-To: Subject:Date:Message-ID:To:Cc:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=Y1U3uaqNDApxGfWtztPHboJtgrEdIGnVIrXDP7zNlcY=; b=n nMefRjZlVoww86grWjdkCZ99hc5HYWFRyqK/JStp0JMtBokvg+NIyBq1SNWlbMUQ7bPkRTniepmvc UoQVm4LJUWtmVpjWCUzPxUiLdhA/p4HdbbRzIdwMNLiooA+9EaXkCSvTgYt0skXJc5YzqLiMRdEQi vL6WXmrV0b+Ed450=; Received: from [2a00:b900:109e:0:855c:1404:1b9d:3a94] (helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1idEVh-0008Lo-Qu for freebsd-transport@freebsd.org (return-path ); Fri, 06 Dec 2019 14:23:09 +0000 Subject: Re: TCP Fast Open To: freebsd-transport@freebsd.org References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> <70c1649f-b3b8-3c3b-ef80-22e851461e9f@wizmail.org> From: Jeremy Harris Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: <75f12c4d-63fb-40d5-8569-f8780de63521@wizmail.org> Date: Fri, 6 Dec 2019 14:23:09 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: <70c1649f-b3b8-3c3b-ef80-22e851461e9f@wizmail.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 8bit X-Pcms-Received-Sender: [2a00:b900:109e:0:855c:1404:1b9d:3a94] (helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47TvvN0Nghz4T41 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=n nMefRj; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-0.99)[-0.995,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Dec 2019 14:23:13 -0000 On 05/12/2019 20:31, Jeremy Harris wrote: > On 05/12/2019 20:17, Michael Tuexen wrote: >>> - tried TFO but the server didn't take it up >> I would expect on = 0. > > Excellent; that's the most-useful one to know. Unfortunately, it seems not to be so; it appears to be recording the sending of a TFO option (of _either_ type; so a cookie-Request still gets it set). This means I can't use it to log "TFO was actually doing something useful for this connection". The TCPOPT_FAST_OPEN bit in TCP_INFO says the same (either pre-ESTABLISHED or post-). Another problem, this time server-side. I was hoping to get the initial server output piggybacked on the SYN,ACK, given the TFO design notes in https://people.freebsd.org/~pkelsey/TFO_Design_Details.pdf - but so far I'm not getting that. Packet capture (on lo0): SYN -> (TFO=C) 0.000224 <- SYN,ACK (TFO=C same value) 0.000078 SYN,ACK -> 0.001421 <- server_data The 224us response time for the SYN,ACK looks immediate, not a delack time as I'd expect. -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Fri Dec 6 19:27:24 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 068681B412A for ; Fri, 6 Dec 2019 19:27:24 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47V2fM4kjqz3HtX for ; Fri, 6 Dec 2019 19:27:23 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:9167:1902:a052:d944] (unknown [IPv6:2a02:8109:1140:c3d:9167:1902:a052:d944]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 07C3B721E281C; Fri, 6 Dec 2019 20:27:19 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: TCP Fast Open From: Michael Tuexen In-Reply-To: <75f12c4d-63fb-40d5-8569-f8780de63521@wizmail.org> Date: Fri, 6 Dec 2019 20:26:52 +0100 Cc: freebsd-transport@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> <70c1649f-b3b8-3c3b-ef80-22e851461e9f@wizmail.org> <75f12c4d-63fb-40d5-8569-f8780de63521@wizmail.org> To: Jeremy Harris X-Mailer: Apple Mail (2.3601.0.10) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 47V2fM4kjqz3HtX X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-1.97 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-0.99)[-0.987,0]; NEURAL_HAM_LONG(-0.98)[-0.983,0]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Dec 2019 19:27:24 -0000 > On 6. Dec 2019, at 15:23, Jeremy Harris wrote: >=20 > On 05/12/2019 20:31, Jeremy Harris wrote: >> On 05/12/2019 20:17, Michael Tuexen wrote: >>>> - tried TFO but the server didn't take it up >>> I would expect on =3D 0. >>=20 >> Excellent; that's the most-useful one to know. >=20 > Unfortunately, it seems not to be so; it appears > to be recording the sending of a TFO option > (of _either_ type; so a cookie-Request still > gets it set). This means I can't use it to log > "TFO was actually doing something useful for > this connection". > The TCPOPT_FAST_OPEN bit in TCP_INFO says the same > (either pre-ESTABLISHED or post-). OK, looking up some documentation in the code: = https://svnweb.freebsd.org/base/head/sys/netinet/tcp_fastopen.c?revision=3D= 336676&view=3Dmarkup#l150 * For passively-created sockets, the TCP_FASTOPEN socket option can be * queried to determine whether the connection was established using TFO. * Note that connections that are established via a TFO SYN, but that = fall * back to using a non-TFO SYN|ACK will have the TCP_FASTOPEN socket = option * set. So this fits with what you observe. However, I think this should be = improved... I can put that on my list or you can file an issue at bugs.freebsd.org. >=20 >=20 > Another problem, this time server-side. I was hoping > to get the initial server output piggybacked on > the SYN,ACK, given the TFO design notes in > https://people.freebsd.org/~pkelsey/TFO_Design_Details.pdf >=20 > - but so far I'm not getting that. Packet capture (on lo0): > SYN -> (TFO=3DC) > 0.000224 <- SYN,ACK (TFO=3DC same value) > 0.000078 SYN,ACK -> > 0.001421 <- server_data >=20 > The 224us response time for the SYN,ACK looks immediate, not > a delack time as I'd expect. That sounds like a bug. Let me test this and I report back. Best regards Michael > --=20 > Cheers, > Jeremy > _______________________________________________ > freebsd-transport@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-transport > To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org" From owner-freebsd-transport@freebsd.org Fri Dec 6 22:32:36 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 348471B9345 for ; Fri, 6 Dec 2019 22:32:36 +0000 (UTC) (envelope-from jgh@wizmail.org) Received: from wizmail.org (wizmail.org [IPv6:2a00:1940:107::2:0:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.wizmail.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47V6m243Y6z4114 for ; Fri, 6 Dec 2019 22:32:34 +0000 (UTC) (envelope-from jgh@wizmail.org) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=wizmail.org; s=r201803; t=1575671554; b=NfFmRCYyPbCpHfHCyMf120DAesFe5voZeOZ/1tU8SjtWlGp2Duh7jHifl0Y0f2EjK+kxWWHGTt uMT3OsP8eGT4nATLJPJyo8eHqQLvmTmxaLhmkex6C/OE9O6v1I6cevTEYUuDhBM9t0N5+ZVQQZ VS9arWlGD3GcdPlzWiRjUz0=; ARC-Authentication-Results: i=1; wizmail.org; iprev=pass (vgate18.wizint.net) smtp.remote-ip=2a00:1940:107::1:2f:0; auth=pass (PLAIN) smtp.auth=jgh@wizmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=wizmail.org; s=r201803; t=1575671554; bh=4GzRL7via//0Cp74rVch2HoHW9XqwJCInNoFfiAIzus=; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:DKIM-Signature; b=GArdydXTY3tQ1CXkUUa5OBLorFbZesSlACd/qYTG90+3EU3wxBCVY6yvfl4xRLcqxxqjFjl7MP /fcX7UfZ5N4XpFycY3L/qBuGTppWiLbTQn0znVDmaPrXSAm72a22Lcp1S/uYcWnjUbcsSrBM6D ieKtMUjtmN2e9grMErLhwGw=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=wizmail.org ; s=r201803; h=Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Subject:From:Sender:Reply-To: Subject:Date:Message-ID:To:Cc:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=7Iu2LNbfnz0AeQyO/tqZyPB0DQA93zG9L3dcbgmkgYI=; b=0 FwvhQ/k91NlLyUWQ3A7rlwffpwXSHkEYENsg+gqe1tkav3qPFmtSYeAkFBQ4tIb0F84j7WzQqnZ4C gvW2K0k7i80civNmrkxFORhCOxx4aD97S6+0eibS7jiVDpl+7YKEybZjP18gEQVpThQ1aujaKNCro XPPLlcLSemT61zR8=; Received: from vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) by wizmail.org (Exim 4.92.134) (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 with esmtpsa id 1idM9J-0005pr-1x for freebsd-transport@freebsd.org (return-path ); Fri, 06 Dec 2019 22:32:33 +0000 Subject: Re: TCP Fast Open To: freebsd-transport@freebsd.org References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> <70c1649f-b3b8-3c3b-ef80-22e851461e9f@wizmail.org> <75f12c4d-63fb-40d5-8569-f8780de63521@wizmail.org> From: Jeremy Harris Autocrypt: addr=jgh@wizmail.org; prefer-encrypt=mutual; keydata= mQENBFWABsQBCADTFfb9EHGGiDel/iFzU0ag1RuoHfL/09z1y7iQlLynOAQTRRNwCWezmqpD p6zDFOf1Ldp0EdEQtUXva5g2lm3o56o+mnXrEQr11uZIcsfGIck7yV/y/17I7ApgXMPg/mcj ifOTM9C7+Ptghf3jUhj4ErYMFQLelBGEZZifnnAoHLOEAH70DENCI08PfYRRG6lZDB09nPW7 vVG8RbRUWjQyxQUWwXuq4gQohSFDqF4NE8zDHE/DgPJ/yFy+wFr2ab90DsE7vOYb42y95keK tTBp98/Y7/2xbzi8EYrXC+291dwZELMHnYLF5sO/fDcrDdwrde2cbZ+wtpJwtSYPNvVxABEB AAG0JkplcmVteSBIYXJyaXMgKG5vbmUpIDxqZ2hAd2l6bWFpbC5vcmc+iQE7BBMBAgAlAhsD BgsJCAcDAgYVCAIJCgsEFgIDAQIeAQIXgAUCVYAYBAIZAQAKCRC85YyM5B8y34iFB/9wozIY RogNdY1aejFFixb6++y4b1riyjMvWEULeEzDlQ0lMT6Z3PxXhZILD4y4aP7Kzx0ozXa5qaKy 41EAPKQoPipnRAH04QytJbIERvz8Tot/LeCVKUc0G9DVxOPBD03czTgqgz4EjV2qvnLF+rTU 0YBevrNCluKosGSd+3RvLWVu0hBhn9pELKfXJNSQXZb+TpHDhSDZ/gCrglBEOhA6YWbDb/4g z+5TFKdk+B++iAQZSHv7zISabjN+BPYgI47A+MU4JycoXaAUnMc0l5ba6fGNaIrzruE4aAZr lP5o+7mlU9Mm0QJqdqYxYPAiplJGrZv+YXH1fp5ueEK3l+NGuQENBFWABsQBCADphLHaKToR uR/E7THerBiCjDatwCaETOKOTY2zRBQpaQ32p/F2XIGLS8Cc27+grZSKQ6ZX0ZN47O+AFyFH F8DH90IXZFpJR3Rb8zgXT8jnLX08DM31eECZHnRzFhGlOmq6WAUlqB3GKCPUCY2c4eTRXyoX LteTxrXCYoj45y/YmvlZrlonBNjPBAyHiO/LNz+V7fZtNsN7N/XGrnLbcdNfNd+SD1ENmbLJ 8RvyymxguTyB/ka9JdjHHIoQEJ6L166B3hhfCHpt8iC0GPZkti9IMl0NoJ029jJm3Jq1qEce EBn5H5QMGn6Fq64iXwTsO1TMNUwpWx8pjvV7wVIxjI8ZABEBAAGJAR8EGAECAAkFAlWABsQC GwwACgkQvOWMjOQfMt9N6Af8CS2CTrMQFdhkGEtBXmL4ifD8UHFkBRBGmM8ZL2fWUBTZXT8m rdRMOK6tcPnKWaCvWvKr0knt970j/DyAgFmH8hgOi3yctigFecVDjjilAeCJMq38s1tYKYiL DbBdHWtdkA9uHZwq3lfd3QxcEEO3QamQF+dO7h8gAOXlG+po87Hm+E0wz4swIB8+S37Jzrx9 uu0LSFDfJCTK+TIKGa5Un8LxPxyq9WnnNDh72zK7BiRidk/s40KcNod83NM4Hn/sbGfyLa8s S0F3ME0S+ocSMOiu/ZHHOiwpLYNbwTJ7stZxGsrguWeT9P+amxbA/YlK95LedstwvN+WcHZ7 d++Arg== Message-ID: Date: Fri, 6 Dec 2019 22:32:32 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Pcms-Received-Sender: vgate18.wizint.net ([2a00:1940:107::1:2f:0] helo=lap.dom.ain) with esmtpsa X-Rspamd-Queue-Id: 47V6m243Y6z4114 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=wizmail.org header.s=r201803 header.b=0 FwvhQ/; dmarc=none; spf=none (mx1.freebsd.org: domain of jgh@wizmail.org has no SPF policy when checking 2a00:1940:107::2:0:0) smtp.mailfrom=jgh@wizmail.org X-Spamd-Result: default: False [-3.31 / 15.00]; IP_SCORE(-0.02)[country: GB(-0.08)]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; R_DKIM_ALLOW(-0.20)[wizmail.org:s=r201803]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[wizmail.org]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[wizmail.org:+]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16353, ipnet:2a00:1940::/32, country:GB]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Dec 2019 22:32:36 -0000 On 06/12/2019 19:26, Michael Tuexen wrote: > So this fits with what you observe. However, I think this should be improved... > I can put that on my list or you can file an issue at bugs.freebsd.org. raised https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=242492 -- Cheers, Jeremy From owner-freebsd-transport@freebsd.org Sat Dec 7 00:09:50 2019 Return-Path: Delivered-To: freebsd-transport@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 49E2B1BC6FE for ; Sat, 7 Dec 2019 00:09:50 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47V8wF6wC4z47T5 for ; Sat, 7 Dec 2019 00:09:49 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:2985:5784:1ff9:2059] (unknown [IPv6:2a02:8109:1140:c3d:2985:5784:1ff9:2059]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 3E060721E281E; Sat, 7 Dec 2019 01:09:46 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: TCP Fast Open From: Michael Tuexen In-Reply-To: Date: Sat, 7 Dec 2019 01:09:17 +0100 Cc: freebsd-transport@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <3442F273-60E1-4EDC-AACA-7FD1FB4A668B@freebsd.org> References: <5276cc23-d37f-e55e-11c5-030314e9e32c@wizmail.org> <1206B1BE-3B7E-45D0-8C2B-6012A5CB6298@freebsd.org> <2752006b-cd6b-7b8b-d23b-ae2c794dc104@wizmail.org> <46A739DC-CCF5-4EA1-802A-0D8E559AC187@freebsd.org> <70c1649f-b3b8-3c3b-ef80-22e851461e9f@wizmail.org> <75f12c4d-63fb-40d5-8569-f8780de63521@wizmail.org> To: Jeremy Harris X-Mailer: Apple Mail (2.3601.0.10) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 47V8wF6wC4z47T5 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-1.97 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-0.99)[-0.987,0]; NEURAL_HAM_LONG(-0.98)[-0.983,0]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-transport@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions of transport level network protocols in FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Dec 2019 00:09:50 -0000 > On 6. Dec 2019, at 23:32, Jeremy Harris wrote: >=20 > On 06/12/2019 19:26, Michael Tuexen wrote: >> So this fits with what you observe. However, I think this should be = improved... >> I can put that on my list or you can file an issue at = bugs.freebsd.org. >=20 > raised > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D242492 Thanks a lot. I assigned it to me... Best regards Michael >=20 > --=20 > Cheers, > Jeremy > _______________________________________________ > freebsd-transport@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-transport > To unsubscribe, send any mail to = "freebsd-transport-unsubscribe@freebsd.org"