From nobody Sat Oct 9 22:27:53 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BB8F417F6E35 for ; Sat, 9 Oct 2021 22:28:01 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670085.outbound.protection.outlook.com [40.107.67.85]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HRfp852xdz4t4r for ; Sat, 9 Oct 2021 22:28:00 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lGU9805oGoo+g/Lpi++QouOnDDsUi65wSYs0HAKsB/CUmt/tWogvlFN5j6Eg8vbBVaRZLC6Wd24JmrYKHWbWMZK9IndqXgGFEy2eB5RIofWw9rhzdtj46tFq10f2Mp72dqhwkvmpRTXXTSV+fZBTqmPXdTwKRLX1yrfYCO1RdO4VLUTA/2TwrLNdHotM4RbRfGf9C5ePZ+wEkC3o4kNYIuL6T1u+7/tTMxn/7T3GwBOdG3oJG2bPWi1J4rSHuZA4lBkNn+Iz+PNK/d456SsvesS86FVcVOiXRN2SlakJu2uD2bQ3IXpVfXMvDOPAS9OYadMfMKa3mhodj8EMLxs83A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zzkeDZiN83FO7gxvy9V/g8ETJgh64Ff7O8W0JOdrhTw=; b=Uo+02ca3HRsVxfPIOladqlXDI/hBDolVBktm8TtwN3RN4TurEy++H/+Vq3SfWPHjUTu/wNcYj/VFuRs0RmVWxl3FZhwzeOSF5MFwwcuqTtfvuzcg9oWKx2gTXst1P7kaOAAlZu04SR/TVJG6cY9WMDyk8kwv8CkUc6WJ2nXHdfUGCHSc6YwR3WRYpLvizzTvXMA6VfBqzh2O1rHoK7TJ9+FPv6jw2ry747WQPQ/tXElw5vK5yC7UGuKbUNPrCgS2HNW22ZyOeZ06yt8t3GbJzM7zm5zYSfsuJrk7D5CDxrdOXjEFGC0QwDjs3YBTbEw7LQ4K9JlL8KK7A34wMNUzEg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=zzkeDZiN83FO7gxvy9V/g8ETJgh64Ff7O8W0JOdrhTw=; b=TxhrEFZyjBAhtpnqgUQDj4nmO9dU8LKJNLvJbWKDQaYY1knJ0qjmoVXNWRAoiZSpwl10IOfDVyCc0kVKOZdYPcdTNFsa3S9UyhczGlat1Kj5ng50J4QG8E61J+pHJPMWLih3ywIAqoWxaV3w3zHnmqQn4bPpqUcTV/2yoS3l7+6L54zNHfHGpSgDddIfpQ6k5weh4xVOmZEn0ydumOeEuDut7FeoAbyq5oJcLJBbl5EigvcIeJMQ/mpm77WDX7YA6yijAQpY1B67mcAXkq4y92nFl+L4aB4VP9ARhRazAP/dEdjj2/5FjHho5q0cCIsE11jHfQ435RQgRmBg7/bPdQ== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQBPR0101MB6489.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:48::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.22; Sat, 9 Oct 2021 22:27:53 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12%5]) with mapi id 15.20.4587.024; Sat, 9 Oct 2021 22:27:53 +0000 From: Rick Macklem To: "freebsd-current@freebsd.org" Subject: Re: Writing large build logs to NFS extremely slow? Thread-Topic: Writing large build logs to NFS extremely slow? Thread-Index: AQHXvRjIhXhFzFqRLESM9Us/FueWtqvKyjubgAAGXICAAAQr+YAAA4KvgABmJrg= Date: Sat, 9 Oct 2021 22:27:53 +0000 Message-ID: References: <20211007021643.bwglyvrswk2nm3fl@nexus.home.palmen-it.de> <20211009141852.3cmjh7tysnehum7b@nexus.home.palmen-it.de> <20211009155033.fckg4i7zqo4yt2te@nexus.home.palmen-it.de> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 9807a5e2-285a-5f0c-1e6a-ee472d85c5d3 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 9e68998f-3928-4a50-cfa7-08d98b740903 x-ms-traffictypediagnostic: YQBPR0101MB6489: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: N0VyJ7jyFVHId0bX+SR+2nXeXw6w2i5hFuOqbfWDBjnwrgIsMvNCEuL0S07DhKjDHBB4izziOvD/mq4oeh0+q1elsR1veLtQ8No58J6o6P+c2+zMrDDj9ts8NIStc/PUkxl7bE77B5EfQL/NaIGA278BpL6Jsirz3keZO+c8Sl3zqASD78w6Tf79ccP8/v/rX45Eh13bW5NpFAoOY1TlVf5H8FdaiRTTVzG7utYcJy0KIsmhY9Dj1xsw/GuGo3ZRbP7+Q/cDklxzogy2JcAwLWvFJl/sgFDIql3aU1DS/9awAOLT0Fss0pf/loLV60PVjfrRuSntJFuSBVDIvLtYnmpNNPQuY8B46oTQ6qv7yZ8j3nOOlGT0OkW6J82PX69+TuBSvKNOeDX88voMkEimCXLqgC1CvVvDcQF4OJFW+8lrbCnV00AIs06Hhj5xMhqbU14WzswLy9Qm02ip7djDx7G0QQuxQjxa3Q1DIIE8gnoy1djfSXCFUxoaRIjOSEuaQzttWOI60c3LjCRwuP1rfl3lTtqVsLuGIh6D98foyqIgvuMoQbBLCdEiu1s9tzHJxwSG0hYHZ65+sxPc+BPHsl4HffwRDqtlnezZhhZJFeohQTrX0oXv2/7GfdgWgVct7OhsAXt+Iu/Yhfj5hMTAMPQnGng7nq0+eNfaHz6fxSWsCgauh/yD+/SIr6lCbSK9DDBzeE8/bmRdbn9nTLu/g/S7TI8fJkplnCD+wggujKGCCS7Sivj3zUr4GpP8io5oz2k9doa4qQDJkl00TsJ7Rd55ZuPIv/GApIX2mHBV1MQ= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(366004)(91956017)(33656002)(76116006)(83380400001)(66556008)(64756008)(66446008)(66946007)(7696005)(66476007)(6916009)(122000001)(38100700002)(38070700005)(2940100002)(2906002)(508600001)(9686003)(86362001)(8676002)(8936002)(55016002)(52536014)(6506007)(966005)(5660300002)(186003)(71200400001)(316002)(786003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?sbESGNNZAfpyTsR94rc+iM1XOGEPKrSaQg6KU2W2i/MPO8KrkgS6Ivjltp?= =?iso-8859-1?Q?MujaA0+143V+mKPv7OtJcJkdodErfvSs/m4rt/F9kKk7F1B2GjP6iiWX5p?= =?iso-8859-1?Q?tQhbI5A91llFCmlx/v8E2HaVS9yywYijep1wKZ7Al33pjePHK9qb9DpXYh?= =?iso-8859-1?Q?mrfFiUij7lS7CY2jHyMpA1q/0Ty98wraZg7Il28vbJYTZ6GjkHO20lOosv?= =?iso-8859-1?Q?cgavJX8d4iLhsHp+fE409BeNYAkQpSOcsjImwQYUneHRfBE0/zCNNKuq8r?= =?iso-8859-1?Q?B/zJRFGG1HICnRIwWJQ4mABczK5OCXXSkDzpT6yy4clFWVNTc5E7sGjvJn?= =?iso-8859-1?Q?iveM7+fAQOWwjldo7ite5ij/7GjDuRrAI0WcsWH83VzhTK3AcT0yfKQJmA?= =?iso-8859-1?Q?7OtgbTf6qap1cndFKyJoAFdau82XTZm3Fv6eG1hdVHkd68pvttWpKvks5z?= =?iso-8859-1?Q?tSfgyo7Yw1dSLlp2QktbbdksGvalPNPIVY7wDoXj5hNurczFbW9CFmnOY0?= =?iso-8859-1?Q?R+/8fazosdmhbnatvzZ7u/AmMoXgS6McQ2TU2wZkmuqZrHAd1nvNruCFVB?= =?iso-8859-1?Q?V3NgNkovIwuPULp3V1eu/TECbq5G38NM3lmMJc4COSgeV9QiZhN8fliZ5p?= =?iso-8859-1?Q?EFgBZv6hxXWdbcRhSkOTdqJy40DNAg2UMdPAmCjKCuY26N/sfksQWa6odZ?= =?iso-8859-1?Q?R8NArj3Gwdle7q6tkEDpLtpjAXWj376XHrT8eWeak+nAnPsOfnkTlSQsDg?= =?iso-8859-1?Q?gO7osANakQbF1J9h4wDksU0MJQfh05bBcsjaPnDvhBYgstdZAqEUq5kP5C?= =?iso-8859-1?Q?vpRekOBPm4thDu70WdOxavh6/VmBO6ePMF3kschZrmpENEv8TDDjXRr1Dh?= =?iso-8859-1?Q?i+Kej5dlBJRKFhGbRSWAmgQ/lFS0Et0IcvZj7ybV/9P3fFxcA4yKG8LD2m?= =?iso-8859-1?Q?+bI3WfUEoURYlWNDpyQtRLpvBpy5CoA+dDcKW5x3PfjT3F0QEUSKvLikmL?= =?iso-8859-1?Q?/URnqbULeOV6xAsyLLGSp7mPQx3QXHB2KKQJZ4g9KT7kMUlmKwZWGHR1ms?= =?iso-8859-1?Q?WgbSUNsbhEIhAHyHUp1J7iNhJDo/uXd3U7gSRHd9YxdXxMnF0v8LALpbsf?= =?iso-8859-1?Q?gOw9Jrc1LbJP4pkoYqOAi84aJij6ykYsmEdroH4RKfgBg4qYMLxTWVP9X4?= =?iso-8859-1?Q?5Mjwi10rG8nmvYzjJULsbYf2ZFeAY/w99Sv0V71TvcWumlJHlAsKHM7lyw?= =?iso-8859-1?Q?HAKUMfOzZ5C6A56pId6OzYrExe7VyCpIe8JEKKOC/jl5XNPNWa03RIZzUO?= =?iso-8859-1?Q?G7SiFieCei2oXYfi+k63NRYWtgSy7rLUI8VSlYUI2wndMYHGICzOh8+HLD?= =?iso-8859-1?Q?vpYE0XVRXJXdEEK9YL1diphf+ZIXA6Z40Mf2yCMWKRTayiR4CFyx28H/tD?= =?iso-8859-1?Q?RvR4iISrXkwXNb57?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 9e68998f-3928-4a50-cfa7-08d98b740903 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Oct 2021 22:27:53.2398 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Qqz0Jhh2EfqyUT3UgeMMRTiZ8EkxMQ/wAOgKVVPCHc3Dqza90JyXcymu8eKgzooWrgq60pTJwD+P/MFLXeEpLw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB6489 X-Rspamd-Queue-Id: 4HRfp852xdz4t4r X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=TxhrEFZy; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.67.85 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.67.85:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.67.85:from] X-ThisMailContainsUnwantedMimeParts: N Rick Macklem wrote:=0A= ?Felix Palmen wrote:=0A= [stuff snipped]=0A= >>Ok, thanks for the insight here! So maybe, I could have a look at=0A= >>poudriere's code? If I understand you correctly, keeping the file open=0A= >>and just issuing more write() calls wouldn't trigger that problem?=0A= >Nope, I don't think keeping the file open would help much.=0A= >However, if the file is opened with O_DIRECT, you could try setting=0A= ># sysctl vfs.nfs.nfs_directio_enable=3D1=0A= >in the NFS client machine.=0A= Oops, my bad..I for some reason was thinking you were using an NFSv3=0A= mount, but you didn't say. For NFSv4, repeated open/close of the same=0A= file will result in significant overhead. The official remedy for this woul= d=0A= be enabling delegations, but there were some significant issues with using= =0A= them that were only fixed recently, so you need a really up to date system= =0A= if you are going to enable delegations on the NFSv4 server.=0A= =0A= rick=0A= =0A= rick=0A= =0A= > You could try the "nocto" mount option, which might help, if the log file= =0A= > is being re-opened many times, but I doubt it will help.=0A= =0A= Well, I take any suggestion, so will try that as well and report back,=0A= thanks again!=0A= =0A= Side note, please don't CC/To me, I'm subscribed the list ;)=0A= =0A= --=0A= Dipl.-Inform. Felix Palmen ,.//..........=0A= {web} http://palmen-it.de {jabber} [see email] ,//palmen-it.de=0A= {pgp public key} http://palmen-it.de/pub.txt // """""""""""=0A= {pgp fingerprint} A891 3D55 5F2E 3A74 3965 B997 3EF2 8B0A BC02 DA2A=0A= =0A= =0A=