From nobody Sat Oct 9 16:09:52 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F215A17E92B3 for ; Sat, 9 Oct 2021 16:09:59 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660059.outbound.protection.outlook.com [40.107.66.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HRVPz5Bjwz3QX8 for ; Sat, 9 Oct 2021 16:09:59 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TU91XMtZqbGdeEX8E773+wJEP3geB9qjzYxITzyRJpUkBkPRy7T0dIOogJsvK72yU8ZrB82IsGf/tkfkoiVLZBL4WFHicPcEQ8heb96ka9DMOJKfmO9laLxQBlF/8PqswvvyHH+eKyyc2gobGd78D1wb7Eq76EQ6+jwP9nsie1NBktl30pvRnSQUgmQb1JOZ66ktaOkb9n0HHr2071iyAZgfHFrUqzoaZsh1lvYvG26Jm2qvav7z+FWC7x77TPmZUUxwAPQFl7qEfzK7bLRfF+dHosbG1ymJo2Vu09Qpa1DzJAwXq53g4ndM9tY9jCOp42fBvNH9wTzOhW4yIPhD6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=s8jLoPe0HQuQj/i519e0Dx8diGPbCJg6++a1Ep4Y4gc=; b=MWqYe+EHu+6He+CUCrWvuEhfjKFFLb5W4Q5n+Dlg7kzW2ESkJcv5vsRjhdsDz31qkLMz9BPh1TlzNhA6lPauU2u+CcSAchdS3UpsF5AmR0aC33ctOKo5y5ulphlJaLIhB94MylbSM1ggofoTegtYPAxhZeFqQfw+LU8mdjLbhBJ2MoBNCm2BhTMDxa7rCrhPKn5PQLvvJcEpZwefIIZzThG7qQhBWj00S/woNifXljiMNEpBGNMNNL4i5BVGroNpN9sOC/2MErVOQ/825w7/H+IoHqOQ2gpbWiGR6JGRcuuW84MiMWSu2OUtx/wBWRnPkoo+2v2YuP0coSMsuWEfMA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=s8jLoPe0HQuQj/i519e0Dx8diGPbCJg6++a1Ep4Y4gc=; b=AElXxkh2hVVeZigzHlyufyUk2c761xNCpF8bWBxHLTVHWs4ilYadtwJT0T4TIDbTYR/xDcyUdHQS0NQ+sFy3WoOqc3Mf4xnUxyQO5EHJffSRCDBWPcccTv4r6xnZx7ehJAh06SacGUmwWCeOdfMKHqKuRPoO8UVVo8X38mZa5XR4lh/JR0stmgXN3CDSj46mH6O1ykqXcjJWBZhYcdqhVnQzXeajEd1vyzuhCeaNF901qCn2hc5q1rkqwoCE7CEghAaRhzsB2xbRfJYaiaP/JU1+NNiCjxqF62eEoirH3il9eX4rJL66kX0A4TGVW/zPMWmqRDjzlVECA8fAEWqEhg== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR01MB2711.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:45::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.22; Sat, 9 Oct 2021 16:09:52 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12%5]) with mapi id 15.20.4587.024; Sat, 9 Oct 2021 16:09:52 +0000 From: Rick Macklem To: Felix Palmen , "freebsd-current@freebsd.org" Subject: Re: Writing large build logs to NFS extremely slow? Thread-Topic: Writing large build logs to NFS extremely slow? Thread-Index: AQHXvRjIhXhFzFqRLESM9Us/FueWtqvKyjubgAAGXICAAAQr+Q== Date: Sat, 9 Oct 2021 16:09:52 +0000 Message-ID: References: <20211007021643.bwglyvrswk2nm3fl@nexus.home.palmen-it.de> <20211009141852.3cmjh7tysnehum7b@nexus.home.palmen-it.de> <20211009155033.fckg4i7zqo4yt2te@nexus.home.palmen-it.de> In-Reply-To: <20211009155033.fckg4i7zqo4yt2te@nexus.home.palmen-it.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 7cf544d2-f350-9973-95e2-db64a6ab6136 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: eecd1837-7cd5-474d-5654-08d98b3f3a45 x-ms-traffictypediagnostic: YQXPR01MB2711: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: PPK9uIaj1W6tfV+Eacie+rM1WSOOqsibxyeTuhwaNwG55XQklH48JptdVkvcqn6HiP9je1Vq4vLx4NvKY6pMbEZhEnP/B4UKY9KCwEG9fRkVDZ+9PGpXEl1XpediS8la0QTnf9LWl6lKSxCPXyD5ArLf5fac52afI+OZUgQTdEdHGEuMUWQBxnihg0N7Qe0iCLRcDTCCohiQiPuqDRflnpan/59B/kdFgGLfwuGTWpn7vSZ7wRlxLS5pg+jCY72Nw+J40ijPPC34zjmLs94M53zAsSrBvfEPGjeNovy3lxLmYeHpwjjOUcO1wTsw8fObunWc3dIvnouYfdhATEwVj99hTINy0E69jCndKbLqvXKr1bjOmTFWIby2R7rcCi6lGmJ6SRhh5mPteoOEaUcN9dX8vUubG4l9JrsokbcBJVWDIDzyicX3ZOwYMyrB/AXQPXUTOck2ClIj6faPGNZU41ijUzatSEgcw/bOjTK/oTcVyHacYvERagbSMWaxfgGYuBDQKUhZQ5EMAEYt3hfr5Kjdm5o8nTIsVAHucERAV5ZFg+nMEBnhpSvcHTZPBh+3JyQm4oIRLQpSbti0JIbO+HXx9GstaRQHWjmHlR1B4C+W9R49wbr9/MEchiQL1pSLzTT7+u8EYTfb4Quh0NGxlrJawGK5LJnTNVCWBCF4BVA+blKX0pPaV0uekYdOiWkhRtiUcSp2lDd87DHMRss+uyDJgN8ZLVp2DJD1+UcwzseOyc31TVJsN73GO+ZObFAQ5QESWeHGlBNHgmCBw++kLSpTHD3ec4Ra/mM0QPyXBGg= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(366004)(7696005)(38100700002)(6506007)(5660300002)(83380400001)(8676002)(110136005)(8936002)(508600001)(316002)(786003)(9686003)(33656002)(2906002)(122000001)(966005)(71200400001)(55016002)(186003)(66556008)(66476007)(64756008)(66446008)(52536014)(86362001)(38070700005)(76116006)(66946007)(91956017);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?p7bbIJN5FRI608VZoUzn7rsLIEz+ZTapRSelviEVH9QGINpawOhv1FaM?= =?Windows-1252?Q?YhWOeHv7thaHznmS4ZBS9tJGrj3Tq3EUDj5ArB4kFXdNUhR55n+HFFCz?= =?Windows-1252?Q?2xkpXUNK8usHJ+0LewzBMY6hTHeqgDM0Ik+rXtLWOvL0DqnbGZr3pPVO?= =?Windows-1252?Q?ZLMedlqG++Mj/9a4MJNy7StyzCAwRhuXRAQxGfUr8h0hd15RKScIqHYF?= =?Windows-1252?Q?ezrQeuVEr8qxYESR2Jg8WxNe9X6IHjD4oCNA9o9VnUThC9gfmNrLZfHn?= =?Windows-1252?Q?kRYaWHsOXbM+9pdQRaWrSt8ebxyEE2E87ngLNIuSVkepdzUkzH1dR0CE?= =?Windows-1252?Q?wsH88XMx5SHaEPlYdY+ER74twrcjcRqhVoBMmfi22a/RAd444glrfaw3?= =?Windows-1252?Q?WcUafGZhdnyw3g0JuMboeHCBtnLriZKjPzK7n7v8OlLNqOF8H2KhZ1hS?= =?Windows-1252?Q?d3LtNBJpPd6KezDah6bLOZpLQSgCXkT85ePpGha9wijbkifX+jlohDYH?= =?Windows-1252?Q?d8O6U1eRGcMxuLGyKTQcpxsbhOdUFht0ZwjicqEpl+sTz1kyT4BhtPGj?= =?Windows-1252?Q?dEef4wLOCOa2vyGUJKH0oRZnOuBt0remxF0BOp2nA3kztlwd5vjoY1qP?= =?Windows-1252?Q?BUEUGXyGrE4LftqtBOUb2WUmG/YH6zARTeZ1MJU0INd6GhH4psKr1Rnx?= =?Windows-1252?Q?rE+fF/LSg0fH+qPYvl+laG200bsMjC5yOR3Wsi7mkaCzSqlrXhs5pZ+y?= =?Windows-1252?Q?6GHEExoedo2+D2Mj6Dh12w009rFp1JU+A566M1iiO/VdImNUmIAfzjK6?= =?Windows-1252?Q?xlSu5TPaYUcNzfMbO6Squayu6GEPE1fWoS2IY9lFOHoP6oyDgm/u/BwD?= =?Windows-1252?Q?TWE0ZachryHV7IN+P9CF2n0Zp9UI65vpeJ+e09olOQZOYkIfTW9qqxSg?= =?Windows-1252?Q?YbP5k2KAZwEbLRit+8rHeFUw1pfiWq4dWRnpczy9lEzIV735d+I6G5Li?= =?Windows-1252?Q?j7kRmnTjAigvm2edKm4FmDcAYz3HN51RxU5DFjbQynqRJWNYSjg3jrHw?= =?Windows-1252?Q?DMCnoHHdpB1mp+OEFSljKL96XdLXIaOChzGlPJx0G4Hkws6HZZ4Y1iw7?= =?Windows-1252?Q?2INXFxoQvOqER6wzX6s+8WFndAqemOo6eqrwdZFrZVFf9Ri9UeHNgjAY?= =?Windows-1252?Q?o4hMdIdRHbsLWC38OGzRx2ZVHXZJd5OOdEFsZEDF/yVzW8F/3G70xFLC?= =?Windows-1252?Q?wLPbVgs9Ec1YLY3cA1ounHjnofV4ilJyY6STs8rGFOVNMf2JKkpOAunF?= =?Windows-1252?Q?51lCraG6CSQn2kSl+WscHEawsv3I+SSRmj6N0fO6TKwGNu5O/vYHmBsR?= =?Windows-1252?Q?De+M0otXz6sDg7ZQRW8Eu5i0ax1AxS62nEUspUl9j3s1SUgZuj1hj+ha?= =?Windows-1252?Q?3fCMOdeIZ9ggrq9HWR5+dxFwb5eMoV/EGxEFjnTPIJcls5zQy1sqtuOE?= =?Windows-1252?Q?FnGxkt5m?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: eecd1837-7cd5-474d-5654-08d98b3f3a45 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Oct 2021 16:09:52.4709 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 3eT+T2c27KhXMWdGTzhjhe4WBKjP3xDHBRc3mHk057MyLFEcIuNevBxzN0hlA+P/x7Pxi9UioodEgT/cv6a79g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB2711 X-Rspamd-Queue-Id: 4HRVPz5Bjwz3QX8 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N Felix Palmen wrote:=0A= >* Rick Macklem [20211009 15:35]:=0A= >> Felix Palmen wrote:=0A= >> Assuming your NFS performance is acceptable for other things and it=0A= >> is only this log file that is a problem, then I doubt there is much you= =0A= >> can do to improve it.=0A= >=0A= >Yes, that's the only problem I found so far=85=0A= Another thing you could try is turning off synchronous writing at the NFS s= erver.=0A= # sysctl vfs.nfsd.async=3D1=0A= and "sync=3Ddisabled" for ZFS if it is a ZFS file system that is exported.= =0A= =0A= However, BE FORWARNED:=0A= Doing so violates the NFS RFCs because it can result is data loss/corrupted= files=0A= that are being written when the NFS server crashes/reboots.=0A= Only do it if the data being written to the NFS server is not particularly = important stuff.=0A= =0A= rick=0A= =0A= > --> Append (as in O_APPEND opens) are a poor case for NFS, since there=0A= > is no append write in NFS. To approximate append write, it must flu= sh=0A= > all dirty data to the server, do a Getattr to find out the file's c= urrent=0A= > size and then do the write (over and over and over again).=0A= =0A= Ok, thanks for the insight here! So maybe, I could have a look at=0A= poudriere's code? If I understand you correctly, keeping the file open=0A= and just issuing more write() calls wouldn't trigger that problem?=0A= =0A= > You could try the "nocto" mount option, which might help, if the log file= =0A= > is being re-opened many times, but I doubt it will help.=0A= =0A= Well, I take any suggestion, so will try that as well and report back,=0A= thanks again!=0A= =0A= Side note, please don't CC/To me, I'm subscribed the list ;)=0A= =0A= --=0A= Dipl.-Inform. Felix Palmen ,.//..........=0A= {web} http://palmen-it.de {jabber} [see email] ,//palmen-it.de=0A= {pgp public key} http://palmen-it.de/pub.txt // """""""""""=0A= {pgp fingerprint} A891 3D55 5F2E 3A74 3965 B997 3EF2 8B0A BC02 DA2A=0A=