From nobody Sat Oct 9 16:21:35 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E3BCA17EB28E for ; Sat, 9 Oct 2021 16:21:43 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660072.outbound.protection.outlook.com [40.107.66.72]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HRVgV6BlBz3hn5 for ; Sat, 9 Oct 2021 16:21:42 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BnHSKvLNkPBwuBLsdBIpYRjB0687WPyIW04U9Iph5W+D5IhA+1+vgTExFVuhG9ThQ6swGgvwE4aqEEKw4eGwBZSH52sic/A+yv5riQPpuf2vgxuMg+uPdViQR5d/+hPeu7EitUCBa7VtmLKOdJSOzb33LvvwCrgtCmCLSfDh5yehCLv31xSbV1kDrQ3Pwz0DQID5XUvgRQILQi4T7127xWcty6B2kCE3nYsM4QK5jkATgveGxHrUnHWLtcysB33QT4dRUNuTpAL7oMEAvnFfKYbad6lFzwzsqC20AtnQN+yO126zMt2VikBqsfMh33AVcmkwQxVNVGoYySvnLJdKZg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=CTbBPegpMJDAsvIfE3RTjzKGgcrM3mMPintCHQoL2JA=; b=HTPkiosuN61CCqLVKnJ88kPs5gIdDWX19ESQKnVobZNOas2AFesUMZQVnpHHyvw9zrB8bj80JyCp09a17JJjpEkC9ge8kTW4aiZcHAbvZH40bv5lXYU6mQ7bGquiCwLtW/aHdQ+GaN4tmpOeslfppJ195WhbA4K4R+sPkCBIqf+tsAimfgIw7YHn9Ztiwjas530DZjnV+mz17QQZbq8ZUX0hbzsuzDjZPJRyF+dDHGBRZpwt6X50rumIfzFOx4JRnoUKwq75VIIjhl+poW65DFp7EZdF8VqbJ/KUGCkspm3GfjYHBTdlqJuKfusch9jFsP7ZN4XDCs03rWCauGMfgw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=CTbBPegpMJDAsvIfE3RTjzKGgcrM3mMPintCHQoL2JA=; b=c0xls1684k5gznIAyR6jPrzQ/8w8aW5nWNqHOp4FMWtWFMApNBoR63532HSXXOjZa9q8dl8XoBxFrljWlabBj9ZB6piS+bF59dX7myBKbGrAOcMYXEPk+bIKnskrqfvEg3QhmFxLqyp8825zjl6MkZ0+z1kODIZ3EAx8W9UMtIJfI+5h2TBuNYCI8TwSNS1WQEREeAHwjpxlT1KG/KykI4GI4LTSWrilse/2Ifae3yQAL3JAWza+R1f3E1U3ZYR7ZlQQZlJ3ECu9rOJtAW7bZDCcCUgDsIHSnwAT2GPYmdLMzAEoXhmgAuyTjZUuhVTdY9NARe8NDo9m4s/iiaeL0g== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQBPR0101MB4888.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:23::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.19; Sat, 9 Oct 2021 16:21:35 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12%5]) with mapi id 15.20.4587.024; Sat, 9 Oct 2021 16:21:35 +0000 From: Rick Macklem To: Felix Palmen , "freebsd-current@freebsd.org" Subject: Re: Writing large build logs to NFS extremely slow? Thread-Topic: Writing large build logs to NFS extremely slow? Thread-Index: AQHXvRjIhXhFzFqRLESM9Us/FueWtqvKyjubgAAGXICAAAQr+YAAA4Kv Date: Sat, 9 Oct 2021 16:21:35 +0000 Message-ID: References: <20211007021643.bwglyvrswk2nm3fl@nexus.home.palmen-it.de> <20211009141852.3cmjh7tysnehum7b@nexus.home.palmen-it.de> <20211009155033.fckg4i7zqo4yt2te@nexus.home.palmen-it.de> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 1e332fc8-1705-dca3-5459-10f6e715a7cb x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 7a2116bf-a9a6-4cc3-fbe9-08d98b40dd06 x-ms-traffictypediagnostic: YQBPR0101MB4888: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:7691; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: WsW6qpGQ8WUn/A+Cd0nYjKBPDkhkZtrIoNo6dFz4wXlLXb667vs+CcRnZa+xkikGPVwy6rnEn4ezYdidlmISnBrqlEQpxMT9qTuBq66k2Yo8IgJKgMFziYbylvIhpiv2ToMbJUGwRqVBUjL2pKYfDY6J3e1aiDam5/dX80zIs6ErPxRWD2SqsCfNhO4e41DUbCM7ivU1pspVJy3HOfe5ITJsdHS9yPbz8HzP9Hn7HoVYWe2/pkbteb2Du/SnM+vgHFeRz0QiLR5GRbpYk6A7GO+7Kv8ewAg4M9u55271q+LR1VNwB/31Z6r9umuyZAest5K5WVhytaQqjOP9LkoX2aLTmefq/yciDe1gQEcdAzPi2wZMKRQL13fIsVEJ2xX8Jpmetyvu6Mnvs73HgxbryClzmILgmu4KJGligW1vokINxC9C5FdKZSPVpPVB2zeoA7Jgtd+vKOajJYv/T2uw3ZoTbWJ5rG0FduNxPR2A2UFNqTfPMW2H0BBDIi2/w3lB2LuRMRKttQXDKtdAoUSHGFoR37AV0sW+G9gUdqM/v9TU/SFTaszJtCY4ajnkuY23j7R85BN5mF8C9XSEDekpOurXo03VM4phCgpG9Z67QmV5tCGlCsLRS4lpaszYRff8OdRyizlUYjsis5D4D89DFktFP3pMp9wyX2a1bDTbP9AU67Au0FaiHyyg+I9RX42ASgsmlrgboltBCUkkIkdKr8jPHs72tVEgwTL7V2RMxK9J1OLLps3wOJlub9ld0yvsdB65KnbYRtgDqvgF4d9tyA== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(366004)(2906002)(38100700002)(7696005)(2940100002)(55016002)(5660300002)(186003)(66556008)(8936002)(64756008)(66446008)(71200400001)(4744005)(66476007)(66946007)(91956017)(76116006)(9686003)(6506007)(52536014)(38070700005)(316002)(786003)(8676002)(86362001)(966005)(122000001)(508600001)(33656002)(110136005);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?NHY7IBvEH5vRuXLPjMLNtI6NYAaGQg+q6+XM+KPFx9RL5SUODg0f69loF9?= =?iso-8859-1?Q?6HEY8rwJfTCW+YcQJ/ILQvzB163dNlGopUoCWk/uUpurgKMQKu4Ls0mpJ6?= =?iso-8859-1?Q?5rGZCyrvaMLeLq8wPYICOeNRrngwylUFjcKm2CvF6rTGDVAlOyiMKq8H/K?= =?iso-8859-1?Q?11DCm0n5uhVn19Ch0QvgHA1gkDPB8OxaatrFc68sJfXzmfW+c8fjs+td/d?= =?iso-8859-1?Q?+6gJVIwHxWG1av2y2mqSSJkoNSIYBMXQ/LgT1WcV3cd6/UzNV2P9xODbi2?= =?iso-8859-1?Q?4ohGR3Lzc725GBhZYRaOGFxrsdlti4HEBwar6nsHtaULPi5qwySiJDNCR/?= =?iso-8859-1?Q?82jLMzhObI7phPuF80I6b2XFHz1+QJgEHn6Lp6JV1S3hNSvNPOaBHpGn6N?= =?iso-8859-1?Q?ZVq0Ytgeq+T0Ox6s1wBmlm3WfBA49jymyOUf4PejjDA8Rv1AMgJGBV2eSf?= =?iso-8859-1?Q?62UmcLKQI4U4Ux51sfI/DYmuDukqFnD01dKQgyxkYCl1QOY/qeBM9Ny3VB?= =?iso-8859-1?Q?hgz8yX44DQ6FflF2Mw3CmUvKVDmq+Cb0SguXxKuHP1DaelasVXmgtr1y2j?= =?iso-8859-1?Q?Bj2zGjp5qgbi6kU45Hslq1TBaMtkG++FwewCD8SY21Bv1/W0fWEqB7E0Ej?= =?iso-8859-1?Q?3hJmbKhigclt+RsjsBx44hNTo+4xyKmejsstyGyGv2/iuOcqlNG+FjoGWJ?= =?iso-8859-1?Q?M/QPBWrhgdCfKYbqC4Z6g87TzmmkaFPs+QByzBznlKWdBcchqVMCBjmqUy?= =?iso-8859-1?Q?Z+BGwpPs4vIN0sgpKst6+8ufRG62E+Dxe/RBhxAfzAnkppiQrce5M0D+ZG?= =?iso-8859-1?Q?1SoeGJ6xDOO8ZMFKJ0laY6pefauRIgzH27UJC+8QAN51bNcpJBcyn4qqZk?= =?iso-8859-1?Q?UeaaDvBX0WEkvAb9BUKNbZRZpxV9U7zWudXLhU40BWUWMPQYf1qZzNTfBr?= =?iso-8859-1?Q?UnUK0HVMSxJyxuc1l0qgKHSw2zug0WdvYnkquaDu4Ddx+JM+BHQAdj0d5x?= =?iso-8859-1?Q?e5N0DnqhJ9a3rOuFjVHkTQ4ilbv1MseqyWK52D2qlhhDAaFbFHtMmPcKI5?= =?iso-8859-1?Q?HHP6P8SlT2h9ka77+ziku22QE1NOIqVOwKWX1UCjvuX8M8ApIqcekoG7S5?= =?iso-8859-1?Q?5glUIB7hRR9UoZWDzs/ke8eyKxjx3PN7HmClm9U4rvvsmaiqOrcKqJFKFO?= =?iso-8859-1?Q?nyvEOt3vCsVlE/g8PHSs41gJbon/o72xDyvuvf1tU9xnkvn95yM4xdiCJw?= =?iso-8859-1?Q?q+6CYO1CXQyITQmdYMriiTzRUcYsdaATEgx9noWDRUB5VjHHySvt9Y1ESo?= =?iso-8859-1?Q?0YQcgSOuK4RWE0AWxtLN4TZS+1Ne3v40p6FE6uQcZOdkcmyPdK0K6EfFS4?= =?iso-8859-1?Q?gbaWuzqARnJfF7aPtj7lqXFK+Adw8/pBkKwqIcf7RW3TEbzLG357PGj6NJ?= =?iso-8859-1?Q?DWzXjdyDSzpiRlUm?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 7a2116bf-a9a6-4cc3-fbe9-08d98b40dd06 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Oct 2021 16:21:35.1006 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: WS37SNi6DuYANyolq0xEy/5it4gsTpHobv5kVD0Je9eqGWxBQ5CmGX5iDuHnck/aoSho1kc8RAqx6lxqbVR0qg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB4888 X-Rspamd-Queue-Id: 4HRVgV6BlBz3hn5 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=c0xls168; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.72 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.99 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.72:from]; NEURAL_HAM_SHORT(-0.99)[-0.995]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.72:from] X-ThisMailContainsUnwantedMimeParts: N =0A= Felix Palmen wrote:=0A= [stuff snipped]=0A= >Ok, thanks for the insight here! So maybe, I could have a look at=0A= >poudriere's code? If I understand you correctly, keeping the file open=0A= >and just issuing more write() calls wouldn't trigger that problem?=0A= Nope, I don't think keeping the file open would help much.=0A= However, if the file is opened with O_DIRECT, you could try setting=0A= # sysctl vfs.nfs.nfs_directio_enable=3D1=0A= in the NFS client machine.=0A= =0A= rick=0A= =0A= > You could try the "nocto" mount option, which might help, if the log file= =0A= > is being re-opened many times, but I doubt it will help.=0A= =0A= Well, I take any suggestion, so will try that as well and report back,=0A= thanks again!=0A= =0A= Side note, please don't CC/To me, I'm subscribed the list ;)=0A= =0A= --=0A= Dipl.-Inform. Felix Palmen ,.//..........=0A= {web} http://palmen-it.de {jabber} [see email] ,//palmen-it.de=0A= {pgp public key} http://palmen-it.de/pub.txt // """""""""""=0A= {pgp fingerprint} A891 3D55 5F2E 3A74 3965 B997 3EF2 8B0A BC02 DA2A=0A= =0A=