Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 9 Oct 2021 17:50:33 +0200
From:      Felix Palmen <felix@palmen-it.de>
To:        freebsd-current@freebsd.org
Subject:   Re: Writing large build logs to NFS extremely slow?
Message-ID:  <20211009155033.fckg4i7zqo4yt2te@nexus.home.palmen-it.de>
In-Reply-To: <YQXPR0101MB096832C878E88DF877B39DB8DDB39@YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM>
References:  <20211007021643.bwglyvrswk2nm3fl@nexus.home.palmen-it.de> <CAOgwaMsLTWaMddx1HPY0eiY4t-12x-bEiZmhUpFsuEqkNhM27w@mail.gmail.com> <20211009141852.3cmjh7tysnehum7b@nexus.home.palmen-it.de> <YQXPR0101MB096832C878E88DF877B39DB8DDB39@YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM>

next in thread | previous in thread | raw e-mail | index | archive | help

--khodntlu4fcbzk3t
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

* Rick Macklem <rmacklem@uoguelph.ca> [20211009 15:35]:
> Felix Palmen wrote:
> Assuming your NFS performance is acceptable for other things and it
> is only this log file that is a problem, then I doubt there is much you
> can do to improve it.

Yes, that's the only problem I found so far=E2=80=A6

> --> Append (as in O_APPEND opens) are a poor case for NFS, since there
>       is no append write in NFS. To approximate append write, it must flu=
sh
>       all dirty data to the server, do a Getattr to find out the file's c=
urrent
>       size and then do the write (over and over and over again).

Ok, thanks for the insight here! So maybe, I could have a look at
poudriere's code? If I understand you correctly, keeping the file open
and just issuing more write() calls wouldn't trigger that problem?

> You could try the "nocto" mount option, which might help, if the log file
> is being re-opened many times, but I doubt it will help.

Well, I take any suggestion, so will try that as well and report back,
thanks again!

Side note, please don't CC/To me, I'm subscribed the list ;)

--=20
 Dipl.-Inform. Felix Palmen  <felix@palmen-it.de>   ,.//..........
 {web}  http://palmen-it.de  {jabber} [see email]   ,//palmen-it.de
 {pgp public key}     http://palmen-it.de/pub.txt   //   """""""""""
 {pgp fingerprint} A891 3D55 5F2E 3A74 3965 B997 3EF2 8B0A BC02 DA2A

--khodntlu4fcbzk3t
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAABCAAdFiEEqJE9VV8uOnQ5ZbmXPvKLCrwC2ioFAmFhukkACgkQPvKLCrwC
2irRMQf/cHZ+l+ta4CW6lojzmkYsb2I+p3WnRKXJM++5XF6SHcq36W2V8+EBfXcN
c9PYCbtdvPE/1+X9HG6RPAOqC1uaiRONh7qmCBtYlPCjEjOOHAugXXpodzIRG3LW
EL1vKKW2OlqgxVVxVHXFaKCjqeqewkfZzONGMJ4yQTfPmllaAuLkJgb8CVmC1A0D
1xPWf3Uk/GSApSLlmyTFT064MDIK6hg3vkBNVLicZuaFn8hv84n8O8jQrS8R0HAi
u0dvLbXgJM7eztYbev+39Jh5IeOr9A5ZI7/ZniCXm0Z4iOWwLDuOr/iEAM9JspFQ
BfO5Ec/H99qzEnDUFq36DEox4TWLpg==
=U4rE
-----END PGP SIGNATURE-----

--khodntlu4fcbzk3t--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20211009155033.fckg4i7zqo4yt2te>