Date: Wed, 19 Jun 2024 07:32:04 +0100 From: Lexi Winter <lexi@le-fay.org> To: fs@freebsd.org Subject: NFS, intermittent 'RPC struct is bad' errors Message-ID: <ZnJ7ZMWfCEQA0rLg@ilythia.eden.le-fay.org>
next in thread | raw e-mail | index | archive | help
--wKOJ5TJPneXaYjNl
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
hi,
i have a few systems running NFSv4 on FreeBSD, using Kerberos (MIT
Kerberos KDC), with the server exporting ZFS filesystems.
recently i've noticed intermittent errors of 'RPC struct is bad' when
writing to the NFS server, which usually resolves itself after retrying.
for example:
% rsync -iavP /scratch/Star.Trek.Prodigy.S01E* .
sending incremental file list
>f++++++++++ Star.Trek.Prodigy.S01E01E02.1080p.WEBRip.x265-KONTRAST.mkv
32,768 0% 0.00kB/s 0:00:00 rsync: [receiver] write failed on "/data/public/TV/Star Trek Prodigy/Season 01/Star.Trek.Prodigy.S01E01E02.1080p.WEBRip.x265-KONTRAST.mkv": RPC struct is bad (72)
rsync error: error in file IO (code 11) at receiver.c(380) [receiver=3.3.0]
rsync: [sender] write error: Broken pipe (32)
% rsync -iavP /scratch/Star.Trek.Prodigy.S01E* .
sending incremental file list
>f.st....... Star.Trek.Prodigy.S01E01E02.1080p.WEBRip.x265-KONTRAST.mkv
912,704,431 100% 96.51MB/s 0:00:09 (xfr#1, to-chk=18/19)
>f++++++++++ Star.Trek.Prodigy.S01E03.1080p.WEBRip.x265-KONTRAST.mkv
477,408,567 100% 100.06MB/s 0:00:04 (xfr#2, to-chk=17/19)
[...]
the client is running FreeBSD 15.0-CURRENT from around May 24, and the
server is running a slightly older 15.0-CURRENT from around May 23.
/etc/exports on the server is pretty standard:
/data/public -sec=krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
/data/public/Books -sec=krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
/data/public/CalibreLibrary -sec=krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
/data/public/Comics -sec=krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
/data/public/Films -sec=krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
/data/public/Miscellaneous -sec=krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
V4: /data -sec=sys:krb5:krb5i:krb5p -network 2001:8b0:aab5::/48
client mount options:
hemlock.eden.le-fay.org:/public /data/public nfs rw,nfsv4,minorversion=2,sec=krb5p,gssname=host,bgnow,proto=tcp6,nconnect=4,rsize=1048576,wsize=1048576,noncontigwr 0 0
is there anything more i can do investigate this? would a tcpdump
capture of the error be useful (considering all the RPC traffic is
Kerberos-encrypted)?
--wKOJ5TJPneXaYjNl
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQGzBAABCAAdFiEEuwt6MaPcv/+Mo+ftDHqbqZ41x5kFAmZye2EACgkQDHqbqZ41
x5mcfAv9H6f6bJIhTIQovyJMQGiJO+VZyQtkSmvR9iup7CPVGnaEf1NfPasXnyLY
OT7XdooA29sEHsJu5+hVgBj/H5YEN1gU+/jHUA2oqTh/LLXEsc18E8DtSHeHPz/h
KBE5f8dA6s5vqcPMPRgh7egfVm0VvvMwzeGlCS4fZWXXNmBOXbh2OMRSXoo7I83e
/d3CR819MgQNPpIkWtO2k7aYEHbaGUNJkcln9YvBPdgTgJII8xd7g0SD/mc0SeXe
p3CNCbI/eECWngZJwnI6Nm0xn1FBcON4hcjbz5How/MXz8szASEzBBinVx2tBt1F
TPeRdwXTyq1rhY8t1w5PCRfyRLKsxNpLAcjwbfpWCGEGFkdZg3oaaECXL0C7OaGD
EoydpwsY16WzpK1ctzuZoTBTQ70q2uIweTWqbcy+8wWnZf+Jwg3hmPJUUGMtOlsx
XahfBNDirs/m/SYYh6dYHtsSrwwbtJKF7TlPm4iRKCx/4nyKkbZ5/VyYvXRySrAs
m6r8ItAQ
=r4rW
-----END PGP SIGNATURE-----
--wKOJ5TJPneXaYjNl--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ZnJ7ZMWfCEQA0rLg>