Date: Wed, 29 May 2013 19:43:02 -0500 From: Bryan Drewery <bryan@shatow.net> To: freebsd-fs@FreeBSD.org Subject: NFS+ZFS+nullfs on Server random Permission Denied errors on client (nfsv4) Message-ID: <51A6A096.8030103@shatow.net>
next in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
------enig2DQXKLBUQPLUNTMLXDRII
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Server:
9.1-RELEASE
mount:
> tank/distfiles/freebsd on /tank/distfiles/freebsd (zfs, NFS exported, l=
ocal, noatime, noexec, nfsv4acls)
/etc/zfs/exports:
> /tank/distfiles/freebsd -maproot=3Droot -network 10.10.0.0/16
Clients:
8.3-RELEASE
fstab:
> tank:/tank/distfiles/freebsd /mnt/distfiles =
nfs rw,bg,noatime,intr,rsize=3D65536,wsize=3D65536,re=
adahead=3D8,nfsv4 0 0
HEAD r250991:
> tank:/tank/distfiles/freebsd /mnt/distfiles nfs =
rw,bg,noatime,intr,rsize=3D65536,wsize=3D65536,readahead=3D8,nfsv4 =
0 0
9.1-STABLE r247421:
> tank:/tank/distfiles/freebsd /mnt/distfiles nfs =
rw,bg,noatime,intr,rsize=3D65536,wsize=3D65536,readahead=3D8,nfsv4 =
0 0
Problem:
For months I constantly get random Permission Denied errors on the
client side. Just trying the read again can fix the problem. The client
will usually show this in dmesg as the same time:
> nfsv4 client/server protocol prob err=3D10020
Example errors:
> root@c1100_1:/usr/local/poudriere/data/logs/bulk/91amd64-default/2013-0=
5-29_19:17:45/logs/errors # grep "Permission denied" *
> dconf-0.12.1_1.log:cannot open gnome3/dconf-0.12.1.tar.xz: Permission d=
enied
> p5-Pod-Tests-1.19_1.log:pax: Unable to open /mnt/distfiles//Pod-Tests-1=
=2E19.tar.gz to read <Permission denied>
> sofia-sip-1.12.11.log:pax: Unable to open /mnt/distfiles//sofia-sip-1.1=
2.11.tar.gz to read <Permission denied>
> tex-ptex-3.3_1.log:fetch: texlive-20120701-texmf.tar.xz: Permission den=
ied
> tkman-2.2_2.log:pax: Unable to open /mnt/distfiles//tkman-2.2.tar.gz to=
read <Permission denied>
I have realized that this problem manifests when I nullfs mount the
/tank/distfiles/freebsd directory on the server and start doing reads
from it, while also reading from the clients.
It became so bad that I had to move my mail off of NFS and back onto the
mail server itself since I had questions of where mail had disappeared to=
!
Has anyone else experienced this? Is is fixed in STABLE already?
Bryan Drewery
------enig2DQXKLBUQPLUNTMLXDRII
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJRpqCbAAoJEG54KsA8mwz5ZF0P/2HBsQt+HkUJW2KyiRgLOJzg
R7pkhy1hkQLFQANYS8PiFHlmjqSbCmDnk3hn2tujjltqYlZ+wIJ0R7XUH7JpLf5w
DPozU2rLYvE6HwjgMYlXoG+pbeB/n5dm+35IxsbUjukPyQHU3g6qeQLYs9rMYeR0
aJh0sp+gbEvcycesIrYj4mp7W76K8znaKRXtL+HpLa9nN0w53Yb2OwqlYXJlsXU5
wnBwlaDw7EjMI3selse05za/18Sn7vMv2D1rQPKHehc0auSZehJ51GgT0TcD4Fct
58/r7B3fy5Zwb4nzjXrX0alRWNVKtd8G/NL3Vrn1QyvrlmUeWlIfUgVB9j/QmtBj
1PBBQpRckPg3mSQhzb9YC0Kf8RmjV3peHdMQq8eozESqyZ8EhJuXLDBhfz+rXu4E
HZMwc8IzCUVPbcCH927V/9Y6X8HL+MXDVPUtb8lUhIetgj1bm1V1H10ZqDxw+zBv
ngd2TBqe/WvUXyTMEH19t/jNn5xv2h5FNRZw0gHUqG0ML9F194Qwt+HmSRssdIbQ
2LM+dVoOri/9Sgil1mXA/fUfLRok4H8I9dKBYGKb0m/95S6BXCw8Z/FdgcLN+0kS
UOkVLHfLuEEQOvIUe4K/g4tjuRqA+LqyPqtqtrasibNjhflq7hJxj3snWLhizsoK
R3U2voi3JJJRxH/XXDx7
=f1By
-----END PGP SIGNATURE-----
------enig2DQXKLBUQPLUNTMLXDRII--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?51A6A096.8030103>