From owner-freebsd-fs@FreeBSD.ORG Thu May 30 00:50:00 2013 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id C46F5B9E for ; Thu, 30 May 2013 00:50:00 +0000 (UTC) (envelope-from bryan@shatow.net) Received: from secure.xzibition.com (secure.xzibition.com [173.160.118.92]) by mx1.freebsd.org (Postfix) with ESMTP id 8E6073F3 for ; Thu, 30 May 2013 00:50:00 +0000 (UTC) DomainKey-Signature: a=rsa-sha1; c=nofws; d=shatow.net; h=message-id :date:from:mime-version:to:subject:content-type; q=dns; s=sweb; b= B+79YKv1Z6RbHDI5/mG3GpkHQQMtHfdDV9Q50Z6fi795Z+XRDysLxAx8Rj0napoL xgxyX8wZMwUahouqW0vgQvxkoXbpLwvk1QPnrTf/gXO09qigO50rgmc/ayUdOmpn TNXQ5aeWqJ4y+4B+lP/SJiuZL4kPYTrVcSSoEbxiROI= DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=shatow.net; h=message-id :date:from:mime-version:to:subject:content-type; s=sweb; bh=Rlvr cELeE7DsN54cGggVHdv8Dvs2iCc2SbFFthiu+3o=; b=JoL8H8Fd7Wj6xMQs1hnq Pa3OV+cF0OEuY3rRfaSlAo6ZNfLl9a5hJDZFB/WTvPgpAoVaAjXAMKXZkHdugg1w 0rYR0wMILvik5cs41t39p8F6sOWx+QJ7+znPvoj1BQJ0BK2+8nbUx/XtvIPKAHdO HucZIEW3mMcwBR8fKfRo5fk= Received: (qmail 2510 invoked from network); 29 May 2013 19:43:17 -0500 Received: from unknown (HELO ?10.10.1.133?) (bryan@shatow.net@10.10.1.133) by sweb.xzibition.com with ESMTPA; 29 May 2013 19:43:17 -0500 Message-ID: <51A6A096.8030103@shatow.net> Date: Wed, 29 May 2013 19:43:02 -0500 From: Bryan Drewery User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130328 Thunderbird/17.0.5 MIME-Version: 1.0 To: freebsd-fs@FreeBSD.org Subject: NFS+ZFS+nullfs on Server random Permission Denied errors on client (nfsv4) X-Enigmail-Version: 1.5.1 OpenPGP: id=3C9B0CF9; url=http://www.shatow.net/bryan/bryan.asc Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="----enig2DQXKLBUQPLUNTMLXDRII" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 00:50:00 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) ------enig2DQXKLBUQPLUNTMLXDRII Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Server: 9.1-RELEASE mount: > tank/distfiles/freebsd on /tank/distfiles/freebsd (zfs, NFS exported, l= ocal, noatime, noexec, nfsv4acls) /etc/zfs/exports: > /tank/distfiles/freebsd -maproot=3Droot -network 10.10.0.0/16 Clients: 8.3-RELEASE fstab: > tank:/tank/distfiles/freebsd /mnt/distfiles = nfs rw,bg,noatime,intr,rsize=3D65536,wsize=3D65536,re= adahead=3D8,nfsv4 0 0 HEAD r250991: > tank:/tank/distfiles/freebsd /mnt/distfiles nfs = rw,bg,noatime,intr,rsize=3D65536,wsize=3D65536,readahead=3D8,nfsv4 = 0 0 9.1-STABLE r247421: > tank:/tank/distfiles/freebsd /mnt/distfiles nfs = rw,bg,noatime,intr,rsize=3D65536,wsize=3D65536,readahead=3D8,nfsv4 = 0 0 Problem: For months I constantly get random Permission Denied errors on the client side. Just trying the read again can fix the problem. The client will usually show this in dmesg as the same time: > nfsv4 client/server protocol prob err=3D10020 Example errors: > root@c1100_1:/usr/local/poudriere/data/logs/bulk/91amd64-default/2013-0= 5-29_19:17:45/logs/errors # grep "Permission denied" * > dconf-0.12.1_1.log:cannot open gnome3/dconf-0.12.1.tar.xz: Permission d= enied > p5-Pod-Tests-1.19_1.log:pax: Unable to open /mnt/distfiles//Pod-Tests-1= =2E19.tar.gz to read > sofia-sip-1.12.11.log:pax: Unable to open /mnt/distfiles//sofia-sip-1.1= 2.11.tar.gz to read > tex-ptex-3.3_1.log:fetch: texlive-20120701-texmf.tar.xz: Permission den= ied > tkman-2.2_2.log:pax: Unable to open /mnt/distfiles//tkman-2.2.tar.gz to= read I have realized that this problem manifests when I nullfs mount the /tank/distfiles/freebsd directory on the server and start doing reads from it, while also reading from the clients. It became so bad that I had to move my mail off of NFS and back onto the mail server itself since I had questions of where mail had disappeared to= ! Has anyone else experienced this? Is is fixed in STABLE already? Bryan Drewery ------enig2DQXKLBUQPLUNTMLXDRII Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (MingW32) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJRpqCbAAoJEG54KsA8mwz5ZF0P/2HBsQt+HkUJW2KyiRgLOJzg R7pkhy1hkQLFQANYS8PiFHlmjqSbCmDnk3hn2tujjltqYlZ+wIJ0R7XUH7JpLf5w DPozU2rLYvE6HwjgMYlXoG+pbeB/n5dm+35IxsbUjukPyQHU3g6qeQLYs9rMYeR0 aJh0sp+gbEvcycesIrYj4mp7W76K8znaKRXtL+HpLa9nN0w53Yb2OwqlYXJlsXU5 wnBwlaDw7EjMI3selse05za/18Sn7vMv2D1rQPKHehc0auSZehJ51GgT0TcD4Fct 58/r7B3fy5Zwb4nzjXrX0alRWNVKtd8G/NL3Vrn1QyvrlmUeWlIfUgVB9j/QmtBj 1PBBQpRckPg3mSQhzb9YC0Kf8RmjV3peHdMQq8eozESqyZ8EhJuXLDBhfz+rXu4E HZMwc8IzCUVPbcCH927V/9Y6X8HL+MXDVPUtb8lUhIetgj1bm1V1H10ZqDxw+zBv ngd2TBqe/WvUXyTMEH19t/jNn5xv2h5FNRZw0gHUqG0ML9F194Qwt+HmSRssdIbQ 2LM+dVoOri/9Sgil1mXA/fUfLRok4H8I9dKBYGKb0m/95S6BXCw8Z/FdgcLN+0kS UOkVLHfLuEEQOvIUe4K/g4tjuRqA+LqyPqtqtrasibNjhflq7hJxj3snWLhizsoK R3U2voi3JJJRxH/XXDx7 =f1By -----END PGP SIGNATURE----- ------enig2DQXKLBUQPLUNTMLXDRII--