From owner-svn-src-head@FreeBSD.ORG Fri Jan 10 06:53:46 2014 Return-Path: Delivered-To: svn-src-head@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BF1E64D7; Fri, 10 Jan 2014 06:53:46 +0000 (UTC) Received: from people.fsn.hu (people.fsn.hu [195.228.252.137]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DD5C01CF7; Fri, 10 Jan 2014 06:53:44 +0000 (UTC) Received: by people.fsn.hu (Postfix, from userid 1001) id DF80D128B5A5; Fri, 10 Jan 2014 07:47:12 +0100 (CET) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.3 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MF-ACE0E1EA [pR: 17.8463] X-CRM114-CacheID: sfid-20140110_07471_50FD818E X-CRM114-Status: Good ( pR: 17.8463 ) X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Fri Jan 10 07:47:12 2014 X-DSPAM-Confidence: 0.9984 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 52cf9770784442092537317 X-DSPAM-Factors: 27, From*Attila Nagy , 0.00010, Subject*commit, 0.00026, Revision, 0.00026, New+Revision, 0.00037, Subject*svn, 0.00046, Subject*svn+commit, 0.00047, >+On, 0.00049, to+>, 0.00098, Author, 0.00109, wrote+>>, 0.00115, conf, 0.00125, conf, 0.00125, Modified, 0.00133, Modified, 0.00133, Log, 0.00153, #+This, 0.00176, #+This, 0.00176, cache, 0.00176, wrote+>, 0.00189, wrote+>, 0.00189, >+>>, 0.00255, >>+>, 0.00263, Url*//svnweb, 0.00263, In-Reply-To*mail.gmail.com>, 0.00289, timeout, 0.00292, References*mail.gmail.com>, 0.00297, X-Spambayes-Classification: ham; 0.00 Received: from japan.t-online.private (japan.t-online.co.hu [195.228.243.99]) by people.fsn.hu (Postfix) with ESMTPSA id 4195E128B595; Fri, 10 Jan 2014 07:47:10 +0100 (CET) Message-ID: <52CF976A.3070501@fsn.hu> Date: Fri, 10 Jan 2014 07:47:06 +0100 From: Attila Nagy MIME-Version: 1.0 To: Adrian Chadd , Alexander Motin Subject: Re: svn commit: r260486 - head/etc/defaults References: <201401091555.s09Fttju004938@svn.freebsd.org> <52CEC79F.2090708@FreeBSD.org> <52CECE57.4040002@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "svn-src-head@freebsd.org" , svn-src-all@freebsd.org, src-committers@freebsd.org X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 06:53:46 -0000 We have 2 and 4 hw.ncpu NFS servers with 70+ disks, so there may be cases, where even the default maximum of 256 threads is not enough to feed the -otherwise slow- disks. I guess the real solution here is to change the nfsd worker model to async. (adapting to top poster) On 01/09/14 18:14, Adrian Chadd wrote: > If it's one request per nfsd then we should likely scale it separate to > ncpu. Otherwise the default for two or core boxes may not be enough. > > Adrian > On Jan 9, 2014 11:29 AM, "Alexander Motin" wrote: > >> On 09.01.2014 18:18, Adrian Chadd wrote: >> >>> Depends if you're thinking locally or globally. >>> >>> Locally - for nfs? not a big deal. >>> >>> Globally - NFS, ZFS, GELI, geom/cam, NIC, etc.. suddenly your machine >>> could default to having a couple thousand worker threads just for a >>> HBA and a 10GE NIC. That's a little nuts. >>> >> So, what is your point? Each NFS thread (unlike GEOM or CAM) executes only >> _one_ request at a time. Would you like your 128-core/many-spindle system >> executed only 4 synchronous requests at a time? >> >> On 9 January 2014 08:00, Alexander Motin wrote: >>>> On 09.01.2014 17:57, Adrian Chadd wrote: >>>> >>>>> .. so with say, 128 core boxes showing up, is this really a good >>>>> default? >>>>> >>>> >>>> And what is the price? 16K+ of KVA per thread for thread stack, etc? 4 >>>> threads is probably much worse default there. May be nfsd's default >>>> could be >>>> tuned, but obviously it should not be hardcoded value. >>>> >>>> >>>> On 9 January 2014 07:55, Alexander Motin wrote: >>>>>> Author: mav >>>>>> Date: Thu Jan 9 15:55:55 2014 >>>>>> New Revision: 260486 >>>>>> URL: http://svnweb.freebsd.org/changeset/base/260486 >>>>>> >>>>>> Log: >>>>>> Remove very low default limit of 4 nfsd threads. nfsd's own >>>>>> default >>>>>> is >>>>>> 8 * hw.ncpu, that sounds more appropriate for these SMP/NCQ/... >>>>>> days. >>>>>> >>>>>> Modified: >>>>>> head/etc/defaults/rc.conf >>>>>> >>>>>> Modified: head/etc/defaults/rc.conf >>>>>> >>>>>> ============================================================ >>>>>> ================== >>>>>> --- head/etc/defaults/rc.conf Thu Jan 9 15:38:28 2014 >>>>>> (r260485) >>>>>> +++ head/etc/defaults/rc.conf Thu Jan 9 15:55:55 2014 >>>>>> (r260486) >>>>>> @@ -311,7 +311,7 @@ nfs_client_enable="NO" # This host is >>>>>> a >>>>>> nfs_access_cache="60" # Client cache timeout in seconds >>>>>> nfs_server_enable="NO" # This host is an NFS server (or NO). >>>>>> oldnfs_server_enable="NO" # Run the old NFS server (YES/NO). >>>>>> -nfs_server_flags="-u -t -n 4" # Flags to nfsd (if enabled). >>>>>> +nfs_server_flags="-u -t" # Flags to nfsd (if enabled). >>>>>> mountd_enable="NO" # Run mountd (or NO). >>>>>> mountd_flags="-r" # Flags to mountd (if NFS server >>>>>> enabled). >>>>>> weak_mountd_authentication="NO" # Allow non-root mount >>>>>> requests >>>>>> to be served. >>>>>> >>>> >>>> -- >>>> Alexander Motin >>>> >> -- >> Alexander Motin >> > _______________________________________________ > svn-src-all@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/svn-src-all > To unsubscribe, send any mail to "svn-src-all-unsubscribe@freebsd.org"