From owner-freebsd-hackers@FreeBSD.ORG Sat Oct 20 11:43:07 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 521DCDE7; Sat, 20 Oct 2012 11:43:07 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1.freebsd.org (Postfix) with ESMTP id A71B68FC12; Sat, 20 Oct 2012 11:43:06 +0000 (UTC) Received: by mail-wi0-f172.google.com with SMTP id hq12so886566wib.13 for ; Sat, 20 Oct 2012 04:43:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=RXy+Wea31o1pgJWOtbZ2ETzHeP87Yg9MjjYy7y21xJE=; b=mgDjQfuTLMxX8KrXeKbpnsRtEM+RWmhKcfL2UtQOSAFZkfFF5b1ruhBPoiKLeOcCze NNkpmAkr7p3pA0UsHA4gKVz6k3/etUmRPYmokzxpWGE8S7EYYUhmOK1GSefsAKz7GR3C TlOpW/n8Bs0fzSTvuvfT7jggG+6TEBzQikOVDLpXgLtzc/vQR1aLocipBpF3QCsFto0c T5Bzw3TLqbLhZ/pV5iy6BuuV2f3tUW9Qez9ev8haTS0OECwa+Mdzx/7pPV8PJ48sgZTQ kOqLh+5Ytd+ucZM3smeil4SWXI+XWX40DtGthXb73eQS02ZyU8Dnb0D8FTodaXUXuRUz SgwA== Received: by 10.216.195.144 with SMTP id p16mr2186313wen.174.1350733379998; Sat, 20 Oct 2012 04:42:59 -0700 (PDT) Received: from [10.0.0.86] ([93.152.184.10]) by mx.google.com with ESMTPS id v3sm9085964wiy.5.2012.10.20.04.42.58 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 20 Oct 2012 04:42:58 -0700 (PDT) Subject: Re: NFS server bottlenecks Mime-Version: 1.0 (Mac OS X Mail 6.1 \(1498\)) Content-Type: text/plain; charset=us-ascii From: Nikolay Denev In-Reply-To: <6DAAB1E6-4AC7-4B08-8CAD-0D8584D039DE@gmail.com> Date: Sat, 20 Oct 2012 14:42:56 +0300 Content-Transfer-Encoding: quoted-printable Message-Id: <23D7CB3A-BD66-427E-A7F5-6C9D3890EE1B@gmail.com> References: <937460294.2185822.1350093954059.JavaMail.root@erie.cs.uoguelph.ca> <302BF685-4B9D-49C8-8000-8D0F6540C8F7@gmail.com> <0857D79A-6276-433F-9603-D52125CF190F@gmail.com> <6DAAB1E6-4AC7-4B08-8CAD-0D8584D039DE@gmail.com> To: "freebsd-hackers@freebsd.org Hackers" X-Mailer: Apple Mail (2.1498) Cc: Rick Macklem , Ivan Voras X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Oct 2012 11:43:07 -0000 On Oct 18, 2012, at 6:11 PM, Nikolay Denev wrote: >=20 > On Oct 15, 2012, at 5:34 PM, Ivan Voras wrote: >=20 >> On 15 October 2012 16:31, Nikolay Denev wrote: >>>=20 >>> On Oct 15, 2012, at 2:52 PM, Ivan Voras wrote: >>=20 >>>> http://people.freebsd.org/~ivoras/diffs/nfscache_lock.patch >>>>=20 >>>> It should apply to HEAD without Rick's patches. >>>>=20 >>>> It's a bit different approach than Rick's, breaking down locks even = more. >>>=20 >>> Applied and compiled OK, I will be able to test it tomorrow. >>=20 >> Ok, thanks! >>=20 >> The differences should be most visible in edge cases with a larger >> number of nfsd processes (16+) and many CPU cores. >=20 > I'm now rebooting with your patch, and hopefully will have some = results tomorrow. >=20 Here are the results from testing both patches : = http://home.totalterror.net/freebsd/nfstest/results.html Both tests ran for about 14 hours ( a bit too much, but I wanted to = compare different zfs recordsize settings ), and were done first after a fresh reboot. The only noticeable difference seems to be much more context switches = with Ivan's patch.