From owner-freebsd-performance@FreeBSD.ORG Mon Apr 12 19:56:12 2010 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 098321065673 for ; Mon, 12 Apr 2010 19:56:12 +0000 (UTC) (envelope-from kmatthew.macy@gmail.com) Received: from qw-out-2122.google.com (qw-out-2122.google.com [74.125.92.26]) by mx1.freebsd.org (Postfix) with ESMTP id AF4A88FC16 for ; Mon, 12 Apr 2010 19:56:10 +0000 (UTC) Received: by qw-out-2122.google.com with SMTP id 5so2086618qwi.7 for ; Mon, 12 Apr 2010 12:56:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:reply-to:received :in-reply-to:references:date:x-google-sender-auth:received :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=v6qzQscN2vfGCi6Lqzy0TtaBo3MwA75JgIapFD2Z944=; b=W2ZqznmxCsCMqjcT0FeJMbq5ty+7DWnaK5/ZAEi02z84aNqO/pMyJaMms3s3S3rG/q A+8XqHbVJKcKFDjhxOvEGD8FeASsEdby5vuHQqQ/+uDdzxiCQBEPCxO9fS8iI4niVl9m GIcl0JC0gR28h33FfgjsUTyWF7ARXTRg3iZak= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:reply-to:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=evs5LV85PZxBru6bSIswvGleAKXhRnGEH98dV+RtxhBR87OPygb+eWLrkEzR/WkcFN je+Bg6yjnYb1AuTQYDxXHhSx95VFO/Xg8cBlZLl7ZjnCeBcJbkcjKDgwGPnoK+H1WtKo 2+6vksyHJu7kAs/jfGIQmq+Mt9BNW9OF/9Tl8= MIME-Version: 1.0 Sender: kmatthew.macy@gmail.com Received: by 10.229.226.6 with HTTP; Mon, 12 Apr 2010 12:56:09 -0700 (PDT) In-Reply-To: <20100412091136.GE61157@runo.ripn.net> References: <20100408153257.GA35557@runo.ripn.net> <20100409024409.GA1602@runo.ripn.net> <20100412091136.GE61157@runo.ripn.net> Date: Mon, 12 Apr 2010 12:56:09 -0700 X-Google-Sender-Auth: 6e502a04439a2813 Received: by 10.229.242.85 with SMTP id lh21mr6432332qcb.67.1271102169847; Mon, 12 Apr 2010 12:56:09 -0700 (PDT) Message-ID: From: "K. Macy" To: "Alexandr D. Sergeev" Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@freebsd.org Subject: Re: Extreme performance falling on ZFS by durable operation of a server X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kmacy@freebsd.org List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Apr 2010 19:56:12 -0000 8-STABLE is definitely better, but you should also set arc_min to at least 384M-512M. I'm not sure that arc_min is even honored under 7.2. -Kip On Mon, Apr 12, 2010 at 2:11 AM, Alexandr D. Sergeev wrote: > Whether there are any ideas about the reasons of such problems? > > Whether transition to FreeBSD 8.0 RELEASE / STABLE can help? > ZFS in it is declared as "bug free" > > On Fri, Apr 09, 2010 at 06:44:09AM +0400, Alexandr D. Sergeev wrote: >> On Thu, Apr 08, 2010 at 01:14:42PM -0700, K. Macy wrote: >> > Hi Alexandr, >> >> Hi Kip, >> >> > >> > - How much memory do you have? >> >> 4Gb. >> Applications consume a lot of memory, is partially used swap (~1Gb, but = without active i/o). >> >> We have planned increase in memory to 16G >> >> > >> > - What are your ARC settings? >> >> Settings is default, that recommended for amd64 kernel. >> But I am not assured that it is optimal. >> Thus sysctl variables are automatically sets to: >> vfs.zfs.arc_max ~800Mb >> vfs.zfs.arc_mim ~128Mb >> >> Now the next reboot was required. >> Together with which following settings have been made: >> >> vm.kmem_size=3D2048M >> vfs.zfs.arc_max=3D1536M >> vfs.zfs.arc_min=3D1024M >> vfs.zfs.vdev.cache.size=3D64M >> >> Let's look, as it will affect. >> >> However there is confidence that no problem at a size of ARC. >> Even at 200Mb ARC, productivity should not fall so strongly. >> >> > >> > Thanks, >> > Kip >> > >> > On Thu, Apr 8, 2010 at 8:32 AM, Alexandr D. Sergeev wr= ote: >> > > Hi, all! >> > > >> > > There are problems with a server on FreeBSD 7.2 CURRENT (6 Jul 2009)= , carrying out the task of mail server SMTP, IMAP. >> > > >> > > Messages are stored in maildirs on file system ZFS (mirror of 2 SAS = 3k drives). >> > > Dovecot is used as IMAP server. >> > > >> > > After reboot the system works perfectly, however, somewhere in a mon= th, at the same load, arise periodic long delays at opening of new letters. >> > > >> > > Judging by output iostat -x -w 1, during these moments the disk subs= ystem is strongly loaded. >> > > %busy disks comes nearer to 100 %. Readings nearby 300 per sec preva= il. and approx. 10MBytes per sec. >> > > >> > > Somebody can advise, what diagnostics needed, for understanding of t= he reason of problems? >> > > >> > > There is an opinion that a problem with ZFS. >> > > >> > > Probably, it does not have enough memory. Because during the periods= of occurrence of a problem, =A0ARC is have less 300MB: >> > > >> > > vmstat -m >> > > ... >> > > =A0 =A0 =A0solaris 1245732 274745K =A0 =A0 =A0 - 25872717949 =A016,3= 2,64,128,256,512,1024,2048,4096 >> > > ... >> > > >> > > Or it is bug of ZFS implementation. >> > > >> > > -- >> > > Best regards, >> > > Alexandr D.Sergeev >> > > _______________________________________________ >> > > freebsd-performance@freebsd.org mailing list >> > > http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> > > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@fr= eebsd.org" >> > > >> > > -- > Best regards, > Alexandr D.Sergeev > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd= .org" >