From owner-freebsd-fs@FreeBSD.ORG Thu Oct 8 17:06:28 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 97C7D1065697; Thu, 8 Oct 2009 17:06:28 +0000 (UTC) (envelope-from artemb@gmail.com) Received: from mail-yx0-f191.google.com (mail-yx0-f191.google.com [209.85.210.191]) by mx1.freebsd.org (Postfix) with ESMTP id 3C4F08FC15; Thu, 8 Oct 2009 17:06:27 +0000 (UTC) Received: by yxe29 with SMTP id 29so55139yxe.14 for ; Thu, 08 Oct 2009 10:06:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=qWW3Vql9oNaAu6ORq7vYIk2Vr/V50MEMVkI3WEjwGfM=; b=l+9zNecT9p7xNNfSn3mwaXQh8zEx7sWsfMZHQqC+0n58ECrPZz7vPxfPHFyxoKKMMv aWzV+kye2HYam6YK8LZYqE+a/pHoA9a8mC00tB5BuqM2S5LeuYx0ijsOHuuNInsLf6xe sZdfvpRa+ZoTMlg+Mib0LnV/X07c6BIICXmKo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=LDsHMQb2yhCkZ3YpvsHAaSCrHAkaC9DrX7e89PE8VyfIMhmgg+27ief5LXaoHmMwWk xmUpiyb2jbM4yZdTIuJTHX7eTN1oXxffCpDkhvKACGG74bbmdVNcHFXLmdAh1EjqPvcD quBZAyoWnUgkMFLCVbqgcs78c6b6tfMpCZvAI= MIME-Version: 1.0 Sender: artemb@gmail.com Received: by 10.91.97.9 with SMTP id z9mr844728agl.46.1255021587252; Thu, 08 Oct 2009 10:06:27 -0700 (PDT) In-Reply-To: <20091008160718.GB2134@garage.freebsd.pl> References: <4AC1E540.9070001@fsn.hu> <4AC5B2C7.2000200@fsn.hu> <20091002184526.GA1660@garage.freebsd.pl> <4ACDA5EA.2010600@fsn.hu> <4ACDDED0.2070707@fsn.hu> <20091008160718.GB2134@garage.freebsd.pl> Date: Thu, 8 Oct 2009 10:06:27 -0700 X-Google-Sender-Auth: 318ccc6cccd49740 Message-ID: From: Artem Belevich To: Pawel Jakub Dawidek Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: ARC size constantly shrinks, then ZFS slows down extremely X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2009 17:06:28 -0000 I've tested with Kip's patch -- no lockups so far. --Artem On Thu, Oct 8, 2009 at 9:07 AM, Pawel Jakub Dawidek wrote= : > On Thu, Oct 08, 2009 at 02:45:04PM +0200, Attila Nagy wrote: >> Attila Nagy wrote: >> >Hello, >> > >> >Pawel Jakub Dawidek wrote: >> >>On Fri, Oct 02, 2009 at 09:59:03AM +0200, Attila Nagy wrote: >> >> >> >>>Backing out this change from the 8-STABLE kernel: >> >>>http://svn.freebsd.org/viewvc/base/head/sys/cddl/contrib/opensolaris/= uts/common/fs/zfs/arc.c?r1=3D191901&r2=3D191902 >> >>> >> >>> >> >>>makes it survive about half and hour of IMAP searching. Of course >> >>>only time will tell whether this helps in the long run, but so far >> >>>10/10 tries succeeded to kill the machine with this method... >> >>> >> >> >> >>Could you try this patch: >> >> >> >> =A0 =A0http://people.freebsd.org/~pjd/patches/arc.c.4.patch >> >> >> >It seems (after running for two days) that this fixes my problem. And >> >I see that Kip has came out with a similar version (which I couldn't >> >yet test, but hope that will also do). >> It seems that I was a little bit quick regarding this. >> The machine just stopped with this: >> last pid: 32358; =A0load averages: =A00.01, =A00.04, =A00.12 =A0 =A0up 2= +06:33:56 >> 14:36:25 >> 114 processes: 1 running, 112 sleeping, 1 zombie >> CPU: =A00.0% user, =A00.0% nice, =A00.0% system, =A00.0% interrupt, =A01= 00% idle >> Mem: 536M Active, 63M Inact, 393M Wired, 8K Cache, 111M Buf >> Swap: 4096M Total, 15M Used, 4081M Free >> >> =A0PID USERNAME =A0THR PRI NICE =A0 SIZE =A0 =A0RES STATE =A0 C =A0 TIME= =A0 WCPU COMMAND >> 24025 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A03932K =A0 992K vmwait =A00= =A0 6:06 =A00.00% zpool >> 84190 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A04700K =A01592K CPU1 =A0 = =A01 =A0 4:17 =A00.00% top >> 99029 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A04132K =A01212K nanslp =A01= =A0 3:53 =A00.00% gstat >> 26317 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01528K =A0 352K piperd =A01= =A0 3:38 =A00.00% >> readproctitl >> 49143 =A0 =A0125 =A0 =A0 =A04 =A045 =A0 =A00 12248K =A03788K sigwai =A00= =A0 2:50 =A00.00% >> milter-greyl >> 39969 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00= =A0 2:50 =A00.00% supervise >> 40241 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00= =A0 2:47 =A00.00% supervise >> 44633 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 512K vmwait =A00= =A0 2:43 =A00.00% supervise >> 43434 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00= =A0 2:43 =A00.00% supervise >> 50575 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00= =A0 2:42 =A00.00% supervise >> 45510 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 512K vmwait =A00= =A0 2:42 =A00.00% supervise >> 58146 =A0 =A0 60 =A0 =A0 =A01 =A044 =A0 =A00 =A0 264M =A08828K pfault = =A00 =A0 2:32 =A00.00% imapd >> 47526 =A0 =A0389 =A0 =A0 =A06 =A044 =A0 =A00 92688K =A02296K ucond =A0 1= =A0 1:29 =A00.00% slapd >> 5417 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A09396K =A01680K pfault =A01 = =A0 1:26 =A00.00% sshd >> 13147 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A03340K =A0 860K vmwait =A01= =A0 0:45 =A00.00% syslogd >> 92597 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A09396K =A01676K pfault =A01= =A0 0:39 =A00.00% sshd >> 26437 =A0 =A0125 =A0 =A0 =A01 =A044 =A0 =A00 =A06924K =A01700K vmwait = =A00 =A0 0:33 =A00.00% qmgr >> >> The above top was refreshing, but every other stuff on different ssh >> consoles (like a running zpool iostat and gstat) was frozen. >> Even top stopped when I have resized the window. > > Please try Kip's patch that was committed, it changes priorities a bit, > which should help. > > -- > Pawel Jakub Dawidek =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 http://ww= w.wheel.pl > pjd@FreeBSD.org =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 http:= //www.FreeBSD.org > FreeBSD committer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 Am I Ev= il? Yes, I Am! >