Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 8 Oct 2009 10:06:27 -0700
From:      Artem Belevich <fbsdlist@src.cx>
To:        Pawel Jakub Dawidek <pjd@freebsd.org>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: ARC size constantly shrinks, then ZFS slows down extremely
Message-ID:  <ed91d4a80910081006u644c94c1x12a65c2718b3a739@mail.gmail.com>
In-Reply-To: <20091008160718.GB2134@garage.freebsd.pl>
References:  <4AC1E540.9070001@fsn.hu> <4AC5B2C7.2000200@fsn.hu> <20091002184526.GA1660@garage.freebsd.pl> <4ACDA5EA.2010600@fsn.hu> <4ACDDED0.2070707@fsn.hu> <20091008160718.GB2134@garage.freebsd.pl>

next in thread | previous in thread | raw e-mail | index | archive | help
I've tested with Kip's patch -- no lockups so far.

--Artem



On Thu, Oct 8, 2009 at 9:07 AM, Pawel Jakub Dawidek <pjd@freebsd.org> wrote=
:
> On Thu, Oct 08, 2009 at 02:45:04PM +0200, Attila Nagy wrote:
>> Attila Nagy wrote:
>> >Hello,
>> >
>> >Pawel Jakub Dawidek wrote:
>> >>On Fri, Oct 02, 2009 at 09:59:03AM +0200, Attila Nagy wrote:
>> >>
>> >>>Backing out this change from the 8-STABLE kernel:
>> >>>http://svn.freebsd.org/viewvc/base/head/sys/cddl/contrib/opensolaris/=
uts/common/fs/zfs/arc.c?r1=3D191901&r2=3D191902
>> >>>
>> >>>
>> >>>makes it survive about half and hour of IMAP searching. Of course
>> >>>only time will tell whether this helps in the long run, but so far
>> >>>10/10 tries succeeded to kill the machine with this method...
>> >>>
>> >>
>> >>Could you try this patch:
>> >>
>> >> =A0 =A0http://people.freebsd.org/~pjd/patches/arc.c.4.patch
>> >>
>> >It seems (after running for two days) that this fixes my problem. And
>> >I see that Kip has came out with a similar version (which I couldn't
>> >yet test, but hope that will also do).
>> It seems that I was a little bit quick regarding this.
>> The machine just stopped with this:
>> last pid: 32358; =A0load averages: =A00.01, =A00.04, =A00.12 =A0 =A0up 2=
+06:33:56
>> 14:36:25
>> 114 processes: 1 running, 112 sleeping, 1 zombie
>> CPU: =A00.0% user, =A00.0% nice, =A00.0% system, =A00.0% interrupt, =A01=
00% idle
>> Mem: 536M Active, 63M Inact, 393M Wired, 8K Cache, 111M Buf
>> Swap: 4096M Total, 15M Used, 4081M Free
>>
>> =A0PID USERNAME =A0THR PRI NICE =A0 SIZE =A0 =A0RES STATE =A0 C =A0 TIME=
 =A0 WCPU COMMAND
>> 24025 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A03932K =A0 992K vmwait =A00=
 =A0 6:06 =A00.00% zpool
>> 84190 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A04700K =A01592K CPU1 =A0 =
=A01 =A0 4:17 =A00.00% top
>> 99029 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A04132K =A01212K nanslp =A01=
 =A0 3:53 =A00.00% gstat
>> 26317 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01528K =A0 352K piperd =A01=
 =A0 3:38 =A00.00%
>> readproctitl
>> 49143 =A0 =A0125 =A0 =A0 =A04 =A045 =A0 =A00 12248K =A03788K sigwai =A00=
 =A0 2:50 =A00.00%
>> milter-greyl
>> 39969 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00=
 =A0 2:50 =A00.00% supervise
>> 40241 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00=
 =A0 2:47 =A00.00% supervise
>> 44633 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 512K vmwait =A00=
 =A0 2:43 =A00.00% supervise
>> 43434 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00=
 =A0 2:43 =A00.00% supervise
>> 50575 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 516K vmwait =A00=
 =A0 2:42 =A00.00% supervise
>> 45510 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A01536K =A0 512K vmwait =A00=
 =A0 2:42 =A00.00% supervise
>> 58146 =A0 =A0 60 =A0 =A0 =A01 =A044 =A0 =A00 =A0 264M =A08828K pfault =
=A00 =A0 2:32 =A00.00% imapd
>> 47526 =A0 =A0389 =A0 =A0 =A06 =A044 =A0 =A00 92688K =A02296K ucond =A0 1=
 =A0 1:29 =A00.00% slapd
>> 5417 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A09396K =A01680K pfault =A01 =
=A0 1:26 =A00.00% sshd
>> 13147 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A03340K =A0 860K vmwait =A01=
 =A0 0:45 =A00.00% syslogd
>> 92597 root =A0 =A0 =A0 =A01 =A044 =A0 =A00 =A09396K =A01676K pfault =A01=
 =A0 0:39 =A00.00% sshd
>> 26437 =A0 =A0125 =A0 =A0 =A01 =A044 =A0 =A00 =A06924K =A01700K vmwait =
=A00 =A0 0:33 =A00.00% qmgr
>>
>> The above top was refreshing, but every other stuff on different ssh
>> consoles (like a running zpool iostat and gstat) was frozen.
>> Even top stopped when I have resized the window.
>
> Please try Kip's patch that was committed, it changes priorities a bit,
> which should help.
>
> --
> Pawel Jakub Dawidek =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 http://ww=
w.wheel.pl
> pjd@FreeBSD.org =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 http:=
//www.FreeBSD.org
> FreeBSD committer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 Am I Ev=
il? Yes, I Am!
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ed91d4a80910081006u644c94c1x12a65c2718b3a739>