Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 30 Apr 2015 16:19:02 +0200
From:      Robert David <robert.david.public@gmail.com>
To:        Martijn <martijn@hostage.nl>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: ZFS stuck on write
Message-ID:  <20150430161902.4868094c@robert-notebook>
In-Reply-To: <20150430134659.GA4950@kobol.office.hostage.nl>
References:  <20150430134659.GA4950@kobol.office.hostage.nl>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi Martin, 

so few information provided to suggest anything. 

What about the pool size, free space? Some exceeding quotas? Features enabled
(compress,dedup)? Zil, l2arc?

Regards,
Robert.

On Thu, 30 Apr 2015 15:47:00 +0200
Martijn <martijn@hostage.nl> wrote:

> Hi,
> 
> I've been trying to get an important production machine stable again since
> yesterday afternoon, but to no avail (so far).
> 
> It seems ZFS is the problem on this box. Situation is as follows:
> 
> - it used to be fbsd 8.3. after reading about deadlocks which have been fixed
>   in the meantime, i upgrade to 10.1, no change, did zpool upgrade, no change
>   and did zfs upgrade -a also no change...
> 
> - Its a machine on which each user has a separate zfs filesystem with refquota
>   set. It also did periodic zfs snapshots, every hour (48), day (14) week (8)
>   month (24), which is way too much but at the time of setting it up i thought
>   it couldn't hurt.
> 
> - After some usage the machine gets stuck when trying to write a file. The
>   process just stops and can't be killed. After some time the whole machine
>   used to become unresponsive in 8.3, but nice 10.1 i can still reach it,
>   although processes attempting to write get stuck for ever.
> 
> - nothing scary shows in dmesg
> 
> What can i do? The machine has 24GB of registered ECC ram  (17GB free), its a
> RAID-Z pool with 4 sata hdd's on a LSI SAS3442E-R (1068 chip) in IT mode.
> 
> loader.conf:
> 
> 	vfs.zfs.arc_max=8G
> 	vfs.zfs.txg.timeout="5"
> 	vfs.zfs.prefetch_disable="1"
> 	vfs.zfs.vdev.min_pending="3"
> 	vfs.zfs.vdev.max_pending="6"
> 	vfs.zfs.txg.write_limit_override=1073741824
> 
> I've tried to copy the most important users to another machine but thats gonna
> take a lot of time. There's 160 users (websites + mailboxes) on it.
> 
> Any help would be much appreciated!
> 
> Thanks in advance,
> 
> Martijn




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20150430161902.4868094c>