From owner-freebsd-fs@FreeBSD.ORG Mon Mar 10 17:50:20 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 09B3A361 for ; Mon, 10 Mar 2014 17:50:20 +0000 (UTC) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9A54091D for ; Mon, 10 Mar 2014 17:50:19 +0000 (UTC) Received: from r2d2 ([82.69.141.170]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50008558932.msg for ; Mon, 10 Mar 2014 17:50:17 +0000 X-Spam-Processed: mail1.multiplay.co.uk, Mon, 10 Mar 2014 17:50:17 +0000 (not processed: message from valid local sender) X-MDDKIM-Result: neutral (mail1.multiplay.co.uk) X-MDRemoteIP: 82.69.141.170 X-Return-Path: prvs=1146ddc565=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-fs@freebsd.org Message-ID: From: "Steven Hartland" To: "Adrian Gschwend" References: <531DF0DD.8070809@netlabs.org> <531DF924.5030109@netlabs.org> Subject: Re: Reoccuring ZFS performance problems Date: Mon, 10 Mar 2014 17:50:08 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Mar 2014 17:50:20 -0000 ----- Original Message ----- From: "Adrian Gschwend" To: "Steven Hartland" Cc: Sent: Monday, March 10, 2014 5:40 PM Subject: Re: Reoccuring ZFS performance problems > On 10.03.14 18:31, Steven Hartland wrote: > > > >> Looks like you may be out of IOP/s but just incase, are you using TRIM >> at all? >> sysctl -a |grep trim > > vfs.zfs.vdev.trim_on_init: 1 > vfs.zfs.vdev.trim_max_pending: 64 > vfs.zfs.vdev.trim_max_bytes: 2147483648 > vfs.zfs.trim.enabled: 1 > vfs.zfs.trim.max_interval: 1 > vfs.zfs.trim.timeout: 30 > vfs.zfs.trim.txg_delay: 32 > kstat.zfs.misc.zio_trim.bytes: 0 > kstat.zfs.misc.zio_trim.success: 0 > kstat.zfs.misc.zio_trim.unsupported: 115 > kstat.zfs.misc.zio_trim.failed: 0 > > so looks like trim is enabled Its enabled but not in use as the devices are reporting unsupported. >> If you are what does "gstat -d" show? > > It looks like finally my MySQL process finished and now the system is > back to completely fine: > > dT: 1.010s w: 1.000s > L(q) ops/s r/s kBps ms/r w/s kBps ms/w d/s kBps > ms/d %busy Name > 10 203 0 0 0.0 192 1674 38.8 0 0 > 0.0 95.2| vtbd0 > 0 0 0 0 0.0 0 0 0.0 0 0 > 0.0 0.0| vtbd0p1 > 0 0 0 0 0.0 0 0 0.0 0 0 > 0.0 0.0| vtbd0p2 > 10 203 0 0 0.0 192 1674 39.0 0 0 > 0.0 95.5| vtbd0p3 > 0 0 0 0 0.0 0 0 0.0 0 0 > 0.0 0.0| cd0 > 0 0 0 0 0.0 0 0 0.0 0 0 > 0.0 0.0| gptid/e402ecce-89ca-11e2-a867-3264262b9894 > 0 0 0 0 0.0 0 0 0.0 0 0 > 0.0 0.0| gptid/e4112d88-89ca-11e2-a867-3264262b9894 > > I restarted MySQL now, curious how long it will take. > >> You also mention your using mysql, have you applied the standard tuning >> for mysql on ZFS? > > At first I didn't so anything special with MySQL, during the process I > redid the MySQL ZFS with a new record size: > > # zfs get recordsize tank/storage/data/db/data > NAME PROPERTY VALUE SOURCE > tank/storage/data/db/data recordsize 16K local Disabled atime, configured innodb settings? Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk.