From owner-freebsd-geom@FreeBSD.ORG Thu Mar 5 14:10:27 2015 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 86501128 for ; Thu, 5 Mar 2015 14:10:27 +0000 (UTC) Received: from mxout01.bytecamp.net (mxout01.bytecamp.net [212.204.60.217]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3A0FED29 for ; Thu, 5 Mar 2015 14:10:26 +0000 (UTC) Received: by mxout01.bytecamp.net (Postfix, from userid 1001) id 3316E30FE52; Thu, 5 Mar 2015 15:10:18 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=bytecamp.net; h=message-id:date:from:mime-version:to:subject:references:in-reply-to:content-type:content-transfer-encoding; s=20140709; bh=52OJw8Z8IK8Ll0gBvzpTkIRzN4o=; b=7UBwfcTGbZKf4JUAngKJk04BnjzmP6gyqGE9QuBSTpOHS7rdKaVeXfGdYqUuNseJ5wa6sV3WqJCFUTj78dAsHrH5lsW/Av4fHRPFDwxPuUi6VzTPt14aU5ZNW5xY/L8U/eHiAioxuoTVDH2TRLTBzpKQA1fvOpuZ66hta2av+Ik= Received: from mail.bytecamp.net (mailstore.bytecamp.net [212.204.60.20]) by mxout01.bytecamp.net (Postfix) with ESMTP id 05CBA30FE08 for ; Thu, 5 Mar 2015 15:10:17 +0100 (CET) Received: (qmail 40808 invoked by uid 89); 5 Mar 2015 15:10:17 +0100 Received: from stella.bytecamp.net (HELO ?212.204.60.37?) (rs%bytecamp.net@212.204.60.37) by mail.bytecamp.net with AES128-SHA encrypted SMTP; 5 Mar 2015 15:10:17 +0100 Message-ID: <54F863C9.3070002@bytecamp.net> Date: Thu, 05 Mar 2015 15:10:17 +0100 From: Robert Schulze Organization: bytecamp GmbH User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-geom@freebsd.org Subject: Re: Trim on gmirrored SSDs is slow and results in inresponsive system References: <54F6FE2E.60303@bytecamp.net> <54F707CC.6070105@multiplay.co.uk> <54F7147F.8070206@bytecamp.net> <54F718D9.1080201@multiplay.co.uk> <54F721BC.5070204@bytecamp.net> <54F72E39.2070105@multiplay.co.uk> In-Reply-To: <54F72E39.2070105@multiplay.co.uk> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Mar 2015 14:10:27 -0000 Hi, Am 04.03.2015 um 17:09 schrieb Steven Hartland: > Transaction sizes look like they are the same but the tps from gmirror > is significantly lower. > > As iostat doesn't properly understand deletes it would still be nice to > see that gstat -d -p output as that will also give us queue depth. Since gstat doesnt just output row by row, I had to screenshot a running gstat and transcribe the values. Running gstat -b in a loop doesn't help here, since the system is inresponsive and won't start any program in time during the DELETE ops. So after deleting a 2GB file on a gmirror with two active SSDs I get: # gstat -dpfada -I3s dT: 3.189s w: 3.000s filter: ada L(q) ops/s r/s kBps ms/r w/s kBps ms/w d/s kBps ms/d %busy Name 0 3342 0 0 0.0 0 0 0.0 3342 106939 10.2 80.5| ada0 0 3342 0 0 0.0 0 0 0.0 3342 106939 10.0 82.0| ada1 9 2606 0 0 0.0 0 0 0.0 2606 83400 60.8 98.3| ada0 9 2606 0 0 0.0 0 0 0.0 2606 83400 56.9 98.7| ada1 46 1705 0 0 0.0 0 0 0.0 1705 54565 62.5 98.4| ada0 51 1704 0 0 0.0 0 0 0.0 1704 54512 62.9 97.6| ada1 22 1540 0 0 0.0 0 0 0.0 1540 49285 20.9 96.6| ada0 24 1541 0 0 0.0 0 0 0.0 1541 49317 21.8 96.0| ada1 2 1496 0 0 0.0 0 0 0.0 1496 47887 13.3 98.6| ada0 7 1495 0 0 0.0 0 0 0.0 1495 47855 14.1 98.9| ada1 11 1032 0 0 0.0 0 0 0.0 1032 33010 18.2 98.8| ada0 10 1033 0 0 0.0 0 0 0.0 1033 33070 15.4 98.1| ada1 12 775 0 0 0.0 0 0 0.0 775 24798 26.2 97.5| ada0 16 773 0 0 0.0 0 0 0.0 773 24746 29.6 98.5| ada1 65 743 0 0 0.0 0 0 0.0 743 23784 25.4 98.8| ada0 59 746 0 0 0.0 0 0 0.0 746 23887 24.4 99.0| ada1 > > Try backing out r268816 and see if that has any impact. could you please explain what you mean by that? regards, Robert Schulze