From owner-freebsd-geom@FreeBSD.ORG Wed Mar 4 14:19:46 2015 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 49BE6B3E for ; Wed, 4 Mar 2015 14:19:46 +0000 (UTC) Received: from mxout01.bytecamp.net (mxout01.bytecamp.net [212.204.60.217]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C6927A17 for ; Wed, 4 Mar 2015 14:19:45 +0000 (UTC) Received: by mxout01.bytecamp.net (Postfix, from userid 1001) id D4F8830FDA6; Wed, 4 Mar 2015 15:19:43 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=bytecamp.net; h=message-id:date:from:mime-version:to:subject:references:in-reply-to:content-type:content-transfer-encoding; s=20140709; bh=3nmuOf0xRjNuixb/Mq9OD9WXCMA=; b=Ufh4nRaOLGs6RfSwmOm6663pBQQ+oWoDAmLXnzChnXCemsrP7pm2AxlMYiN+TXMYXeYveel4KrtYQ87t9WRRwBBFQNhotZW675hkPNwIJ7eUz96zMGWt9aSNeHx587TU7JmsZTnsrts0lEur5dxSKmxlGlWpcySQ/p98pncI2TU= Received: from mail.bytecamp.net (mailstore.bytecamp.net [212.204.60.20]) by mxout01.bytecamp.net (Postfix) with ESMTP id 8D28630FD99 for ; Wed, 4 Mar 2015 15:19:43 +0100 (CET) Received: (qmail 2513 invoked by uid 89); 4 Mar 2015 15:19:43 +0100 Received: from stella.bytecamp.net (HELO ?212.204.60.37?) (rs%bytecamp.net@212.204.60.37) by mail.bytecamp.net with AES128-SHA encrypted SMTP; 4 Mar 2015 15:19:43 +0100 Message-ID: <54F7147F.8070206@bytecamp.net> Date: Wed, 04 Mar 2015 15:19:43 +0100 From: Robert Schulze Organization: bytecamp GmbH User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-geom@freebsd.org Subject: Re: Trim on gmirrored SSDs is slow and results in inresponsive system References: <54F6FE2E.60303@bytecamp.net> <54F707CC.6070105@multiplay.co.uk> In-Reply-To: <54F707CC.6070105@multiplay.co.uk> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Mar 2015 14:19:46 -0000 Hi, Am 04.03.2015 um 14:25 schrieb Steven Hartland: > Do you have one disk which has really slow TRIM? > please note, it does not depend on the disk, it is related to gmirror. > What's the output for: > camcontrol identify # camcontrol identify ada0 pass1: ATA-9 SATA 3.x device pass1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 512bytes) protocol ATA/ATAPI-9 SATA 3.x device model INTEL SSDSC2BB240G4 firmware revision D2010370 serial number BTWL404203MN240NGN WWN 55cd2e404b586c42 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 4096, offset 0 LBA supported 268435455 sectors LBA48 supported 468862128 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM non-rotating Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags NCQ Queue Management no NCQ Streaming no Receive & Send FPDMA Queued no SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management no no automatic acoustic management no no media status notification no no power-up in Standby no no write-read-verify no no unload yes yes general purpose logging yes yes free-fall no no Data Set Management (DSM/TRIM) yes DSM - max 512byte blocks yes 4 DSM - deterministic read yes zeroed Host Protected Area (HPA) yes no 468862128/468862128 HPA - Security no > grep quirks /var/run/dmesg.boot results in empty output, same as dmesg|grep quirks > sysctl kern.cam |grep sort_io_queue kern.cam.sort_io_queues: 1 kern.cam.ada.0.sort_io_queue: 0 kern.cam.ada.1.sort_io_queue: 0 kern.cam.da.0.sort_io_queue: -1 > > Also how does gstat -d -p compare between gmirror and none gmirror > installs on the same machine? Deleting on a non-mirrored UFS does not influence the system, because the BIO_DELETE calls are processed extremely fast (~ 1 sec with 1GB file), with a high number of d/s (~ 100k). > Do you see high kernel CPU when the deletes are happening? no. Here are the top system processes after deleting a 5GB file: 0:40 144.87% cam 0:22 77.59% g_mirror var 0:14 62.79% bufdaemon 0:14 0.88% intr 0:13 0.59% geom 0:01 0.00% rand_harvestq 0:00 0.00% kernel with kind regards, Robert Schulze