From owner-freebsd-fs@freebsd.org Tue Jun 20 00:57:14 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 401AADA7C5E for ; Tue, 20 Jun 2017 00:57:14 +0000 (UTC) (envelope-from Aaron.Caza@ca.weatherford.com) Received: from NAM01-BN3-obe.outbound.protection.outlook.com (mail-bn3nam01on0059.outbound.protection.outlook.com [104.47.33.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A4E3765A0F for ; Tue, 20 Jun 2017 00:57:12 +0000 (UTC) (envelope-from Aaron.Caza@ca.weatherford.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=weatherford.onmicrosoft.com; s=selector1-ca-weatherford-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=fpvYwEwcAa2oAlosDCKnA98KwHNWsniPdHpQswIr7JU=; b=RyQJwYKb4xtIKdnMYcxVaDliCeEN7P0qmm5TsVTl4uJ2ocQ47GEqutSBvYr5UkjtnYPZx7kJutjM+oBMhXwNgoNngmNJAt7VgXED38rlChcR353PgHBMKxqRp363qW6NdoDPD6qppbi8KAkxZlR0NN6/jPJsNadO3lApfBjU8z8= Received: from BN6PR03CA0090.namprd03.prod.outlook.com (10.164.122.156) by CY4PR03MB3272.namprd03.prod.outlook.com (10.171.246.141) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1178.14; Tue, 20 Jun 2017 00:57:10 +0000 Received: from BY2FFO11FD011.protection.gbl (2a01:111:f400:7c0c::152) by BN6PR03CA0090.outlook.office365.com (2603:10b6:405:6f::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1178.14 via Frontend Transport; Tue, 20 Jun 2017 00:57:10 +0000 Authentication-Results: spf=pass (sender IP is 23.103.226.20) smtp.mailfrom=ca.weatherford.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=bestguesspass action=none header.from=ca.weatherford.com; Received-SPF: Pass (protection.outlook.com: domain of ca.weatherford.com designates 23.103.226.20 as permitted sender) receiver=protection.outlook.com; client-ip=23.103.226.20; helo=032-smtp-out.weatherford.com; Received: from 032-smtp-out.weatherford.com (23.103.226.20) by BY2FFO11FD011.mail.protection.outlook.com (10.1.14.129) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1157.12 via Frontend Transport; Tue, 20 Jun 2017 00:57:10 +0000 Received: from DM2PR58MB013.032d.mgd.msft.net (141.251.110.81) by DM2PR58MB016.032d.mgd.msft.net (141.251.110.84) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1178.14; Tue, 20 Jun 2017 00:57:08 +0000 Received: from DM2PR58MB013.032d.mgd.msft.net ([141.251.110.81]) by DM2PR58MB013.032d.mgd.msft.net ([141.251.110.81]) with mapi id 15.01.1178.018; Tue, 20 Jun 2017 00:57:08 +0000 From: "Caza, Aaron" To: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 11.1 Beta 2 ZFS performance degradation on SSDs Thread-Topic: Re: FreeBSD 11.1 Beta 2 ZFS performance degradation on SSDs Thread-Index: AdLpVvY5oAKJNs3ZTx6kAWjOND0OCw== Date: Tue, 20 Jun 2017 00:57:08 +0000 Message-ID: <431d958c658a408d8bfd4c574a565439@DM2PR58MB013.032d.mgd.msft.net> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [141.251.110.69] x-ms-publictraffictype: Email X-MS-TrafficTypeDiagnostic: DM2PR58MB016:|CY4PR03MB3272: X-MS-Office365-Filtering-Correlation-Id: 30af2779-b18a-49a8-0e46-08d4b77747e9 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OrganizationHeadersPreserved: DM2PR58MB016.032d.mgd.msft.net X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:23.103.226.20; IPV:NLI; CTRY:; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(39400400002)(39850400002)(39840400002)(39860400002)(39450400003)(39410400002)(2980300002)(438002)(189002)(40224003)(13734003)(24454002)(199003)(9170700003)(356003)(46406003)(2351001)(478600001)(6116002)(966005)(106466001)(3846002)(50466002)(33646002)(23726003)(110136004)(8676002)(8936002)(53936002)(50986999)(54356999)(72206003)(305945005)(189998001)(81166006)(6916009)(42882006)(53546009)(86146001)(38730400002)(8746002)(86362001)(229853002)(97756001)(2501003)(575784001)(5640700003)(55016002)(47776003)(5890100001)(2900100001)(6306002)(22756006)(2906002)(5660300001)(24736003)(7696004)(66066001)(9686003)(299355004); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR03MB3272; H:032-smtp-out.weatherford.com; FPR:; SPF:Pass; MLV:sfv; MX:1; A:0; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; BY2FFO11FD011; 1:Rlx9+kV9VXe31cLaLxoM1KoKBhGYBbbIr1SJGXp7toM/BUK+f+d7TG5Wr2Klg0BxHuhsVD5QkjYT+kd0rj+BitrZc2Hfss09IHok005UbTXfAmxdd5+tjepgvNFvML7tEPgl98g7N2UnSwFakTSmqh5JPfwGT5JLb2svojVwj/AL9j6LLQ4QKH67m1w0S8c9mb5XnDnUMZEWEaNUlqURXNnzSrTQQbDyxOEHUDf/lZOuQ1fAJbBWlcFq+EYyWEUzh/0DgYJMqiKEyVz7ljl9uqNHM2nSDWzIUouz6C0hznAcIE+4F6tLEqFedBTXx49kL+6FldcI89ftrD6KH5zg5biprGWImEUJ2cuXbvEUCjhw38M0LsAHl7g/aZOoJDpDDoWwD4fgRtsEcOStVMlVoZpJ6K4H/+zuExtfaiRvPRIBPd9vaAiqjalfZbfev5PktJreTbjf4yxasMcz/m9C/476Bw4OeV8ZjkpSMaJnd+zqU4s4ObKEv/gmO4+fXzJVe5atMQSOMUFpwZ2ubrRMoQ== X-CrossPremisesHeadersPromoted: BY2FFO11FD011.protection.gbl X-CrossPremisesHeadersFiltered: BY2FFO11FD011.protection.gbl X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(8251501002)(2017030254075)(201703131423075)(201703031133081)(201702281549075); SRVR:CY4PR03MB3272; X-Microsoft-Exchange-Diagnostics: 1; CY4PR03MB3272; 3:XARSO3q55PxVDwqlN4zI0U+IS1jvc+HRQ8eSONfgrs5dCBdZMHuqAV3fmH6jF6hBQ/g/WOTFfrI1HSeFEOBa/9D/RSbs/S+ugLYSq6VTQIyrYwDbHUggPteNht5ShxpmteZjrhoHnEU06mQ8baP4gGUCq8+BBTAZHlCqPmZ5O+MA8wXyuyxIzRm02fNg3e5p4ijVYS/H7al1mpBIIC1Fwc2Dav42NLsbqqE5C8aTP8dHyJu7R1kUzhkeG/c7x24l6ZtE70swVRgwxNPZ5HGJ3eN9HqZshAi3MkGZZ7w9VoM5+jJERhsuTfDTzPLhcU4Q2Y9CC5ZenA19cpvbTgDfn5nFsHw+UGaw0fbGBHHvu4ZV4PreG6uYcDA/RAmD36d6Q6TQpgWSIbnOc/yT17D6opoRJXtihIP+bIrkfZkzztAvKIun7uEhRNcLW5p1HOibvgRq++//BtH3ZxRDDX52gHX1+RyVjkC/ic0sRcF9DaIDLO9uU//S1zadDMKqBoMdPOmtXlR62b6ePtUb2OqH3Q== X-Microsoft-Exchange-Diagnostics: 1; CY4PR03MB3272; 25:wKWWx6wMavz9CnvDXRc3cO4oDiKQvmwmrNqzG8dm9J3+2220ZZXnoz5ilKxwynAsGmI1CiBPDkgL4s/Ioj5zvA2yfUeNKfsEU/hTUOQomjpVT0nybW+hzSBcjX0d/6Y/68VbaCzVj9xQViRjzDAMP3ar3VfZLuM6ElOrHW5j80AHz6wozEii1QA+V6wwDRPJIBoQUucxFZXg3lOAzMosl0Xzmwp6kDQ7JL0PP2kPC8FtLzEXdf0NO9FnF84yBVrJBhngUdg54V0jkDbihBzPW29N66fLUUbbyv1jpna1r+Sx9QQ6fCJwdYdQGGgT/KBCg0xcwqDLK6HIqmA66UVju+u30LiIPudWO0WRvw8KiS9T15m9J+QNb1ncRisl1pn1/pdYXz8XSY0Dp4LZAGjsaQHcOlCrbD/zkBJgopSAJNsUN0qk2zBakqqjd8nJdCjEbFZouZ9vWqNj0Xs2JnFPSIkqAjj1PjX2WKQ83wZKLVE=; 31:GBSJF2ojp1lGa+bjuzN9lz0V4BrTU4FAxH7hZq2C1SX1NYxk4NOXu7nk+ovMHo9M/rq3fsxzHcs66x7qwRP+ZLDcuWCKxDQZVSWP1UncQA5cVjZf7UPda1DqOyERHyX7qdNifss0+5P+NzAhsgKbzsxkm9Ads3fNRp66ySbcnVlOKSGoz85yUJzJKlwTcmWE/t41SDlQG3hKzAqOXB79sb9EH5maeji+84uTF7rYU4DbgNSZO8RTp/Y0b/R1sJRXbUjdSS0VPKuuOXG7CAeS0A== X-Microsoft-Exchange-Diagnostics: 1; CY4PR03MB3272; 20:7+tfuhmVWc92nowtr7o35GPnvWVRKhbIvA6pfef8nbXL4ybIx/t3UoTvTqeBr0P8Uf45DFg9vq4FIyAmoIfBGW5iAqb/f/SmoOHPYmm7BTyjO7fzRDqVljXsIThVqOPtVU/I/wt6HQmWSGPlJbZTG4bVaKKHd3cfW+ZV4SFMryr9TThkTetcSEHKPuytSPyQ0XXQR4luhHH1MQr/9KxwUONKDuloSO2lQHUtx02UYXDDI4x1jY/07oWxAWJGHTiMpkcz3K/4ifl5L2Y7iaVgST1iJuF5EYhZBa7rByrZNmja/hCOnd7uqBm7oe4tbZLWUNrY82ZzyGloUGxfismc7JiDg1SmtXTCXwW+SnNxj4mOeaE2bQkB92RgifNwFLu6V6hLdv+f2FgaullSYWjDc2K5vpo2xxN6nSTlVRYCLsVxvxoUm9khPdq7L7moZaBWrWdRqueCHmvAPD7KubXcAyUW8q9e/Tw9v74ceCoMvTtwYDtcESG+J6kGQF90IjGy X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(158342451672863)(209352067349851)(192374486261705); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(11241501159)(6040450)(601004)(2401047)(13018025)(8121501046)(13016025)(5005006)(10201501046)(100000703101)(100105400095)(93006095)(93004095)(3002001)(6055026)(6041248)(20161123562025)(20161123564025)(20161123555025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123558100)(20161123560025)(6072148)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:CY4PR03MB3272; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:CY4PR03MB3272; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; CY4PR03MB3272; 4:ebdfKt0AyhBawDMV77UJZOOJkSVBXL5en7CW9gFspQ?= =?us-ascii?Q?aqg/L1L34qcMA2iYV+zEo6Mu1dTG9vja/tLWBf2cBs0FrqUobxAeMOtZc6WJ?= =?us-ascii?Q?cdhkgz9d2meA+Ljhsmfgu7IEwFR9iO6NWE2/7lGbm+P+FGUj+w7sraW+dCUc?= =?us-ascii?Q?h6Rbw6j/kZuI3z/+HKJEpg3cF2fotTBV124ElqANOvFq89DKdjRWlb6SChqd?= =?us-ascii?Q?B6NySzuHJr7/gDrHtDd5OXajQD6Q/u40SpaGO8BgBZL5wNgdBRbM+c6Fhksw?= =?us-ascii?Q?tOxlOh74SCmrGcOoagmWfc41J7V5ctgOYRR0PZv6i0hFoD0x5OMQT9T1UWpg?= =?us-ascii?Q?Uc9XLG1M9YujNAOWThmbsO0ExqbtAm5byboFrpA4xFuPnAcGPKEhUIkI0A6o?= =?us-ascii?Q?d2s+5Xjb3sWG+nfkEZ8VNCKE4eWpx6IkJ1/bebQKN4hVgdusVZxxweV0ZbDX?= =?us-ascii?Q?39tXCYnKnAXgjWZ0OioM8xvASi4QtBsPWui/sCIGbS4jeeL06hubVpOrAyll?= =?us-ascii?Q?1I6JWwiQ3wBGWJi6+YFlI0exrfSnuO7BsYYJUpGdMoZWr18hTgL7N1GPtI4F?= =?us-ascii?Q?n+12rB9kosPRJc+gpoYsmk/waJoBqVWstcsO6PfGWcPivBQxn862TqHG2nuO?= =?us-ascii?Q?Hk8wf0f/MiqRNnDiW+Y2jrNpJgl8YyWCjzAE+h29tW8jBIzWfhZz+TnD7n/P?= =?us-ascii?Q?rJuwXWJJf6QDXIAn0J9OSLKxondU1T0UNpE1dlam2v6wbjLKYT8gkUafcXKg?= =?us-ascii?Q?XVzR0q+cw+KeD0NVWiNgapCOTTWlBxEakp8ZB1mXVLtFOehS+264/wvHMI85?= =?us-ascii?Q?fwEGXZs7y/qnxxyhhnUpWDDX4Ef8ai302fbDG2rM0Hn31q77eHVlQitDoPYr?= =?us-ascii?Q?Q74MSduhwxPme/7JNHbg9VO9rwgddqmHl8pyVdEZqi0wFxFBv/+T51QJorCX?= =?us-ascii?Q?I4UtSzB6xBqPtS5x2n1PmmwMfr2Y5sxsI9IX13xkrkb/zfViH0W0g9DRHrdY?= =?us-ascii?Q?RmriOFnaV82Dns0mlbaIRRfuKRDkO6uyulRKrX1/tt5o1S2egaUmzoiIKe10?= =?us-ascii?Q?Ya9ATjvh28WzJ3NHlgbi5uhGZYvFrdnSejB+hrDCn/FQOsFvryS09py3X58n?= =?us-ascii?Q?kkSk96wiHDbdQtdBfloBFjV484jI1rczLE6GJJaN6pzShBj1nUgiKWokpQ0G?= =?us-ascii?Q?2Xdtu3Ezf5GccSIJEhCTASPf54qWFXacdhEkRbAE0j902emE0nJ4GUR1Se64?= =?us-ascii?Q?IzOtp+ZOV1txKNVI72R/cPuUZA6EEaJ0041K2rsM/twuICRkGIvGfjWsL/x9?= =?us-ascii?Q?vXh2wzxHA2qxHP1AfIcBmDWMB/KQJjW0eRH/Pi6A/WyfRxiYpt1oZr4qIUSF?= =?us-ascii?Q?UgDw=3D=3D?= X-Forefront-PRVS: 03449D5DD1 X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; CY4PR03MB3272; 23:/7Axl30SDG4N6Ibzp8mMHrFQuVv5BhR8Z8fyATPlI?= =?us-ascii?Q?LK7FlFNRsS0x44uvhqoUFx+JTc53SNNQLX3xRZO7bUHuwybjiG/ti8HqsHpE?= =?us-ascii?Q?VXFLnyMSh0nMkYiTQs88BDms00rszwdB2p4GNVuJcsk0Wub4GCnrpeOWRdqx?= =?us-ascii?Q?r0UnEAV7DSd434ZC5RsEp+we0Ro66RZWTmH3zYVcPFa7Nmdy/DbwIQL5m4DT?= =?us-ascii?Q?dWRpkh5Vdb0VpNwHelX05XhtQ2D9tKKp6bi7njVvZ+v8Mdxhcmk5HOKMXCVe?= =?us-ascii?Q?J6jDAdwtNnbxvGAcknORWEORJAhR6fAkmFGAfc58S71rIf9cEMEUn2B0UPYc?= =?us-ascii?Q?fFZUrxZPpWnGgfWH4o0bvA3WC0T4REgPPo9hzjSCNwOlBRokYEJ+J1Y2l5Xw?= =?us-ascii?Q?dUgi3CH+TlZUzSX+CFH3wFjWmwBVybnHssx44TSNjDO2fRfSmUesi0mVGxMg?= =?us-ascii?Q?aair5VkLGvAghvUJ674Xw1YugSOsrFvuR4It5okrXEq2iS/aKQPqyz+E7rMl?= =?us-ascii?Q?VCsCUwaCL6YShZ2LQppy1tdHzpTAxm3wXCpz3IJC+65elc7Ox4DUqhApk0bU?= =?us-ascii?Q?UnRkfm+vmomM/fzR6yXypli98WNaxRJLg5kMTG9jWTzdkHxjgDVvF7cau25X?= =?us-ascii?Q?lV8iWSymhFzt1dUYBzmOK2mO1t+KO18SjbVOrPvpSEdxeyn613fIOk8ewL/z?= =?us-ascii?Q?b8G+jPVXO8y3MYckQXh5yYypJHqxWn+b/+rgHusV9efjVzWLTdkEk1ClyF4t?= =?us-ascii?Q?x6zVZ7Xn82j/+i2VafNWLG103ABX47o3/hvamyPa0OaLvXcMC/yuU0qI1ZTZ?= =?us-ascii?Q?IbHcbhUL3vJtpsqpi/tqUi/yKsRft+t+Ay8ojQV86cR/G+hOOBQyo+wFj0Jd?= =?us-ascii?Q?o5LUNtfH1t4fZ7/CPgloLHIx+emr9epztm0aTwEfaPefWPx4M/RpQYzxoDNk?= =?us-ascii?Q?efVMgxryOatZLVr/3bQ/GQUzNDjpb/4D5jkLwD0qQB1BIe4wOZbD8JO1DZC5?= =?us-ascii?Q?gW79Q+/H+X2UKMBsqybJNQgL0jJJSlcMDvDJwbkfqLmN0ixiN4X9ytcMsUYv?= =?us-ascii?Q?teFvemcdUq+TrUL2Qgpfise/41Z6BWagdnMiI9DJv8Syd70sVtVfO1RIQAwY?= =?us-ascii?Q?9S+L3pXoTtt7NerLC9ardShcgpfps5wei8N66ppcD2C014vfn0BAPrSl5EKL?= =?us-ascii?Q?11TZMblASjof/a5mllqdpz4GDkdHtegelB+PSw6EXPdcVm8UShYcv1EvPkZ1?= =?us-ascii?Q?IuReoy8b8zn3PlkbTvGWHbXvkSpyfSJK+1iyOUE9m07IdIiDtCVtcZUdva1v?= =?us-ascii?Q?NYkykUvPmdfgoBvaLreEoADzPbjVvk0PpViAJ1IhFS5KiyVzDj4NLJLDCrzM?= =?us-ascii?Q?7JzXdtLioMBhUNWtb8WaEZQ0Zx5X0dvA3+GlTKy6yxyhozxw1k33xT+On7w4?= =?us-ascii?Q?NqJSdBqsZc9dsAEQneqsYSTP4UpzAlRW54j8fOFaFy/SiK30GK+?= X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; CY4PR03MB3272; 6:nF8pfRA20ybPkiP3JRjhylHm7n4hV7I9srgXybMk5v?= =?us-ascii?Q?HeBxW5WwS3a3m3QrkFZOp/XbG+NW/uXD2uEKVxAZz7llpes5OPICKm70pJiO?= =?us-ascii?Q?Tjpix0Wl5lvqzODKTbKzm3zSA+qve3KRGkpI4j33Y2ZYSGZ0RXZbRlTUshxv?= =?us-ascii?Q?QuwDWo3Z0olp3ovc/geAk5TQe8vXLhfCsSXeJeS8SRRwNLMt0MSZwJIxnC+V?= =?us-ascii?Q?iCdI/d2sSB+kvQv/BMHRX8koCeEUl/Yjlf4ybnR5tHhUtBoPp5bNxmbLYj7F?= =?us-ascii?Q?+yEdjMbxzZHBixY8TjTFoL5bPX2EW2Z2X9e/ESQAQnWS4xRX3S4IOEWjGb16?= =?us-ascii?Q?NCiXsl3J5Gno+Ve6myu32xIImNFoIHqXVZ1jS5BIL0uHkRHXWACEl4W79K7N?= =?us-ascii?Q?LPNw9phQ1O3e31QkLDVkn6vyGZOrmbMHNvGhukUUV1PK2R0ErFb3FY2a6Lhq?= =?us-ascii?Q?FlOEqb94l4t6EvP+PHeecQn3M0opfGqSGdBt9FGYnr2m14Rglz59ZOBG3F6F?= =?us-ascii?Q?SCMgSnF+vEH+PVroKYrxGoRkXSLh26Bbel5kAO/LTbojg0g2XpLXknYDP+N+?= =?us-ascii?Q?njMMRK2Aj5kJau5mmPdg4E0HbSCim9Ree1ui56pTcZZ7RBHrZtzrv05sS6Ed?= =?us-ascii?Q?fXtTXSJvSieY/zgyrj3jJ2A0kjKjTSe+eJcJ2hPSo3XBlPaNxjzrkxbtlbjk?= =?us-ascii?Q?ytXHZuVtuEU2C9W6nqG4obtxPzYLFFIXGvteFuajjuGZOjxMdei+tIR/oEsW?= =?us-ascii?Q?w5teOppiUX3V1nX1Bd/LCPEWbQ5RTY4ALkU/LQ+oJn+ksJQG4gMfPqfgz9UE?= =?us-ascii?Q?5fM1AeEKZdXioPk2ZhA7OA1+qoQAT/0DdsnvMqYS9326JOIloatsCG/ccSr1?= =?us-ascii?Q?xxocxctFJwTuenk/glprhvaMtxJUd8XhofwDzGzRyMCF+Tx2qlRUWzSzH4tt?= =?us-ascii?Q?Cu/viiwQWT+aofyexKIuaStpGcZvOeartrzeEkirEVNk8kO1Dq9wBBpOxYoE?= =?us-ascii?Q?9V1k5jO7NFkTmO4AuXEcfA?= X-Microsoft-Exchange-Diagnostics: 1; CY4PR03MB3272; 5:mfCYTROCn90V2Izvnm1yAcQVG3tc68LtfwzCuhBRXawGsp1CALYsA8/LMIsNYd3K1BX9ldITZNZkmU2cNkbkTa6cH9CPtflNr7EfZ3q7zTw3R+DCzjTSLo5/+E0o9ZoLTkVi2vNfCtpVZSsIoWG2jzRV8ZqdeyGY2UcSoYvq+yYCxy+Zzara5ARYxPyq2f0j3S2s8qYggitqykBKNE60fLylFwqP4/ERuvpVPgjnTWIWmP7TRqJ5K/sSzQbmyO/ukgobfN0v0Dl56gk/tFSyWXLKkw/TLxSUxzkaPACjywhVB6heDzjy+zBwtdxUUY7osFHltOreU7K6xs/W9F55lclULqgZqoHIU0lTq9zoz63abHdMkr8tfpG4T/q9Iw6ITqRwrlAx0A6HXDKUKBVg426sZYUuW+iEL2JgkkYYjoIrfT/qmQwkHm0EFSvO9M+cLGohzb2kQ8THb+mM265BEt+1V49NrVVdMNSx7rEi/pUr2bTONNUwN3qNSt3/UVN1; 24:KuHCDjceQW1Zerr0aDV07u0fdma4oUGhmTtCaQFIxX2wtv3X2fcS6MXnZ32AC7JMuL9QQUa2tTwpAVXonF9MB2j1bnacM3xSLxeEGjcdZf4= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; CY4PR03MB3272; 7:jPnyzrAKN3YCqupnXB3EX1ebFfl/mwRnqYyuH7J13TaK3snaWKpjrkoGyliqp3qncedHiBeHGHM6PvfgHRGuh0746xSuoFtuj6C4EIpmCjoRUODF2X3wI+sFxrq4TYxvJvj8x/YWSpqa9Sl4FhC1LeY/SnWZ7IgR2vZue0TAmoaJyEJP0ksCGlXNuXqCRvQnaZyk3uiA3mqvQx8tvxyKMyr1cHg962IcIEyRYhF5XAaz8ghWFLxUgvASZxZfi39fS/QCk4arA43l0i6TgISbOjmo8NJO/YNHOJ6JPsLD0aKaqi6GI/llbU/lpAwjuX1JadwlkkeVdB81Yds4h5KEzdxgUccR8lNPyLmzlUoKk1bm5hFTYOz8BffzGGagykGHQaOjufogd85y2MZ/bR9PxhFtK8ltt6RM7yGXS04X5Xavh8U/StPL74PBVWauPVyG57XsZTf2KrvyFYzH8gKtL1rRE/cgbZP4aK77/2htd7P9UUzJoPXTT3aAp+vm6v8HR0KcLAvILU644T3/q9NqUp/osJVgkWX8ykM7gF4gYFki44LqhGcgFWT6d3u/ksmghsHt9m6rVGjik3lsJa7jaYQqidbwYb6kDQtUbwZkJ5XKHh/V+eg1K762GVxePys+4FdZucrFdA5p+jSeuqmActYgPwF5dFK0xyhJihBhPFKLy0kjtNpA7n6Ym0QjswMdZbNHiHfIkKrVpygFgl81wqTkcqm0l6dvtb39N+bQb+ikZ4x0adptmMGQa6V3xzbe+EW80LxDnEdZpQbK77bANAAi5zZglNmSJPjUYBZCCxY= X-OriginatorOrg: ca.weatherford.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jun 2017 00:57:10.0593 (UTC) X-MS-Exchange-CrossTenant-Id: dd63fb60-07f6-4d96-8d40-ebeca61a524e X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=dd63fb60-07f6-4d96-8d40-ebeca61a524e; Ip=[23.103.226.20]; Helo=[032-smtp-out.weatherford.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR03MB3272 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Jun 2017 00:57:14 -0000 > vfs.zfs.min_auto_ashift is a sysctl only its not a tuneable, so setting i= t in /boot/loader.conf won't have any effect. > > There's no need for it to be a tuneable as it only effects vdevs when the= y are created, which an only be done once the system is running. > The bsdinstall install script itself set vfs.zfs.min_auto_shift=3D12 in /bo= ot/loader.conf yet, as you say, this doesn't do anything. As a user, this = is a bit confusing to see it in /boot/loader.conf but do a 'sysctl -a | gre= p min_auto_ashift' and see 'vfs.zfs.min_auto_ashift: 9' so felt it was wort= h mentioning. > You don't explain why you believe there is degrading performance? As I related in my post, my previous FreeBSD 11-Stable setup using this sam= e hardware, I was seeing 950MB/s after bootup. I've been posting to the fr= eebsd-hackers list, but have moved to freebsd-fs list as this seemingly has= something to do with FreeBSD+ZFS behavior and user Jov had previously cros= s-posted to this list for me: https://docs.freebsd.org/cgi/getmsg.cgi?fetch=3D2905+0+archive/2017/freebsd= -fs/20170618.freebsd-fs I've been using FreeBSD+ZFS ever since FreeBSD 9.0, admittedly, with a diff= erent zpool layout which is essentially as follows: adaXp1 - gptboot loader adaXp2 - 1GB UFS partition adaXp3 - UFS with UUID labeled partition hosting a GEOM ELI layer using= NULL encryption to emulate 4k sectors (done before ashift was an option) So, adaXp3 would show up as something like the following: /dev/gpt/b62feb20-554b-11e7-989b-000bab332ee8 /dev/gpt/b62feb20-554b-11e7-989b-000bab332ee8.eli Then, the zpool mirrored pair would be something like the following: pool: wwbase state: ONLINE scan: none requested config: NAME STATE READ WR= ITE CKSUM wwbase ONLINE 0 = 0 0 mirror-0 ONLINE 0 = 0 0 gpt/b62feb20-554b-11e7-989b-000bab332ee8.eli ONLINE 0 = 0 0 gpt/4c596d40-554c-11e7-beb1-002590766b41.eli ONLINE 0 = 0 0 Using the above zpool configuration on this same hardware on FreeBSD 11-Sta= ble, I was seeing read speeds of 950MB/s using dd (dd if=3D/testdb/test of= =3D/dev/null bs=3D1m). However, after anywhere from 5 to 24 hours, perform= ance would degrade down to less than 100MB/s for unknown reasons - server w= as essentially idle so it's a mystery to me why this occurs. I'm seeing th= is behavior on FreeBSD 10.3R amd64 up through FreeBSD11.0 Stable. As I was= n't making any headway in resolving this, I opted today to use the FreeBSD1= 1.1 Beta 2 memstick image to create a basic FreeBSD 11.1 Beta 2 amd64 Auto(= ZFS) installation to see if this would resolve the original issue I was hav= ing as I would be using ZFS-on-root and vfs.zfs.min_auto_ashift=3D12 instea= d of my own emulation as described above. However, instead of seeing the 9= 50MB/s that I expected - which it what I see it with my alternative emulati= on - I'm seeing 450MB/s. I've yet to determine if this zpool setup as done= by the bsdinstall script will suffer from the original performance degrada= tion I observed. > What is the exact dd command your running as that can have a huge impact = on performance. dd if=3D/testdb/test of=3D/dev/null bs=3D1m Note that file /testdb/test is 16GB, twice the size of ram available in thi= s system. The /testdb directory is a ZFS file system with recordsize=3D8k,= chosen as ultimately it's intended to host a PostgreSQL database which use= s an 8k page size. My understanding is that a ZFS mirrored pool with two drives can read from = both drives at the same time hence double the speed. This is what I've act= ually observed ever since I first started using this in FreeBSD 9.0 with th= e GEOM ELI 4k sector emulation. This is actually my first time using FreeB= SD's native installer's Auto(ZFS) setup with 4k sectors emulated using vfs.= zfs.min_auto_ashift=3D12. As it's a ZFS mirrored pool, I still expected it= to be able to read at double-speed as it does with the GEOM ELI 4k sector = emulation; however, it does not. /var/run/dmesg.boot: Copyright (c) 1992-2017 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.1-BETA2 #0 r319993: Fri Jun 16 02:32:38 UTC 2017 root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on LLVM = 4.0.0) VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E31240 @ 3.30GHz (3292.60-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x206a7 Family=3D0x6 Model=3D0x2a Steppi= ng=3D7 Features=3D0xbfebfbff Features2=3D0x1dbae3ff AMD Features=3D0x28100800 AMD Features2=3D0x1 XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory =3D 8589934592 (8192 MB) avail memory =3D 8232431616 (7851 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #5 Launched! Timecounter "TSC-low" frequency 1646297938 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80f5a190, 0) error 19 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 550 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pcib0: _OSC returned error 0x10 pci0: on pcib0 em0: port 0xf020-0xf03f mem = 0xfba00000-0xfba1ffff,0xfba24000-0xfba24fff irq 20 at device 25.0 on pci0 em0: Using an MSI interrupt em0: Ethernet address: 00:25:90:76:6b:41 em0: netmap queues/slots: TX 1/1024, RX 1/1024 ehci0: mem 0xfba23000-0xfba233ff ir= q 16 at device 26.0 on pci0 usbus0: EHCI version 1.0 usbus0 on ehci0 usbus0: 480Mbps High Speed USB v2.0 pcib1: irq 17 at device 28.0 on pci0 pci1: on pcib1 pcib2: irq 17 at device 28.4 on pci0 pci2: on pcib2 em1: port 0xe000-0xe01f mem = 0xfb900000-0xfb91ffff,0xfb920000-0xfb923fff irq 16 at device 0.0 on pci2 em1: Using MSIX interrupts with 3 vectors em1: Ethernet address: 00:25:90:76:6b:40 em1: netmap queues/slots: TX 1/1024, RX 1/1024 ehci1: mem 0xfba22000-0xfba223ff ir= q 23 at device 29.0 on pci0 usbus1: EHCI version 1.0 usbus1 on ehci1 usbus1: 480Mbps High Speed USB v2.0 pcib3: at device 30.0 on pci0 pci3: on pcib3 vgapci0: mem 0xfe000000-0xfe7fffff,0xfb800000-0xfb= 803fff,0xfb000000-0xfb7fffff irq 23 at device 3.0 on pci3 vgapci0: Boot video device isab0: at device 31.0 on pci0 isa0: on isab0 ahci0: port 0xf070-0xf077,0xf060-= 0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfba21000-0xfba217ff = irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahciem0: on ahci0 acpi_button0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 ppc0: cannot reserve I/O port range est0: on cpu0 est1: on cpu1 est2: on cpu2 est3: on cpu3 est4: on cpu4 est5: on cpu5 est6: on cpu6 est7: on cpu7 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec nvme cam probe device init ugen0.1: at usbus0 ugen1.1: at usbus1 uhub0: on usbus0 uhub1: on usbus1 ses0 at ahciem0 bus 0 scbus2 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number S39KNB0HB00482Y ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada0: Command Queueing enabled ada0: 244198MB (500118192 512 byte sectors) ada0: quirks=3D0x3<4K,NCQ_TRIM_BROKEN> ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number S39KNB0HB00473Z ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada1: Command Queueing enabled ada1: 244198MB (500118192 512 byte sectors) ada1: quirks=3D0x3<4K,NCQ_TRIM_BROKEN> Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered Root mount waiting for: usbus1 usbus0 ugen0.2: at usbus0 uhub2 on uhub0 uhub2: on = usbus0 ugen1.2: at usbus1 uhub3 on uhub1 uhub3: on = usbus1 Root mount waiting for: usbus1 usbus0 uhub2: 6 ports with 6 removable, self powered uhub3: 6 ports with 6 removable, self powered ugen1.3: at usbus1 umodem0 on uhub3 umodem0: on usbus1 umodem0: data interface 1, has CM over data, has break > On 19/06/2017 23:14, Caza, Aaron wrote: > > I've been having a problem with FreeBSD ZFS SSD performance inexplicab= ly degrading after < 24 hours uptime as described in a separate e-mail thr= ead. In an effort to get down to basics, I've now performed a ZFS-on-Root = install of FreeBSD 11.1 Beta 2 amd64 using the default Auto(ZFS) install us= ing the default 4k sector emulation (vfs.zfs.min_auto_ashift=3D3D12) settin= g (no swap, not encrypted). > > > > Firstly, the vfs.zfs.min_auto_ashift=3D3D12 is set correctly in the /bo= ot=3D/loader.conf file, but doesn't appear to work because when I log in an= d do "systctl -a | grep min_auto_ashift" it's set to 9 and not 12 as expect= ed. I tried setting it to vfs.zfs.min_auto_ashift=3D3D"12" in /boot/loader= .conf but that didn't make any difference so I finally just added it to /et= c/sysctl.conf where it seems to work. So, something needs to be changed to= make this functionaly work correctly. > > > > Next, after reboot I was expecting somewhere in the neighborhood of 950= MB/s from the ZFS mirrored zpool of 2 Samsung 850 Pro 256GB SSDs that I'm u= sing as I was previously seeing this before with my previous FreeBSD 11-Sta= ble setup which, admittedly, is a different from the way the bsdinstall scr= ipt does it. However, I'm seeing half that on bootup. > > > > Performance result: > > Starting 'dd' test of large file...please wait > > 16000+0 records in > > 16000+0 records out > > 16777216000 bytes transferred in 37.407043 secs (448504207 bytes/sec) > > > > Zpool Status: > > pool: zroot > > state: ONLINE > > scan: none requested > > config: > > > > NAME STATE READ WRITE CKSUM > > zroot ONLINE 0 0 0 > > mirror-0 ONLINE 0 0 0 > > ada0p2 ONLINE 0 0 0 > > ada1p2 ONLINE 0 0 0 > > > > /boot/loader.conf: > > kern.geom.label.disk_ident.enable=3D3D"0" > > kern.geom.label.gptid.enable=3D3D"0" > > vfs.zfs.min_auto_ashift=3D3D12 > > vfs.zfs.arc_min=3D3D"50M" > > vfs.zfs.arc_max=3D3D"51M" > > zfs_load=3D3D"YES" > > > > /etc/sysctl.conf: > > vfs.zfs.min_auto_ashift=3D3D12 > > > > > > Is this the expected behavior now in FreeBSD 11.1? > > > > -- > > Aaron -- Aaron This message may contain confidential and privileged information. If it has= been sent to you in error, please reply to advise the sender of the error = and then immediately delete it. If you are not the intended recipient, do n= ot read, copy, disclose or otherwise use this message. The sender disclaims= any liability for such unauthorized use. PLEASE NOTE that all incoming e-m= ails sent to Weatherford e-mail accounts will be archived and may be scanne= d by us and/or by external service providers to detect and prevent threats = to our systems, investigate illegal or inappropriate behavior, and/or elimi= nate unsolicited promotional e-mails (spam). This process could result in d= eletion of a legitimate e-mail before it is read by its intended recipient = at our organization. Moreover, based on the scanning results, the full text= of e-mails and attachments may be made available to Weatherford security a= nd other personnel for review and appropriate action. If you have any conce= rns about this process, please contact us at dataprivacy@weatherford.com.