From owner-freebsd-hackers@freebsd.org Fri Jun 16 05:06:31 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 496CDBF689E for ; Fri, 16 Jun 2017 05:06:31 +0000 (UTC) (envelope-from Aaron.Caza@ca.weatherford.com) Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-sn1nam02on0049.outbound.protection.outlook.com [104.47.36.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C5E7A70523 for ; Fri, 16 Jun 2017 05:06:30 +0000 (UTC) (envelope-from Aaron.Caza@ca.weatherford.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=weatherford.onmicrosoft.com; s=selector1-ca-weatherford-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=/01uIStrE5la+cL0AqhUsqSHYcO2YiqF3MdqJ7mg9Ig=; b=FWjPmutoc8JOljCyROUC14RtNNSyzdlYPgFNu4OKDidvvcN7cfImUmIAPXr0GiKNYwDk5rs8sqkiRvlpuNn08LFzw2BqTtV7egiM93vTvDys5qSAIVHfb6gNjGMrmOLolCUD9zh8ZUw+Z5aWgNZFDNWNd/Tzv24pfubLaN6HwLo= Received: from DM5PR03CA0055.namprd03.prod.outlook.com (10.174.189.172) by BY1PR0301MB1239.namprd03.prod.outlook.com (10.161.203.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1178.14; Fri, 16 Jun 2017 05:06:28 +0000 Received: from BN1AFFO11FD026.protection.gbl (2a01:111:f400:7c10::116) by DM5PR03CA0055.outlook.office365.com (2603:10b6:4:3b::44) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1178.14 via Frontend Transport; Fri, 16 Jun 2017 05:06:27 +0000 Authentication-Results: spf=pass (sender IP is 23.103.226.20) smtp.mailfrom=ca.weatherford.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=bestguesspass action=none header.from=ca.weatherford.com; Received-SPF: Pass (protection.outlook.com: domain of ca.weatherford.com designates 23.103.226.20 as permitted sender) receiver=protection.outlook.com; client-ip=23.103.226.20; helo=032-smtp-out.weatherford.com; Received: from 032-smtp-out.weatherford.com (23.103.226.20) by BN1AFFO11FD026.mail.protection.outlook.com (10.58.52.86) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1157.12 via Frontend Transport; Fri, 16 Jun 2017 05:06:27 +0000 Received: from DM2PR58MB013.032d.mgd.msft.net (141.251.110.81) by DM2PR58MB015.032d.mgd.msft.net (141.251.110.83) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1157.12; Fri, 16 Jun 2017 05:06:26 +0000 Received: from DM2PR58MB013.032d.mgd.msft.net ([141.251.110.81]) by DM2PR58MB013.032d.mgd.msft.net ([141.251.110.81]) with mapi id 15.01.1157.022; Fri, 16 Jun 2017 05:06:26 +0000 From: "Caza, Aaron" To: "freebsd-hackers@freebsd.org" Subject: RE: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD performance drop < 24 hours Thread-Topic: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD performance drop < 24 hours Thread-Index: AdLlL01Bja9RgR6rT826WHBpLYHdbgAAzCeAAABmhaAACYTJAABAA/BQ Date: Fri, 16 Jun 2017 05:06:26 +0000 Message-ID: References: <201706142204.v5EM4IEu063454@pdx.rh.CN85.dnsmgr.net> In-Reply-To: <201706142204.v5EM4IEu063454@pdx.rh.CN85.dnsmgr.net> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [141.251.136.196] x-ms-publictraffictype: Email X-MS-TrafficTypeDiagnostic: DM2PR58MB015:|BY1PR0301MB1239: X-MS-Office365-Filtering-Correlation-Id: 074f86ba-b2c3-4cb7-fb53-08d4b47571bb Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OrganizationHeadersPreserved: DM2PR58MB015.032d.mgd.msft.net X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:23.103.226.20; IPV:NLI; CTRY:; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(39450400003)(39410400002)(39400400002)(39850400002)(39840400002)(39860400002)(2980300002)(438002)(13464003)(377424004)(189002)(199003)(377454003)(24454002)(9170700003)(86146001)(86362001)(6916009)(106466001)(46406003)(2900100001)(8746002)(5640700003)(108616004)(8936002)(72206003)(305945005)(54356999)(2351001)(81166006)(9686003)(110136004)(76176999)(229853002)(53936002)(66066001)(38730400002)(6246003)(50986999)(114624004)(47776003)(50466002)(8676002)(55016002)(2501003)(102836003)(2950100002)(3846002)(6116002)(2906002)(23726003)(33646002)(97756001)(189998001)(7696004)(22756006)(356003)(478600001)(5660300001)(24736003)(7736002)(53546009)(42882006)(5890100001); DIR:OUT; SFP:1101; SCL:1; SRVR:BY1PR0301MB1239; H:032-smtp-out.weatherford.com; FPR:; SPF:Pass; MLV:sfv; MX:1; A:0; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; BN1AFFO11FD026; 1:9oeLyZDAO56jT8O0sAE5gpvVRR+joUncKMLROTXXKrmxPSAscU5NYjJCUML8FtJkz3m38xxC2PcBa4Y9xhymJhaLPiygKWknPXjrBe6D7eeiwzdaDgNHk8L8BivR9J18g/4jaLlPzC4S0f7Z8jWDevq41qPSoP3q+qN5shMOam6S4A+O5OMhD2XL1JFGzq2YrpifKi3u29RW4+lQ0wEba4mAm/muACUIMkkdF6nN+9XecJbb/eSBqPLWJKFhdCzZAjsePNVQttDWQVsdErW4rUylW/kf9v/1fHjG8ftugqfiWGJ2FgRkG0FxHYd6z/O17AvVNt8VfXzVeNiWGAju3TzPBebYe4o3oA/Ck55EI3PIVXzY0i6nU6bNjyyWPvlFTi7/7hTcZfGNnQCiP9nXy2QwZdAB/NG5k/KeLxiAhAkLENgS6elA4JkpyFQd76JFTvpcTbwNIiZxHcjKONDDAZLPGcKRKq2Huqiwv+sKbQEbLiLs0JzvFuomvUH7FdxQOZC99FMO3OKAn7CLUswUSGIJGLuLtAycS3jx5WlnJTY= X-CrossPremisesHeadersPromoted: BN1AFFO11FD026.protection.gbl X-CrossPremisesHeadersFiltered: BN1AFFO11FD026.protection.gbl X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(8251501002)(2017030254075)(201703131423075)(201703031133081)(201702281549075); SRVR:BY1PR0301MB1239; X-Microsoft-Exchange-Diagnostics: 1; BY1PR0301MB1239; 3:AzvSFmhZDubtSs/tiHIGMZaF/RZDZG9mnZt0j5YGwnom/wJmLfuNG2qfyVI+gG7ChlbwDoxQj7QgKn1RziSoufUGaKPzEdq8vrL38yq+gKWBKlvORyIgv5/r5RC/FVRioriBRHLqbKoC67OPt90DhF1S7KJdoIWqTiBKDJ7UCoM208r47iH96/VS+FWXRzaasPXe+ct3YjkYvMPQTbPwSO7jXSXZPVQu819p91ZazrwpLk5CeLESRihkiO0t/f80TyoE1x07U2U4THdiuRVoXcMNYmqpf7y74JdkNmfCYaQ5skLcXLdMQCCZ7Ct3wSX/SmDwPhW32nQzDGDj2bejSe7DBySfZ0b2vSr0FhW8RnIKNBezgkJIN48jwwPSFC/INlS5jIZofjTIXQQneE8VZPdVtNYcPe90sd16InqCmWo3BW475JA6qInPkmVycBVgDDHw0NIlvDiiXjk1sQ20ksjla2ttVHKfqrGM5Kpt4DuQQQ8aLh/bmPkdJ9YvR2Z7kBLAK13BIAuOOfCQ2bU2zg== X-Microsoft-Exchange-Diagnostics: 1; BY1PR0301MB1239; 25:3Zlg13wpLn1amGi6DtK3JeRQ47ruLayzGyQkAaHqxwmJK2rPT7rfnORFn8tfaUeb+J4jXJPSZ/Y4dgNKjnhv4uH+WZTOeYlURe2Gdk2xlgTMv4G0in6a6OS4vztKcgOTc7t6CMdpBXHBXGveQkQGddFfUFswdcQGl1AU/MsgUebxWHc8EkuWL+So7CLCXlwfvqmAsYk/XWIny7Z2/7bxmJF/53Gpyw9EWUujPLAmrpGKp7EmN4mPOuY3nDUIs0jVXj5Od/6q/m3zhYXj7FOM0A79pFHAF4bgJrnsFP085RHE4JMDgO3Bzwi6JwpBma7KYmKP3LR8oW6fNAr/NV7FvTf82XYK/nUg9O3qj/xyihN9VA63mf8NKDGK1gz+3L9+NIJWZjOf4WiUAm86e3cf1lxV+JJloJr1+4iOsvgaYHnSavBC5HDdF0bsqNlwITvOEn9qFnhz4M4mzICFg5dikrvc64EFfbvc64WCM3dAx7o=; 31:cDc4yaAhokRhpxo5aBbalDcSZe0otmlmS1Vazy7ds5kMrLY9vJ90/AYKS4tpOXB2KxZyAckwbUE1CYmveIgkx3zKJT8/qj0CCJV6C2TgdSh8et0NiQVIKmls+nh1CfrgQnlRBEC78hKamXWVCJrCgEfYZnuQdcga5LbbBOsda+Gm0i50tgXhlOqAAd4Qlg0eCXcFQGUrTw/QpEWJoFnYI1cZVrsa4887EAcny+Ay5MC+UdC8apH5CgjtHHcL6WIu6JsdAn0TbSTbJzKAuhvzUCQTSg3dX2QVi3CeeVPrkYw= X-Microsoft-Exchange-Diagnostics: 1; BY1PR0301MB1239; 20:8GGviNCJe9EvcsxNYwk+QTbKMMnmVED2AK2Xz7jwjMBfNvPJNK35jcDeSBiAtFSbuXAqubNOciS/Sr9J0nvvSqQgXssz09n4g48D0JnJGBtrV19ERvraXVkko5ZJAW27jGmAmc7q/1ROFI/QhW4a7TVc1kqNn+F+nT0TwLtB12WCcpQfjhkEyKhz9kkfyLi1raAkvQfkTWVtlHunfjubB/BXmS0UY0iTByujuoU8O7Gw+BGivCBntsB3nbtmMLH2owkWCrAPC8QwJFHXv+qzKvtYQsdvmbPTXAAua2KZ+TJWqRXTFeDFkhpNmPn8p5NYAy0DFzjgujkw8UCmDgr1T8JWzsuVttX2JK19KZyJFmH5SkteOvuUsvg9f0oRjMpV5ZlY1tLehiE309SYz/h8cpqriC49TRinnGPkGqCYPdp9S3JT4XDXEYDX2NxsdY8//MXv3tWu+xo9lLQaLz7G+v3LXW6qqlhVDGJn5zNuWIgZGYOypzae8yY04IKAxZJa X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(158342451672863)(192374486261705); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(11241501159)(6040450)(601004)(2401047)(13018025)(5005006)(13016025)(8121501046)(93006095)(93004095)(3002001)(10201501046)(100000703101)(100105400095)(6055026)(6041248)(20161123564025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123562025)(20161123558100)(20161123560025)(20161123555025)(6072148)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:BY1PR0301MB1239; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:BY1PR0301MB1239; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BY1PR0301MB1239; 4:DfGgTgb0EJqCL3sDDCqvurOYmKm7zSxJhSTC9+V8?= =?us-ascii?Q?QCh/Dma+Br7MIF4yY7vSxW5FAjhbeIX+OYQLUvp+3fmMHZp0JkFzo/7epWv2?= =?us-ascii?Q?TmM2Wsk4DAd3FckSotpM+hrbPNhARscvm7hFezw9uC8DTwKVaXfm/IrWIizD?= =?us-ascii?Q?u0wZvfZA8c5xD+kwI0MWdCAvYmccrZR3KN1S6Avp9NPL1m2BnAHgTn0QR5yK?= =?us-ascii?Q?CSfcqrbsNIee0Gpgj3gBqc3o9T/ruf0GLh+GRcPKj00cG3u1Lk6ZxgJla5h2?= =?us-ascii?Q?5zS89HEcuxuBHrnlHlG6Yd8C+p5ROlO5qrWrzIPf6t6/C2OLMpFjzsKaTdi+?= =?us-ascii?Q?hOsbQkqItRMx8sJqIrtNLbElUGUcG/iTddjnptUOHMguzLdhVbxbZn0A05nt?= =?us-ascii?Q?qpy1XYO/dudMqnftRcPEjsp+jWqjhIQxeM9L/l94Dcph4ltVN3wRhoaaQrCV?= =?us-ascii?Q?YPgfuVgVXjPjCraoPazQVnYduRQtvvCuEktQ+aN2hm6XYKCYu3Hcf/DGrvAu?= =?us-ascii?Q?8o+i3o8Ko7fu7+vtc980z+KVnSn3HoIxgx1Ce5WQ0Y4ChyNvgUc340I9Gm/w?= =?us-ascii?Q?mQPZRXQB4DmNWEBZgltmNgLzIJnhX7kTijmbyplJiwE7Sipq9TXZ6oUilUF9?= =?us-ascii?Q?Wu2Wuw5owpasNti/mFhgqzpAKSaDdtvI/dr3MS85UV0jt2xd/AxKraZCq5JN?= =?us-ascii?Q?+V+sHEG61gfTlFWZF4ohZQS3OSylRHdm9S/IVDLK503dZ5IBm7Ojis/aOvcN?= =?us-ascii?Q?ZyxWdLDLLleFUkwq3mzGQuu6ZABbOqMW3sg+Y8LXHmTNTjjrpdr19BEP7CSG?= =?us-ascii?Q?c3ENYLrq2LMGtno4Al6QtaHUqh0GllQ409aQRBzFpUvysNIl2W5COjYGbvx2?= =?us-ascii?Q?fK8TNVcc1u6jP/qEnb96+LubEezjIwcF0sVqEsFhqGoha83PXKMi8N9eQrd9?= =?us-ascii?Q?xWj6fscE+Pc5cwBG3PQgnysvV7prMK9cWx+8u8kWzcyYa3erlrE5XM+vdPqi?= =?us-ascii?Q?sa10/yu5zPF0M7uCVSHkkyZmq9FdXsAazO1kLr3kjRSLmLYWc5+WWsmxz+my?= =?us-ascii?Q?Ps5P2aUufYdxPYVAFh616rR1XeApj7wJNpnPNHDSoY6sA465ADD4TASERPRR?= =?us-ascii?Q?Bj0w9y8UjtGfU7beF9FHfCn5dO4myhL5Ti/oNBNAv8pOQBCKHQ+Cd72yNTb2?= =?us-ascii?Q?rG6Zg+5UD0aup4k/PIe0cJOXjaLYxUv+8Pa4yySbCEJbM+nGAnxkyoEpvp7V?= =?us-ascii?Q?bRnNJbvcqajgiJq3sVHbSEUFXtkwb7/MTytUW2c5f7Q/ORGi+8AtlqBxCtgA?= =?us-ascii?Q?eiKWoNL10CEDpgxm372/bdE=3D?= X-Forefront-PRVS: 0340850FCD X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BY1PR0301MB1239; 23:1Yl+8LwVwgQESuk8uxSfWCp0+yzIyfxRSFuHb6h?= =?us-ascii?Q?Tzr4jwzeP2gicDflqBRhfIikCF/E/PDAswRmoXsUTrBh+HHuthcCR4oj/b6v?= =?us-ascii?Q?g39ltGTw1pkzzXAzyLTUX9N2XNvcdF7zht38MIFsWMW8e7y9XcpY3QEbzCQR?= =?us-ascii?Q?VeEjeA2GfgeA+ZqHQUb3WPS6zDEobti6S3bG0fUKH0SdQTTVNeqeJkZy2wcX?= =?us-ascii?Q?Rd0fNO1gH2yKnDwyO5aYpzYdf9/T7Xuy11YT0DCrUOLlvP30RVjos4eKqwl3?= =?us-ascii?Q?GTtV8Z6hBluytWJrfr98mGn7HjcQItscIfBgaCUrIQXYcS9UOCMDQbyyWYAz?= =?us-ascii?Q?cPjYfp75Kb5U28ihvXKAquP5m0z1t2Tu0F/hd3mHEMvhq6qoYZXTIQJMsxZx?= =?us-ascii?Q?ZDyVybLfPgFAVuE8NlGnloQkHWghD4KS+il130/VEV85gaA8rYp5HTK3jfVi?= =?us-ascii?Q?v6oiwhf4Z0sFTLk8eBpOjfq9DBxIfL+gXkQFPNSJJiDcA2SSWLzJWTpJ/rjT?= =?us-ascii?Q?cXWVf77fvWPg6uytAE2JGLGrr/SQ0Wmli6kvek06KJUyENNx0n7FJ4OYD6wp?= =?us-ascii?Q?ebD+9azgMCfHZ97cT8ED0lu83NsO5WT0m5yCIMc7VJmviaJYdiDow90WwqhA?= =?us-ascii?Q?2OTBifCOKFw2BZii/XlIRvjyx4/yV6zlGrlFixgI10YgzHqgrZdzsejn4FL9?= =?us-ascii?Q?jGX7vxqIIic1TNylfIrUPENk6ITnJDiEI707c9GxOVWSLzbZ2y6j/H8K8rJ1?= =?us-ascii?Q?M3gH4ozXzB6FvWqdXosJNQg7k4f498bLNKw5Cg20ikxP+ArAbtuY7pjzobs/?= =?us-ascii?Q?05MEYvWNUjwtSYUkFpfjQ0nJX7nS6KHOoRAvGqKA2riBgQZQk5mOTdB71L9S?= =?us-ascii?Q?XcPnE/fWCowXWEHYsrYfXX8FP5gYTmkGfatuymAcAfZLAdt9wTqZpUlIfRMX?= =?us-ascii?Q?RbuLwY7AEps3+gkiIWkm8n9Ag1DSV+xJ3dubvI2fzt3IIuWFqvvnsLNZBbPw?= =?us-ascii?Q?QAICoxtjDCDt5yIu/ULNLp+VmYo7QDk/jVsnO2IwRuLcTfF9Y+1DmvUERdhr?= =?us-ascii?Q?T/AWQavqpBvp8I31bgXR1wpatgKq4vIcdASOCXoWfnerCnlOoMd5wCBjLu2g?= =?us-ascii?Q?cD77Ej+vTMlmxSgFb8rkmPEpLOacfj0oqXF1b8s1uxxD/E8GFJIcHjIzghb3?= =?us-ascii?Q?tR2UllplNP53MmqOT8sNwYG5/3LNnRhee9RwGMsm6YT4qHZvg+tk/Prf/bma?= =?us-ascii?Q?KWD0OaG3GsUBsjmj6bHi6/EdCu5d2VN3d0B3X0QlMxs7nFQNWZXsKBJuTpBN?= =?us-ascii?Q?AQGi5KpdXVFwvZiEK4BYJbNx3CLpOyZ5ApRBxeiTUsOpFOd25pvePybXNL+o?= =?us-ascii?Q?auxFW54WkgVZFlqTvPceGVKduoscTR2c8XMng9h4ds30u0Z/oepS3uJbZTd1?= =?us-ascii?Q?dM3jVg26lhu8VGqtpbL1IL1VUOHLJCWEiSscws91dEPXhPFJ7KfUDeSLQMhA?= =?us-ascii?Q?wGIRgds9ZIfFPc6aXwNmkEh57JiqYsA/7hUei1DsdH051LK3FjxkkaJOVuBQ?= =?us-ascii?Q?lOqj7Ai2Iwz7khKqN2Q=3D=3D?= X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BY1PR0301MB1239; 6:2AsAjIMxraDA2wBfNeNHgdGw6eMQp+K4afFwPSHV?= =?us-ascii?Q?gvfCeDIetEl+3a/VkRGy7InkjYpEpbCbHoBD31NPYW6fW1GBqvR43RaVqwj6?= =?us-ascii?Q?yOKw4o7QEZRgAkL2E8h5kom4R1Yq7HcQr55oIX8RHEBQdGtkSjtg2rqMDXLL?= =?us-ascii?Q?iB3oldGGIHB6E1lmjw8G3R6uUi5LV2FcF3aZ9cdZhn9nHQI0mhPl+l7eyZrH?= =?us-ascii?Q?dcpAfu9BI+8N1f29WgNezRkkb33llXlAxF4kxzujgQFMflTXE1EsjlIxDP6b?= =?us-ascii?Q?tIYBinkPjPa6o+qXdwVfNRIVzLXAc2nu6jFBYh/kJGlEFSIm9OaH8RcRE6cu?= =?us-ascii?Q?JbOYhP+nBhNKWTxi+DV+PkOFUMqYDpzyfOZLDFl78L5Fv5dwPhBrSVQSRnUH?= =?us-ascii?Q?VYPZGszbnaB0xXnrdjKm8fZmV+netfdCvaF0/2gNr/E6mk3azuKAz+L/rhLM?= =?us-ascii?Q?erhJrHwXBm+bwvcI8k99CPi4BfzpgpJTRBn5FU3v9Kgh/ONIKc6YGQWyDPi4?= =?us-ascii?Q?ehyBz/56SwDIr87Ifm/Wsgytj7f6NOQl6zTOVlm1sdxpwin3noocmYFYFHe6?= =?us-ascii?Q?xcCaiviRIwMZcSgGjJSt8pzOcobjdlJC4w92feX/ngAFHrLLYvNWMWueY55g?= =?us-ascii?Q?yQYAE7ifscS2PfmKDza9E6br3sAvaOJ0aSTcTSPYwJJrCJqk3zOxB9gbqsGX?= =?us-ascii?Q?wVYqlUGfJvohitDKb5/Bm7hlzo4TXSqh8A7Gt05wX4r+S6N7wfBw9DOovqhp?= =?us-ascii?Q?0mbnFPqdtC2g5WHtC4sNqyqRMZhrcJKuHaReCXWXWIoM8OUsqHOWAJ4StEU1?= =?us-ascii?Q?CQsiaFDuvWYLpEwciVLLA15C7dThRzNL4o2cX1oApACAe8ugOGmXSA6hYfy8?= =?us-ascii?Q?zet22MFCSFvxPK/WJnGAg61A2THqEri0DsC+b5vUQC6D8EK3Qisqdd9Kn8ra?= =?us-ascii?Q?8BfJcuvQTRkJhHo8fHEDC9zOejECXKh5sw7WZ6ui8b4w1NUXI363sUdJl3hB?= =?us-ascii?Q?PHZosz3o1eU22FF37MvyjoCi?= X-Microsoft-Exchange-Diagnostics: 1; BY1PR0301MB1239; 5:XKj5TFYEl2WHJn9VGjuetkR4IxBXgjwLaLjM9YaSvsR8jfevXcgoyAIxINASzNGHBVJ72K3D0LPM9blvx6uTA/eDW5Q1dGSaSJe0DRrSKWjsJ5PD1GicjPqPYLMjBz1oFI6iwrJo6P3ikGVTP5PcN7nwbmSXGAzhX4NxiGXwffUwyK9YxGPSNeADxQrXI3uHf5NLFHDMw3xlfcTLt2KL38eKDzLFNZ0SrAhiz5VpHNWciqSrTv7bt3ifro6vcboCsaGcJjEz4XBMBI23Y0NzQ2P2hdKvVSlzc4DnrXHaBTagh3zGv1Mi9GbIivbK9dElBFrziCvpVpsUGtUUwRG8MZ+YGeQz7dWP2EUq73No4RO06D57ASQV/rhL9cfvjLot94OCxzaV3QFH1BCgF2zPjyy54ybkqBNboodQ1zzC9+kicegPKsPzS0rckQDQy74oMN+GzSg7LzrsqRP6HpU60DmlTZ7m47MCR1uZPN3tylsxbPA13naGQOE2i3yg4i7J; 24:FQUQUFZhuQdrM8uwDFZOOvDrsIdovNqX6OEGGgczSW9zTFODh5xsrY0FiPNlKXvPrcT/2OVr4erUcgc/4KOI2RARI1DvE9hofz4JztVAalo= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; BY1PR0301MB1239; 7:PFAVyLX5Ryj1nM71zVw9/uFDKND55dokkTPPQfhC5muelPJqmgSE7He8trPT0dR7HeQWqImHzPjNk1wEvZ6b+j0PHoeJZiEUxTGwbf8+LrsTAGo+06Ar1qsfphu/rjgKtRLxKXn7LCHmjV+SeAJbzXCt3OEfaDyfmR05z6OPDlrwcdzQTqKYQg1STtOrywgZxnEbCrTObJkpMD9T6noS53KUjYY36M2MVChnb/Wk2HtiV1CFAotplfjUf/5yu3l6IiDlan6CtWSUAJYjHBHanVtV/Nzoydlbb8f7jKiCurFADtVIKNJhXGTuiT1YEmgrFZ8JoynIKSdTDqUPcfm1Nkm4JSQzE2Bcm5OgesBWkqy88slV8MEGJxEugDn5pNzTftq+I2R87yPNeX2XSAijHz0/yDMSyzmfpCP0XE5YiS9AUi6AEFhk1rLGUKIgKzdjj5AaY2Xyl6CV1dCUCmcu7ZTA6nnUmEuLLkKBx0+KlozyANiKPyEW6W94xIZwNsi/xVuAyxufXU1ddb+Co1OSzYnmDwxrGd1dxOKcixEsvssdEMEAx96/iN1k4rnAC05YTYyme+wc5DQCZKOfG9UI1k9xEjgF/qyah+2Znp8By5i+Ut37JGesrdxUjtdOt2kcmZTHHryCTvfEOCEOrGUPcZtjkryPCtHmFq5nqWg7eujgafmzIcH9kxiHSr8yLJCwyfDIvRDvws+DGXekwP7akTiHc3hzASUlqFbuL7+zQ1+7AvaDaucP7XPHCPzkk3M5KNpE/aHOFUBmCduN32xgghZWqS3KLYJz0CltAe6FodU= X-OriginatorOrg: ca.weatherford.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jun 2017 05:06:27.7620 (UTC) X-MS-Exchange-CrossTenant-Id: dd63fb60-07f6-4d96-8d40-ebeca61a524e X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=dd63fb60-07f6-4d96-8d40-ebeca61a524e; Ip=[23.103.226.20]; Helo=[032-smtp-out.weatherford.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY1PR0301MB1239 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Jun 2017 05:06:31 -0000 > -----Original Message----- > From: Rodney W. Grimes [mailto:freebsd-rwg@pdx.rh.CN85.dnsmgr.net] > Sent: Wednesday, June 14, 2017 4:04 PM > To: Caza, Aaron > Cc: Allan Jude; freebsd-hackers@freebsd.org > Subject: Re: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD per= formance drop < 24 hours > > > > -----Original Message----- > > > From: owner-freebsd-hackers@freebsd.org > > > [mailto:owner-freebsd-hackers@freebsd.org] On Behalf Of Allan Jude > > > Sent: Wednesday, June 14, 2017 11:20 AM > > > To: freebsd-hackers@freebsd.org > > > Subject: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD > > > performance drop < 24 hours > > > > > > On 2017-06-14 13:11, Caza, Aaron wrote: > > > > Further to this: > > > > > > > > I've now tested FreeBSD 10.3-RELEASE-p19 and FreeBSD 11.0-STABLE #0= r307264M, both of which suffer the same degraded performance. > > > > > > > > test$ uname -a > > > > FreeBSD xyz.com 10.3-RELEASE-p19 FreeBSD 10.3-RELEASE-p19 #0 r31990= 4M: Tue Jun 13 12:38:29 MDT 2017 aaronc@WFT:XYZ amd64 > > > > test$ uptime > > > > 10:15AM up 21:09, 2 users, load averages: 1.00, 1.14, 1.30 test$ > > > > dd if=3D/testdb/test of=3D/dev/null bs=3D1m > > > > 16000+0 records in > > > > 16000+0 records out > > > > 16777216000 bytes transferred in 200.379127 secs (83727363 > > > > bytes/sec) > > > > > > > > After reboot: > > > > test$ dd if=3D/testdb/test of=3D/dev/null bs=3D1m > > > > 16000+0 records in > > > > 16000+0 records out > > > > 16777216000 bytes transferred in 23.213040 secs (722749623 > > > > bytes/sec) > > > > > > > > Same Intel Xeon E31240 with 8GB ram and 2x Samsung 850 Pro 256GB SS= Ds as before. > > > > > > > > > > Can you do the same test, but grab the memory lines from top(1) befor= e and after each of those two runs. > > > > > > I am guessing the ARC is being squeezed out by PostgreSQL, because yo= u have so little RAM. > > > > > > -- > > > Allan Jude > > > > Takes a while for the degradation to kick in now that I rebooted this m= orning. > > > > Regarding the ARC being squeezed - well, that doesn't explain why gstat= shows on 95-100% busy on the drives on reboot but only ~15 %busy after the= degradation hits. > > > > In fact, ARC is being squeezed all the time because I've limited it to = 50M in /boot/loader.conf: > > vfs.zfs.arc_min=3D"50M" > > vfs.zfs.arc_max=3D"50M" > > Would you passify an old fart by at least having a delta of 1 between a m= in and max please? > Some code may oscilate when min=3Dmax. > > Note that the FreeBSD 9.0 server that I tested on also hamstrings the A= RC to 50M but doesn't suffer a performance degradation hence why I hadn't b= othered mentioning it before. > > > > To remove Postgres entirely, I won't even start it and simply use dd on= the 16GB file. The server is essentially doing nothing at all. > > > > At this point, I'm looking at going back to FreeBSD 10.3-RELEASE-p7 as = yesterday as 'trafdev' reported that he doesn't see any performance drop an= d he's got 95 days uptime. He's also mentioned vfs.zfs.metaslab.lba_weight= ing_enabled=3D0 setting which I also need to try. > > > > -- > > Aaron > > -- > Rod Grimes rgrimes@freebs= d.org Allan, here's the top(1) output after degradation: last pid: 9403; load averages: 1.09, 1.48, 1.30 up 0+23:29:14 10:3= 0:06 21 processes: 1 running, 19 sleeping, 1 zombie CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 1528K Active, 46M Inact, 462M Wired, 4856K Cache, 624K Buf, 7376M Free ARC: 53M Total, 5K MFU, 16M MRU, 16K Anon, 1137K Header, 36M Other And, after reboot with performance back to normal: last pid: 739; load averages: 0.99, 0.95, 0.58 up 0+00:08:02 10:5= 3:21 19 processes: 1 running, 17 sleeping, 1 zombie CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 18M Active, 22M Inact, 224M Wired, 432K Buf, 7626M Free ARC: 28M Total, 3385K MFU, 24M MRU, 16K Anon, 232K Header, 1005K Other The above was done using FreeBSD 10.3-RELEASEp19 (amd64) on the aforementio= ned Xeon server with 2x Samsung 850 Pro 256GB SSDs. PostgreSQL was never s= tarted or use - simply dd'ing the 16GB test file. These results were still= using vfs.zfs.arc_min and vfs.zfs_arc_max of "50MB" though subsequent test= s will utilize 50M and 51M, respectively as suggested by Rod. Checking the FreeBSD 9.0 test server, it had vfs.zfs.arc_max=3D"50M" but di= d not have vfs.zfs.arc_min set in /boot/loader.conf; consequently, it was a= ctually higher that vfs.zfs.arc_max. I've reset to 50M and 51M and reboote= d. Time for "select count(*)" in Postgres for ~21.5 million row test table= , after 24hours, is still maintaining the ~82 seconds as it did after reboo= t. Additionally, on separate test servers I've checked the performance of both= FreeBSD 10.3-RELEASE-p6 r303605M and the FreeBSD 11.0-STABLE snapshot date= d May 10, 2017 and both exhibited the same degradation in performance. Suggestions? -- Aaron This message may contain confidential and privileged information. If it has= been sent to you in error, please reply to advise the sender of the error = and then immediately delete it. If you are not the intended recipient, do n= ot read, copy, disclose or otherwise use this message. The sender disclaims= any liability for such unauthorized use. PLEASE NOTE that all incoming e-m= ails sent to Weatherford e-mail accounts will be archived and may be scanne= d by us and/or by external service providers to detect and prevent threats = to our systems, investigate illegal or inappropriate behavior, and/or elimi= nate unsolicited promotional e-mails (spam). This process could result in d= eletion of a legitimate e-mail before it is read by its intended recipient = at our organization. Moreover, based on the scanning results, the full text= of e-mails and attachments may be made available to Weatherford security a= nd other personnel for review and appropriate action. If you have any conce= rns about this process, please contact us at dataprivacy@weatherford.com.