From owner-freebsd-net@freebsd.org Sun Apr 15 12:58:58 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3A129F90CE2 for ; Sun, 15 Apr 2018 12:58:58 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670063.outbound.protection.outlook.com [40.107.67.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BC78C85CF3 for ; Sun, 15 Apr 2018 12:58:57 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM (52.132.66.153) by YQBPR0101MB1555.CANPRD01.PROD.OUTLOOK.COM (52.132.69.150) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.675.9; Sun, 15 Apr 2018 12:58:55 +0000 Received: from YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM ([fe80::893c:efc2:d71f:945a]) by YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM ([fe80::893c:efc2:d71f:945a%13]) with mapi id 15.20.0675.015; Sun, 15 Apr 2018 12:58:54 +0000 From: Rick Macklem To: Niels Kobschaetzki CC: "freebsd-net@freebsd.org" Subject: Re: High rate of NFS cache misses after upgrading from 10.3-prerelease to 11.1-release Thread-Topic: High rate of NFS cache misses after upgrading from 10.3-prerelease to 11.1-release Thread-Index: AQHT0qiQifFFt12p/0eGRV3S1dRLRqP/ezZKgAA+WICAASn0RIAAy+AAgAAcWdY= Date: Sun, 15 Apr 2018 12:58:54 +0000 Message-ID: References: , <36907CE0-EAD3-4E11-8023-5BCEA1239813@kobschaetzki.net> In-Reply-To: <36907CE0-EAD3-4E11-8023-5BCEA1239813@kobschaetzki.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=rmacklem@uoguelph.ca; x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YQBPR0101MB1555; 7:RRsk1Cs2ayjKS21qL/JUl84KdYtNeoYMpKaif16a8sb1EOZYvZYT6GlM/AwIol3PnUNq4G+CtKBfc+30fTTKcTLZ7iVH7gpeiBFj+y1T9rkI2iU0XtJWTakyU5OXiPXOagaaXLXanoBGTvS9RI6UJqssDEEJRxI+cuwnNU+n81yk2vh3J4RdKIWTMNq80p6Ke+gr2HR+r7NtxbjAHZ+r0b40KqPpKsXBT8GO0jrUE/nTG3QUn8WAH1C2VSgojL9S x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(8989080)(5600026)(4534165)(4627221)(201703031133081)(201702281549075)(8990040)(2017052603328)(7153060)(7193020); SRVR:YQBPR0101MB1555; x-ms-traffictypediagnostic: YQBPR0101MB1555: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(8121501046)(5005006)(3002001)(93006095)(93001095)(3231232)(944501327)(52105095)(10201501046)(6041310)(20161123558120)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123564045)(20161123562045)(6072148)(201708071742011); SRVR:YQBPR0101MB1555; BCL:0; PCL:0; RULEID:; SRVR:YQBPR0101MB1555; x-forefront-prvs: 0643BDA83C x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(39860400002)(376002)(39380400002)(346002)(396003)(199004)(189003)(5250100002)(14454004)(229853002)(6916009)(25786009)(8936002)(33656002)(8676002)(81156014)(74482002)(81166006)(4326008)(97736004)(786003)(316002)(478600001)(6506007)(59450400001)(5660300001)(76176011)(99286004)(7696005)(305945005)(74316002)(446003)(11346002)(476003)(486006)(186003)(102836004)(26005)(93886005)(105586002)(9686003)(86362001)(53936002)(2906002)(3660700001)(68736007)(3280700002)(55016002)(2900100001)(6246003)(106356001)(6436002); DIR:OUT; SFP:1101; SCL:1; SRVR:YQBPR0101MB1555; H:YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: uoguelph.ca does not designate permitted sender hosts) x-microsoft-antispam-message-info: jvlMsoehPQksaG2HyuWqg3LYfneT/981Pr3zjPLWNEWg52rXplUSIKmXJiJR1WePWRXWaCVojRiV7yCpIiB0Sc3pHHruKhbYYBYRWgeNHIIYy4/wwMg5EQL7qkYVASke2mIr9YO+Sjk8K8QqtsXFC2qIQPobvPE1e141xxNHevxN21dGjMs+dkp6XObERZCR spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: f6d693f4-515a-4e4b-9407-08d5a2d0a514 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: f6d693f4-515a-4e4b-9407-08d5a2d0a514 X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Apr 2018 12:58:54.8967 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB1555 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Apr 2018 12:58:58 -0000 Niels Kobschaetzki wrote: [stuff snipped] >It is a website with quite some traffic handles by three webservers behind= a pair >of loadbalancers. >We see a loss of 20% in speed(TTFB reduced by 100ms; sounds not a lot but = >Google et al doesn=92t like it at all) after upgrading to 11.1 with a comb= ined upgrade >to php7.1. On another server without NFS that upgrade improve= d performance >considerably (I was told ca 30% by the front end-dev) One thing you could try is booting the 11.1 kernel on an 10.3 system. Newer FreeBSD kernels should work with older userland. This would tell you if it is kernel changes or userland changes that are ca= using the higher miss rate. Good luck with it, rick=