From owner-freebsd-fs@freebsd.org Tue Apr 24 12:36:27 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1816CFA2C43 for ; Tue, 24 Apr 2018 12:36:27 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670063.outbound.protection.outlook.com [40.107.67.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8034277D5B for ; Tue, 24 Apr 2018 12:36:26 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM (52.132.66.153) by YQBPR0101MB1587.CANPRD01.PROD.OUTLOOK.COM (52.132.69.158) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.696.12; Tue, 24 Apr 2018 12:36:25 +0000 Received: from YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM ([fe80::893c:efc2:d71f:945a]) by YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM ([fe80::893c:efc2:d71f:945a%13]) with mapi id 15.20.0696.019; Tue, 24 Apr 2018 12:36:25 +0000 From: Rick Macklem To: "freebsd-fs@freebsd.org" , "karli@inparadise.se" Subject: Re: pNFS server completed Thread-Topic: pNFS server completed Thread-Index: AQHT2n6KBZhPilerAEebAsjWoa5XxaQOAmgAgADSTViAAJ1SAIAAZzU1 Date: Tue, 24 Apr 2018 12:36:24 +0000 Message-ID: References: ,<1524471526.9560.51.camel@inparadise.se> , <1524550472.1130.10.camel@inparadise.se> In-Reply-To: <1524550472.1130.10.camel@inparadise.se> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=rmacklem@uoguelph.ca; x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YQBPR0101MB1587; 7:hfsihZCSVFxSqc3X7nqu7TMN/zINJaR+kjDKwldl9MzhSfUnhDGvJifV0ESAjwfEnHoU4eQHj7RYPJqQNFkqZetWQOEXWKH+SJFzmNoQBHVwYCv0VwZbTZ6rxxZlnnB6/Dqu6dLGLAvqO5FyCdDT3LUAcCU8PkQ4feg0p/PpshtT023lNjNmpVqQN1BV9INx26/HxTKp9e7yoH9o36RHA4lBEsBj4KIQnIekmQD+wTpJ2fYZfO+4KvTvJZ6b9PTU x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(8989080)(5600026)(4534165)(4627221)(201703031133081)(201702281549075)(8990040)(2017052603328)(7153060)(7193020); SRVR:YQBPR0101MB1587; x-ms-traffictypediagnostic: YQBPR0101MB1587: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(10201501046)(3231232)(944501410)(52105095)(3002001)(93006095)(93001095)(6041310)(20161123564045)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123562045)(20161123558120)(6072148)(201708071742011); SRVR:YQBPR0101MB1587; BCL:0; PCL:0; RULEID:; SRVR:YQBPR0101MB1587; x-forefront-prvs: 0652EA5565 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(366004)(376002)(346002)(39860400002)(39380400002)(189003)(199004)(6436002)(446003)(11346002)(53936002)(9686003)(2900100001)(5250100002)(99286004)(81156014)(81166006)(8936002)(106356001)(186003)(476003)(8676002)(86362001)(68736007)(55016002)(3480700004)(26005)(74482002)(6246003)(5890100001)(229853002)(345774005)(93886005)(97736004)(478600001)(3660700001)(105586002)(305945005)(3280700002)(2906002)(74316002)(14454004)(59450400001)(102836004)(6506007)(486006)(110136005)(76176011)(33656002)(316002)(786003)(7696005)(2501003)(25786009)(5660300001)(7116003); DIR:OUT; SFP:1101; SCL:1; SRVR:YQBPR0101MB1587; H:YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: uoguelph.ca does not designate permitted sender hosts) x-microsoft-antispam-message-info: Ky9WAGFJWkc+2I9OchMHsz9roT7Jgtbs8IVe/aeVLcF9+ewWZqcAbHBn68No+2uri9dZE/ncxpx86IibmHoGST1PSc+PfKa+vYvG6qzAh+F0q42hfQ7BR252/GBhS4cLDwhJrkjaWCJvWukvw2q80tFKg9sb8DMvX0gbxCtHG8bGS4Y0c2MryOELwOUehb9Z spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: a9e0bffa-c041-4066-fc30-08d5a9dffe3d X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: a9e0bffa-c041-4066-fc30-08d5a9dffe3d X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Apr 2018 12:36:24.9975 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB1587 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2018 12:36:27 -0000 Karli Sj=F6berg wrote: [stuff snipped] >OK, I think I understand, thank you for the explanation! > >So you could say that this enhancement is more about the performance >benifit of scaling out, rather than resiliance/tolerance? Yes, although without the DS mirroring (which is optional and doesn't have = to be done), you would go from one SPOF to N SPOFs. To be honest, this pNFS service will not be useful for many. Only people wh= o need to scale out beyond the limits of one NFS server and find it more conv= enient that creating a second NFS server. Improving resiliance/tolerance for an NFS server is a separate topic (and w= ould apply to the MDS of this pNFS service as well). I don't have any expertise w.r.t. this, but something like HA (which I just= learned about from the email thread) might be appropriate. If you can build a stora= ge subsystem with internal redundancy (raid at the drive level) and then have two servers "attached" to the storage subsystem so that it can fail over from the 1st to 2nd server, that would be a good start. With that, you would just need to have something that would tell the nfs servers to start/stop when the HA failover happens, I think? This is a really interesting problem, but not one for me. Of course if some= one gets to the point where it needs an nfsd tweak to make the fail over work, = I could help with that. Thanks for your interest, rick