From owner-freebsd-net@freebsd.org Mon Jun 29 13:09:04 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4FFF098F4E3 for ; Mon, 29 Jun 2015 13:09:04 +0000 (UTC) (envelope-from Carsten.Aulbert@aei.mpg.de) Received: from smtp.welcomes-you.com (welcomes-you.com [144.76.218.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0B52812D7 for ; Mon, 29 Jun 2015 13:09:03 +0000 (UTC) (envelope-from Carsten.Aulbert@aei.mpg.de) Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp.welcomes-you.com (Postfix) with ESMTP id 5D44831A2E29; Mon, 29 Jun 2015 15:00:07 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at welcomes-you.com Received: from smtp.welcomes-you.com ([IPv6:::ffff:127.0.0.1]) by localhost (smtp.welcomes-you.com [::ffff:127.0.0.1]) (amavisd-new, port 10024) with ESMTP id USrfTyZAk8Yo; Mon, 29 Jun 2015 15:00:04 +0200 (CEST) Received: from [10.117.11.97] (ahgate1.aei.uni-hannover.de [130.75.117.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.welcomes-you.com (Postfix) with ESMTPSA id AB2D831A2C4D; Mon, 29 Jun 2015 15:00:04 +0200 (CEST) Message-ID: <55914154.9000401@aei.mpg.de> Date: Mon, 29 Jun 2015 15:00:04 +0200 From: Carsten Aulbert Organization: Max Planck Institute for Gravitational Physics - Albert Einstein Institute (AEI) User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Icedove/31.7.0 MIME-Version: 1.0 To: Rick Macklem , =?UTF-8?B?R2Vycml0IEvDvGhu?= CC: Scott Larson , freebsd-net@freebsd.org Subject: Re: NFS on 10G interface terribly slow References: <20150625145238.12cf9da3b368ef0b9a30f193@aei.mpg.de> <1629011632.413406.1435365728977.JavaMail.zimbra@uoguelph.ca> <20150629091958.af9720d478a8903ab28adc1d@aei.mpg.de> <1467277373.898391.1435580412070.JavaMail.zimbra@uoguelph.ca> In-Reply-To: <1467277373.898391.1435580412070.JavaMail.zimbra@uoguelph.ca> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jun 2015 13:09:04 -0000 Hi Rick On 06/29/2015 02:20 PM, Rick Macklem wrote: > If the Solaris server is using ZFS, setting sync=disabled might help w.r.t. > write performance. It is, however, somewhat dangerous w.r.t. loss of recently > written data when the server crashes. (Server has told client data is safely > on stable storage so client will not re-write the block(s) although data wasn't > on stable storage and is lost.) > (I'm not a ZFS guy, so I can't suggest more w.r.t. ZFS.) > The system on the other side uses SAM/QFS, i.e. there is no such option for the file system per se (only the file system metadata is in a zvol thus not a full featured zfs). In parallel we are working also with Oracle to see where there may be a matching knob to turn as we see about the same performance issues from a Linux host (NFS client, Debian Jessie) with a Mellanox Technologies MT27500 Family [ConnectX-3] controller. Cheers Carsten -- Dr. Carsten Aulbert, Atlas cluster administration Max Planck Institute for Gravitational Physics (Albert Einstein Institute) Callinstraße 38, 30167 Hannover, Germany Tel: +49 511 762 17185, Fax: +49 511 762 17193