From owner-freebsd-stable@FreeBSD.ORG Tue Mar 29 21:18:47 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 154D71065677 for ; Tue, 29 Mar 2011 21:18:47 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from mail-qw0-f54.google.com (mail-qw0-f54.google.com [209.85.216.54]) by mx1.freebsd.org (Postfix) with ESMTP id BA9E48FC12 for ; Tue, 29 Mar 2011 21:18:46 +0000 (UTC) Received: by qwc9 with SMTP id 9so510259qwc.13 for ; Tue, 29 Mar 2011 14:18:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=WTi8VkoECAo0Q5EWBfcPeY9I+lW/2ItAgGhutKgfve0=; b=mKl/Zzb6H/CyFUncQZNGubxmaQyqXwlyX+fjfdaeqA2JZrnMO06GuXUbjDIY5Hgalj /n7eRBDEBLBdOFqHnGHl6cOHM/G3T45ggE4WfchmcD7RRNBb71d27J6lys4pNgG0TBvy TURm/fSWMbrjc1N0HY2bRlGTlK7SwRUoYAl8k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=QBQHxGtkeBXwc03M4XxtiDcHKtv3ri9u80d69INN8xmCeUQQ5pntlfcDsWHzisDsY4 981pp8IUwaMYlPS526bHkSszS3kt2O1e9nTUcGNSRon5ltll6M9+vk7BKBj2ggN/FKZ3 iNOk7Ui4pMGd3dLAX2fRhJRjbICoStQCV+4zs= MIME-Version: 1.0 Received: by 10.229.105.96 with SMTP id s32mr322207qco.185.1301433525986; Tue, 29 Mar 2011 14:18:45 -0700 (PDT) Received: by 10.229.91.144 with HTTP; Tue, 29 Mar 2011 14:18:45 -0700 (PDT) In-Reply-To: <20110329205527.GA77676@icarus.home.lan> References: <113777190.2282503.1301350571721.JavaMail.root@erie.cs.uoguelph.ca> <20110329155149.167768mu74in1ios@webmail.leidinger.net> <20110329205527.GA77676@icarus.home.lan> Date: Tue, 29 Mar 2011 23:18:45 +0200 Message-ID: From: Claus Guttesen To: Jeremy Chadwick Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Alexander Leidinger , Rick Macklem , FreeBSD Stable Subject: Re: zfs, nfs and zil X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Mar 2011 21:18:47 -0000 >> It's a supermicro server with dual igb-nics on the mainboard. I did >> try other cables and other ports on the switch (hp procurve). I don't >> have access to the server atm. but I'll get the chip-info in a day or >> two. Both ip-addresses are on same subnet. >> >> Speed is autonegotiated to 1 GB full duplex on server and switch. No >> errors detected using netstat or on switch. > > Something tells me (gut feeling) the virtualisation part is probably > somehow responsible for the problem, quote: > >> I'm mounting the FreeBSD-server from a couple of vmware esxi 4.1 >> servers using nfs, but when there is alot of i/o the server becomes >> unresponsive, easily triggered by installing ie. ms-sql. The server >> itself is up but is not reachable from the network. When I take the >> nic down and up again connection to the network is reestablished >> (ip-wise). > > Can you remove ESXi from the picture and see if the problem continues? > If it does, we should probably pull Jack Vogel into the discussion, as > Supermicro predominantly uses Intel-based NICs. =A0He'll need output from > "pciconf -lvcb" and "dmesg" to assist. > > But before pulling him in, please see if you can remove ESXi from the > picture. I've done some testing i Feb. when I initially installed the server with samba and iscsi from a windows 7 client and managed to get approx. 118 MB/s on plain GB nics. I copied some 30-40 GB and never had a hickup. Then I mounted iscsi from vmware and migrated some windows-servers and it behaved well. When we moved to nfs the peculiar problems began to arise. I will redo my testing from my windows 7 client to verify that my memory do not put a spell on me! I've also begun to move some virtual windows-servers back to iscsi and mount the iscsi-volume from several vmware-servers. Vmfs is cluster-aware and should handle it just fine. In a few days I'll move a server I know causes problems to iscsi and I'll post the results. Thank you for your input! :-) --=20 regards Claus When lenity and cruelty play for a kingdom, the gentler gamester is the soonest winner. Shakespeare twitter.com/kometen