From owner-freebsd-fs@FreeBSD.ORG Fri Aug 1 18:30:11 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E399366D for ; Fri, 1 Aug 2014 18:30:11 +0000 (UTC) Received: from mail-lb0-x229.google.com (mail-lb0-x229.google.com [IPv6:2a00:1450:4010:c04::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C66E2491 for ; Fri, 1 Aug 2014 18:30:11 +0000 (UTC) Received: by mail-lb0-f169.google.com with SMTP id s7so3554868lbd.28 for ; Fri, 01 Aug 2014 11:30:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=6Y6AO7OIT34y6867btV6ukw8KlPVeBJ4MyuTwye2ZsU=; b=xlo2gR/VXXTiZHxWE/4zR0W8vnU0AGtNxVqFLORGuiSllJaAyK7mH6GlLHeX+a2mTG vRYn9oWFLhwQ8Hwp+DFFgB1HG1yw6cWEPfAjGDpLl6NiwCXS/PX7D/eyq/PHEuI5DvBI sqkRrgr9PswdlwepEijuQVKbBIlfYJgPuGtY5KSYGTYfJ6LuivDvZDwmFZ3/12Wf1F9W i4qURfSNGPw7ibghTDSBs/+C+54k2XojQPa5LRRKxLLTDO2TtJc5ic8OxusMNwM24RSZ uYJDhSr0FMAXCxaY67CptcYm5OfG1by91jU5YqKZRatyA/sA5ZrwOhXWVt/6VwjwDZQw jL7w== X-Received: by 10.152.23.197 with SMTP id o5mr8107787laf.60.1406917809257; Fri, 01 Aug 2014 11:30:09 -0700 (PDT) Received: from localhost ([91.225.202.19]) by mx.google.com with ESMTPSA id x10sm14266026lba.7.2014.08.01.11.30.07 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 01 Aug 2014 11:30:08 -0700 (PDT) Date: Fri, 1 Aug 2014 21:30:06 +0300 From: Mikolaj Golub To: Mike Tancsa Subject: Re: HAST slowness ? Message-ID: <20140801183005.GA3286@gmail.com> References: <53DAB322.1050703@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <53DAB322.1050703@sentex.net> User-Agent: Mutt/1.5.22 (2013-10-16) Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2014 18:30:12 -0000 On Thu, Jul 31, 2014 at 05:20:34PM -0400, Mike Tancsa wrote: > I am trying to setup my first HAST setup and for some reason, traffic > sync seems to be really slow. If I do something simple like > > > #dd if=/dev/zero of=/hastvirt/test count=2000 bs=1024k > > on the primary box, traffic on the secondary never gets much beyond a > Mb/s ?!?! > > iperf and netrate show I can pretty well saturate across the link. There > are no errors and the underlying NICs are both at gigabit with no other > traffic. Everything seems happy, just very slow to sync. Any idea where > to start debugging ? It looks you are writing to a file-system, not directly to HAST device? What is this FS? I see two HAST devices? Are they combined in one FS? How? What if you write directly to a HAST device instead? Also note, "hole" compression is enabled by default, so your test with copying zero blocks is not very good. You might be limited here by RTT, because in memsync mode, on every "compressed" block sent HAST waits for response before proceeding with the next block. -- Mikolaj Golub