Date: Thu, 13 Oct 2016 20:41:32 +0200 From: Michael Osipov <1983-01-06@gmx.net> To: freebsd-geom@freebsd.org Subject: Re: Abysmally slow write to geom class volume over network Message-ID: <636763f0-a732-18ba-262b-c3fc01f4342c@gmx.net> In-Reply-To: <20161013014143.GA1669@funkthat.com> References: <33da0f73-48f1-4727-fe76-41343dc4955b@gmx.net> <18314f27-849b-31df-d88d-af64e89c133f@gmx.net> <346c7da7-02b2-ba34-1463-f3f0a5a3cd9a@rlwinm.de> <15e9cb94-7ad8-e547-b06a-699ce2250624@gmx.net> <20161013014143.GA1669@funkthat.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Am 2016-10-13 um 03:41 schrieb John-Mark Gurney: > Michael Osipov wrote this message on Wed, Oct 12, 2016 at 20:54 +0200: >> As if there is a bottleneck between socket read and geom write to FS. >> >> Is that better? > > Have you run gstat on the system to see if there is an IO bottle > neck? Since you are using graid3, you want to look to see if > it's %busy is ~100, while the underlying components are not. This is hardly impossible because as soon as I start some SFTP transfer, all of my SSH sessions free or receive connetion timeout/abort. Doing a SFTP from FreeBSD to FreeBSD gives me on both physical disks and RAID3 volume a busy of zero to one perfect. In other terms, the drives are bored. > Also, if you do dd if=/dev/zero of=/mnt/somefile bs=1m count=1024, > from the local system, are things still slow? I have done this in the first place, this is fast: # dd if=/dev/zero bs=1M count=10240 | pv -s 10G -treab --progress > /mnt/file.bin 10240+0 records out 10737418240 bytes transferred in 216.084333 secs (49690869 bytes/sec) 10GiB 0:03:36 [47.4MiB/s] [47.4MiB/s] [==========================>] 100% > P.S. This is basic debugging, have to identify which part of the > system is misbehaving. I am aware of that. Thank you. > P.P.S. Your "non-geom" test is still using geom, just not w/ the graid3 > module. Oh ok, I wasn't aware of that. Actually, I have tried all of them: concat, stripe, mirror, gvinum. Local operations are fast, though remote still crawls slowly. Michael
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?636763f0-a732-18ba-262b-c3fc01f4342c>