Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 9 Nov 2011 02:47:06 -0600
From:      Kurt Touet <ktouet@gmail.com>
To:        "Daniel O'Connor" <doconnor@gsoft.com.au>
Cc:        Garrett Cooper <yanegomi@gmail.com>, freebsd-current@freebsd.org, Dan The Man <dan@sunsaturn.com>
Subject:   Re: samba+zfs
Message-ID:  <CALM%2B6aK3PgdPNZJEHCdday84tH_7P9Ug=_yk=PfxcFOV6ejEzA@mail.gmail.com>
In-Reply-To: <82C85C01-62C4-4E75-B3F2-59D703CA5D78@gsoft.com.au>
References:  <alpine.BSF.2.00.1110272039500.50739@sunsaturn.com> <CAGH67wRZZx0hG9ug2k-5ohCOPJ9sZOU9iFVKg7hv9WM=R761GA@mail.gmail.com> <alpine.BSF.2.00.1111080259270.89703@sunsaturn.com> <alpine.BSF.2.00.1111080328010.89703@sunsaturn.com> <CALM%2B6aJkF=CFq8LA3FrSMYo8La-8txK4h2p4yZtdHshskBU6Vw@mail.gmail.com> <alpine.BSF.2.00.1111082015260.93923@sunsaturn.com> <CALM%2B6aJiM%2BNfikax9vNiYzBJqo3B8WLEXiZgrjUUQa9ngCQaKg@mail.gmail.com> <B4FEAF5B-52AC-40E5-90A3-7BD060BB7A73@gsoft.com.au> <F8AEDB62-4C76-4D95-8CBA-6C58B54C1965@gsoft.com.au> <CAGH67wRJkN%2BsDhxxMVSZx3RXQJm5xyyfW9iwiY1FrkFxLu%2BTWQ@mail.gmail.com> <82C85C01-62C4-4E75-B3F2-59D703CA5D78@gsoft.com.au>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Nov 9, 2011 at 1:07 AM, Daniel O'Connor <doconnor@gsoft.com.au> wro=
te:
>
> On 09/11/2011, at 17:32, Garrett Cooper wrote
>>> dd's of large files (spooled backups going to tape) to /dev/null are as=
 slow as Samba.
>>
>> =A0 =A0- Dedupe?
>
> Nope.
>
>> =A0 =A0- Compression?
>
> On the mail spool & ports, but not on the tape spool.
>
>> =A0 =A0- How much RAM?
>
> 8GB.
>
>> =A0 =A0- What debug options do you have enabled in the kernel?
>
> It is 8.2-GENERIC so.. no WITNESS (for example)
>
>> =A0 =A0I've been noticing a slowdown in some respects with NFS/SMB, but =
I
>> suspected it was because I have an re(4) based NIC. ZFS has also wired
>> down a lot of my system memory for the L2ARC=85
>
>
> re isn't great but I wouldn't expect it to slow down over time.. Unless b=
ounce buffers got used more and more or something.
>
> I have an em0 card in this system - but in any case it is slow locally (i=
.e. dd a large file with 64k block size).
>
> --
> Daniel O'Connor software and network engineer
> for Genesis Software - http://www.gsoft.com.au
> "The nice thing about standards is that there
> are so many of them to choose from."
> =A0-- Andrew Tanenbaum
> GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C
>
>

Right now (while experience slow writes via samba+zfs) this is general
read speed off a 4 x 1.5TB sata2 raidz1:

# dd if=3Dtest.file of=3D/dev/null
13753502+1 records in
13753502+1 records out
7041793036 bytes transferred in 100.020897 secs (70403218 bytes/sec)

That's not in the same ball park of slow writes, but it is below what
I expect for reads.

My setup is a little odd:  4x1.5tb raidz sata2 on mobo + 2 x 2tb
mirror on sata1 pci controller, zfs v28, stable/9 r227357, amd x4 810
2.6ghz, 4gb ram, no dedupe, no compression, daily snapshots saved for
7 days

The above file read was stored before the 2 x 2tb mirror addition, so
it was a solely read off the sata2 mobo ports.   Reading off of
something more recent (and split amongst both raidz1 and mirror
vdevs):

# dd if=3Dtest2.file of=3D/dev/null
9154715+1 records in
9154715+1 records out
4687214153 bytes transferred in 82.963181 secs (56497522 bytes/sec)

This is, again, seems slower than usual, but not as terrible as the
write speeds that I've been seeing via samba.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CALM%2B6aK3PgdPNZJEHCdday84tH_7P9Ug=_yk=PfxcFOV6ejEzA>