Date: Wed, 8 Apr 2009 23:18:51 -0400 From: Hussain Ali <hali@datapipe.net> To: <freebsd-fs@freebsd.org> Subject: Re: ZFSKnownProblems - needs revision? Message-ID: <20090409031851.GE6052@datapipe.com>
next in thread | raw e-mail | index | archive | help
> Ivan Voras wrote:
>
>
>>* Are the issues on the list still there?
>>* Are there any new issues?
>>* Is somebody running ZFS in production (non-trivial loads) with
>>success? What architecture / RAM / load / applications used?
>>* How is your memory load? (does it leave enough memory for other
>>services)
I have a storage server its constantly heavy writing and reading (at
times) though not with high concurrency:
# df -h
Filesystem Size Used Avail Capacity Mounted on
/dev/ufs/rootfs 19G 395M 17G 2% /
devfs 1.0K 1.0K 0B 100% /dev
/dev/ufs/tmp 4.8G 20K 4.5G 0% /tmp
/dev/ufs/usr 19G 2.9G 15G 16% /usr
/dev/ufs/var 15G 7.5G 5.8G 56% /var
backupstorage 94T 80T 13T 86% /backupstorage
# cat /etc/sysctl.conf
# $Id: sysctl.conf,v 1.3 2009/04/09 03:06:31 hali Exp root $
security.bsd.see_other_uids=3D0
net.inet.tcp.blackhole=3D2
net.inet.udp.blackhole=3D1
net.inet.icmp.icmplim=3D50
net.inet.tcp.sendspace=3D524288
net.inet.tcp.recvspace=3D524288
net.inet.ip.intr_queue_maxlen=3D2048
net.inet.ip.intr_queue_drops=3D4096
kern.ipc.maxsockbuf=3D2097152
kern.ipc.somaxconn=3D8096
kern.maxfiles=3D443808
vfs.hirunningspace=3D4194304
vfs.ufs.dirhash_maxmem=3D4194304
vfs.lookup_shared=3D1
# cat /boot/loader.conf
# $Id: loader.conf,v 1.4 2009/04/09 03:07:40 hali Exp root $
isp_load=3D"YES"
ispfw_load=3D"YES"
isp_2400_load=3D"NO"
vm.kmem_size_max=3D"1073741824"
vm.kmem_size=3D"1073741824"
vfs.zfs.prefetch_disable=3D1
vfs.zfs.arc_max=3D"786M"
kern.maxvnodes=3D"50000
# zpool iostat 3
capacity operations bandwidth
pool used avail read write read write
------------- ----- ----- ----- ----- ----- -----
backupstorage 80.4T 14.9T 2 355 186K 38.7M
backupstorage 80.4T 14.9T 0 316 0 31.7M
backupstorage 80.4T 14.9T 0 99 0 12.2M
backupstorage 80.4T 14.9T 0 164 0 15.7M
backupstorage 80.4T 14.9T 0 225 0 22.0M
I have another another in another dc, but less capacity:
backupstorage 56T 32T 24T 57% /backupstorage
Both are the following:
HP ProLiant DL385 G2
8GB RAM
dual dual core AMD 2.2Ghz cpus
3 x Nexsan SataBEAST for the san.
Inbound about 900Mb/s, uptime has generally been 3-4 months before
increasing the ZFS arc/KVM sizes. I should just max it out but its
relatively stable. Am looking for ZFSv8+ for L2Arc and separate ZIL.
Load averages about ~ 1.0 . My wish list would be KVM support fot 64GB
ARC, fusion-IO driver support for the ZIL, version 8 of ZFS in FreeBSD
7.2, active multipath, etc, etc..
It works, its stable, its production, but its not like i am cvsuping
ports tree 100 times concurrently.
--
-hussain
This message may contain confidential or privileged information. If you ar=
e not the intended recipient, please advise us immediately and delete this =
message. See http://www.datapipe.com/emaildisclaimer.aspx for further info=
rmation on confidentiality and the risks of non-secure electronic communica=
tion. If you cannot access these links, please notify us by reply message a=
nd we will send the contents to you.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20090409031851.GE6052>