From owner-freebsd-xen@FreeBSD.ORG Fri Jan 20 02:40:38 2012 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BA582106564A for ; Fri, 20 Jan 2012 02:40:38 +0000 (UTC) (envelope-from mikemacleod@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 8327F8FC15 for ; Fri, 20 Jan 2012 02:40:38 +0000 (UTC) Received: by iagz16 with SMTP id z16so286759iag.13 for ; Thu, 19 Jan 2012 18:40:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=d807b3J0i1CacUJiEJ5XfB7Tc6DM1hdL3ZVAUlx61GY=; b=hLvY3iuIIus9OSwMdw+kZ3YwYmJ3eKZcPhekOsR2Od+ug3M+TKTBcLB3d6ZqwN4CVL AkXICgK7f2ZwucAlJXySIFysZtAIU66607JUxcYH9c/9veslWBeJcbic7OYsXH38J02E F+/271iPlcvMvnHXqkggGPoaIMNoiLF8JPhY8= Received: by 10.43.48.132 with SMTP id uw4mr14596221icb.17.1327025907352; Thu, 19 Jan 2012 18:18:27 -0800 (PST) MIME-Version: 1.0 Received: by 10.42.172.8 with HTTP; Thu, 19 Jan 2012 18:18:06 -0800 (PST) In-Reply-To: <65d33d61a2d7c4ccc167658407f5b189@www1.xerq.net> References: <7840786B-5C23-4C6D-AEE5-3DC23E96FC82@kfu.com> <4F18A4F2.7040205@delphij.net> <65d33d61a2d7c4ccc167658407f5b189@www1.xerq.net> From: Michael MacLeod Date: Thu, 19 Jan 2012 21:18:06 -0500 Message-ID: To: Matt Connor Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-xen@freebsd.org, d@delphij.net Subject: Re: 9.0-RELEASE success X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jan 2012 02:40:38 -0000 On Thu, Jan 19, 2012 at 9:06 PM, Matt Connor wrote: > On 2012-01-19 15:19, Xin Li wrote: > >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On 01/19/12 13:22, Matt Connor wrote: >> >>> On 19.01.2012 13:15, Nick Sayer wrote: >>> >>>> I have a VPS at rootbsd.net, and have been running 8.2-RELEASE >>>> with a XENHVM kernel with a patch to fix the 'do something smart' >>>> panic in if_xn. I fetched the 9.0-RELEASE source tree and built a >>>> kernel to try and it worked without any muss or fuss. I did the >>>> rest of the upgrade and it's working just fine, so far as I can >>>> tell. >>>> >>>> And there was much >>>> rejoicing.____________________**___________________________ >>>> >>> >>> Same here at ssdnodes.com - we pulled the new source tree, rebuilt >>> with our modified XENHVM and haven't had any issues so far. >>> >>> We had many tweaks in /etc/sysctl.conf to improve throughput for >>> the 8.2-RELEASE, the 9.0-RELEASE systems still remained snappy >>> after the tweaks were removed. >>> >> >> What kinds of tweaks are needed? (i.e. should we make them the defaults?) >> > > > The tweaks were only "needed" because we were trying to achieve a specific > network throughput in our particular workload (read: turning the knob all > the way until it broke off). These values are no longer in production on > version 9.0-RELEASE, I highly recommend these never become default. > > For your amusement, I've included the values below: > > > -/boot/loader.conf > # ZFS tuning parameters > # We're running on top of a hardware battery-backed RAID controller, > therefore disable cache flush > vfs.zfs.cache_flush_disable=1 > vfs.zfs.prefetch_disable=1 > # Recommends not setting a kmem limit and increasing arc > # http://www.listshow.net/**201005/freebsd-fs/9744-very-** > bad-zfs-performance-on-fresh-**freebsd-8-installation.html > vfs.zfs.arc_min="512M" > vfs.zfs.arc_max="3584M" > # Drive tweaks > vfs.zfs.vdev.min_pending=2 > vfs.zfs.vdev.max_pending=30 > vfs.zfs.txg.timeout=5 > > > -/etc/sysctl.conf > # not having this will cause the system to be very sluggish during file > I/O as well as hanging during the nightly cron jobs > vfs.ufs.dirhash_maxmem=**64777216 > > vfs.write_behind=0 > vfs.lorunningspace=1048576 > vfs.hirunningspace=8388608 > > # Kernel Tuning > kern.ipc.maxsockbuf=16777216 > net.inet.tcp.rfc1323=1 > kern.ipc.somaxconn=2048 > > # Experimental > kern.maxfilesperproc=64768 > kern.maxvnodes=800000 > net.local.stream.recvspace=**65536 > kern.maxfiles=65536 > net.inet.udp.maxdgram=57344 > net.inet.tcp.mssdflt=1460 > net.inet.tcp.sendbuf_max=**67108864 > net.inet.tcp.recvbuf_max=**67108864 > net.inet.tcp.inflight.enable=0 > net.inet.tcp.sendspace=262144 > net.inet.tcp.recvspace=262144 > net.inet.udp.recvspace=262144 > net.inet.tcp.sack.enable=1 > net.inet.tcp.path_mtu_**discovery=1 > net.inet.tcp.sendbuf_auto=1 > net.inet.tcp.sendbuf_inc=16384 > net.inet.tcp.recvbuf_auto=1 > net.inet.tcp.recvbuf_inc=**524288 > net.inet.tcp.hostcache.expire=**1 Any of these recommended for those of us who aren't rushing to leave 8.2 yet?