From owner-freebsd-emulation@FreeBSD.ORG Mon Feb 10 08:39:36 2014 Return-Path: Delivered-To: freebsd-emulation@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 316968D3 for ; Mon, 10 Feb 2014 08:39:36 +0000 (UTC) Received: from mail-oa0-x230.google.com (mail-oa0-x230.google.com [IPv6:2607:f8b0:4003:c02::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id CAD1B12D3 for ; Mon, 10 Feb 2014 08:39:35 +0000 (UTC) Received: by mail-oa0-f48.google.com with SMTP id l6so7140424oag.35 for ; Mon, 10 Feb 2014 00:39:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bluelife.at; s=google; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=vPHUUZDelj/4SDFcvv/DZ0vbaxcVqmp9UXX0lBkCGzA=; b=TCSp8lDBfEzwo6iI515DyNU3gz05EHAsQA7jIeu6guLXEJmZd4e8fU32Y4rAqrI4fJ TkdKuu8zmUJbccFSwXSIbkA5kLau7JnZ0SuiyTrGQkeqzkeXN9Ku/GqbnEOLuAkD3XID aPH6IvpV3TiQJHrkWU58JKOmTTOFc0iqyy+1M= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=vPHUUZDelj/4SDFcvv/DZ0vbaxcVqmp9UXX0lBkCGzA=; b=YToU9Q70LV6y15s5jv1IX4tqmS6fJNWPuLtty5KGrem2wN4EFon2hr4WLvM0qCniED opm7H21YZ//mGUWl/VOphc/PXmElwwQmYUNMsMCEGmrT9Zp0Rzqj6/0Vd2btlgxh4SBE laMZjqa/G9cZ9Ub64m35OLFOUutBv0QjWPgCs2Nit7oPoUM5aYX4qpPgMXa+tvsJdAZU KrQpkzC+T2kuXpYW4ALEukxPyWDJsvZU7r9dr+e5CwafX7P62vNtmS1X2VGbK/piKaUp k0+/EG9RTIW1bta+7+7egonbs4zkHuXMx1gRe2zXv2TreWru0semQIVp/2CcEfWWg0Xg lYYw== X-Gm-Message-State: ALoCoQnUFdQrSXI5KoLuPxUEphqGVzpIdtECkugLyNrW1jTLVt4WVnErETiJPwugyTsl1z9VGZ9s MIME-Version: 1.0 X-Received: by 10.60.246.139 with SMTP id xw11mr26126755oec.36.1392021575069; Mon, 10 Feb 2014 00:39:35 -0800 (PST) Sender: decke@bluelife.at Received: by 10.76.144.71 with HTTP; Mon, 10 Feb 2014 00:39:34 -0800 (PST) X-Originating-IP: [80.123.233.199] In-Reply-To: <20140208095107.GA1232@potato.growveg.org> References: <20140208095107.GA1232@potato.growveg.org> Date: Mon, 10 Feb 2014 09:39:34 +0100 X-Google-Sender-Auth: 4fOzNO5Zzy86uCu08RvShnQCg3E Message-ID: Subject: Re: virtualbox tips for performance specific to FreeBSD-10 hosts From: =?ISO-8859-1?Q?Bernhard_Fr=F6hlich?= To: John Content-Type: text/plain; charset=ISO-8859-1 Cc: "freebsd-emulation@freebsd.org" X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Feb 2014 08:39:36 -0000 On Sat, Feb 8, 2014 at 10:51 AM, John wrote: > Hello list, > > As subject, can anyone recommend any tips for getting optimum > performance from various guests on a freebsd-10-R host? I've looked at > the page about changing polling interval but that only applies to > freebsd guests. I'm looking advice specifically for linux guests on this > host. Guests are ubuntu and opensuse. > > Machine is a Xeon E5-2650L @ 1.80GHz with 32 cores, 192GB RAM and 10TB > available storage on zfs. I would not recommend using VirtualBox on such a box. VirtualBox is a Desktop Virtualisation product and that specs are too high to make good use of them. One issue you will run into is ZFS ARC - with that amount of memory it will take quite some time to fill up but ZFS ARC and VirtualBox wired memory will start fighting each other. So I recommend limiting ZFS ARC to some sane amount. (32GB?) VirtualBox has quite a bit more overhead than all the other server grade virtualisation products out there and that is especially true for I/O. With FreeBSD 10 you should already use AHCI on the host and the linux guests will likely use an SATA controller and AHCI too. That should be the minimum and is also what we have already written down in the vbox tuning notes: https://wiki.freebsd.org/VirtualBox/Tuning > No issues sofar freebsd on freebsd. Just looking for advice linux guest > on freebsd with virtualbox. Or perhaps there's something better than > virtualbox? Basically all guests need to be isolated from one another. > It makes backing up and restoring systems pain-free. So far this are the mainstream candidates: BSD: - BHyVe Linux: - KVM - Xen Proprietary: - VMware ESXi - XenServer I have had a look at a server virtualisation product myself some months ago and came to the conclusion that there is no painfree server virtualisation product that is focused on ONE machine with a proper webinterface with a reasonable easy installation and for free. VMware ESXi came close but it fails badly with the webinterface (no I don't consider the required 8-16GB RAM for the webinterface appropriate). RedHats oVirt also made a good impression but I broke it within half an hour and the webinterface never detected the nodes properly. Also oVirt really wants you to have a dedicated storage box which I wanted to avoid. Running it all on one machine is on their todo for years. No I don't want to run 3 boxes for two VMs. OpenStack was just a mess and I gave up because all the different components didn't fit into my small head. This really looks like you want to build your own cloud with 1000+ nodes. There are quite a few more KVM based products out there which I didn't try just because I gave up at that point and went with the free ESXi and a windows VM with vSphere Client. The ones that I remember were also appropriate candiates for my search were Ubuntu 12.04 LTS with KVM + convirt2, Proxmox or a simple Linux distribution and shell. So VirtualBox + phpvirtualbox does a few things very very good and I love it for that on small boxes with light load but it's not a proper server virtualisation product. What I would really like to see is a FreeNAS like appliance for virtualisation with a webinterface and based on BHyVe. The Linux KVM stuff is not quite there yet when it comes to "painless". -- Bernhard Froehlich http://www.bluelife.at/