From owner-freebsd-virtualization@freebsd.org Sun Sep 3 19:55:01 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 890C1E1C25B for ; Sun, 3 Sep 2017 19:55:01 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (vm1982.vellance.net [79.99.187.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3CE37766A7 for ; Sun, 3 Sep 2017 19:55:00 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 5D1ED2018E for ; Sun, 3 Sep 2017 21:54:51 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1504468491; bh=u2IitJWMJfrOSnAqJJ8JOAkIgTaIuetS9+iRaswkRSI=; h=Subject:To:References:From:Date:In-Reply-To; b=LyWtoBK0yMStCqQU8cGAgQhUqFSI57n7QcxMKZLaUKq59mSpwQGvMn/ytu5vQxRWM cvjVEHXIHpnPgAEeeAmeEy0S/9TB9H1UcUJ1997m25UfvvsTFcaLxb/6OSENReKB/C XcRTtVmqsmgFbHNtdTM1AJqmEHIeNWIFaaP5lYW/IMUZNe6daKpxWI1rT6eFKpRcna EDXmW23tSB5IFvU0Bx1M7rceMG5q9f7VMoEBH5gAnjn+jXh4dHzCOt6b1JdcOto3Wm 7Zm9w70cmm23oPflf/PlrF5r0DDRwY5F2Dd/L2cKDIogwpEj+Fz3pc9lzEZ06CwfMQ AWQ+0Y5j/YeXplKawvws5NgiD1l/TO+OPfq/jcK0ssduXen+lXBjrlSkXIsrLewE/R QRlF1w5FTFvsAoRc/f6XQ00j+B+vVX823cu7e5dl1UJ0p9PQnrkEiTdAg7iN/cD679 /W5OBQi26vf5i/SobWllEvt43AWJkCilFFFehRID5SQJLXzSNOu+BnHKL5z3GC+4ai x1wkHrg+t/z9unth2lF6va9VR8jgZtR4ZJwjOvS1/2Yi6te4VhcGOMCD0k3AzOa63z /6ho6Dia2mKUCIA2IwInM2NG9BmgOzHNKEXxBWbY4Zhx1vFY8c8JYbIQ/nodZRasPf jbmt28CsRYG4op91vDos+fI0= Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 456AA20139 for ; Sun, 3 Sep 2017 21:54:39 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1504468490; bh=u2IitJWMJfrOSnAqJJ8JOAkIgTaIuetS9+iRaswkRSI=; h=Subject:To:References:From:Date:In-Reply-To; b=aV/oaLfb3zEfsK/x2t94cFRrCxP17+ZUC1EtuM0n5e3TMRiTFkMilPfCVJv4f78+P Wzqlu/SA5t5NwbJRKCyH2WFzwi1bTD9MM4+0HWsxODWHPfIIwThXzkpdcXtCW644KR jA2ovLyM/S1TpCtixW6KJ25Dahw8PMCEZY4qj8jMEQu9POmKXnaNCOYXbluAd+gVTe UOTY7yXp4FZ4QpPWG5zs+Qb0Qh73JkqhszxNe2sBqR1aTT3ZBRyRKhg4zJsJsYZw6Y A4ZXDnyVmJruAzj1QvS2ISI3sxRC8uYiqgicSEqU/nQ5vu6womM4KPzgdBPcmPyy02 GfwwTxXTmwlTyQ8sALCTcv035+FgO/5PhUbzV4XtSWBCx1fgXPUnTBJS+nZ9DdNF64 Z6VyzqLGgN6rjo/skNKVx+LOxvTJ2IiXDj136v3jtX7wvt4EZ5zcBbPMTFVP9qghS2 ZJCrTzBXLyHLuf79yareWy0q7QqEPRvy1MUJSaZhvB70orJi8dI3SJFeIxlCffyYBx mRViKrMFLAnTtFXgGejxeqAABiHQsBnhtrwxU6sUPNek9GQklXEseuNZliaT++fE30 OVkQU7hMr4XPb0joDIaizvF3TwWcHRxAajOkc2lYPXdwlw5xqHKXfbEWKYgmt3ZBN3 HA695I++Lw9h/SvX7BncrJeA= X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on vm1982.vellance.net X-Spam-Level: X-Spam-Status: No, score=0.7 required=5.0 tests=ALL_TRUSTED,URIBL_BLACK autolearn=no autolearn_force=no version=3.4.1 Received: from rubens-MacBook-Air.local (ip4da7bddc.direct-adsl.nl [77.167.189.220]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by vm1982.vellance.net (Postfix) with ESMTPSA for ; Sun, 3 Sep 2017 21:54:37 +0200 (CEST) Subject: Re: bhyve VM drive size limit? To: freebsd-virtualization@freebsd.org References: <147e2841-bb29-1fe6-11cc-917f22bf8e87@osfux.nl> From: Ruben Message-ID: <7908ecba-d45a-5f42-744f-dfa267be8d80@osfux.nl> Date: Sun, 3 Sep 2017 21:54:39 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Sep 2017 19:55:01 -0000 Hi Allan/Jason, I think Ill have a go at the "missing space" situation again after some reading up. Since I went with the default block sizes (on both the zvol and the ext4 fs) I probably have some reconfiguration to do.. Thank you very much for your feedback/directions! Kind regards, Ruben On 03/09/17 06:01, Allan Jude wrote: > On 2017-09-02 10:52, Ruben wrote: >> Hi Jason, >> >> >>> Make sure >>> you adjust the zvol block size in the default config before creating your >>> guest or you will wonder where your storage starts to disappear to. >>> >>> Cheers, >>> >>> Jason >> Perhaps slightly off-topic, but might you have any recommendations >> regarding those blocksizes? >> >> I'm not really that well versed in blocksizes / filesystems and am often >> wondering where my 5TB zvol (bhyves into an ext4 volume for an ubuntu >> guest) exactly disappears into :P >> >> Regards, >> >> Ruben >>> On 2 Sep 2017 2:46 p.m., "Dylan Williams" wrote: >>> >>> Dear all, >>> >>> Is there a limit with respect to the size of the virtual drive I can create >>> for a VM using bhyve? Presumably not but I’m running into problems with a >>> larger drive. >>> >>> I am trying to create a 4T Ubuntu machine on a FreeBSD11.1 server using >>> iohyve. There’s plenty of drive space available so it’s not a drive space >>> issue. I am able to create a 40G machine without any problems but exactly >>> the same commands to create a 4000G machine results in a server that won’t >>> boot past Grub. Is this an iohyve issue perhaps? >>> >>> Commands used that results in a working Ubuntu server: >>> >>> iohyve create ubu 40G >>> iohyve set ubu loader=grub-bhyve os=debian ram=40G cpu=10 >>> iohyve install ubu ubuntu-16.04.3-server-amd64.iso < >>> ftp://ftp.cuhk.edu.hk/pub/Linux/ubuntu-releases/16.04.3/ >>> ubuntu-16.04.3-server-amd64.iso> >>> >>> Commands used that results in a broken Ubuntu server: >>> >>> iohyve create ubu 4000G >>> iohyve set ubu loader=grub-bhyve os=debian ram=40G cpu=10 >>> iohyve install ubu ubuntu-16.04.3-server-amd64.iso < >>> ftp://ftp.cuhk.edu.hk/pub/Linux/ubuntu-releases/16.04.3/ >>> ubuntu-16.04.3-server-amd64.iso> >>> >>> The screen I get in the console when I boot (iohyve start ubu) the 4T >>> machine is: >>> >>> GNU GRUB version 2.00 >>> >>> Minimal BASH-like line editing is supported. For the first word, TAB >>> lists possible command completions. Anywhere else TAB lists possible >>> device or file completions. >>> >>> >>> grub> >>> >>> Does anyone have any ideas? I’ve been at this for hours trying different >>> configurations. LVM is not selected when installing either of the above >>> machines as that seems to cause more problems. >>> >>> Many thanks, >>> Dylan. >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to "freebsd-virtualization- >>> unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" >> > To understand why space in a ZVOL goes missing, research 'raidz padding'. > > See here: > https://www.delphix.com/blog/delphix-engineering/zfs-raidz-stripe-width-or-how-i-learned-stop-worrying-and-love-raidz > > For more detail, see Chapter 9 of "FreeBSD Mastery: Advanced ZFS" from > http://www.zfsbook.com > >