From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 01:10:18 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E31FF3FE for ; Sun, 19 Jan 2014 01:10:17 +0000 (UTC) Received: from mail-ea0-x22f.google.com (mail-ea0-x22f.google.com [IPv6:2a00:1450:4013:c01::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7423610A7 for ; Sun, 19 Jan 2014 01:10:17 +0000 (UTC) Received: by mail-ea0-f175.google.com with SMTP id z10so2391166ead.6 for ; Sat, 18 Jan 2014 17:10:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=FlqF8V1aZCSjYgDn/EWiiDPi8aed2kgY1T1O42rMx+8=; b=iH7Yb6PcZQosQw+1TN2zlpRPBHyI+RYb3lR/pbDvuFT+UWLiIRjUNopvvB/d5IkhQQ ote1wNgqcgDj/1s5JQNLBE/vB4I/Gb+zR5fmougRoCHHeXoOCk8yaxXGq2lNVN3N2qW8 lmR1Yom1QTYXhDArDV2mIPPRDZpq0oQAle3QFl3Gw3MkVFa0ZHD6pxCE/4PXjAxfuH1V iDVJ2jS8elI2IyLb3+/Xjvh4KeR/30Z18fOGhb1qQmvEWYh4Pgqnf+xogK2UbVYO1ckk hhTWoa6LrfXugNb2ERsbmxyPANXk7SpOkm1GWZDArKCXMUzLEfN0Md5VYPvbHEjiT4Wl H86g== X-Received: by 10.14.109.137 with SMTP id s9mr7068462eeg.6.1390093814967; Sat, 18 Jan 2014 17:10:14 -0800 (PST) Received: from [10.0.1.109] ([91.176.87.51]) by mx.google.com with ESMTPSA id l4sm39542737een.13.2014.01.18.17.10.13 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 18 Jan 2014 17:10:14 -0800 (PST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) Subject: Re: Xen PVHVM with FreeBSD10 Guest From: Sydney Meyer In-Reply-To: <52D94E74.8000401@citrix.com> Date: Sun, 19 Jan 2014 02:10:12 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <76E20919-2457-407F-9564-7A032658C515@googlemail.com> References: <9DF57091-9957-452D-8A15-C2267F66ABEC@googlemail.com> <52D81009.6050603@citrix.com> <51F93577-E5A2-4237-9EDD-A89DDA5FC428@gmail.com> <52D8F301.2080701@citrix.com> <52D94E74.8000401@citrix.com> To: "freebsd-virtualization@freebsd.org" X-Mailer: Apple Mail (2.1827) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 01:10:18 -0000 Hello Roger, here are the results. I=92ve tested FreeBSD 9.2, 10.0-RC5 in conjunction = with XEN PVHVM,XEN-QEMU-DM, KVM-VirtIO and the bare metal performance of = the hosts, every run respectively with file IO via raw images and block = IO via LVM volumes. Each VM ran with 1GB of memory and 1 VCPU. The = results are the average of 3 consecutive runs with bonnie, writing each = time the double size of the hosts memory. Xen 4.1 with Linux 3.2 Dom0 = and QEMU 0.10.2 on Intel i3 4310T / 8 GB, KVM with Linux 3.11 on Intel = i7 860 / 12 GB. Please keep in mind that these results are more of an =93subjective=94 = impression rather a scientific comparison held under the exact same = conditions, etc. http://pastebin.com/pUZfXda7 +----------+-----+-------+--------+------------+-----------+ | OS | HV | Disk | IO | Write MB/s | Read MB/s | +----------+-----+-------+--------+------------+-----------+ | 9.2 | Xen | File | QEMU | 60,5 | 111,2 | | 9.2 | Xen | File | PV | 43,2 | 106,5 | | 9.2 | Xen | Block | QEMU | 49,4 | 91,0 | | 9.2 | Xen | Block | PV | 72,9 | 100,4 | | 10.0 | Xen | File | PV | 38,6 | 107,2 | | 10.0 | Xen | Block | PV | 72,6 | 99,8 | | 9.2 | KVM | File | VirtIO | 40,6 | 138,1 | | 9.2 | KVM | Block | VirtIO | 44,5 | 131,6 | | 10.0 | KVM | File | VirtIO | 38,1 | 131,4 | | 10.0 | KVM | Block | VirtIO | 43,2 | 134,7 | | Xen Host | | | | 90,1 | 109,0 | | KVM Host | | | | 93,4 | 126,1 | +----------+-----+-------+--------+------------+-----------+ As you can see, there are no leads to my inital observation (Emulated = Block IO =93faster=94 than PVHVM Block IO). I will take a closer look = what went wrong first time, probably some sort of caching issue.=20 Anyhow, i=92ve read that you have been working together with others to = bring PVHVM support into GENERIC, so i wanted to thank you and all the = other developers for making FreeBSD 10.0 another great release of this = rock solid, awesome Operating System. Native Xen PV- and therefore freebsd-update support are a very big plus = in our evergoing fight against management over the choice of weapons. Cheers, S. On 17.01.2014, at 16:38, Roger Pau Monn=E9 wrote: > On 17/01/14 10:17, Sydney Meyer wrote: >> I=92m doing some benchmarks with bonnie and dd on the Variations = 9.2/10.0;PVHVM/VirtIO;fileio/blockio. I will post the results here to = this thread. >=20 > By VirtIO I guess you mean emulated IO? That sounds great, I'm eager = to > see the results :) >=20 > Roger. From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 08:47:27 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0020FDB2; Sun, 19 Jan 2014 08:47:26 +0000 (UTC) Received: from mail-ig0-x231.google.com (mail-ig0-x231.google.com [IPv6:2607:f8b0:4001:c05::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id AC31D1A4D; Sun, 19 Jan 2014 08:47:26 +0000 (UTC) Received: by mail-ig0-f177.google.com with SMTP id k19so5407855igc.4 for ; Sun, 19 Jan 2014 00:47:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=FO9F9f0F43wS5W9s6/ygoOysOku2id76mo8IpY4Eflc=; b=XABKLYA4s1oYL5/wclgqsj6fogtiwMpxzBlScFgwuBAZU7+u0IUr8WutYYbOly7TUn QlrlvGR8+fucRnl/DGng/91YErTQ4SVUsGFqgDyls62UvI1K4xvX+Zr2H9p+TRj46fL6 ULvRrzA6gOAc5KiRw6sK9O2NycuiNI8RIGUxY3TyiKDyH99CNmmtXqGQAyyXotuQOmpZ jWC281BwkyncuEvq/M7NjvmNcYeTczS4TyqroIwj9ioPPyCEm7SYmYR7tLfviAK4yt+5 v9+xEDt0rz8SUamoX0jw/caIJDtDmRzUAUpw2RtkySYjKm4hjS96FOp3UZYqDJkpWmEN rA2w== MIME-Version: 1.0 X-Received: by 10.51.17.101 with SMTP id gd5mr6719485igd.25.1390121245799; Sun, 19 Jan 2014 00:47:25 -0800 (PST) Sender: jdavidlists@gmail.com Received: by 10.42.170.8 with HTTP; Sun, 19 Jan 2014 00:47:25 -0800 (PST) Date: Sun, 19 Jan 2014 03:47:25 -0500 X-Google-Sender-Auth: us4bPXAWxvueZzYlem9wY1c_NbE Message-ID: Subject: Terrible NFS performance under 9.2-RELEASE? From: J David To: freebsd-net@freebsd.org, freebsd-stable , freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 08:47:27 -0000 While setting up a test for other purposes, I noticed some really horrible NFS performance issues. To explore this, I set up a test environment with two FreeBSD 9.2-RELEASE-p3 virtual machines running under KVM. The NFS server is configured to serve a 2 gig mfs on /mnt. The performance of the virtual network is outstanding: Server: $ iperf -c 172.20.20.169 ------------------------------------------------------------ Client connecting to 172.20.20.169, TCP port 5001 TCP window size: 1.00 MByte (default) ------------------------------------------------------------ [ 3] local 172.20.20.162 port 59717 connected with 172.20.20.169 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 16.1 GBytes 13.8 Gbits/sec $ iperf -s ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 1.00 MByte (default) ------------------------------------------------------------ [ 4] local 172.20.20.162 port 5001 connected with 172.20.20.169 port 45655 [ ID] Interval Transfer Bandwidth [ 4] 0.0-10.0 sec 15.8 GBytes 13.6 Gbits/sec Client: $ iperf -s ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 1.00 MByte (default) ------------------------------------------------------------ [ 4] local 172.20.20.169 port 5001 connected with 172.20.20.162 port 59717 [ ID] Interval Transfer Bandwidth [ 4] 0.0-10.0 sec 16.1 GBytes 13.8 Gbits/sec ^C$ iperf -c 172.20.20.162 ------------------------------------------------------------ Client connecting to 172.20.20.162, TCP port 5001 TCP window size: 1.00 MByte (default) ------------------------------------------------------------ [ 3] local 172.20.20.169 port 45655 connected with 172.20.20.162 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 15.8 GBytes 13.6 Gbits/sec The performance of the mfs filesystem on the server is also good. Server: $ sudo mdconfig -a -t swap -s 2g md0 $ sudo newfs -U -b 4k -f 4k /dev/md0 /dev/md0: 2048.0MB (4194304 sectors) block size 4096, fragment size 4096 using 43 cylinder groups of 48.12MB, 12320 blks, 6160 inodes. with soft updates super-block backups (for fsck_ffs -b #) at: 144, 98704, 197264, 295824, 394384, 492944, 591504, 690064, 788624, 887184, 985744, 1084304, 1182864, 1281424, 1379984, 1478544, 1577104, 1675664, 1774224, 1872784, 1971344, 2069904, 2168464, 2267024, 2365584, 2464144, 2562704, 2661264, 2759824, 2858384, 2956944, 3055504, 3154064, 3252624, 3351184, 3449744, 3548304, 3646864, 3745424, 3843984, 3942544, 4041104, 4139664 $ sudo mount /dev/md0 /mnt $ cd /mnt $ sudo iozone -e -I -s 512m -r 4k -i 0 -i 1 -i 2 Iozone: Performance Test of File I/O Version $Revision: 3.420 $ [...] random random KB reclen write rewrite read reread read write 524288 4 560145 1114593 933699 831902 56347 158904 iozone test complete. But introduce NFS into the mix and everything falls apart. Client: $ sudo mount -o tcp,nfsv3 f12.phxi:/mnt /mnt $ cd /mnt $ sudo iozone -e -I -s 512m -r 4k -i 0 -i 1 -i 2 Iozone: Performance Test of File I/O Version $Revision: 3.420 $ [...] random random KB reclen write rewrite read reread read write 524288 4 67246 2923 103295 1272407 172475 196 And the above took 48 minutes to run, compared to 14 seconds for the local version. So it's 200x slower over NFS. The random write test is over 800x slower. Of course NFS is slower, that's expected, but it definitely wasn't this exaggerated in previous releases. To emphasize that iozone reflects real workloads here, I tried doing an svn co of the 9-STABLE source tree over NFS but after two hours it was still in llvm so I gave up. While all this not-much-of-anything NFS traffic is going on, both systems are essentially idle. The process on the client sits in "newnfs" wait state with nearly no CPU. The server is completely idle except for the occasional 0.10% in an nfsd thread, which otherwise spend their lives in rpcsvc wait state. Server iostat: $ iostat -x -w 10 md0 extended device statistics device r/s w/s kr/s kw/s qlen svc_t %b [...] md0 0.0 36.0 0.0 0.0 0 1.2 0 md0 0.0 38.8 0.0 0.0 0 1.5 0 md0 0.0 73.6 0.0 0.0 0 1.0 0 md0 0.0 53.3 0.0 0.0 0 2.5 0 md0 0.0 33.7 0.0 0.0 0 1.1 0 md0 0.0 45.5 0.0 0.0 0 1.8 0 Server nfsstat: $ nfsstat -s -w 10 GtAttr Lookup Rdlink Read Write Rename Access Rddir [...] 0 0 0 471 816 0 0 0 0 0 0 480 751 0 0 0 0 0 0 481 36 0 0 0 0 0 0 469 550 0 0 0 0 0 0 485 814 0 0 0 0 0 0 467 503 0 0 0 0 0 0 473 345 0 0 0 Client nfsstat: $ nfsstat -c -w 10 GtAttr Lookup Rdlink Read Write Rename Access Rddir [...] 0 0 0 0 518 0 0 0 0 0 0 0 498 0 0 0 0 0 0 0 503 0 0 0 0 0 0 0 474 0 0 0 0 0 0 0 525 0 0 0 0 0 0 0 497 0 0 0 Server vmstat: $ vmstat -w 10 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr vt0 vt1 in sy cs us sy id [...] 0 4 0 634M 6043M 37 0 0 0 1 0 0 0 1561 46 3431 0 2 98 0 4 0 640M 6042M 62 0 0 0 28 0 0 0 1598 94 3552 0 2 98 0 4 0 648M 6042M 38 0 0 0 0 0 0 0 1609 47 3485 0 1 99 0 4 0 648M 6042M 37 0 0 0 0 0 0 0 1615 46 3667 0 2 98 0 4 0 648M 6042M 37 0 0 0 0 0 0 0 1606 45 3678 0 2 98 0 4 0 648M 6042M 37 0 0 0 0 0 1 0 1561 45 3377 0 2 98 Client vmstat: $ vmstat -w 10 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr md0 da0 in sy cs us sy id [...] 0 0 0 639M 593M 33 0 0 0 1237 0 0 0 281 5575 1043 0 3 97 0 0 0 639M 591M 0 0 0 0 712 0 0 0 235 122 889 0 2 98 0 0 0 639M 583M 0 0 0 0 571 0 0 1 227 120 851 0 2 98 0 0 0 639M 592M 198 0 0 0 1212 0 0 0 251 2497 950 0 3 97 0 0 0 639M 586M 0 0 0 0 614 0 0 0 250 121 924 0 2 98 0 0 0 639M 586M 0 0 0 0 765 0 0 0 250 120 918 0 3 97 Top on the KVM host says it is 93-95% idle and that each VM sits around 7-10% CPU. So basically nobody is doing anything. There's no visible bottleneck, and I've no idea where to go from here to figure out what's going on. Does anyone have any suggestions for debugging this? Thanks! From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 12:01:00 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5ADBC9AC for ; Sun, 19 Jan 2014 12:01:00 +0000 (UTC) Received: from sunner.semmy.ru (sunner.semmy.ru [IPv6:2a00:14d0:0:20::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 16AF5174C for ; Sun, 19 Jan 2014 12:01:00 +0000 (UTC) Received: from broadband-178-140-93-168.nationalcablenetworks.ru ([178.140.93.168] helo=[172.16.100.50]) by sunner.semmy.ru with esmtpsa (TLSv1:DHE-RSA-CAMELLIA256-SHA:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1W4r3g-0006E4-Mp for freebsd-virtualization@freebsd.org; Sun, 19 Jan 2014 16:00:56 +0400 Message-ID: <52DBBE89.6020609@FreeBSD.org> Date: Sun, 19 Jan 2014 16:01:13 +0400 From: Sergey Matveychuk User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: panic: AP #1 (PHY# 1) failed! Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 12:01:00 -0000 Hi. Now I can say it happens not every time but one time on two or three good boots. FreeBSD bhyve 10.0-PRERELEASE FreeBSD 10.0-PRERELEASE #0 r259951: Sat Dec 28 03:44:43 MSK 2013 root@myhost:/usr/obj/usr/src/sys/GENERIC amd64 VM_MEMSIZE="1024" VM_IFACE="tap0" VM_CPUNUM="2" ... /usr/sbin/bhyve -c ${VM_CPUNUM} -m ${VM_MEMSIZE} -AI -HP -g0 \ -s 0:0,hostbridge \ -s 1:0,virtio-net,${VM_IFACE} \ -s 2:0,virtio-blk,${VM_DISK} \ -S 31,uart,${VM_CONSOLE} \ ${VM_NAME} Need any more info? From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 16:34:33 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2C96A912; Sun, 19 Jan 2014 16:34:33 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id E1760195C; Sun, 19 Jan 2014 16:34:32 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id C2D5912217; Mon, 20 Jan 2014 02:34:30 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-174-51-225-141.hsd1.co.comcast.net [174.51.225.141]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRG13720 (AUTH peterg@ptree32.com.au); Mon, 20 Jan 2014 02:34:29 +1000 Message-ID: <52DBFE98.50507@freebsd.org> Date: Sun, 19 Jan 2014 09:34:32 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: Sergey Matveychuk Subject: Re: panic: AP #1 (PHY# 1) failed! References: <52DBBE89.6020609@FreeBSD.org> In-Reply-To: <52DBBE89.6020609@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 16:34:33 -0000 Hi Sergey, > Now I can say it happens not every time but one time on two or three > good boots. Are you destroying the VM after the bhyve process exits and before each load ? i.e. bhyvectl --destroy --vm= If not: that's required. If so, then could be a bug and yes we may need more info. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 21:41:41 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DD40CD9C for ; Sun, 19 Jan 2014 21:41:40 +0000 (UTC) Received: from mail.0x20.net (mail.0x20.net [217.69.76.211]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 924321FA4 for ; Sun, 19 Jan 2014 21:41:39 +0000 (UTC) Received: from e-new.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.0x20.net (Postfix) with ESMTPS id 0FDBA6A6008; Sun, 19 Jan 2014 22:41:37 +0100 (CET) Received: from e-new.0x20.net (localhost [127.0.0.1]) by e-new.0x20.net (8.14.7/8.14.7) with ESMTP id s0JLfait003016; Sun, 19 Jan 2014 22:41:36 +0100 (CET) (envelope-from lars@e-new.0x20.net) Received: (from lars@localhost) by e-new.0x20.net (8.14.7/8.14.7/Submit) id s0JLfaiQ002301; Sun, 19 Jan 2014 22:41:36 +0100 (CET) (envelope-from lars) Date: Sun, 19 Jan 2014 22:41:36 +0100 From: Lars Engels To: Aryeh Friedman Subject: Re: emulators/petitecloud 0.2.1 available Message-ID: <20140119214136.GR86491@e-new.0x20.net> References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Aq6vH1t1JS3Uc7g3" Content-Disposition: inline In-Reply-To: X-Editor: VIM - Vi IMproved 7.4 X-Operation-System: FreeBSD 8.4-RELEASE-p4 User-Agent: Mutt/1.5.22 (2013-10-16) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 21:41:41 -0000 --Aq6vH1t1JS3Uc7g3 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 17, 2014 at 09:36:27PM -0500, Aryeh Friedman wrote: > On Fri, Jan 17, 2014 at 7:25 PM, Aryeh Friedman wrote: >=20 > > > > > > > > On Fri, Jan 17, 2014 at 7:11 PM, Mark Martinec < > > Mark.Martinec+freebsd@ijs.si> wrote: > > > >> http://www.PetiteCloud.org > >>> --> http://www.petitecloud.org/downloads/port.tar.gz > >>> > >> > >> # make > >> =3D=3D=3D> src-petitecloud-aegis-0.2.1 depends on file: /usr/local/s= bin/pkg - > >> found > >> =3D> src-petitecloud-aegis-0.2.1.tar.gz doesn't seem to exist in > >> /usr/ports/distfiles/. > >> =3D> Attempting to fetch > >> ftp://ftp.petitecloud.org/petitecloud/0.2.1/aegis/src- > >> petitecloud-aegis-0.2.1.tar.gz > >> fetch: ftp://ftp.petitecloud.org/petitecloud/0.2.1/aegis/src- > >> petitecloud-aegis-0.2.1.tar.gz: > >> File unavailable (e.g., file not found, no access) > >> > >> There is no directory 'aegis' there, but there is an 'aryeh'. > >> Also there is no src-petitecloud-aegis-0.2.1.tar.gz in it. > >> URL should probably be: > >> ftp://ftp.petitecloud.org/petitecloud/0.2.1/aryeh/src- > >> petitecloud-aryeh-0.2.1.tar.gz > >> > >> > > Will look into this... for now just use aegis... you will need to modify > > the Makefile... since the Makefile itself is autogenerated we will post= new > > port files later tonight with the fix in them.... btw if you're interes= ted > > in helping with development you will also need devel/aegis in addition = to > > the port's dependencies > > > > > Fixed and posted new port files to petitecloud.org... side question shou= ld > I update the PR for the port or create a new one? Please update the existing one. --Aq6vH1t1JS3Uc7g3 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iEYEARECAAYFAlLcRpAACgkQKc512sD3afg7ywCeMqrF63PYIkKxBztkY4q88Nsj lP8AoJpnSDCwuZYtXNuzRERep/MgEnQ0 =dzLd -----END PGP SIGNATURE----- --Aq6vH1t1JS3Uc7g3-- From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 22:15:34 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AD38E3E3 for ; Sun, 19 Jan 2014 22:15:34 +0000 (UTC) Received: from mail-pb0-x229.google.com (mail-pb0-x229.google.com [IPv6:2607:f8b0:400e:c01::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7BEF911A6 for ; Sun, 19 Jan 2014 22:15:34 +0000 (UTC) Received: by mail-pb0-f41.google.com with SMTP id up15so5706006pbc.28 for ; Sun, 19 Jan 2014 14:15:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=y2XQ8j74LOzCf5/sm8fnOkNf97j7lO10U+SVz2AGsNg=; b=v0lHSHMJ7OvTNhoKsahx5bk83iyROZHY9x50/Wvw61KfF+EuXlm5AfCNmLem7GCUtq KXOL2lhS3pZ4x3rkjztkZJd/2YWHj55piPy2ELp+rHogaPUsCQHggAceWIU3V+PRww4z Zn02Bj9wbfiDNwKJI+SLxs8cWotoTBlqFh+Y6DhE5dlY3kU7d4DhkEx4BLbT+dGmyhRt UTYZl4QBAqianRaYhMuB3mhOltTT3awwx1Ei1ya2ft/w+kucdtdsi4TVk+zCJAcpeB0x 9S7WQoEMveESm2JiZC2DLUH/GNazWYYdiDZtVgquS2vjJFPyLqtNXZvKB+dapPmdXWvX VuLw== MIME-Version: 1.0 X-Received: by 10.68.98.3 with SMTP id ee3mr15150158pbb.31.1390169734026; Sun, 19 Jan 2014 14:15:34 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sun, 19 Jan 2014 14:15:33 -0800 (PST) In-Reply-To: <20140119214136.GR86491@e-new.0x20.net> References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Date: Sun, 19 Jan 2014 17:15:33 -0500 Message-ID: Subject: Re: emulators/petitecloud 0.2.1 available From: Aryeh Friedman To: Lars Engels Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 22:15:34 -0000 > > > > > Fixed and posted new port files to petitecloud.org... side question > should > > I update the PR for the port or create a new one? > > Please update the existing one. > Already done via GNATS -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 22:21:22 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A9C9C50D for ; Sun, 19 Jan 2014 22:21:22 +0000 (UTC) Received: from mail-oa0-x22c.google.com (mail-oa0-x22c.google.com [IPv6:2607:f8b0:4003:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 70C4511D6 for ; Sun, 19 Jan 2014 22:21:22 +0000 (UTC) Received: by mail-oa0-f44.google.com with SMTP id g12so6883097oah.31 for ; Sun, 19 Jan 2014 14:21:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=l1gPUVOxvMt1bKG/FYCgUoytHqX245WWdbhRxIC/mpw=; b=iKaLlkSc805khcqealsERZorhucmASKc/beEvhVIA5it5A6JtgCPSZnjEzsa+CfJT0 c8EgxN6BlbDQqz03uMaG5EmgPYYTr+iVxix8ajw2sg9FRfPMFxLAGMTedsfu7/HzQEv2 osUuXO1tSI7TEgajiFI6T+nGT9viLMIlyur2XSWbzm/LtRyCilMh8bmRd0BUeBOzX4/8 9KbnQg2ZQIgaz617PUSrhxGR1uuNmHpu62UndJWZRTT2zoc5p64Qx8xMHbunX8fW5+Gd cgNMsQ0iKgRo0g5TPZ6vo8eMrEjUymOGS/0Bir+Zk6oPTJOy2dMXDuqZrexbSfMJx1au E9rA== X-Received: by 10.60.63.144 with SMTP id g16mr12806889oes.33.1390170081660; Sun, 19 Jan 2014 14:21:21 -0800 (PST) Received: from [10.0.1.3] (ip72-209-165-165.ks.ks.cox.net. [72.209.165.165]) by mx.google.com with ESMTPSA id r6sm23269188obi.14.2014.01.19.14.21.20 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 19 Jan 2014 14:21:20 -0800 (PST) From: Joe Maloney Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Subject: kldload vmm partial lockup Message-Id: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> Date: Sun, 19 Jan 2014 16:21:14 -0600 To: freebsd-virtualization@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) X-Mailer: Apple Mail (2.1827) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 22:21:22 -0000 I=92ve been trying to get bhyve to work on a system with the following = specs: FreeBSD 10.0 64 bit ASUS P6T Deluxe Intel i7 920 According to what I=92ve researched my cpu should have the VT-D = extensions. However many users of this motherboard have complained = about ASUS not properly supporting VT-D with Xen and something about a = problem with tables getting corrupt due to a problem with the bios. On = the third link below which is the Xen wiki it even states that this = motherboard needs a bios update which is not available to the public. https://communities.intel.com/thread/28389 = http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den-= us&board_id=3D1 http://wiki.xen.org/wiki/VTd_HowTo I am curious though if this would be what would be causing my problem = with bhyve? I suppose I am willing to just by a new motherboard if so. =20= I can run kldload vmm and I see a bunch of text fly by and then = something about uhci interrupt problem. As soon as that happens the = messages repeats my network drops and no keyboard input. However the = message repeats and it doesn=92t appear that the system has fully locked = up otherwise. However on another system that works I notice that = kldload VMM does not show this information it just loads the module. Is there a way I can gather more logs somehow so that I can determine = what text is appearing before the uhci errors? Perhaps some kind of = dump procedure? Or is there a way I can confirm that freebsd can = properly see and utilize the VT-D extensions. VirtualBox runs fine with = the VT extensions enabled. I also made sure VirtualBox wasn=92t = installed or loaded before I tried bhyve. I=92ve tried to research for = a week or two before posting here. Joe Maloney From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 22:34:04 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A44447FB for ; Sun, 19 Jan 2014 22:34:04 +0000 (UTC) Received: from mail-vb0-x22e.google.com (mail-vb0-x22e.google.com [IPv6:2607:f8b0:400c:c02::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5FD601289 for ; Sun, 19 Jan 2014 22:34:04 +0000 (UTC) Received: by mail-vb0-f46.google.com with SMTP id o19so2384563vbm.5 for ; Sun, 19 Jan 2014 14:34:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=tzoTEAQAP/9pLDzQeFUaps8xINm9IAN1iTENP9LMf1Y=; b=QqAn1hnRshZ88FFayOhCCiZI9GATeLmltCxI1vTbRXRlMznwA/LwrAJNqko2TywcIc w3yEizi8pd7YaojpwvCCN3yDCQvOXuhlgFg9xnDit4aSGruTgTE2/mn8/lm6SDyIIWvu REmYzGFjli1L52ONjdUpzUF3Ux/HCwxarHCWiFIqZHye553IfiNpVtWnjD2JAI2uRt0J fdR+0dGuoqB3oYTaC0sNcxQSSco/NGZKPzYVduONAsPH0T0wuwDYWaRCTlDXAkfWJH2a F6pHj9AXWeyTWSChSDOiyLXQBd7hcXHr2ntItjuDiRgJNCf/eqbegX2duCfUw1bTOErR PvaA== MIME-Version: 1.0 X-Received: by 10.220.147.16 with SMTP id j16mr6817vcv.28.1390170843388; Sun, 19 Jan 2014 14:34:03 -0800 (PST) Received: by 10.220.168.135 with HTTP; Sun, 19 Jan 2014 14:34:03 -0800 (PST) In-Reply-To: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> Date: Sun, 19 Jan 2014 17:34:03 -0500 Message-ID: Subject: Re: kldload vmm partial lockup From: Thomas Hoffmann To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 22:34:04 -0000 On Sun, Jan 19, 2014 at 5:21 PM, Joe Maloney wrote: > I=92ve been trying to get bhyve to work on a system with the following sp= ecs: > > FreeBSD 10.0 64 bit > ASUS P6T Deluxe > Intel i7 920 > > According to what I=92ve researched my cpu should have the VT-D extension= s. > However many users of this motherboard have complained about ASUS not > properly supporting VT-D with Xen and something about a problem with tabl= es > getting corrupt due to a problem with the bios. On the third link below > which is the Xen wiki it even states that this motherboard needs a bios > update which is not available to the public. > > https://communities.intel.com/thread/28389 > > > http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den= -us&board_id=3D1 > > http://wiki.xen.org/wiki/VTd_HowTo > > I am curious though if this would be what would be causing my problem wit= h > bhyve? I suppose I am willing to just by a new motherboard if so. > > I can run kldload vmm and I see a bunch of text fly by and then something > about uhci interrupt problem. As soon as that happens the messages repea= ts > my network drops and no keyboard input. However the message repeats and = it > doesn=92t appear that the system has fully locked up otherwise. However = on > another system that works I notice that kldload VMM does not show this > information it just loads the module. > > Is there a way I can gather more logs somehow so that I can determine wha= t > text is appearing before the uhci errors? Perhaps some kind of dump > procedure? Or is there a way I can confirm that freebsd can properly see > and utilize the VT-D extensions. VirtualBox runs fine with the VT > extensions enabled. I also made sure VirtualBox wasn=92t installed or lo= aded > before I tried bhyve. I=92ve tried to research for a week or two before > posting here. > > Joe Maloney > According to this, your processor supports VT-x, but not VT-d ; http://ark.intel.com/products/37147/Intel-Core-i7-920-Processor-8M-Cache-2_= 66-ghz-4_80-gts-Intel-qpi -Tom From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 22:55:08 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3BA73A50 for ; Sun, 19 Jan 2014 22:55:08 +0000 (UTC) Received: from mail-ve0-x22f.google.com (mail-ve0-x22f.google.com [IPv6:2607:f8b0:400c:c01::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EA4AD13BD for ; Sun, 19 Jan 2014 22:55:07 +0000 (UTC) Received: by mail-ve0-f175.google.com with SMTP id c14so177855vea.6 for ; Sun, 19 Jan 2014 14:55:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CGpu38qDZ2ePqLw+gCEbYIV5tNpoLiy/irSD7SbP2MI=; b=JHjzIjlrcVqi8RHgZ0YxWEiQrsHTAiiLrRW8E/YCXIzJcn2JRQW8Be6Vs9TcM58mW2 v5P2nLGfxuk14k+D66undL1r802MH10lQ25ktUcfXuDX/AQmW4CWrnIRwl7jj36f2CNX C5eOtlkO3MIZLXrr/sj/KtPkZ5KGLf150ET9izZca3cmw1QtmBjg05hXG3gM0jKCvl5p UDscNGzZALvSaaBxnFVJDT6YUNqHGcdfP9EFUL1vfzjGh8uSCaeV6DLEgTz+BwoGWWGi qTluwnpltFxwt9eJe+t+xM/apQn1ZYb9HK28EswGrxT1NaY9MVMVwme3hmUavIDLw6iD /RUg== MIME-Version: 1.0 X-Received: by 10.58.227.38 with SMTP id rx6mr8676289vec.10.1390172107050; Sun, 19 Jan 2014 14:55:07 -0800 (PST) Received: by 10.220.168.135 with HTTP; Sun, 19 Jan 2014 14:55:07 -0800 (PST) In-Reply-To: References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> Date: Sun, 19 Jan 2014 17:55:07 -0500 Message-ID: Subject: Re: kldload vmm partial lockup From: Thomas Hoffmann To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 22:55:08 -0000 On Sun, Jan 19, 2014 at 5:34 PM, Thomas Hoffmann wrote: > On Sun, Jan 19, 2014 at 5:21 PM, Joe Maloney wrote: > >> I=92ve been trying to get bhyve to work on a system with the following >> specs: >> >> FreeBSD 10.0 64 bit >> ASUS P6T Deluxe >> Intel i7 920 >> >> According to what I=92ve researched my cpu should have the VT-D extensio= ns. >> However many users of this motherboard have complained about ASUS not >> properly supporting VT-D with Xen and something about a problem with tab= les >> getting corrupt due to a problem with the bios. On the third link below >> which is the Xen wiki it even states that this motherboard needs a bios >> update which is not available to the public. >> >> https://communities.intel.com/thread/28389 >> >> >> http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3De= n-us&board_id=3D1 >> >> http://wiki.xen.org/wiki/VTd_HowTo >> >> I am curious though if this would be what would be causing my problem >> with bhyve? I suppose I am willing to just by a new motherboard if so. >> >> I can run kldload vmm and I see a bunch of text fly by and then somethin= g >> about uhci interrupt problem. As soon as that happens the messages repe= ats >> my network drops and no keyboard input. However the message repeats and= it >> doesn=92t appear that the system has fully locked up otherwise. However= on >> another system that works I notice that kldload VMM does not show this >> information it just loads the module. >> >> Is there a way I can gather more logs somehow so that I can determine >> what text is appearing before the uhci errors? Perhaps some kind of dum= p >> procedure? Or is there a way I can confirm that freebsd can properly se= e >> and utilize the VT-D extensions. VirtualBox runs fine with the VT >> extensions enabled. I also made sure VirtualBox wasn=92t installed or l= oaded >> before I tried bhyve. I=92ve tried to research for a week or two before >> posting here. >> >> Joe Maloney >> > > According to this, your processor supports VT-x, but not VT-d ; > http://ark.intel.com/products/37147/Intel-Core-i7-920-Processor-8M-Cache-= 2_66-ghz-4_80-gts-Intel-qpi > > -Tom > But this i7-920 processor does: http://ark.intel.com/products/43126/Intel-Core-i7-920XM-Processor-Extreme-E= dition-8M-Cache-2_00-GHz Not sure which you have. -Tom From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 23:28:23 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 37D93FFE for ; Sun, 19 Jan 2014 23:28:23 +0000 (UTC) Received: from mail-pb0-x230.google.com (mail-pb0-x230.google.com [IPv6:2607:f8b0:400e:c01::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 096AB1664 for ; Sun, 19 Jan 2014 23:28:23 +0000 (UTC) Received: by mail-pb0-f48.google.com with SMTP id rr13so6243786pbb.35 for ; Sun, 19 Jan 2014 15:28:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=zCOORPS53ats/zTjVdmTmy7qP3LFzNB9SKQ9kqxSggg=; b=LsmZCyjvJgp37REQPXUDgyrFCrvpMaknnbShEOQlh29HPLkWx5Ku5UDK0e6nwOM2X8 Ul2InFgsVMA8pxIZ5DSIrzTHgA4AeehrZRJ+zhR6ZFuQP063pICRtqwRoNoaa4J8XrML DWodMDa1wJ1UYMl+HL9csfWeIt0f/SJbbcHws8hvGEBa46N6sDyDUZfKxXe5rbQw56Dh tlG+24iM1+En7VJA4qFId9FUKn8R1wTR7RBsZJKYfYFkkzfc22u7ZyEmxfIPfqbur1Rb a0DEktRMrfTsRI18BjimUbrUQcsBkPVwIJTHzHnfR0ZMaacEzJbdLJR2FT2oSUtJhkMy Y4yg== MIME-Version: 1.0 X-Received: by 10.66.163.74 with SMTP id yg10mr15159147pab.57.1390174102718; Sun, 19 Jan 2014 15:28:22 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sun, 19 Jan 2014 15:28:22 -0800 (PST) In-Reply-To: References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> Date: Sun, 19 Jan 2014 18:28:22 -0500 Message-ID: Subject: Fwd: kldload vmm partial lockup From: Aryeh Friedman To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 23:28:23 -0000 ---------- Forwarded message ---------- From: Aryeh Friedman Date: Sun, Jan 19, 2014 at 6:26 PM Subject: Re: kldload vmm partial lockup To: Thomas Hoffmann You should see the proposed handbook entry on virtualization ( http://www.petitecloud.org/handbook.jsp) for more info... note to the list Dee will be doing some additional proofing of this soon and we will submit again On Sun, Jan 19, 2014 at 5:55 PM, Thomas Hoffmann wrote: > On Sun, Jan 19, 2014 at 5:34 PM, Thomas Hoffmann wrote= : > > > On Sun, Jan 19, 2014 at 5:21 PM, Joe Maloney wrote: > > > >> I=92ve been trying to get bhyve to work on a system with the following > >> specs: > >> > >> FreeBSD 10.0 64 bit > >> ASUS P6T Deluxe > >> Intel i7 920 > >> > >> According to what I=92ve researched my cpu should have the VT-D > extensions. > >> However many users of this motherboard have complained about ASUS not > >> properly supporting VT-D with Xen and something about a problem with > tables > >> getting corrupt due to a problem with the bios. On the third link bel= ow > >> which is the Xen wiki it even states that this motherboard needs a bio= s > >> update which is not available to the public. > >> > >> https://communities.intel.com/thread/28389 > >> > >> > >> > http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den= -us&board_id=3D1 > >> > >> http://wiki.xen.org/wiki/VTd_HowTo > >> > >> I am curious though if this would be what would be causing my problem > >> with bhyve? I suppose I am willing to just by a new motherboard if so= . > >> > >> I can run kldload vmm and I see a bunch of text fly by and then > something > >> about uhci interrupt problem. As soon as that happens the messages > repeats > >> my network drops and no keyboard input. However the message repeats > and it > >> doesn=92t appear that the system has fully locked up otherwise. Howev= er > on > >> another system that works I notice that kldload VMM does not show this > >> information it just loads the module. > >> > >> Is there a way I can gather more logs somehow so that I can determine > >> what text is appearing before the uhci errors? Perhaps some kind of > dump > >> procedure? Or is there a way I can confirm that freebsd can properly > see > >> and utilize the VT-D extensions. VirtualBox runs fine with the VT > >> extensions enabled. I also made sure VirtualBox wasn=92t installed or > loaded > >> before I tried bhyve. I=92ve tried to research for a week or two befo= re > >> posting here. > >> > >> Joe Maloney > >> > > > > According to this, your processor supports VT-x, but not VT-d ; > > > http://ark.intel.com/products/37147/Intel-Core-i7-920-Processor-8M-Cache-= 2_66-ghz-4_80-gts-Intel-qpi > > > > -Tom > > > > But this i7-920 processor does: > > http://ark.intel.com/products/43126/Intel-Core-i7-920XM-Processor-Extreme= -Edition-8M-Cache-2_00-GHz > > Not sure which you have. > > -Tom > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Sun Jan 19 23:30:33 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 48260128 for ; Sun, 19 Jan 2014 23:30:33 +0000 (UTC) Received: from mail-pd0-x22f.google.com (mail-pd0-x22f.google.com [IPv6:2607:f8b0:400e:c02::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 159A61693 for ; Sun, 19 Jan 2014 23:30:33 +0000 (UTC) Received: by mail-pd0-f175.google.com with SMTP id w10so856636pde.34 for ; Sun, 19 Jan 2014 15:30:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=VLCghs49WMZkeK6Kce52OyF+fHAV9qQQOjt/3OGOKyk=; b=RFU+eqCLCL7hOq/n+VpelzRh/xZ421vi7iugs88sCUfICGwWR4oyXsjYwCFkBZvtqK smWLLTJ91zRpsk9Ev81ztmYbYTkA75xyqDDl4TvinRmhyAsnYshX9poAq5cp9z3Q1qF/ zRTwLjlJnbA9FieCjgsLkXDdAK+VM8ejklWR7l7PIPPcCgr1VrU+HPjTRyV8WFTn4I1j Rnc2IFZvE6uXS+psf7Jod+2bI897x+kVjRjmVbmraunvGffDp25ELowIqCbnwz+zlNwm erNeoKoeHSfUZuMvdd1F+I9NQAlkYlr0lIQSasz25+xiknSTmVTy/B05KP1COptwrPIT m5yw== MIME-Version: 1.0 X-Received: by 10.66.139.169 with SMTP id qz9mr15586680pab.16.1390174232736; Sun, 19 Jan 2014 15:30:32 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sun, 19 Jan 2014 15:30:32 -0800 (PST) In-Reply-To: References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Date: Sun, 19 Jan 2014 18:30:32 -0500 Message-ID: Subject: Re: emulators/petitecloud 0.2.1 available From: Aryeh Friedman To: Lars Engels Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2014 23:30:33 -0000 On Sun, Jan 19, 2014 at 5:15 PM, Aryeh Friedman wrote: > > > > >> > Fixed and posted new port files to petitecloud.org... side question >> should >> > I update the PR for the port or create a new one? >> >> Please update the existing one. >> > > Already done via GNATS > > If any committers are willing to take it that is ;-) > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 01:08:22 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ABD56A9A; Mon, 20 Jan 2014 01:08:22 +0000 (UTC) Received: from sunner.semmy.ru (sunner.semmy.ru [IPv6:2a00:14d0:0:20::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 658AA1DF0; Mon, 20 Jan 2014 01:08:22 +0000 (UTC) Received: from broadband-178-140-93-168.nationalcablenetworks.ru ([178.140.93.168] helo=[172.16.100.50]) by sunner.semmy.ru with esmtpsa (TLSv1:DHE-RSA-CAMELLIA256-SHA:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1W53Lg-000CF8-92; Mon, 20 Jan 2014 05:08:20 +0400 Message-ID: <52DC7718.8000409@FreeBSD.org> Date: Mon, 20 Jan 2014 05:08:40 +0400 From: Sergey Matveychuk User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Peter Grehan Subject: Re: panic: AP #1 (PHY# 1) failed! References: <52DBBE89.6020609@FreeBSD.org> <52DBFE98.50507@freebsd.org> In-Reply-To: <52DBFE98.50507@freebsd.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 01:08:22 -0000 19.01.2014 20:34, Peter Grehan пишет: > Hi Sergey, > >> Now I can say it happens not every time but one time on two or three >> good boots. > > Are you destroying the VM after the bhyve process exits and before > each load ? i.e. > > bhyvectl --destroy --vm= > > If not: that's required. If so, then could be a bug and yes we may > need more info. Thank you. I added this command in my startup script. Will watch a result. From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 02:43:33 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B9139AC4 for ; Mon, 20 Jan 2014 02:43:33 +0000 (UTC) Received: from mail-qa0-x232.google.com (mail-qa0-x232.google.com [IPv6:2607:f8b0:400d:c00::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 780161398 for ; Mon, 20 Jan 2014 02:43:33 +0000 (UTC) Received: by mail-qa0-f50.google.com with SMTP id cm18so5092872qab.23 for ; Sun, 19 Jan 2014 18:43:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=kJT+WpMTo29yxeZomoC0jGo6M7k2+xPitYdMUNSM4NA=; b=zMgC0bGfuNU72HFETXuKQYFYOYtDbAKuqYBdgSSYA5bT+LCUUAvvPQeGcwRMCHXkx2 busY1TXkZdxQvJZiYDJhPRfQr9t6/RSTLR75b/R/DbcftfmiKW9jBnlETS4iNhCtJa/T 2bOLXFmMkXmrngQKNMZJyJ+ToFmQq+mi2RRrUEMtUYuaTn5rbqzo0t8ryZfZahzh7GVy uRDME5ciXwbD0U7huaMwFNTweWL3s2oLQ/dMETxNlerqZStT+IQDjqSKaIcAYWCl52nX 4Z4gpnyZoLyOyi8C22jT2xKUxsEntRTl7a4JbYVANQVJp3YxvkEjOocQyuVu+/u2fC08 a84Q== MIME-Version: 1.0 X-Received: by 10.224.167.19 with SMTP id o19mr22524272qay.77.1390185812111; Sun, 19 Jan 2014 18:43:32 -0800 (PST) Received: by 10.140.34.17 with HTTP; Sun, 19 Jan 2014 18:43:32 -0800 (PST) In-Reply-To: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> Date: Sun, 19 Jan 2014 18:43:32 -0800 Message-ID: Subject: Re: kldload vmm partial lockup From: Neel Natu To: Joe Maloney Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 02:43:33 -0000 Hi Joe, On Sun, Jan 19, 2014 at 2:21 PM, Joe Maloney wrote: > I=92ve been trying to get bhyve to work on a system with the following sp= ecs: > > FreeBSD 10.0 64 bit > ASUS P6T Deluxe > Intel i7 920 > > According to what I=92ve researched my cpu should have the VT-D extension= s. However many users of this motherboard have complained about ASUS not p= roperly supporting VT-D with Xen and something about a problem with tables = getting corrupt due to a problem with the bios. On the third link below wh= ich is the Xen wiki it even states that this motherboard needs a bios updat= e which is not available to the public. > > https://communities.intel.com/thread/28389 > > http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den= -us&board_id=3D1 > > http://wiki.xen.org/wiki/VTd_HowTo > > I am curious though if this would be what would be causing my problem wit= h bhyve? I suppose I am willing to just by a new motherboard if so. > > I can run kldload vmm and I see a bunch of text fly by and then something= about uhci interrupt problem. As soon as that happens the messages repeat= s my network drops and no keyboard input. However the message repeats and = it doesn=92t appear that the system has fully locked up otherwise. However= on another system that works I notice that kldload VMM does not show this = information it just loads the module. > > Is there a way I can gather more logs somehow so that I can determine wha= t text is appearing before the uhci errors? Perhaps some kind of dump proc= edure? Or is there a way I can confirm that freebsd can properly see and u= tilize the VT-D extensions. VirtualBox runs fine with the VT extensions en= abled. I also made sure VirtualBox wasn=92t installed or loaded before I t= ried bhyve. I=92ve tried to research for a week or two before posting here= . > I have a patch to not initialize the iommu unless there are passthru devices explicitly configured for bhyve to use. It is available here: http://people.freebsd.org/~neel/patches/bhyve_iommu_init.patch Could you give it a spin and see if it helps with the ASUS system? best Neel > Joe Maloney > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 11:06:55 2014 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A8E44B2D for ; Mon, 20 Jan 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 93D701D88 for ; Mon, 20 Jan 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id s0KB6tWT088529 for ; Mon, 20 Jan 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id s0KB6toe088527 for freebsd-virtualization@FreeBSD.org; Mon, 20 Jan 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 20 Jan 2014 11:06:55 GMT Message-Id: <201401201106.s0KB6toe088527@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 11:06:55 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail 7 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 18:06:24 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 17056A26 for ; Mon, 20 Jan 2014 18:06:24 +0000 (UTC) Received: from mail-pa0-x244.google.com (mail-pa0-x244.google.com [IPv6:2607:f8b0:400e:c03::244]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E3F661A04 for ; Mon, 20 Jan 2014 18:06:23 +0000 (UTC) Received: by mail-pa0-f68.google.com with SMTP id kp14so5345633pab.7 for ; Mon, 20 Jan 2014 10:06:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=message-id:from:to:reply-to:subject:date; bh=Iyk2K6fvYNLbDPkOF2p5SQgAED667GVP56ua58RI4bE=; b=RatKLBR5D1JrsanzCxOt7u3T4mamy87dCO0P1/TzlXNUsDV1krnO7ok3ICRxBkvIJR Zc6qaKffx3RIedy2Z3TYiWqUm42bRcsttg2eYv/5gqMuuuUN5it0FIrPIEGz3/Vu+igG Wm81rBvAg9o/N9NbZ3JbR6syJcvyy/e8WKlkvKNtNJXLrfCxUeGA38PmAvra7gQCk8zs pSDuVKAGidNkSboXwgKdPRq8u4/6hbrjftSAKQV0XkR/4vAYpa4tsE9tVjWrILBnf4yL iBQOspBb+gHwOXWsRsKxn9UE6ckzxVRmTZSjfhJwrcizJ77Vn57nMs0r4BHt8GCWvexH riwg== X-Received: by 10.66.165.4 with SMTP id yu4mr20249150pab.88.1390241183540; Mon, 20 Jan 2014 10:06:23 -0800 (PST) Received: from localhost.localdomain ([124.253.33.120]) by mx.google.com with ESMTPSA id qf7sm7619738pac.14.2014.01.20.10.06.21 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Mon, 20 Jan 2014 10:06:22 -0800 (PST) Message-ID: <52dd659e.a7dd420a.7a18.ffffd84c@mx.google.com> From: brandie31089@googlemail.com To: freebsd-virtualization@freebsd.org Subject: RE: LOCAL MAP OPTIMIZATION FOR : mail-archive.com (Less Than $99/Month) Date: Mon, 20 Jan 2014 23:36:24 +0530 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: LORI76557@gmail.com List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 18:06:24 -0000 Good Morning Sir / Mam Is your business ranking in local maps shown on PAGE 1 of google ? With new google policies they have specifically asked local business owners to optimize their website for local maps rather than JUST organics. Do you know the reason why you are not ranked well on google MAPs or why there is drop in your website rankings? Prime reason for bad rankings for a busniess is lack of local presence and local citations ie getting your business listed on directories like YELP, MANTA & Many more. These websites not just give your business a push but also help you Maintain a good Online Reputation. Why you need to optimize your website for local MAP Listings ? - MAP listings get 10 times more clicks than organic listings - Increased conversions because of real reviews posted on your Google Plus Page - Every year there is 30% increase in searches for local keywords - Increases legitimacy of a Business We will help you get your website ranked well on google for the related keywords in your niche. We specialize in LOCAL SEARCH ENGINE OPTIMIZATION increasing visibility for small businesses by ranking them for geographically-related keywords. Say for eg-: you want to search a plumber in your city, You will be typing in keywords like Plumbers + City Or Plumbers + IN + City. We make sure your website comes in google MAP listings shown on page 1 for each such keyword. Now Google believes in - BE ORIGINAL, HAVE ORIGINAL AND GIVE ORIGINAL which means that google wants to end up that frustrating experience of users who are searching for Service Or Product and seeing the results that are not even close to what they are looking for. Google only wants to give their user original and relevant results. This makes it even more important that we showcase our business in the best possible way and make sure our website in valued high by google. We at TheLOCALIST will make google feel the importance of your business by following their guidelines thus ranking your website higher in serach results. We are presently offering LOCAL OPTIMIZATION to more than 400 websites and they all rank page 1 for all possible keywords !!! Each month your website is submitted to more than 50 citations and social presence is controlled by posting videos and blogs all over the web. Email us back with your website & phone number so we can discuss this further with you. Our Packages start from as low as 99$/month. Thanks For Taking Time To Read Our Email Polly Martin Local SEO Manager ( THE Localist ) Address : 24 ST Suite 32 Downtown Provo Utah ------------------- NOT INTERESTED ? REPLY WITH NOT INTERESTED IN THE SUBJECT LINE From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 19:43:00 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7CE6D4D3 for ; Mon, 20 Jan 2014 19:43:00 +0000 (UTC) Received: from sunner.semmy.ru (sunner.semmy.ru [IPv6:2a00:14d0:0:20::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 38C0B1395 for ; Mon, 20 Jan 2014 19:43:00 +0000 (UTC) Received: from broadband-178-140-93-168.nationalcablenetworks.ru ([178.140.93.168] helo=[172.16.100.50]) by sunner.semmy.ru with esmtpsa (TLSv1:DHE-RSA-CAMELLIA256-SHA:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1W5KkL-000KTQ-BF for freebsd-virtualization@freebsd.org; Mon, 20 Jan 2014 23:42:57 +0400 Message-ID: <52DD7C56.4090804@semmy.ru> Date: Mon, 20 Jan 2014 23:43:18 +0400 From: Sergey Matveychuk User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: bhyve: can't to passthru bge(4) card Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 19:43:00 -0000 Hi. I try to passthru bge: % pciconf -vl ... ppt0@pci0:3:0:1: class=0x020000 card=0x169d103c chip=0x165714e4 rev=0x01 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme BCM5719 Gigabit Ethernet PCIe' class = network subclass = ethernet ... % cat /boot/loader.conf vmm_load="yes" pptdevs="3/0/1" % bhyve -c ${VM_CPUNUM} -m ${VM_MEMSIZE} -AI -HP -g0 \ -s 0:0,hostbridge \ -s 3:0,passthru,3/0/1 \ -s 2:0,virtio-blk,${VM_DISK} \ -S 31,uart,${VM_CONSOLE} \ ${VM_NAME} And I got this on boot: bge0: mem 0xc0010000-0xc001ffff,0xc0020000-0xc002ffff,0xc0030000-0xc003ffff irq 36 at device 3.0 on pci0 bge0: APE FW version: NCSI v1.0.60.0 bge0: CHIP ID 0x05719001; ASIC REV 0x5719; CHIP REV 0x57190; PCI-E bge0: Try again bge0: Try again bge0: Try again bge0: Try again bge0: attaching PHYs failed device_attach: bge0 attach returned 6 I used this as an instruction: https://wiki.freebsd.org/bhyve/pci_passthru From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 20:01:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2CF26D2E for ; Mon, 20 Jan 2014 20:01:57 +0000 (UTC) Received: from mail-pd0-x22d.google.com (mail-pd0-x22d.google.com [IPv6:2607:f8b0:400e:c02::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 01F4B159B for ; Mon, 20 Jan 2014 20:01:56 +0000 (UTC) Received: by mail-pd0-f173.google.com with SMTP id y10so3680328pdj.18 for ; Mon, 20 Jan 2014 12:01:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=9ShLriB+xielHAb0xKud66z1anqKPqvC9UH5mpdfA7s=; b=WWXQ1DVj36VEHBTNWi9KwcEB0TyhQVuVF69VWjlqaGB7K6gP+awvCnWe9oc/KEjwtl pSE8cxOE5/IJ+rXmPZAJBmD0vAz3XMVW4+e7n4GYbgDiIvP3JfKFWzQFUOw3gq0Q3pgv gCFRBGQGlyPoyXOGzS9Jqnu2fab78xCqzJreP6ob5RfteJMjcN/FW5fnkcCmXnT0IkcS u17D0tFp9xPdoAsgddeESNOfXkXaneTCh8134kCJ1iarJXoGgt4VuWHTNtXBraJuKSwt 9blstXhm4AIOamNhR3Uj1fYYB7v9JnHRBIaOhXUjl1kvjKtJQvRx8Vf6UQI3TCXzyj4L 9U7g== MIME-Version: 1.0 X-Received: by 10.66.241.73 with SMTP id wg9mr20698389pac.69.1390248116435; Mon, 20 Jan 2014 12:01:56 -0800 (PST) Received: by 10.68.155.38 with HTTP; Mon, 20 Jan 2014 12:01:56 -0800 (PST) In-Reply-To: References: <52DD7C56.4090804@semmy.ru> Date: Mon, 20 Jan 2014 15:01:56 -0500 Message-ID: Subject: Fwd: bhyve: can't to passthru bge(4) card From: Aryeh Friedman To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 20:01:57 -0000 ---------- Forwarded message ---------- From: Aryeh Friedman Date: Mon, Jan 20, 2014 at 3:01 PM Subject: Re: bhyve: can't to passthru bge(4) card To: Sergey Matveychuk A question if you make the NIC the bridge device in PetiteCloud (we will have physical NIC support in the next few tertiary versions but for now your stuck with something like the manual version above) does it work any better.... I suspect you have the networking set up wrong before calling bhyve On Mon, Jan 20, 2014 at 2:43 PM, Sergey Matveychuk wrote: > Hi. > > I try to passthru bge: > % pciconf -vl > ... > ppt0@pci0:3:0:1: class=0x020000 card=0x169d103c chip=0x165714e4 > rev=0x01 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'NetXtreme BCM5719 Gigabit Ethernet PCIe' > class = network > subclass = ethernet > ... > % cat /boot/loader.conf > vmm_load="yes" > pptdevs="3/0/1" > > % bhyve -c ${VM_CPUNUM} -m ${VM_MEMSIZE} -AI -HP -g0 \ > -s 0:0,hostbridge \ > -s 3:0,passthru,3/0/1 \ > -s 2:0,virtio-blk,${VM_DISK} \ > -S 31,uart,${VM_CONSOLE} \ > ${VM_NAME} > > And I got this on boot: > > bge0: mem > 0xc0010000-0xc001ffff,0xc0020000-0xc002ffff,0xc0030000-0xc003ffff irq 36 > at device 3.0 on pci0 > bge0: APE FW version: NCSI v1.0.60.0 > bge0: CHIP ID 0x05719001; ASIC REV 0x5719; CHIP REV 0x57190; PCI-E > bge0: Try again > bge0: Try again > bge0: Try again > bge0: Try again > bge0: attaching PHYs failed > device_attach: bge0 attach returned 6 > > I used this as an instruction: https://wiki.freebsd.org/bhyve/pci_passthru > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" > -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 20:50:25 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8FC75CD4 for ; Mon, 20 Jan 2014 20:50:25 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 497D81954 for ; Mon, 20 Jan 2014 20:50:25 +0000 (UTC) Received: from pippin.baldwin.cx (pool-173-70-85-31.nwrknj.fios.verizon.net [173.70.85.31]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 4EA4CB945; Mon, 20 Jan 2014 15:50:23 -0500 (EST) From: John Baldwin To: freebsd-virtualization@freebsd.org Subject: Re: KVM Clock Date: Mon, 20 Jan 2014 15:22:23 -0500 Message-ID: <3298215.G6vx8QjdMB@pippin.baldwin.cx> User-Agent: KMail/4.10.5 (FreeBSD/11.0-CURRENT; KDE/4.10.5; amd64; ; ) In-Reply-To: <1389805150.16498.18.camel@janus.xn--pl-wia.net> References: <52D6B18D.4080204@citrix.com> <1389805150.16498.18.camel@janus.xn--pl-wia.net> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="iso-8859-1" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 20 Jan 2014 15:50:23 -0500 (EST) Cc: Julian Stecklina X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 20:50:25 -0000 On Wednesday 15 January 2014 17:59:10 Julian Stecklina wrote: > On Mi, 2014-01-15 at 17:04 +0100, Roger Pau Monn=E9 wrote: > > On 15/01/14 14:45, Julian Stecklina wrote: > > > On Mi, 2014-01-15 at 14:08 +0100, Roger Pau Monn=E9 wrote: > > >> On 15/01/14 13:05, Julian Stecklina wrote: > > >>> On 01/14/2014 05:13 PM, Peter Grehan wrote: > > >>>> Hi Julian, > > >>>>=20 > > >>>>> is anyone working on KVM clock support for FreeBSD? If not, I= > > >>>>> might take a shot at it. > > >>>>=20 > > >>>> None I know of: go for it :) > > >>>=20 > > >>> Works for me so far: > > >>> https://github.com/blitz/freebsd/commit/cdc5f872b3e48cc0dda031f= c7d6bde > > >>> dc65c3148f> >>=20 > > >> Looking > > >>=20 > > >> at the code it seems some common routines could be shared > > >> between the KVM PV clock and the Xen PV clock > > >> (sys/dev/xen/timer/timer.c). The data passed from the hypervisor= to > > >> the guest has exactly the same format (see struct vcpu_time_info= in > > >> Xen public headers). > > >=20 > > > Yes, I know. Didn't get around to making it pretty yesterday even= ing. ;) > > > I'll post an updated patch, when I have some time. Any suggestion= s where > > > to put the two common functions? > > >=20 > > >> At a first sight the KVM clock can benefit from using scale_delt= a > > >> (which is going to be faster than the C version implemented in > > >> kvmclock_get_timecount), > > >=20 > > > At least somewhat on amd64. 32-bit looks pretty identical. > > >=20 > > >> and xen_fetch_vcpu_tinfo is exactly the same > > >>=20 > > >> as kvmclock_fetch. > > >=20 > > > I think xen_fetch_vcpu_tinfo has a subtle bug: > > > 217 do { > > > 218 dst->version =3D src->version; > > > 219 rmb(); > > > 220 dst->tsc_timestamp =3D src->tsc_timestamp; > > > 221 dst->system_time =3D src->system_time; > > > 222 dst->tsc_to_system_mul =3D src->tsc_to_syst= em_mul; > > > 223 dst->tsc_shift =3D src->tsc_shift; > > > 224 rmb(); > > > 225 } while ((src->version & 1) | (dst->version ^ > > >=20 > > > src->version)); > > >=20 > > > In line 225 src->version is potentially read twice. If you consid= er the > > > following schedule: > > >=20 > > > host starts updating data, sets src->version to 1 > > > guest reads src->version (1) and stores it into dst->version. > > > guest copies inconsistent data > > > guest reads src->version (1) and computes xor with dst->version. > > > host finishes updating data and sets src->version to 2 > > > guest reads src->version (2) and checks whether lower bit is not = set. > > > while loop exits with inconsistent data! > > >=20 > > > I think the C standard (at least C11) permits this as it does not= > > > specify in which order the two reads in line 225 need to happen. > >=20 > > According to the operator precedence and associativity in C > > (http://en.wikipedia.org/wiki/Operators_in_C_and_C%2B%2B#Operator_p= receden > > ce), if I'm reading it right, the condition in the while line will = be > > evaluated as follows (because of the left-to-right associativity of= the > >=20 > > | operator): > > 1. (src->version & 1) > > 2. (dst->version ^ src->version) > > 3. result of 1 | result of 2 > >=20 > > So AFAICT the flow that you describe could never happen, because > > (src->version & 1) is always done before (dst->version ^ src->versi= on). >=20 > Operator precedence doesn't matter. Consider it written like this: >=20 > or(and(src->version, 1), xor(dst->version, src->version)) >=20 > C gives you no guarantees whether the and or the xor will be executed= > first. There is no sequence point in between. And even with a sequenc= e > point, the C11 memory model gives you no guarantees about how the rea= ds > are ordered. >=20 > This discussion is somewhat theoretical, because > a) the hypervisor will probably update the data structure in the > current vCPU context (making memory consistency issues go away). > b) the compiler will likely not be an asshole. ;) >=20 > Pseudocode for a better fetch could be: >=20 > dst->version =3D src->version; > rmb(); > ... read data ... > rmb(); > version_post =3D src->version; > rmb(); <- keeps the compiler from reading src->version multiple times= >=20 > and then doing the test with version_post and dst->version. > Unfortunately, rmb() expands into lfence, even if there is no need fo= r > that here. There is the __compiler_membar() macro in that you could = use if=20 this code is x86-specific (and thus knows it only needs a compiler barr= ier). --=20 John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 23:31:37 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2CFE11D0 for ; Mon, 20 Jan 2014 23:31:37 +0000 (UTC) Received: from sunner.semmy.ru (sunner.semmy.ru [IPv6:2a00:14d0:0:20::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DC68517B9 for ; Mon, 20 Jan 2014 23:31:36 +0000 (UTC) Received: from broadband-178-140-93-168.nationalcablenetworks.ru ([178.140.93.168] helo=[172.16.100.50]) by sunner.semmy.ru with esmtpsa (TLSv1:DHE-RSA-CAMELLIA256-SHA:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1W5OJZ-000MQQ-Ig for freebsd-virtualization@freebsd.org; Tue, 21 Jan 2014 03:31:34 +0400 Message-ID: <52DDB1DC.5040908@FreeBSD.org> Date: Tue, 21 Jan 2014 03:31:40 +0400 From: Sergey Matveychuk User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: bhyve: reboot stops vm Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 23:31:37 -0000 Hi. Is it expected behaviour? sem@vm0[17]% sudo reboot Jan 21 07:27:51 vm0 reboot: rebooted by sem Jan 21 07:27:51 vm0 syslogd: exiting on signal 15 Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...2 0 done All buffers synced. Uptime: 1m17s Rebooting... cpu_reset: Stopping other CPUs root@bhyve[36]# From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 23:36:28 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 987104E3 for ; Mon, 20 Jan 2014 23:36:28 +0000 (UTC) Received: from mail.grem.de (outcast.grem.de [213.239.217.27]) by mx1.freebsd.org (Postfix) with SMTP id DDEEE181B for ; Mon, 20 Jan 2014 23:36:27 +0000 (UTC) Received: (qmail 61485 invoked by uid 89); 20 Jan 2014 23:36:19 -0000 Received: from unknown (HELO bsd64.grem.de) (mg@grem.de@88.217.181.240) by mail.grem.de with ESMTPA; 20 Jan 2014 23:36:19 -0000 Date: Tue, 21 Jan 2014 00:36:15 +0100 From: Michael Gmelin To: Sergey Matveychuk Subject: Re: bhyve: reboot stops vm Message-ID: <20140121003615.082d5e63@bsd64.grem.de> In-Reply-To: <52DDB1DC.5040908@FreeBSD.org> References: <52DDB1DC.5040908@FreeBSD.org> X-Mailer: Claws Mail 3.9.2 (GTK+ 2.24.18; amd64-portbld-freebsd9.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 23:36:28 -0000 On Tue, 21 Jan 2014 03:31:40 +0400 Sergey Matveychuk wrote: > Hi. > > Is it expected behaviour? > > sem@vm0[17]% sudo reboot > Jan 21 07:27:51 vm0 reboot: rebooted by sem > Jan 21 07:27:51 vm0 syslogd: exiting on signal 15 > Waiting (max 60 seconds) for system process `vnlru' to stop...done > Waiting (max 60 seconds) for system process `bufdaemon' to stop...done > Waiting (max 60 seconds) for system process `syncer' to stop... > Syncing disks, vnodes remaining...2 0 done > All buffers synced. > Uptime: 1m17s > Rebooting... > cpu_reset: Stopping other CPUs > root@bhyve[36]# Yes -- Michael Gmelin From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 20 23:36:39 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 57CF6525; Mon, 20 Jan 2014 23:36:39 +0000 (UTC) Received: from mail-pd0-x22c.google.com (mail-pd0-x22c.google.com [IPv6:2607:f8b0:400e:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 2A18A181F; Mon, 20 Jan 2014 23:36:39 +0000 (UTC) Received: by mail-pd0-f172.google.com with SMTP id p10so3145335pdj.31 for ; Mon, 20 Jan 2014 15:36:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=xQVPcN/e4XvyoWHt0CbdEgP1H1nbdOX1nDqKvQVr2vU=; b=gFUeQBseFQdbJpNruaYwhWL6s3pSJka17dg8xeBmhOw+6w7J4cnuIttjiO5Hw7Lo6m l/9lPUzb4PUuOW/kpqUcWi11LmuiyKRSjBQa69m/57j82Jh/VQt0zKE05GKuS1tU+dtn IF+bMxOSMfcJm3b0rw2joWVcwGGrBkNLTCqeaqlrQ+9JWyXTCC1N7LJH77nURHu+nSvK jcxRMEc0CK+bVjWu1M1SiN43hFnU37Xu1+zYEO1tGD4kwBSkxNKv7uv46ZwBOPq3g5SA wtXIbIiwZLM29BIkKQBJ2OBV4GLUlufiq2DR/VS9HfO1dYQfE+H3P1w0KtEhuJnwIYHt IuKA== MIME-Version: 1.0 X-Received: by 10.68.66.103 with SMTP id e7mr21152907pbt.120.1390260998536; Mon, 20 Jan 2014 15:36:38 -0800 (PST) Received: by 10.68.155.38 with HTTP; Mon, 20 Jan 2014 15:36:38 -0800 (PST) In-Reply-To: <52DDB1DC.5040908@FreeBSD.org> References: <52DDB1DC.5040908@FreeBSD.org> Date: Mon, 20 Jan 2014 18:36:38 -0500 Message-ID: Subject: Re: bhyve: reboot stops vm From: Aryeh Friedman To: Sergey Matveychuk Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Jan 2014 23:36:39 -0000 On Mon, Jan 20, 2014 at 6:31 PM, Sergey Matveychuk wrote: > Hi. > > Is it expected behaviour? > > sem@vm0[17]% sudo reboot > Jan 21 07:27:51 vm0 reboot: rebooted by sem > Jan 21 07:27:51 vm0 syslogd: exiting on signal 15 > Waiting (max 60 seconds) for system process `vnlru' to stop...done > Waiting (max 60 seconds) for system process `bufdaemon' to stop...done > Waiting (max 60 seconds) for system process `syncer' to stop... > Syncing disks, vnodes remaining...2 0 done > All buffers synced. > Uptime: 1m17s > Rebooting... > cpu_reset: Stopping other CPUs > root@bhyve[36]# > Yes it is... -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 00:41:36 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B72B1461; Tue, 21 Jan 2014 00:41:36 +0000 (UTC) Received: from os.inf.tu-dresden.de (os.inf.tu-dresden.de [IPv6:2002:8d4c:3001:48::99]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7A57F1E21; Tue, 21 Jan 2014 00:41:36 +0000 (UTC) Received: from [178.5.125.60] (helo=android-433a6bf599ba4d8.fritz.box) by os.inf.tu-dresden.de with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.82) id 1W5PPH-00069T-20; Tue, 21 Jan 2014 01:41:31 +0100 User-Agent: Kaiten Mail In-Reply-To: <3298215.G6vx8QjdMB@pippin.baldwin.cx> References: <52D6B18D.4080204@citrix.com> <1389805150.16498.18.camel@janus.xn--pl-wia.net> <3298215.G6vx8QjdMB@pippin.baldwin.cx> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Subject: Re: KVM Clock From: Julian Stecklina Date: Tue, 21 Jan 2014 01:41:26 +0100 To: John Baldwin ,freebsd-virtualization@freebsd.org Message-ID: X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 00:41:36 -0000 John Baldwin wrote: >There is the __compiler_membar() macro in that you could >use if >this code is x86-specific (and thus knows it only needs a compiler >barrier). Ah. Thanks. This will do. Something like access_once would be perfect, though. I'll post an updated patch that does not duplicate code that is in xen/ soonish. Didn't get around to testing it the last days. Julian -- Out of office. Please excuse my brevity. From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 04:56:37 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 31FD772A for ; Tue, 21 Jan 2014 04:56:37 +0000 (UTC) Received: from mail-qe0-x229.google.com (mail-qe0-x229.google.com [IPv6:2607:f8b0:400d:c02::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E70D1107A for ; Tue, 21 Jan 2014 04:56:36 +0000 (UTC) Received: by mail-qe0-f41.google.com with SMTP id gc15so3890800qeb.14 for ; Mon, 20 Jan 2014 20:56:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=AXcC5VgZJ1ayAYGPY/RK8iqm2hCuXAlxZsSByFmXLwY=; b=lVrnYCYXqCZSxTttfJOk+kXxayTPUXXBfMkr3Keg+rQxnEN4hIf3nbJ8+7aevtZbnd 7s7f1xVnHlYQ1SjjX8r9UAN/19cgk270cj4VvQqmBdRHziTq885r60aykdfWVP+QYmwK n9C0tcdHMHuqMlb2d2vrII0a+uDzVW3Gv4jnn2WoZKrTZJnUO0YbMOcycLk86deSL74k e672GBSu4q0FZi5IXsskMA36ALK7VANYm1v5GebdTcs4Lykzvls6+7x43kNmQ6x9DalH PjchNHSfdZwvMmFgAc5sYg2006etQOIAQ7fMmAQk0mWMEvuKqbNb+DeVkGfApa3af4Kc gJXg== MIME-Version: 1.0 X-Received: by 10.229.194.1 with SMTP id dw1mr34005491qcb.20.1390280196139; Mon, 20 Jan 2014 20:56:36 -0800 (PST) Received: by 10.140.34.17 with HTTP; Mon, 20 Jan 2014 20:56:36 -0800 (PST) In-Reply-To: <52DD7C56.4090804@semmy.ru> References: <52DD7C56.4090804@semmy.ru> Date: Mon, 20 Jan 2014 20:56:36 -0800 Message-ID: Subject: Re: bhyve: can't to passthru bge(4) card From: Neel Natu To: Sergey Matveychuk Content-Type: text/plain; charset=ISO-8859-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 04:56:37 -0000 Hi Sergey, On Mon, Jan 20, 2014 at 11:43 AM, Sergey Matveychuk wrote: > Hi. > > I try to passthru bge: > % pciconf -vl > ... > ppt0@pci0:3:0:1: class=0x020000 card=0x169d103c chip=0x165714e4 > rev=0x01 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'NetXtreme BCM5719 Gigabit Ethernet PCIe' > class = network > subclass = ethernet > ... > % cat /boot/loader.conf > vmm_load="yes" > pptdevs="3/0/1" > > % bhyve -c ${VM_CPUNUM} -m ${VM_MEMSIZE} -AI -HP -g0 \ > -s 0:0,hostbridge \ > -s 3:0,passthru,3/0/1 \ > -s 2:0,virtio-blk,${VM_DISK} \ > -S 31,uart,${VM_CONSOLE} \ > ${VM_NAME} > I suspect that this is because the function number of the virtual PCI device and the physical PCI device are different. Could you try to use the following instead: -s 2:1,passthru,3/0/1 Alternatively you could try assigning the physical PCI device 3/0/0: -s 3:0,passthru,3/0/0 best Neel > And I got this on boot: > > bge0: mem > 0xc0010000-0xc001ffff,0xc0020000-0xc002ffff,0xc0030000-0xc003ffff irq 36 at > device 3.0 on pci0 > bge0: APE FW version: NCSI v1.0.60.0 > bge0: CHIP ID 0x05719001; ASIC REV 0x5719; CHIP REV 0x57190; PCI-E > bge0: Try again > bge0: Try again > bge0: Try again > bge0: Try again > bge0: attaching PHYs failed > device_attach: bge0 attach returned 6 > > I used this as an instruction: https://wiki.freebsd.org/bhyve/pci_passthru > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 08:50:08 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F2EE75B4 for ; Tue, 21 Jan 2014 08:50:08 +0000 (UTC) Received: from mail-qa0-x247.google.com (mail-qa0-x247.google.com [IPv6:2607:f8b0:400d:c00::247]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B21C412F5 for ; Tue, 21 Jan 2014 08:50:08 +0000 (UTC) Received: by mail-qa0-f71.google.com with SMTP id j5so12748952qaq.10 for ; Tue, 21 Jan 2014 00:50:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:message-id:date:subject:from:to:content-type; bh=4FEWWFHtzHW1tmBCTebVsWSUQTb95o86nuA801vWLI8=; b=0wsd/8Rq7HDYcBRybi/kGS7HxRYASZxM8iTRjk5/fmmrorKW1wvpPlVk77MpdTQ/+q K8C7zwSUEqtDS4M3py19x/DZvYOFQYOjqt1iY9aYT6uLw/8mqG/TlCoxKpUNM1QgqFWd QLKV6gnQ47H7iMSX7/FYz4zHyitzEZzX7aclbFMSeUGfqIl/3RnqlB5Wlt+QcKpbZSRQ A2y8n2OxrYnU7et+igeWbvEAlHyDR2uXK62VyyBJ1fgH+0gKlP5jG/+jSzcmb58GYgWI wk4P5M90DNwvNcR/0nGiV+NLFP3/rjDkaC6efRAzQMwo6YFoYqJUvFy4ySTST3CqfPYG cRsA== MIME-Version: 1.0 X-Received: by 10.236.127.199 with SMTP id d47mr6899155yhi.29.1390294207974; Tue, 21 Jan 2014 00:50:07 -0800 (PST) Message-ID: Date: Tue, 21 Jan 2014 08:50:07 +0000 Subject: www.freebsd.org From: Anna Garcia To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=windows-1252; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 08:50:09 -0000 SGksDQoNCkkganVzdCB3YW50ZWQgdG8gc2VuZCB5b3UgYSBxdWljayBub3RlLiBXaXRoIGEgZmV3 IHNpbXBsZSBjaGFuZ2VzIHRvIG1ha2UNCnlvdXIgc2l0ZSBtb3JlIFNFTy1mcmllbmRseSBJkm0g c3VyZSB5b3UgY2FuIGNvbnZlcnQgbW9yZSB2aXNpdG9ycyBpbnRvDQpsZWFkcyBhbmQgZ2V0IGl0 IHBsYWNlZCBoaWdoZXIgaW4gdGhlIG9yZ2FuaWMgc2VhcmNoIHJlc3VsdHMsIGZvciBrZXl3b3Jk cw0KdGhhdCBtYXR0ZXIgdG8geW91IHRoZSBtb3N0Lg0KDQpXZSBhcmUgYW4gQXVzdHJhbGlhbiBi YXNlZCBjb21wYW55IHdpdGggYSBncmVhdCBpbi1ob3VzZSB0ZWNobmljYWwgdGVhbSB3aG8NCnJl YWxseSBrbm93IHRoZWlyIHN0dWZmIGFib3V0IHNlYXJjaCBlbmdpbmUgb3B0aW1pemF0aW9uLg0K DQpXb3VsZCB5b3UgbGlrZSBhIGJpdCBtb3JlIGluZm9ybWF0aW9uIGFib3V0IGhvdyB0byBnaXZl IHlvdXIgd2Vic2l0ZSBhDQpib29zdCB3aXRoIGJldHRlciBTRU8/DQoNCkJlc3QgcmVnYXJkcywN Cg0KQW5uYSBHYXJjaWENClNFTy9XRUIgU3BlY2lhbGlzdA0KDQpbaW1hZ2U6IExpbmtlZEluXSBb aW1hZ2U6IEZhY2Vib29rXSBbaW1hZ2U6IFR3aXR0ZXJdIFtpbWFnZTogU2t5cGVdDQogICAgICAg ICAgICAgUyAgIEUgIE8gICAgICAgICAgICAqU2VhcmNoIEVuZ2luZSBPcHRpbWl6YXRpb24qDQoN CldlIHJlc3BlY3QgeW91ciBwcml2YWN5IGFuZCB3YW50IHRvIG1ha2Ugc3VyZSB5b3UgYXJlIGF3 YXJlIG9mIGEgZmV3DQp0aGluZ3MuIEJ5IHJlcGx5aW5nIHRvIHRoaXMgZW1haWwsIHlvdSBhdXRo b3JpemUgb3VyIEF1c3RyYWxpYW4gYWZmaWxpYXRlcw0KdGhhdCBjYW4gaGVscCB3aXRoIHlvdXIg cHJvamVjdCB0byBjYWxsIHlvdSBhdCB0aGUgbnVtYmVyIHlvdSBwcm92aWRlZCwgYW5kDQp5b3Ug dW5kZXJzdGFuZCB0aGF0IHRoZXkgbWF5IHVzZSBhdXRvbWF0ZWQgcGhvbmUgdGVjaG5vbG9neSB0 byBjYWxsIHlvdS4gQXQNCm5vIHRpbWUgYXJlIHlvdSByZXF1aXJlZCB0byBtYWtlIGEgcHVyY2hh c2UuDQo= From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 09:27:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 40D1D238 for ; Tue, 21 Jan 2014 09:27:20 +0000 (UTC) Received: from sunner.semmy.ru (sunner.semmy.ru [IPv6:2a00:14d0:0:20::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EE361176B for ; Tue, 21 Jan 2014 09:27:19 +0000 (UTC) Received: from broadband-178-140-93-168.nationalcablenetworks.ru ([178.140.93.168] helo=[172.16.100.50]) by sunner.semmy.ru with esmtpsa (TLSv1:DHE-RSA-CAMELLIA256-SHA:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1W5Xc4-00019d-Vx; Tue, 21 Jan 2014 13:27:17 +0400 Message-ID: <52DE3D8A.5070209@semmy.ru> Date: Tue, 21 Jan 2014 13:27:38 +0400 From: Sergey Matveychuk User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Neel Natu Subject: Re: bhyve: can't to passthru bge(4) card References: <52DD7C56.4090804@semmy.ru> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 09:27:20 -0000 21.01.2014 8:56, Neel Natu пишет: > I suspect that this is because the function number of the virtual PCI > device and the physical PCI device are different. > > Could you try to use the following instead: -s 2:1,passthru,3/0/1 Thank you. It works. I've tried 3:1,passthru,3/0/1 but it does not work. What rules for a slot number to choose? > > Alternatively you could try assigning the physical PCI device 3/0/0: > -s 3:0,passthru,3/0/0 > 3/0/0 is a first network card. I'd like to leave it for the host system. From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 16:46:26 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ADE21A19 for ; Tue, 21 Jan 2014 16:46:26 +0000 (UTC) Received: from mail-pa0-x233.google.com (mail-pa0-x233.google.com [IPv6:2607:f8b0:400e:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7F7C6108B for ; Tue, 21 Jan 2014 16:46:26 +0000 (UTC) Received: by mail-pa0-f51.google.com with SMTP id ld10so6312732pab.24 for ; Tue, 21 Jan 2014 08:46:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=TRPVnD0CjpLsce630xAXwYuviT76zz/FR2g4k1Ci58c=; b=H8fjtOoQxU2InhprF37ULxl/RQ9wgKVAc4A1QOsFTwnAf6sPcQhzxxI/rKrNnZvU7g Vmt0btB/G9aj5fqG6fLFfHYxUAC5we3hOberXemxVv7QjHOLYdLjV9PU9RmyiOCyjMOU Ebq+VXsUwnGuh9LgzlUNA8c5sJUXwezoN0iNgAHOP1lDOuDkFP5ape9PIEsEzNzCdTqo 8Q+Qdhf0zyweS1CAIfcfBB7slnlWDVzoWuV+kEoKARxzprGWakBwD9S7rx/TP8iwpCDp KGlwI/6ZdNLz12G13/Aa2yaw7xXHbwmh8/8IRce6dnMR464zGf5Wegw+Zscm+lyaBk5r RNpA== X-Received: by 10.68.66.33 with SMTP id c1mr26124827pbt.118.1390322785666; Tue, 21 Jan 2014 08:46:25 -0800 (PST) Received: from [10.97.82.79] (mobile-166-137-213-204.mycingular.net. [166.137.213.204]) by mx.google.com with ESMTPSA id jp3sm13919832pbc.36.2014.01.21.08.46.24 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 21 Jan 2014 08:46:24 -0800 (PST) References: <52DD7C56.4090804@semmy.ru> <52DE3D8A.5070209@semmy.ru> Mime-Version: 1.0 (1.0) In-Reply-To: <52DE3D8A.5070209@semmy.ru> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Message-Id: <09444E73-EF4F-473F-9A75-8B0DA73E2620@gmail.com> X-Mailer: iPhone Mail (11B554a) From: Neel Natu Subject: Re: bhyve: can't to passthru bge(4) card Date: Tue, 21 Jan 2014 08:46:19 -0800 To: Sergey Matveychuk Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 16:46:26 -0000 Hi Sergey, > On Jan 21, 2014, at 1:27 AM, Sergey Matveychuk wrote: >=20 > 21.01.2014 8:56, Neel Natu =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >> I suspect that this is because the function number of the virtual PCI >> device and the physical PCI device are different. >>=20 >> Could you try to use the following instead: -s 2:1,passthru,3/0/1 >=20 > Thank you. It works. >=20 > I've tried 3:1,passthru,3/0/1 but it does not work. What rules for a slot n= umber to choose? >=20 It depends on the PCI function that you are passing to the guest. For some, e.g. Intel e1000, it does not matter. You can have it appear on a c= ompletely different function number in the guest as compared to the host. For others, e.g. bge, as you discovered, the function numbers in the guest a= nd host have to match. Also, PCI requires that for a multi-function device, function 0 must be pres= ent. So, it is not possible to assign a device to a function > 0 without als= o having some device present at function 0. Hope that helps. Best Neel >>=20 >> Alternatively you could try assigning the physical PCI device 3/0/0: >> -s 3:0,passthru,3/0/0 >=20 > 3/0/0 is a first network card. I'd like to leave it for the host system. From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 17:26:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 69340F03; Tue, 21 Jan 2014 17:26:57 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 41D5E1435; Tue, 21 Jan 2014 17:26:57 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 32077B9B7; Tue, 21 Jan 2014 12:26:56 -0500 (EST) From: John Baldwin To: freebsd-virtualization@freebsd.org Subject: Re: bhyve: reboot stops vm Date: Tue, 21 Jan 2014 12:25:39 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20130906; KDE/4.5.5; amd64; ; ) References: <52DDB1DC.5040908@FreeBSD.org> In-Reply-To: <52DDB1DC.5040908@FreeBSD.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201401211225.39942.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 21 Jan 2014 12:26:56 -0500 (EST) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 17:26:57 -0000 On Monday, January 20, 2014 6:31:40 pm Sergey Matveychuk wrote: > Hi. > > Is it expected behaviour? > > sem@vm0[17]% sudo reboot > Jan 21 07:27:51 vm0 reboot: rebooted by sem > Jan 21 07:27:51 vm0 syslogd: exiting on signal 15 > Waiting (max 60 seconds) for system process `vnlru' to stop...done > Waiting (max 60 seconds) for system process `bufdaemon' to stop...done > Waiting (max 60 seconds) for system process `syncer' to stop... > Syncing disks, vnodes remaining...2 0 done > All buffers synced. > Uptime: 1m17s > Rebooting... > cpu_reset: Stopping other CPUs > root@bhyve[36]# Yes, I use the vmrun.sh script which uses a loop to restart the VM when you reboot. -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 21 21:48:39 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3419B406; Tue, 21 Jan 2014 21:48:39 +0000 (UTC) Received: from mail-pd0-x22c.google.com (mail-pd0-x22c.google.com [IPv6:2607:f8b0:400e:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0492C1D26; Tue, 21 Jan 2014 21:48:38 +0000 (UTC) Received: by mail-pd0-f172.google.com with SMTP id p10so4469968pdj.31 for ; Tue, 21 Jan 2014 13:48:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=c3jBsnLsbJvSK+XcSj2GODR2kngzs53Hi+zoQMx6ehI=; b=A8GWoefaiTYjnA32ecGeYw9+JW5bbns0ZxsNhsYI1Bhkkbtdr7d74jTxlvTEN/3auL fdS3AvnIwymn9+jnxPAlO8P0bSh1a2RO+7SHMwVgFN8U1Q+0ZPMZUVZEKJxxVzhrW6nH JgTFtcTgZhz+GnNRkUDFRsTY0z+siN8YeqGo8qCYLZ/jMDYuFBw4NQLH9+JENqNYL2ub sEH7+XohD/Mb6WgOWteWGAWuOQV7poWyHVzR3aE/65iKo3p9aqlu2pTskzxmJ7Nm3J14 6X/LP6rYBSYGKfpmYJr/O9Dbih1n/sZFicU9s7odu0JFRlVN/m9gFLMuS78qBfEuVRxD +7DQ== MIME-Version: 1.0 X-Received: by 10.68.230.137 with SMTP id sy9mr27269274pbc.126.1390340918595; Tue, 21 Jan 2014 13:48:38 -0800 (PST) Received: by 10.68.155.38 with HTTP; Tue, 21 Jan 2014 13:48:38 -0800 (PST) In-Reply-To: <201401211225.39942.jhb@freebsd.org> References: <52DDB1DC.5040908@FreeBSD.org> <201401211225.39942.jhb@freebsd.org> Date: Tue, 21 Jan 2014 16:48:38 -0500 Message-ID: Subject: Re: bhyve: reboot stops vm From: Aryeh Friedman To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Jan 2014 21:48:39 -0000 > > Yes, I use the vmrun.sh script which uses a loop to restart the VM when you > reboot. Ideally shouldn't the -H option be the default? -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 02:34:28 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 68B91AA1 for ; Wed, 22 Jan 2014 02:34:28 +0000 (UTC) Received: from mail-pa0-x22c.google.com (mail-pa0-x22c.google.com [IPv6:2607:f8b0:400e:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3AAB41253 for ; Wed, 22 Jan 2014 02:34:28 +0000 (UTC) Received: by mail-pa0-f44.google.com with SMTP id kq14so9261240pab.31 for ; Tue, 21 Jan 2014 18:34:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:from:date:message-id:subject:to:content-type; bh=5UWTfVH0pq2rifsTi+6ELZo0W2KhyDUvQxvJ+ooasbI=; b=PKJVSUhZsuiszhTUvnrTalmVb8+oIRW5k2NB8n265v5LH/9l8bWtDBPl5ssRFQGk1F Rhgd9rMI9Q5re0r3FlPjfLjqFCt5RBtNnyHhZmK15oJe8StW2XIux7rlywhrtxHcPHrd 7n1XHkbMjFPoIPees9B7CuimVsKGP3Y2YjpnE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-type; bh=5UWTfVH0pq2rifsTi+6ELZo0W2KhyDUvQxvJ+ooasbI=; b=SIHjgwRPmu7qn9j0Kxj1/+piQeyM12wvV5cbITIenphse+l05S9HhoJuy6q9Xq0SZz woTM/pM4kTUq09PDCFfZcFxDfZLcyc/N3UhTqXyetXDMJTEHHFQS8e+hmOoFEfLJSSDL aFj92OiXMvoM6Y44cuBNLAl9T635UZEy02kOxjDxxWgvdqu71GH/gZNYg9blAX7G1v05 9KGu14eBiZT4JaTtm7ORTFjIDIa4tF/PPHtK159hQxAqL01k1BbyRw/nklu5lx5dl9bi YeomD/jlfhawxEs4oWIs0a6b+KM1TFcYwcr9e3p7xcJ0RfRQuclSSI5s0u9MuCeS3KOT cOxw== X-Gm-Message-State: ALoCoQkfZ2zZoyzQu/EhHro4259Gw+c5lMycyPw5uZ94vzTDhtC3NOuQ465Rn0c7AIpg9QbFZxmj X-Received: by 10.66.154.75 with SMTP id vm11mr18238481pab.124.1390358058929; Tue, 21 Jan 2014 18:34:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 18:33:38 -0800 (PST) From: Takuya ASADA Date: Wed, 22 Jan 2014 11:33:38 +0900 Message-ID: Subject: Linux on BHyVe in 10.0-RELEASE To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 02:34:28 -0000 Hi, I want to know which Linux distribution is supported on BHyVe (+grub2-bhyve) in 10.0-RELEASE. I tried to these distributions, but I haven't succeeded to install any choice. On these tests, I used modified vmrun.sh script for all test, source code is here: https://gist.github.com/syuu1228/8552418 * Fedora 20 Fedora 20 has disk image for VM, I just tried to boot it from the image: ./linuxrun.sh -d Fedora-x86_64-20-20131211.1-sda.raw fedora grub> linux (hd1,msdos1)/boot/vmlinuz-3.11.10-301.fc20.x86_64 grub> initrd (hd1,msdos1)/boot/initramfs-3.11.10-301.fc20.x86_64.img grub> boot but bhyve dies by unhandled rdmsr: [ 1.676041] device-mapper: uevent: version 1.0.3 [ 1.676556] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) initialised: dm-devel@redhat.com vm exit rdmsr 0xe8, cpu 0 * CentOS 6.5 Tried to install with following commands but no luck: ./linuxrun.sh centos grub> linux (hd0)/isolinux/vmlinuz grub> initrd (hd0)/isolinux/initrd.img grub> boot Got following error: NET: Registered protocol family 1 Trying to unpack rootfs image as initramfs... Freeing initrd memory: 32610k freed Unknown WRMSR code 391, val 2000000f, cpu 0 * Ubuntu 13.10 Almost boot-up but couldn't mount cdrom. ./linuxrun.sh -d ubuntu.img -I ubuntu-13.10-desktop-amd64.iso ubuntu grub> linux (hd0)/casper/vmlinuz.efi grub> initrd (hd0)/casper/initrd.lz grub> boot Got following error, maybe it can prevents by passing root= argument? [ 6.380384] Btrfs loaded Scanning for Btrfs filesystems done. mount: can't read '/etc/fstab': No such file or directory Begin: Running /scripts/local-bottom ... done. done. Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev failed: No such file or directory done. mount: mounting /sys on /root/sys failed: No such file or directory mount: mounting /proc on /root/proc failed: No such file or directory Target filesystem doesn't have requested /sbin/init. No init found. Try passing init= bootarg. BusyBox v1.20.2 (Ubuntu 1:1.20.0-8.1ubuntu1) built-in shell (ash) Enter 'help' for a list of built-in commands. (initramfs) Any suggestions? From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 02:38:08 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 74A0DB00 for ; Wed, 22 Jan 2014 02:38:08 +0000 (UTC) Received: from mail-pd0-x22c.google.com (mail-pd0-x22c.google.com [IPv6:2607:f8b0:400e:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4288E1260 for ; Wed, 22 Jan 2014 02:38:08 +0000 (UTC) Received: by mail-pd0-f172.google.com with SMTP id p10so4718214pdj.17 for ; Tue, 21 Jan 2014 18:38:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=TT+Z9X9NQdbXqzZ4nLgFsirwSIVQsY6Q/i5AoQexg4g=; b=V6qlCha/HJKi5lktwvAfi6X2iUQwLaYV3b8yde8ArVEoJinB/IUQY4LWEHvWW7ji+d DqH88GqqEWQ/eA37TncFG4jT4Cz0Va3rqoIatH54iYp6eevoWyM0oFM3+4LKRv2srE30 a/cREmRvjB/4g6gwsT6c+3fuXQ4mZNbnzLeOY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=TT+Z9X9NQdbXqzZ4nLgFsirwSIVQsY6Q/i5AoQexg4g=; b=C47KJYHNy8Tf3+wutoqXS3guJNmV9QTs4BCbieYkG0+G3uBz3Q07J23p+uke5r007W GDB6LOjjFfA0rxNXkgIoSr2Q8T4aTQU8nZS6HR5gTfEM7Yf04GUfnS12mTwlfYh7k36M 6TUzOJzXNbggTxIlCc/YJdOpW6au+bo1Z7uGc447fYZa/4vaqqqJhO0wQOvDGNvLECKy h1JISZs3PuIZKJcKK1CxxO7MAbX7fknhWUeNhWwle+AK/HySBejtXOeNtaKS6q47pmof 5xLr/OK6jXfHuqmx7EzJJjOnEGDIyxm1w0/K5CcCLO2gc2Y6mRdMeIB+Q9JWMNoUySOr n5ug== X-Gm-Message-State: ALoCoQltAcdRR0V7/LCfbSM+m2qBeC2B6YSC4QZZYQMSTysga9TvQEz88KKaNFNE24uRrdjBR0Qr X-Received: by 10.68.193.233 with SMTP id hr9mr28728481pbc.26.1390358287635; Tue, 21 Jan 2014 18:38:07 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 18:37:27 -0800 (PST) In-Reply-To: References: From: Takuya ASADA Date: Wed, 22 Jan 2014 11:37:27 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 02:38:08 -0000 Hmm, looks like neel@ adding ignoring unimplemented MSR access patch on -CURRENT. Does it means we can't use (some version of) Linux on 10.0-RELEASE? https://github.com/freebsd/freebsd/commit/5dab6f9ed3816204ff73fd075abfaba1ed5c7673 2014/1/22 Takuya ASADA > Hi, > > I want to know which Linux distribution is supported on BHyVe > (+grub2-bhyve) in 10.0-RELEASE. > I tried to these distributions, but I haven't succeeded to install any > choice. > On these tests, I used modified vmrun.sh script for all test, source code > is here: > https://gist.github.com/syuu1228/8552418 > > * Fedora 20 > Fedora 20 has disk image for VM, I just tried to boot it from the image: > > ./linuxrun.sh -d Fedora-x86_64-20-20131211.1-sda.raw fedora > > grub> linux (hd1,msdos1)/boot/vmlinuz-3.11.10-301.fc20.x86_64 > grub> initrd (hd1,msdos1)/boot/initramfs-3.11.10-301.fc20.x86_64.img > grub> boot > > but bhyve dies by unhandled rdmsr: > [ 1.676041] device-mapper: uevent: version 1.0.3 > [ 1.676556] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) > initialised: dm-devel@redhat.com > vm exit rdmsr 0xe8, cpu 0 > > * CentOS 6.5 > Tried to install with following commands but no luck: > > ./linuxrun.sh centos > > grub> linux (hd0)/isolinux/vmlinuz > grub> initrd (hd0)/isolinux/initrd.img > grub> boot > > Got following error: > > NET: Registered protocol family 1 > Trying to unpack rootfs image as initramfs... > Freeing initrd memory: 32610k freed > Unknown WRMSR code 391, val 2000000f, cpu 0 > > * Ubuntu 13.10 > Almost boot-up but couldn't mount cdrom. > > ./linuxrun.sh -d ubuntu.img -I ubuntu-13.10-desktop-amd64.iso ubuntu > > grub> linux (hd0)/casper/vmlinuz.efi > grub> initrd (hd0)/casper/initrd.lz > grub> boot > > Got following error, maybe it can prevents by passing root= argument? > > [ 6.380384] Btrfs loaded > Scanning for Btrfs filesystems > done. > mount: can't read '/etc/fstab': No such file or directory > Begin: Running /scripts/local-bottom ... done. > done. > Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev > failed: No such file or directory > done. > mount: mounting /sys on /root/sys failed: No such file or directory > mount: mounting /proc on /root/proc failed: No such file or directory > Target filesystem doesn't have requested /sbin/init. > No init found. Try passing init= bootarg. > > BusyBox v1.20.2 (Ubuntu 1:1.20.0-8.1ubuntu1) built-in shell (ash) > Enter 'help' for a list of built-in commands. > > (initramfs) > > > Any suggestions? > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 02:53:25 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BA178CBA for ; Wed, 22 Jan 2014 02:53:25 +0000 (UTC) Received: from mail-oa0-x22e.google.com (mail-oa0-x22e.google.com [IPv6:2607:f8b0:4003:c02::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 79F681374 for ; Wed, 22 Jan 2014 02:53:25 +0000 (UTC) Received: by mail-oa0-f46.google.com with SMTP id n16so7139524oag.5 for ; Tue, 21 Jan 2014 18:53:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=tnTIr7vWFi1kDcmGY6wMUzSy3wCcj1aqEemE3k49lXE=; b=FN8hll6i9Ed9vigxm3Ne9TBOSRYQG6e/dyaMPLnMncSWR0kXav2JZz9PTika76oSWh 5Ppv9/lp/dTI7yMZUQTmmcoX/h8wPU9gEsD2vAz5OVCjtGH8DSPbX7ck+plo1g/wPsTV utpEL7mqEU9B6yFDy3MsmvV1mBL6EUCf1dcWM6TH9okpkk/BDfbYdlYcgi64hQEys1Bn /HUPNze2bL8dsvZRJMw5cPzMJccNUhVD3zDpBwTgGTQyvF6DwECTjAt4wINMd0OWCr/S u5KDMDI/ZOy253/ROTgZc3+Qomg9UyrE4V29OrOyRsFti0B+meUTu4RgWaERwduA4cfz 9Iuw== X-Received: by 10.182.29.66 with SMTP id i2mr24314733obh.23.1390359204402; Tue, 21 Jan 2014 18:53:24 -0800 (PST) Received: from [10.0.1.3] (ip72-209-165-165.ks.ks.cox.net. [72.209.165.165]) by mx.google.com with ESMTPSA id fn10sm11241178obb.12.2014.01.21.18.53.23 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 21 Jan 2014 18:53:23 -0800 (PST) Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) Subject: Re: kldload vmm partial lockup From: Joe Maloney In-Reply-To: Date: Tue, 21 Jan 2014 20:53:17 -0600 Message-Id: <52A1E4D3-9625-40B7-AF4A-2EAFBF3A7025@gmail.com> References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> To: Neel Natu X-Mailer: Apple Mail (2.1827) Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 02:53:25 -0000 Neel, sorry it took me a day or two to get to test this. The patch compiles = cleanly however it fails now trying to build the vmm module. Joe Maloney /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:232:7: error: implicit = declaration of function 'ppt_avail_devices' is invalid in C99 [-Werror,-Wimplicit-function-declaration] if (ppt_avail_devices() > 0) ^ /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:565:6: error: implicit = declaration of function 'ppt_assigned_devices' is invalid in C99 [-Werror,-Wimplicit-function-declaration] if (ppt_assigned_devices(vm) =3D=3D 0) { ^ /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:565:6: note: did you mean = 'ppt_assign_device'? if (ppt_assigned_devices(vm) =3D=3D 0) { ^~~~~~~~~~~~~~~~~~~~ ppt_assign_device /usr/src/sys/modules/vmm/../../amd64/vmm/io/ppt.h:46:5: note: = 'ppt_assign_device' declared here int ppt_assign_device(struct vm *vm, int bus, int slot, int func); ^ 2 errors generated. *** Error code 1 Stop. make[4]: stopped in /usr/src/sys/modules/vmm *** Error code 1 Stop. make[3]: stopped in /usr/src/sys/modules *** Error code 1 Stop. make[2]: stopped in /usr/obj/usr/src/sys/GENERIC *** Error code 1 Stop. make[1]: stopped in /usr/src *** Error code 1 Stop. make: stopped in /usr/src root@jmhome-pc:/usr/src #=20 On Jan 19, 2014, at 8:43 PM, Neel Natu wrote: > Hi Joe, >=20 > On Sun, Jan 19, 2014 at 2:21 PM, Joe Maloney wrote: >> I=92ve been trying to get bhyve to work on a system with the = following specs: >>=20 >> FreeBSD 10.0 64 bit >> ASUS P6T Deluxe >> Intel i7 920 >>=20 >> According to what I=92ve researched my cpu should have the VT-D = extensions. However many users of this motherboard have complained = about ASUS not properly supporting VT-D with Xen and something about a = problem with tables getting corrupt due to a problem with the bios. On = the third link below which is the Xen wiki it even states that this = motherboard needs a bios update which is not available to the public. >>=20 >> https://communities.intel.com/thread/28389 >>=20 >> = http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den-= us&board_id=3D1 >>=20 >> http://wiki.xen.org/wiki/VTd_HowTo >>=20 >> I am curious though if this would be what would be causing my problem = with bhyve? I suppose I am willing to just by a new motherboard if so. >>=20 >> I can run kldload vmm and I see a bunch of text fly by and then = something about uhci interrupt problem. As soon as that happens the = messages repeats my network drops and no keyboard input. However the = message repeats and it doesn=92t appear that the system has fully locked = up otherwise. However on another system that works I notice that = kldload VMM does not show this information it just loads the module. >>=20 >> Is there a way I can gather more logs somehow so that I can determine = what text is appearing before the uhci errors? Perhaps some kind of = dump procedure? Or is there a way I can confirm that freebsd can = properly see and utilize the VT-D extensions. VirtualBox runs fine with = the VT extensions enabled. I also made sure VirtualBox wasn=92t = installed or loaded before I tried bhyve. I=92ve tried to research for = a week or two before posting here. >>=20 >=20 > I have a patch to not initialize the iommu unless there are passthru > devices explicitly configured for bhyve to use. >=20 > It is available here: > http://people.freebsd.org/~neel/patches/bhyve_iommu_init.patch >=20 > Could you give it a spin and see if it helps with the ASUS system? >=20 > best > Neel >=20 >> Joe Maloney >>=20 >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 03:01:49 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 77DA3F32 for ; Wed, 22 Jan 2014 03:01:49 +0000 (UTC) Received: from mail-qc0-x22b.google.com (mail-qc0-x22b.google.com [IPv6:2607:f8b0:400d:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3598E14F5 for ; Wed, 22 Jan 2014 03:01:49 +0000 (UTC) Received: by mail-qc0-f171.google.com with SMTP id n7so8097072qcx.2 for ; Tue, 21 Jan 2014 19:01:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=zFKWgY5P4fvAez05XqQ/2tmi/T5Y698ww3fKQBiNZto=; b=rfEIK0+06OyCCcVNahNovgEN6nb28Q1iGSSraQJ1NDBBya3E4cd/9t8hYzSMvfgKpL AuNAhDzpyvKQO3+S2ykO4BZZNFb7avJwNnppxLYSMrUXKb7Tqc3mNEkj0DAZAT5kHgfh kWUyGxzEimRc8943Rlrcann/NeHT5eFPSzlcMrk9P9yTFoeBc33/rAZHiqAVr7JjtEXF f1nsFGbCQPOZPivIZ1qZTyPFWg643V/eoKWBBgXfVyk1WwlPaCc9fhFwYklmE63P13ZN 2URss35LiNJRo7yQQt80AMT7qldpXvodAm3FnZhfdUwdztv73/dj2SBPcCQZgeuKpcPh vB5g== MIME-Version: 1.0 X-Received: by 10.140.81.112 with SMTP id e103mr40771603qgd.85.1390359708386; Tue, 21 Jan 2014 19:01:48 -0800 (PST) Received: by 10.140.34.17 with HTTP; Tue, 21 Jan 2014 19:01:48 -0800 (PST) In-Reply-To: <52A1E4D3-9625-40B7-AF4A-2EAFBF3A7025@gmail.com> References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> <52A1E4D3-9625-40B7-AF4A-2EAFBF3A7025@gmail.com> Date: Tue, 21 Jan 2014 19:01:48 -0800 Message-ID: Subject: Re: kldload vmm partial lockup From: Neel Natu To: Joe Maloney Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 03:01:49 -0000 Hi Joe, On Tue, Jan 21, 2014 at 6:53 PM, Joe Maloney wrote: > Neel, > sorry it took me a day or two to get to test this. The patch compiles > cleanly however it fails now trying to build the vmm module. > No worries. I committed the patch as r260972: http://svnweb.freebsd.org/base?view=3Drevision&revision=3D260972 Could you get the latest HEAD and see how it works for you? best Neel p.s. not sure why the patch is not compiling - perhaps ppt.h did not get patched properly? > Joe Maloney > > /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:232:7: error: implicit > declaration of function 'ppt_avail_devices' is invalid in C99 > [-Werror,-Wimplicit-function-declaration] > if (ppt_avail_devices() > 0) > ^ > /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:565:6: error: implicit > declaration of function 'ppt_assigned_devices' is invalid in C99 > [-Werror,-Wimplicit-function-declaration] > if (ppt_assigned_devices(vm) =3D=3D 0) { > ^ > /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:565:6: note: did you mean > 'ppt_assign_device'? > if (ppt_assigned_devices(vm) =3D=3D 0) { > ^~~~~~~~~~~~~~~~~~~~ > ppt_assign_device > /usr/src/sys/modules/vmm/../../amd64/vmm/io/ppt.h:46:5: note: > 'ppt_assign_device' declared here > int ppt_assign_device(struct vm *vm, int bus, int slot, int func); > ^ > 2 errors generated. > *** Error code 1 > > Stop. > make[4]: stopped in /usr/src/sys/modules/vmm > *** Error code 1 > > Stop. > make[3]: stopped in /usr/src/sys/modules > *** Error code 1 > > Stop. > make[2]: stopped in /usr/obj/usr/src/sys/GENERIC > *** Error code 1 > > Stop. > make[1]: stopped in /usr/src > *** Error code 1 > > Stop. > make: stopped in /usr/src > root@jmhome-pc:/usr/src # > > On Jan 19, 2014, at 8:43 PM, Neel Natu wrote: > > Hi Joe, > > On Sun, Jan 19, 2014 at 2:21 PM, Joe Maloney wrote: > > I=92ve been trying to get bhyve to work on a system with the following sp= ecs: > > FreeBSD 10.0 64 bit > ASUS P6T Deluxe > Intel i7 920 > > According to what I=92ve researched my cpu should have the VT-D extension= s. > However many users of this motherboard have complained about ASUS not > properly supporting VT-D with Xen and something about a problem with tabl= es > getting corrupt due to a problem with the bios. On the third link below > which is the Xen wiki it even states that this motherboard needs a bios > update which is not available to the public. > > https://communities.intel.com/thread/28389 > > http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den= -us&board_id=3D1 > > http://wiki.xen.org/wiki/VTd_HowTo > > I am curious though if this would be what would be causing my problem wit= h > bhyve? I suppose I am willing to just by a new motherboard if so. > > I can run kldload vmm and I see a bunch of text fly by and then something > about uhci interrupt problem. As soon as that happens the messages repea= ts > my network drops and no keyboard input. However the message repeats and = it > doesn=92t appear that the system has fully locked up otherwise. However = on > another system that works I notice that kldload VMM does not show this > information it just loads the module. > > Is there a way I can gather more logs somehow so that I can determine wha= t > text is appearing before the uhci errors? Perhaps some kind of dump > procedure? Or is there a way I can confirm that freebsd can properly see > and utilize the VT-D extensions. VirtualBox runs fine with the VT > extensions enabled. I also made sure VirtualBox wasn=92t installed or lo= aded > before I tried bhyve. I=92ve tried to research for a week or two before > posting here. > > > I have a patch to not initialize the iommu unless there are passthru > devices explicitly configured for bhyve to use. > > It is available here: > http://people.freebsd.org/~neel/patches/bhyve_iommu_init.patch > > Could you give it a spin and see if it helps with the ASUS system? > > best > Neel > > Joe Maloney > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" > > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 03:24:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 52EBE2F3 for ; Wed, 22 Jan 2014 03:24:57 +0000 (UTC) Received: from mail-qc0-x22d.google.com (mail-qc0-x22d.google.com [IPv6:2607:f8b0:400d:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0D2BB16DA for ; Wed, 22 Jan 2014 03:24:56 +0000 (UTC) Received: by mail-qc0-f173.google.com with SMTP id i8so8145200qcq.18 for ; Tue, 21 Jan 2014 19:24:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=tpfyLmPkwXNV8Ikx/BwO8XE1b94Jeth8CcGy3ko23Ac=; b=hFChBDaY3la6dGk/Z/MeBCZLdk7lswxv49rsL014WtPwY6aNuID63aY9YBzs33r0x+ 3avbeWcJid6dHvSU2XahvZBPhEhIOOvSW7LD9oQXj8AvWN/ToJjn3CGHtiFYgATt5Juq pJPbLFCnpybq3jO1qYETaM/53tW75g46ABSzRhBKqcVZYfPzjMPwhT/lz9fPalWaPkrM 6AAyrEi0rFHVpnHCT2c44OvsRWqFas4drcqqWvUvDIdtBwfv7eYNQY/e9Y7k06nllKj3 uU9/0ef5F4qb4GD+Udry+S0eWh6mQsWGr0SxDkWpggG65kseZUO0YNrwhfyeQad82RrR MseQ== MIME-Version: 1.0 X-Received: by 10.140.82.50 with SMTP id g47mr40338973qgd.99.1390361096246; Tue, 21 Jan 2014 19:24:56 -0800 (PST) Received: by 10.96.86.199 with HTTP; Tue, 21 Jan 2014 19:24:55 -0800 (PST) Received: by 10.96.86.199 with HTTP; Tue, 21 Jan 2014 19:24:55 -0800 (PST) In-Reply-To: References: Date: Wed, 22 Jan 2014 03:24:55 +0000 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Matt Donovan To: Takuya ASADA Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 03:24:57 -0000 Hello On Jan 21, 2014 8:38 PM, "Takuya ASADA" wrote: > > Hmm, looks like neel@ adding ignoring unimplemented MSR access patch on > -CURRENT. > Does it means we can't use (some version of) Linux on 10.0-RELEASE? > > https://github.com/freebsd/freebsd/commit/5dab6f9ed3816204ff73fd075abfaba1ed5c7673 > > > 2014/1/22 Takuya ASADA > > > Hi, > > > > I want to know which Linux distribution is supported on BHyVe > > (+grub2-bhyve) in 10.0-RELEASE. > > I tried to these distributions, but I haven't succeeded to install any > > choice. > > On these tests, I used modified vmrun.sh script for all test, source code > > is here: > > https://gist.github.com/syuu1228/8552418 > > > > * Fedora 20 > > Fedora 20 has disk image for VM, I just tried to boot it from the image: > > > > ./linuxrun.sh -d Fedora-x86_64-20-20131211.1-sda.raw fedora > > > > grub> linux (hd1,msdos1)/boot/vmlinuz-3.11.10-301.fc20.x86_64 > > grub> initrd (hd1,msdos1)/boot/initramfs-3.11.10-301.fc20.x86_64.img > > grub> boot > > > > but bhyve dies by unhandled rdmsr: > > [ 1.676041] device-mapper: uevent: version 1.0.3 > > [ 1.676556] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) > > initialised: dm-devel@redhat.com > > vm exit rdmsr 0xe8, cpu 0 > > > > * CentOS 6.5 > > Tried to install with following commands but no luck: > > > > ./linuxrun.sh centos > > > > grub> linux (hd0)/isolinux/vmlinuz > > grub> initrd (hd0)/isolinux/initrd.img > > grub> boot > > > > Got following error: > > > > NET: Registered protocol family 1 > > Trying to unpack rootfs image as initramfs... > > Freeing initrd memory: 32610k freed > > Unknown WRMSR code 391, val 2000000f, cpu 0 > > > > * Ubuntu 13.10 > > Almost boot-up but couldn't mount cdrom. > > > > ./linuxrun.sh -d ubuntu.img -I ubuntu-13.10-desktop-amd64.iso ubuntu > > > > grub> linux (hd0)/casper/vmlinuz.efi > > grub> initrd (hd0)/casper/initrd.lz > > grub> boot > > > > Got following error, maybe it can prevents by passing root= argument? > > > > [ 6.380384] Btrfs loaded > > Scanning for Btrfs filesystems > > done. > > mount: can't read '/etc/fstab': No such file or directory > > Begin: Running /scripts/local-bottom ... done. > > done. > > Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev > > failed: No such file or directory > > done. > > mount: mounting /sys on /root/sys failed: No such file or directory > > mount: mounting /proc on /root/proc failed: No such file or directory > > Target filesystem doesn't have requested /sbin/init. > > No init found. Try passing init= bootarg. > > > > BusyBox v1.20.2 (Ubuntu 1:1.20.0-8.1ubuntu1) built-in shell (ash) > > Enter 'help' for a list of built-in commands. > > > > (initramfs) > > > > > > Any suggestions? > > > I have gotten Centos 6.5 to boot however I used the bhyve scripts which can be gotten at bhyve.org. haven't tried any other currently From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 03:31:42 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5BDEA3C3 for ; Wed, 22 Jan 2014 03:31:42 +0000 (UTC) Received: from mail-pd0-x234.google.com (mail-pd0-x234.google.com [IPv6:2607:f8b0:400e:c02::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 2DD7F177E for ; Wed, 22 Jan 2014 03:31:42 +0000 (UTC) Received: by mail-pd0-f180.google.com with SMTP id x10so7771102pdj.39 for ; Tue, 21 Jan 2014 19:31:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=As7WE4fTFsuWKX7jFWZLzPnj0mLXMrmL96qImFeZbqg=; b=L35rd5JacVx5G6tnIgzDc8SO+EnBkDSMUyp9TG+m0LU66Ke9KZLVHdYoqi9p079wda OiBh7fRTLFeaZ7F+cgpwhFrY2jPTT/zRgWTIk14X7GKHuXAtwINZUleGF+R2i4f1dLfu F7149CEj5OiLsEXwmammBum/wRo5i5ZfZLK7ajQlWx7rQlNEmu4/+CxEcurv1+sxcoue mK9nDnvFb+NAGbYXHARxTtIZabWHsD8FxTYA5rW4b5qYAAKdekby6axAFaWjedlK7zja scyn2iAvn7pOqRO4IyDPIsDLTIErXhYGNZLpkCw4RbwkF2M073t+x98R0D05Wy/xuUr8 6Lgw== MIME-Version: 1.0 X-Received: by 10.66.179.143 with SMTP id dg15mr29007606pac.52.1390361501762; Tue, 21 Jan 2014 19:31:41 -0800 (PST) Received: by 10.68.155.38 with HTTP; Tue, 21 Jan 2014 19:31:41 -0800 (PST) In-Reply-To: References: Date: Tue, 21 Jan 2014 22:31:41 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: Matt Donovan Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 03:31:42 -0000 Since I have not personally looked into doing this I have no idea if the following idea will work or not (it is on my personal todo list for the next week or so though) and that is to create a new HyperV subclass in PetiteCloud for bhyve-grub (you should only need to override loadVm(...) and there only to put in a new loader name)... the above assumes that bhyve-grub is close enough to bhyveload to not need to much more and that once loaded normal bhyve is called On Tue, Jan 21, 2014 at 10:24 PM, Matt Donovan wrote: > Hello > On Jan 21, 2014 8:38 PM, "Takuya ASADA" wrote: > > > > Hmm, looks like neel@ adding ignoring unimplemented MSR access patch on > > -CURRENT. > > Does it means we can't use (some version of) Linux on 10.0-RELEASE? > > > > > > https://github.com/freebsd/freebsd/commit/5dab6f9ed3816204ff73fd075abfaba1ed5c7673 > > > > > > 2014/1/22 Takuya ASADA > > > > > Hi, > > > > > > I want to know which Linux distribution is supported on BHyVe > > > (+grub2-bhyve) in 10.0-RELEASE. > > > I tried to these distributions, but I haven't succeeded to install any > > > choice. > > > On these tests, I used modified vmrun.sh script for all test, source > code > > > is here: > > > https://gist.github.com/syuu1228/8552418 > > > > > > * Fedora 20 > > > Fedora 20 has disk image for VM, I just tried to boot it from the > image: > > > > > > ./linuxrun.sh -d Fedora-x86_64-20-20131211.1-sda.raw fedora > > > > > > grub> linux (hd1,msdos1)/boot/vmlinuz-3.11.10-301.fc20.x86_64 > > > grub> initrd (hd1,msdos1)/boot/initramfs-3.11.10-301.fc20.x86_64.img > > > grub> boot > > > > > > but bhyve dies by unhandled rdmsr: > > > [ 1.676041] device-mapper: uevent: version 1.0.3 > > > [ 1.676556] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) > > > initialised: dm-devel@redhat.com > > > vm exit rdmsr 0xe8, cpu 0 > > > > > > * CentOS 6.5 > > > Tried to install with following commands but no luck: > > > > > > ./linuxrun.sh centos > > > > > > grub> linux (hd0)/isolinux/vmlinuz > > > grub> initrd (hd0)/isolinux/initrd.img > > > grub> boot > > > > > > Got following error: > > > > > > NET: Registered protocol family 1 > > > Trying to unpack rootfs image as initramfs... > > > Freeing initrd memory: 32610k freed > > > Unknown WRMSR code 391, val 2000000f, cpu 0 > > > > > > * Ubuntu 13.10 > > > Almost boot-up but couldn't mount cdrom. > > > > > > ./linuxrun.sh -d ubuntu.img -I ubuntu-13.10-desktop-amd64.iso ubuntu > > > > > > grub> linux (hd0)/casper/vmlinuz.efi > > > grub> initrd (hd0)/casper/initrd.lz > > > grub> boot > > > > > > Got following error, maybe it can prevents by passing root= argument? > > > > > > [ 6.380384] Btrfs loaded > > > Scanning for Btrfs filesystems > > > done. > > > mount: can't read '/etc/fstab': No such file or directory > > > Begin: Running /scripts/local-bottom ... done. > > > done. > > > Begin: Running /scripts/init-bottom ... mount: mounting /dev on > /root/dev > > > failed: No such file or directory > > > done. > > > mount: mounting /sys on /root/sys failed: No such file or directory > > > mount: mounting /proc on /root/proc failed: No such file or directory > > > Target filesystem doesn't have requested /sbin/init. > > > No init found. Try passing init= bootarg. > > > > > > BusyBox v1.20.2 (Ubuntu 1:1.20.0-8.1ubuntu1) built-in shell (ash) > > > Enter 'help' for a list of built-in commands. > > > > > > (initramfs) > > > > > > > > > Any suggestions? > > > > > > > I have gotten Centos 6.5 to boot however I used the bhyve scripts which can > be gotten at bhyve.org. haven't tried any other currently > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 03:55:41 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 33F7F692 for ; Wed, 22 Jan 2014 03:55:41 +0000 (UTC) Received: from mail-pb0-x229.google.com (mail-pb0-x229.google.com [IPv6:2607:f8b0:400e:c01::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id F1E9518EE for ; Wed, 22 Jan 2014 03:55:40 +0000 (UTC) Received: by mail-pb0-f41.google.com with SMTP id up15so8808588pbc.28 for ; Tue, 21 Jan 2014 19:55:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=OjrD5raaqsgSYK3JIZa5OvTRYct/sEq+/xdcaA9Jqw0=; b=eVQIxQ4tP8icXBXoMjKUGVEY0jeV9Sf5bJLD4dsOcTSr0T1j/9HgK+tCoKWsaifqDy voDwHttsoxXky8CIcTPyoHqL+lw117fXWty171YgMb8I7Aa5jqXpZtFbUehAh7UgGD8g 2aoIN0vyd2UnEY5Fz2O5vU+FNSKl4+t/Tgpkg= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=OjrD5raaqsgSYK3JIZa5OvTRYct/sEq+/xdcaA9Jqw0=; b=C0ukRus406EaNA1HPeL23jS9Ba0XojVMWFtZWS7LDD07NNJWlWCDK6vJA2IqmKYFXf NoWt2CZ8pdMD4Ea9An5uB0kD/P3+lT77qdEB7HLrNYs5BAyJlJ3yZ3aRExV1bS8VWtTt iVKRsPBmTggfhNGNlJCMClRIpCdNoGJovyUDduaM3tStqPzNaoK/esGKBtDxTweDFvyg aejJSmcpY6w7q480xReSbbRj6qNk7HcnCIejOqf/dIVOJufnG2wdqvvOIQgDAsxIllbg haumVBKX6em+EXj5L8PogeZtJdy+O8sv3VkAZjYol8oRd9oulqKjSl2xIfPtu0JLjF5R YezA== X-Gm-Message-State: ALoCoQkqRMzY9TZY+jOfV4vF4/GxWzKGDmXIQUK9nibgCxtdtcjtgMtqSExEuX+89deJx3zP3ygr X-Received: by 10.68.193.233 with SMTP id hr9mr29059304pbc.26.1390362939821; Tue, 21 Jan 2014 19:55:39 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 19:54:59 -0800 (PST) In-Reply-To: References: From: Takuya ASADA Date: Wed, 22 Jan 2014 12:54:59 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: Matt Donovan Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 03:55:41 -0000 Oh, I didn't know bhyve-script.tar is still on bhyve.org (I didn't notice there's "Tools" tab on the page). I'll try it. 2014/1/22 Matt Donovan > Hello > > On Jan 21, 2014 8:38 PM, "Takuya ASADA" wrote: > > > > Hmm, looks like neel@ adding ignoring unimplemented MSR access patch on > > -CURRENT. > > Does it means we can't use (some version of) Linux on 10.0-RELEASE? > > > > > https://github.com/freebsd/freebsd/commit/5dab6f9ed3816204ff73fd075abfaba1ed5c7673 > > > > > > 2014/1/22 Takuya ASADA > > > > > Hi, > > > > > > I want to know which Linux distribution is supported on BHyVe > > > (+grub2-bhyve) in 10.0-RELEASE. > > > I tried to these distributions, but I haven't succeeded to install any > > > choice. > > > On these tests, I used modified vmrun.sh script for all test, source > code > > > is here: > > > https://gist.github.com/syuu1228/8552418 > > > > > > * Fedora 20 > > > Fedora 20 has disk image for VM, I just tried to boot it from the > image: > > > > > > ./linuxrun.sh -d Fedora-x86_64-20-20131211.1-sda.raw fedora > > > > > > grub> linux (hd1,msdos1)/boot/vmlinuz-3.11.10-301.fc20.x86_64 > > > grub> initrd (hd1,msdos1)/boot/initramfs-3.11.10-301.fc20.x86_64.img > > > grub> boot > > > > > > but bhyve dies by unhandled rdmsr: > > > [ 1.676041] device-mapper: uevent: version 1.0.3 > > > [ 1.676556] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) > > > initialised: dm-devel@redhat.com > > > vm exit rdmsr 0xe8, cpu 0 > > > > > > * CentOS 6.5 > > > Tried to install with following commands but no luck: > > > > > > ./linuxrun.sh centos > > > > > > grub> linux (hd0)/isolinux/vmlinuz > > > grub> initrd (hd0)/isolinux/initrd.img > > > grub> boot > > > > > > Got following error: > > > > > > NET: Registered protocol family 1 > > > Trying to unpack rootfs image as initramfs... > > > Freeing initrd memory: 32610k freed > > > Unknown WRMSR code 391, val 2000000f, cpu 0 > > > > > > * Ubuntu 13.10 > > > Almost boot-up but couldn't mount cdrom. > > > > > > ./linuxrun.sh -d ubuntu.img -I ubuntu-13.10-desktop-amd64.iso ubuntu > > > > > > grub> linux (hd0)/casper/vmlinuz.efi > > > grub> initrd (hd0)/casper/initrd.lz > > > grub> boot > > > > > > Got following error, maybe it can prevents by passing root= argument? > > > > > > [ 6.380384] Btrfs loaded > > > Scanning for Btrfs filesystems > > > done. > > > mount: can't read '/etc/fstab': No such file or directory > > > Begin: Running /scripts/local-bottom ... done. > > > done. > > > Begin: Running /scripts/init-bottom ... mount: mounting /dev on > /root/dev > > > failed: No such file or directory > > > done. > > > mount: mounting /sys on /root/sys failed: No such file or directory > > > mount: mounting /proc on /root/proc failed: No such file or directory > > > Target filesystem doesn't have requested /sbin/init. > > > No init found. Try passing init= bootarg. > > > > > > BusyBox v1.20.2 (Ubuntu 1:1.20.0-8.1ubuntu1) built-in shell (ash) > > > Enter 'help' for a list of built-in commands. > > > > > > (initramfs) > > > > > > > > > Any suggestions? > > > > > > > I have gotten Centos 6.5 to boot however I used the bhyve scripts which > can be gotten at bhyve.org. haven't tried any other currently > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 05:12:45 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 666CE5CD for ; Wed, 22 Jan 2014 05:12:45 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 26F431E82 for ; Wed, 22 Jan 2014 05:12:44 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id D48C8122D8; Wed, 22 Jan 2014 15:12:42 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRH65236 (AUTH peterg@ptree32.com.au); Wed, 22 Jan 2014 15:12:40 +1000 Message-ID: <52DF533E.5090301@freebsd.org> Date: Tue, 21 Jan 2014 21:12:30 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: Takuya ASADA Subject: Re: Linux on BHyVe in 10.0-RELEASE References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 05:12:45 -0000 Hi Takuya, > * Ubuntu 13.10 > Almost boot-up but couldn't mount cdrom. That's a Linux issue - there isn't a virtio block driver in the installer's initrd so it can't be used as the backend for the ISO image. Use ahci-cd instead for the ISO. I've been able to boot Ubuntu 12.04/13.04/13.10/14.04b, but I've only used the server spin and not the desktop. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 05:21:02 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 99DBC679 for ; Wed, 22 Jan 2014 05:21:02 +0000 (UTC) Received: from mail-pa0-x22f.google.com (mail-pa0-x22f.google.com [IPv6:2607:f8b0:400e:c03::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 671EE1EAA for ; Wed, 22 Jan 2014 05:21:02 +0000 (UTC) Received: by mail-pa0-f47.google.com with SMTP id kp14so9428168pab.20 for ; Tue, 21 Jan 2014 21:21:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=ikPwxEc7J7qjbO2+hisVqe9+D+cU4id7r4Y82SY1RtE=; b=je0KX1DcqsbcQqqQDrWwt8+NKA3vqjYBWD1Te+tlJGjnUVVJb/Qm7H0Wga6q3m/x54 5aL8/9om54DOmIdAc0a7Iqde9VLrnjr6H+4A/ayultyBvk0DbhBo2r6wTsFhGfjaofaW s25odvolT6KsumnLtZw2wkjNIPKQJH+81WPbI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=ikPwxEc7J7qjbO2+hisVqe9+D+cU4id7r4Y82SY1RtE=; b=ImgjwRgYW3clvX9KoziXwjmWvF6q2V/Tf7I5Iw6pQyf3G2h6opmY3Zwnag7v2SDMqb c+U2ShJTmIur13DUbUX5FzR+LzV7JHEH1NPs6wJ8Fjm/JLVSgFM9prbJT9l2eYtZyEV5 9kbWqmnDeBeoqxqhl8aIKdz8Akm2N+y4rC9FDBFL7YItEKIse+2CI3SBDGZcUBPddRIL tkJs98ojuoqGclYYZc+Y210UkYk8ifkAqt62rrLV6Oy8KIzTuwF9QzgKZf1b23KDdIi3 L+6ldI2nv3L5Nf4/HoCbMRcMLRin3X4KkUdENpCfm17H1mrW3Go8Ber8Hy2Oqx/tEbe6 MipQ== X-Gm-Message-State: ALoCoQm9PkjDc3HDbzuGVBObRKiJ+ZhGGDuF4uj3tudFEhN9LeqDqcsn1Qi46H9KqBzhDPEplDn2 X-Received: by 10.68.37.42 with SMTP id v10mr29058920pbj.127.1390368061786; Tue, 21 Jan 2014 21:21:01 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 21:20:21 -0800 (PST) In-Reply-To: References: From: Takuya ASADA Date: Wed, 22 Jan 2014 14:20:21 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: Matt Donovan Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 05:21:02 -0000 Looks like CentOS 6.5 with bhyve-script fails on same place: Unknown WRMSR code 391, val 2000000f, cpu 0 Did you succeeded with 10.0-RELEASE? not -CURRENT? 2014/1/22 Matt Donovan > > I have gotten Centos 6.5 to boot however I used the bhyve scripts which > can be gotten at bhyve.org. haven't tried any other currently > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 05:29:41 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EBA8C782 for ; Wed, 22 Jan 2014 05:29:41 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id A83331F40 for ; Wed, 22 Jan 2014 05:29:41 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 05C4712235; Wed, 22 Jan 2014 15:29:40 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRH66377 (AUTH peterg@ptree32.com.au); Wed, 22 Jan 2014 15:29:39 +1000 Message-ID: <52DF5741.2090203@freebsd.org> Date: Tue, 21 Jan 2014 21:29:37 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: Takuya ASADA Subject: Re: Linux on BHyVe in 10.0-RELEASE References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 05:29:42 -0000 On 1/21/14 9:20 PM, Takuya ASADA wrote: > Looks like CentOS 6.5 with bhyve-script fails on same place: > Unknown WRMSR code 391, val 2000000f, cpu 0 > > Did you succeeded with 10.0-RELEASE? not -CURRENT? The MSR access is dependent on the host CPU model, and doesn't show up on desktop variants. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 05:38:59 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B3B39850 for ; Wed, 22 Jan 2014 05:38:59 +0000 (UTC) Received: from mail-pb0-x236.google.com (mail-pb0-x236.google.com [IPv6:2607:f8b0:400e:c01::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 804801FCE for ; Wed, 22 Jan 2014 05:38:59 +0000 (UTC) Received: by mail-pb0-f54.google.com with SMTP id uo5so5735314pbc.41 for ; Tue, 21 Jan 2014 21:38:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=mRZgqD1ATFQZLXznbZZ4Nt9gyeGRO4XS2tYntxphmyk=; b=xNOlylRDWQHINjGPVGjybCc3kvXYgqXHzbUQnDS9qLAdNQZ5qelCfP1LkbllqtYMUu rVq8iv5sULS9EH+QqQgkFxmJrTRcyqgCvLuOeo29TsTbIjaufRGJ7wQAwaF78njK+dBB QU/056Nm8VN2/I5hSjcL/GhSizjr77oTwsvxo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=mRZgqD1ATFQZLXznbZZ4Nt9gyeGRO4XS2tYntxphmyk=; b=iVKWOTA6Pmk9MyjOqguy1z6eDr6DSoyWJBtgEmRJRuTKCRAeBuzXtQnOtzpJSuN7v+ E1Ht/VMlKRApQ40zUInEYWDQstd152WLBJNXC2fTxePDffZnnZ5M2sfKZY4yc0TnDwOz SU4V0T6FTB5RK45edlj1eBx4uEqEP4h8RFlGk3PwdD7HEOzw8bWluCcK0x+iyiojOn/0 9sq73R/i9cPsNWwCs7nb84mTPnfEn08PnD140lJ5stN4xpAwD3DiKrmiH2jTsNwunaQ8 t07AMspLYStKFrcrwvYx0Q0Uh7VAMkOPSqkd400FynX5AZmWTog5ZdVEaPF1+QJxe6j5 oOFA== X-Gm-Message-State: ALoCoQlk2mYhL8JGTeralB3jigOPjxcp+ebgfkgDuA/zLUGEU3lXh6y4MfcQyMD0WnLQQDQUMsBS X-Received: by 10.68.193.233 with SMTP id hr9mr29490813pbc.26.1390369139156; Tue, 21 Jan 2014 21:38:59 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 21:38:19 -0800 (PST) In-Reply-To: <52DF5741.2090203@freebsd.org> References: <52DF5741.2090203@freebsd.org> From: Takuya ASADA Date: Wed, 22 Jan 2014 14:38:19 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: Peter Grehan Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 05:38:59 -0000 2014/1/22 Peter Grehan > On 1/21/14 9:20 PM, Takuya ASADA wrote: > >> Looks like CentOS 6.5 with bhyve-script fails on same place: >> Unknown WRMSR code 391, val 2000000f, cpu 0 >> >> Did you succeeded with 10.0-RELEASE? not -CURRENT? >> > > The MSR access is dependent on the host CPU model, and doesn't show up on > desktop variants. > Ah okay, so this is HW dependent issue, not happen all models. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 05:41:02 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4F2B891D for ; Wed, 22 Jan 2014 05:41:02 +0000 (UTC) Received: from mail-pd0-x233.google.com (mail-pd0-x233.google.com [IPv6:2607:f8b0:400e:c02::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1C604106A for ; Wed, 22 Jan 2014 05:41:02 +0000 (UTC) Received: by mail-pd0-f179.google.com with SMTP id q10so7091900pdj.24 for ; Tue, 21 Jan 2014 21:41:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=asBKg1b7kPHYg6ARO2VWpW4bCt23NI2DggHiIm58GEY=; b=mJ9eERESJbK/CD+YKAWWHVOMDm0KnArgzYT9ffZPMBB7uaMtLr4fftdEKxwTqB2iWd br6WI+lCvVYRhxays3dHtVpZFLHRuGSyKbHFzO3BnNhAhoC/JjV7gA2Fc3RCbtniOBoD iuG+2r/FKpkExdKbKAA9HueLKq1IJ+91FME7Q= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=asBKg1b7kPHYg6ARO2VWpW4bCt23NI2DggHiIm58GEY=; b=KxR4LBEj5zfds43bzEe/HPXWw8rGzl9H8r8I3aHCdpJZ+qLolDUcor/6SEGL1ruVg7 LjONcwue4YRdEFInyvoo6Q9qlbULZY5ns+0k+wcO1G1QtOQzA2Lldyi8mlerWuOx09rA IerEkC1MHuJKQ/jPmSe21998b5ImdtAO6jatv1Dtf8PBO5eUMg8CsZIWQspNZOmwpDUz ZgDj0GAoB7HU3YglDpgGaIxrWYb7OxVHuBxBNqBl4O3VGKShYUlFvHj/99clVRp69SyF pUAF7+rqouyZnUYiSID+xS4TMnfTJ3TLQwx8/Oolr3o6mX2MZtQkCsl5B//yDoIGkePd hfdg== X-Gm-Message-State: ALoCoQlR8UzIVMHTnen7y/nckDeRL42xzcqcz4fLi9eBP87OGU15MjIWrLmz7Z4h1YiZyNU5eqRG X-Received: by 10.67.4.169 with SMTP id cf9mr29205790pad.45.1390369261791; Tue, 21 Jan 2014 21:41:01 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 21:40:21 -0800 (PST) In-Reply-To: References: From: Takuya ASADA Date: Wed, 22 Jan 2014 14:40:21 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 05:41:02 -0000 Append results using bhyyve-scripts. * CentOS 6.5 with bhyve-scripts Dies at same place: Unknown WRMSR code 391, val 2000000f, cpu 0 * Ubuntu 13.10 with bhyve-scripts Dies at same place: (initramfs) Anyway I'll test with ahci-cd, which is point-outed by Peter. * Debian 7.3 with bhyve-scripts Able to install, bootup! But serial console sometimes outputs "AT+GCAP" or something, looks like AT command? Maybe I mis-configured Debian during installation? * OpenBSD 5.4 with bhyve-scripts Hangs at virtio0 initialization: scsibus0 at vioblk0: 2 targets sd0 at scsibus0 targ 0 lun 0: SCSI3 0/direct fixed sd0: 10240MB, 512 bytes/sector, 20971520 sectors virtio0: couldn't map interrupt So, only Debian had worked on my environment for now. 2014/1/22 Takuya ASADA > Hi, > > I want to know which Linux distribution is supported on BHyVe > (+grub2-bhyve) in 10.0-RELEASE. > I tried to these distributions, but I haven't succeeded to install any > choice. > On these tests, I used modified vmrun.sh script for all test, source code > is here: > https://gist.github.com/syuu1228/8552418 > > * Fedora 20 > Fedora 20 has disk image for VM, I just tried to boot it from the image: > > ./linuxrun.sh -d Fedora-x86_64-20-20131211.1-sda.raw fedora > > grub> linux (hd1,msdos1)/boot/vmlinuz-3.11.10-301.fc20.x86_64 > grub> initrd (hd1,msdos1)/boot/initramfs-3.11.10-301.fc20.x86_64.img > grub> boot > > but bhyve dies by unhandled rdmsr: > [ 1.676041] device-mapper: uevent: version 1.0.3 > [ 1.676556] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) > initialised: dm-devel@redhat.com > vm exit rdmsr 0xe8, cpu 0 > > * CentOS 6.5 > Tried to install with following commands but no luck: > > ./linuxrun.sh centos > > grub> linux (hd0)/isolinux/vmlinuz > grub> initrd (hd0)/isolinux/initrd.img > grub> boot > > Got following error: > > NET: Registered protocol family 1 > Trying to unpack rootfs image as initramfs... > Freeing initrd memory: 32610k freed > Unknown WRMSR code 391, val 2000000f, cpu 0 > > * Ubuntu 13.10 > Almost boot-up but couldn't mount cdrom. > > ./linuxrun.sh -d ubuntu.img -I ubuntu-13.10-desktop-amd64.iso ubuntu > > grub> linux (hd0)/casper/vmlinuz.efi > grub> initrd (hd0)/casper/initrd.lz > grub> boot > > Got following error, maybe it can prevents by passing root= argument? > > [ 6.380384] Btrfs loaded > Scanning for Btrfs filesystems > done. > mount: can't read '/etc/fstab': No such file or directory > Begin: Running /scripts/local-bottom ... done. > done. > Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev > failed: No such file or directory > done. > mount: mounting /sys on /root/sys failed: No such file or directory > mount: mounting /proc on /root/proc failed: No such file or directory > Target filesystem doesn't have requested /sbin/init. > No init found. Try passing init= bootarg. > > BusyBox v1.20.2 (Ubuntu 1:1.20.0-8.1ubuntu1) built-in shell (ash) > Enter 'help' for a list of built-in commands. > > (initramfs) > > > Any suggestions? > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 05:50:58 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9DF71B42 for ; Wed, 22 Jan 2014 05:50:58 +0000 (UTC) Received: from mail-pd0-x22e.google.com (mail-pd0-x22e.google.com [IPv6:2607:f8b0:400e:c02::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6CAAC1117 for ; Wed, 22 Jan 2014 05:50:58 +0000 (UTC) Received: by mail-pd0-f174.google.com with SMTP id z10so3947103pdj.33 for ; Tue, 21 Jan 2014 21:50:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=By4L+7pJEbxenDJLmNxIgudNBlKRcsb3AUuNPXZqVMQ=; b=IaI3imfTV5wTO8kFMS1/ZoYjcDxcn5Szn5fIVA+SHQEnmbuwsRg60uq/Rj0uTP7Hq9 DMFrMoQFdtD+I0OPr+aC87+0PQtPgS8sdGvhgQoWRhvlaPZrJ2EPCcXi1k5xBfBdAiXN OoiWvp5vN9f7xBvGkDsnUShycrwuxYcCW3W4M= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=By4L+7pJEbxenDJLmNxIgudNBlKRcsb3AUuNPXZqVMQ=; b=cmHdUe/CssjEkfyFVtGKqFb2I37nr0WzQgLaMaP4A/T13uFxFtNYxGcwl7DeN+7Vk6 w6bjKFxWkKxp6/+L05rVjxZRTDR03wvzplJnAlepUBU44ZQSEIl0KGlJoqhpGwsxlHMF 4EecTzPHuBAInGXE6IHemLdzCA0gtFBkiBOuqK7U790eb6ZEl2JIPFeshNKtz82/0FcU fej1odI5pydgBE/WkyjYoWA5by021BahfE9H9IsZQrXb3ZB8m4GQOw59Ym9LapB1Mh7v Vyn2h3SXVO4M8pOyw5T4P3HTh0XWixVDsyfHIVcrZDkUlNagHERabY4nV61qyz3wLE/K Q8OQ== X-Gm-Message-State: ALoCoQkBOuAihGvo6/XAGQMjwpEZYU+PngsP7aIXkOT2jbMa+OjOsNpF7Bzu+/O9ji0pp+FNxS6H X-Received: by 10.66.145.166 with SMTP id sv6mr29642600pab.31.1390369858060; Tue, 21 Jan 2014 21:50:58 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 21:50:17 -0800 (PST) In-Reply-To: References: From: Takuya ASADA Date: Wed, 22 Jan 2014 14:50:17 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 05:50:58 -0000 > > > * Ubuntu 13.10 with bhyve-scripts > Dies at same place: (initramfs) > Anyway I'll test with ahci-cd, which is point-outed by Peter. > > No this was wrong, bhyve-scripts already uses ahci-cd, I could install&boot Ubuntu 13.10 without problem. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 06:03:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1B076CBE for ; Wed, 22 Jan 2014 06:03:20 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id CE8D811C6 for ; Wed, 22 Jan 2014 06:03:19 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 46C9E12220; Wed, 22 Jan 2014 16:03:18 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRH68600 (AUTH peterg@ptree32.com.au); Wed, 22 Jan 2014 16:03:17 +1000 Message-ID: <52DF5F22.3060706@freebsd.org> Date: Tue, 21 Jan 2014 22:03:14 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: Takuya ASADA Subject: Re: Linux on BHyVe in 10.0-RELEASE References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 06:03:20 -0000 Hi Takuya, > * Debian 7.3 with bhyve-scripts > Able to install, bootup! > But serial console sometimes outputs "AT+GCAP" or something, looks like AT > command? > Maybe I mis-configured Debian during installation? I think I saw this but it eventually popped up a login prompt. Guessing it was attempting to detect if a modem was present. > * OpenBSD 5.4 with bhyve-scripts > Hangs at virtio0 initialization: > > scsibus0 at vioblk0: 2 targets > sd0 at scsibus0 targ 0 lun 0: SCSI3 0/direct fixed > sd0: 10240MB, 512 bytes/sector, 20971520 sectors > virtio0: couldn't map interrupt OpenBSD 5.4 doesn't have the change to use MSI interrupts for virtio devices (http://www.openbsd.org/cgi-bin/cvsweb/src/sys/dev/pci/virtio_pci.c 1.7) I built a 5.4/amd64 flashrd image with this change at http://people.freebsd.org/~grehan/flashimg.amd64-20131014.bz2 5.5 isn't displaying serial console output - I've yet to debug this; probably an issue with grub-bhyve. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 06:22:54 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 85D38F7D for ; Wed, 22 Jan 2014 06:22:54 +0000 (UTC) Received: from mail-pa0-x235.google.com (mail-pa0-x235.google.com [IPv6:2607:f8b0:400e:c03::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 54698130F for ; Wed, 22 Jan 2014 06:22:54 +0000 (UTC) Received: by mail-pa0-f53.google.com with SMTP id lj1so9456778pab.12 for ; Tue, 21 Jan 2014 22:22:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=BDu9l2yIDk0t1/5IFvSfabTOYZBp4b418RfPUf6wiW8=; b=FiEf0FEIZGMWqcH5Xejkpq0pS3KW94h7ixPpi7Sc4llzu9DIjmek3Aj3oyqr4jVBhO pZCMGo62WrmwcJwi0n0Ow2c9vcDV0kdIlZvmIG3gafYQT+b0IL/nHHxe7Fa3esIIzM0Z QJIsjSQ3FMfEhzloBUHnuvXocyiFVOUBky7dM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=BDu9l2yIDk0t1/5IFvSfabTOYZBp4b418RfPUf6wiW8=; b=EHPVPBwtL75yI3lz87mVELPlgZjTAFK4XLGXdoVG0Xxj4Z2QcFMZ0SLMdS1GRNyHph QYhkEE9fFLi/Gm44qpSuVzH39xLO1T7lJy50fk424Gw5hjwcs8+ucEjFzp8N4QfipHrN 514KubFw6rCSAm8CbAP3/FystTVIc3DibVQduxohJzJbMPzhAFUgXyvPDj37X8eUr9xz APtqpORXLqnWsO5Wj6/SN4LC5DTif6q/ybk3jRMtMXoFj+K4jSzlqinIcPjqZojIbKra Rbp97qFhqFv57kpVGJWQSz+TVVcX9t7Q2FQDSQHhJtpY2UbbbPZETaH1FaiPMO0Prruy nzcA== X-Gm-Message-State: ALoCoQnEEpzHG0ZWISIulMYyT/IXkJBTrwFvxNMh19sDf781MAKZvDGjzCmwzRRC4du1N6VAUMPG X-Received: by 10.68.195.4 with SMTP id ia4mr13998914pbc.142.1390371773699; Tue, 21 Jan 2014 22:22:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 22:22:13 -0800 (PST) In-Reply-To: References: From: Takuya ASADA Date: Wed, 22 Jan 2014 15:22:13 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 06:22:54 -0000 2014/1/22 Takuya ASADA > Append results using bhyyve-scripts. > > * CentOS 6.5 with bhyve-scripts > Dies at same place: Unknown WRMSR code 391, val 2000000f, cpu 0 > > This issue was resolved by back-porting -CURRENT patch: svn co svn://svn.freebsd.org/base/head cd head svn diff -r259634:r259635 > ~/msr.diff cd /usr/src patch -p0 < ~/msr.diff cd usr.sbin/bhyve make make install Then CentOS 6.5 worked on my machine without any problems. Since we modified source code maybe we should not call it "worked on 10.0-RELEASE", actually it's good for temporally workaround. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 06:23:59 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C6246FEC for ; Wed, 22 Jan 2014 06:23:59 +0000 (UTC) Received: from mail-pa0-x230.google.com (mail-pa0-x230.google.com [IPv6:2607:f8b0:400e:c03::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9400B1317 for ; Wed, 22 Jan 2014 06:23:59 +0000 (UTC) Received: by mail-pa0-f48.google.com with SMTP id kx10so7893722pab.7 for ; Tue, 21 Jan 2014 22:23:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=9Y0QqIP1E7WV+zIeWMaG7MgvLyP8Nuf7i5yNFU3MNHw=; b=v9SXyt8Z46H6ZKwqWee6a78A7T5V/9P7sLNtJjTG5gw4fdb9tjumPAzwJ9mddCR3Nr 8l97HW8KkC818SZKhj+9U9rieDYIxFh4kSRxRPOCoPWOj+gSwBadjhOxpE1VWeYDBrkf ZyAx6971vBaTEgOtZqTGImFnSvIgjtJRpC/IA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=9Y0QqIP1E7WV+zIeWMaG7MgvLyP8Nuf7i5yNFU3MNHw=; b=JRzwrgnnz8ZDMKAGnt5jScBNPc5Lmkqix8W45cyFmH9qQV8wNyhDTxRNOuJweGMEnA /o1iTBOWGlJQTpUx1vWN6HnEgpNq6xRXwx/FFlxwUBq7H+49t23Mf/JAhg1hIZQVJmPU 4skEVQF2/HRBMzYaP2VdduSJPt1pWJ547ug5hQZgTToW6sIvX9GlDNx2sE+OiAEq+4eq CoPPjQ/fojqrpJSvGMHlDrgOGgW3dURS5H1BfrdveBtHAQ4iyoSfudIi8t6RGnog62zA Ibdk/nWFBdKTY4v1YA7NQqCOvFPXVRO6kF/wiihKSr8uOIenM7B7katT1hLDX9ikCmYi t6bg== X-Gm-Message-State: ALoCoQkf+KHf+OB3ln4drfL1aAqa+mkk3l8QsOTTAK3/ruU78fzANKI+ALdWermSepUYLhgZLGcp X-Received: by 10.68.194.97 with SMTP id hv1mr13757766pbc.162.1390371838962; Tue, 21 Jan 2014 22:23:58 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.36.38 with HTTP; Tue, 21 Jan 2014 22:23:18 -0800 (PST) In-Reply-To: <52DF5F22.3060706@freebsd.org> References: <52DF5F22.3060706@freebsd.org> From: Takuya ASADA Date: Wed, 22 Jan 2014 15:23:18 +0900 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: Peter Grehan Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 06:23:59 -0000 Thanks, I'll test your image. 2014/1/22 Peter Grehan > Hi Takuya, > > > * Debian 7.3 with bhyve-scripts >> Able to install, bootup! >> But serial console sometimes outputs "AT+GCAP" or something, looks like AT >> command? >> Maybe I mis-configured Debian during installation? >> > > I think I saw this but it eventually popped up a login prompt. Guessing > it was attempting to detect if a modem was present. > > > * OpenBSD 5.4 with bhyve-scripts >> Hangs at virtio0 initialization: >> >> scsibus0 at vioblk0: 2 targets >> sd0 at scsibus0 targ 0 lun 0: SCSI3 0/direct >> fixed >> sd0: 10240MB, 512 bytes/sector, 20971520 sectors >> virtio0: couldn't map interrupt >> > > OpenBSD 5.4 doesn't have the change to use MSI interrupts for virtio > devices (http://www.openbsd.org/cgi-bin/cvsweb/src/sys/dev/pci/ > virtio_pci.c 1.7) > > I built a 5.4/amd64 flashrd image with this change at > http://people.freebsd.org/~grehan/flashimg.amd64-20131014.bz2 > > 5.5 isn't displaying serial console output - I've yet to debug this; > probably an issue with grub-bhyve. > > later, > > Peter. > > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 17:20:34 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7D9B2749 for ; Wed, 22 Jan 2014 17:20:34 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 50CEF1EB6 for ; Wed, 22 Jan 2014 17:20:34 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 3C777B93B; Wed, 22 Jan 2014 12:20:33 -0500 (EST) From: John Baldwin To: Aryeh Friedman Subject: Re: bhyve: reboot stops vm Date: Wed, 22 Jan 2014 12:19:22 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20130906; KDE/4.5.5; amd64; ; ) References: <52DDB1DC.5040908@FreeBSD.org> <201401211225.39942.jhb@freebsd.org> In-Reply-To: X-KMail-Markup: true MIME-Version: 1.0 Message-Id: <201401221219.22522.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 22 Jan 2014 12:20:33 -0500 (EST) Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 17:20:34 -0000 On Tuesday, January 21, 2014 4:48:38 pm Aryeh Friedman wrote: > > > > Yes, I use the vmrun.sh script which uses a loop to restart the VM when you > > reboot. > > > Ideally shouldn't the -H option be the default? That doesn't do what you think it does. That means when the guest does a 'hlt' instruction to idle, the processor signals a trap to the hypervisor and exits VMX mode. That has nothing to do with restarting on a virtual reboot. -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Wed Jan 22 22:15:49 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B3FFC8CC for ; Wed, 22 Jan 2014 22:15:49 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 8E3981975 for ; Wed, 22 Jan 2014 22:15:49 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id A1D8CB93B for ; Wed, 22 Jan 2014 17:15:45 -0500 (EST) From: John Baldwin To: virtualization@freebsd.org Subject: bhyve and legacy Date: Wed, 22 Jan 2014 17:15:42 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20130906; KDE/4.5.5; amd64; ; ) MIME-Version: 1.0 Content-Type: Text/Plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <201401221715.42164.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 22 Jan 2014 17:15:45 -0500 (EST) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jan 2014 22:15:49 -0000 Is there any interest in supporting more "legacy" setups via bhyve? In particular, I'd like to take a whack at improving the PCI INTx support, but that can involve several things such as possibly implementing 8259A support and a PCI interrupt router vs always assuming that we have APICs. If we do want to support a more legacy route, is there interest in supporting a BIOS interface in the VM? I know that one option is to go grab a BIOS ROM from something like qemu, but another option is to have the real-mode IDT vector to stub routines in a very small ROM that traps to the hypervisor to implement BIOS requests. OTOH, that may turn out to be rather messy. Finally, I noticed a comment fly by about removing the need for bhyveload. One thing I have found useful recently is passing -H to bhyveload. Specifically, I can build a test kernel outside of the VM on the host and access it via the host0 filesystem in bhyveload so I can easily test kernels in the VM while still using the host as my development environment. It would be nice to retain this ability in some fashion. -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 00:03:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C443AEAC for ; Thu, 23 Jan 2014 00:03:57 +0000 (UTC) Received: from mail.ijs.si (mail.ijs.si [IPv6:2001:1470:ff80::25]) by mx1.freebsd.org (Postfix) with ESMTP id 246ED12B8 for ; Thu, 23 Jan 2014 00:03:57 +0000 (UTC) Received: from amavis-proxy-ori.ijs.si (localhost [IPv6:::1]) by mail.ijs.si (Postfix) with ESMTP id 3f8kH00VfszGMbp for ; Thu, 23 Jan 2014 01:03:56 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ijs.si; h= user-agent:message-id:references:in-reply-to:organization :subject:subject:from:from:date:date:content-transfer-encoding :content-type:content-type:mime-version:received:received :received:received; s=jakla2; t=1390435433; x=1393027434; bh=YTH gZyOBPIFwmqUJWdL4C9xV/N7/SFdAcgrnmLofB8E=; b=LSdXVjxO0z2zCiE7EpE 1vOWaE2OX6JobQuD62EtlijKMuApDFN/e3AzUMcvcmK/w+2MQlDRb1i0iF+LoGrp WNwo3T+GK/KL4W70AfpeLQN2+BKGVydsZwgfwzK7wWUYbk31uvTQU5/pwe67X3q1 JzQ2aPI4yCsr1EdEnSV+DXrQ= X-Virus-Scanned: amavisd-new at ijs.si Received: from mail.ijs.si ([IPv6:::1]) by amavis-proxy-ori.ijs.si (mail.ijs.si [IPv6:::1]) (amavisd-new, port 10012) with ESMTP id xxFJWSgBRR7X for ; Thu, 23 Jan 2014 01:03:53 +0100 (CET) Received: from mildred.ijs.si (mailbox.ijs.si [IPv6:2001:1470:ff80::143:1]) by mail.ijs.si (Postfix) with ESMTP for ; Thu, 23 Jan 2014 01:03:53 +0100 (CET) Received: from neli.ijs.si (neli.ijs.si [193.2.4.95]) by mildred.ijs.si (Postfix) with ESMTP id E55B1B88 for ; Thu, 23 Jan 2014 01:03:53 +0100 (CET) Received: from sleepy.ijs.si ([2001:1470:ff80:e001::1:1]) by neli.ijs.si with HTTP (HTTP/1.1 POST); Thu, 23 Jan 2014 01:03:53 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 23 Jan 2014 01:03:53 +0100 From: Mark Martinec To: freebsd-virtualization@freebsd.org Subject: Re: emulators/petitecloud 0.2.1 available Organization: J. Stefan Institute In-Reply-To: References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Message-ID: X-Sender: Mark.Martinec+freebsd@ijs.si User-Agent: Roundcube Webmail/0.9.5 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 00:03:57 -0000 2014-01-20 Aryeh Friedman wrote: >>> > Fixed and posted new port files to petitecloud.org... >>> > side question - should I update the PR for the port or create a new one? >>> >>> Please update the existing one. >> >> Already done via GNATS Trying the patch from http://www.freebsd.org/cgi/query-pr.cgi?pr=185362 # make ===> License BSD accepted by the user ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by src-petitecloud-aryeh-0.2.1 for building ===> Extracting for src-petitecloud-aryeh-0.2.1 => SHA256 Checksum mismatch for src-petitecloud-aryeh-0.2.1.tar.gz. ===> Refetch for 1 more times files: src-petitecloud-aryeh-0.2.1.tar.gz ===> License BSD accepted by the user ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/sbin/pkg - found => src-petitecloud-aryeh-0.2.1.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch ftp://ftp.petitecloud.org/petitecloud/0.2.1/aryeh/src-petitecloud-aryeh-0.2.1.tar.gz fetch: ftp://ftp.petitecloud.org/petitecloud/0.2.1/aryeh/src-petitecloud-aryeh-0.2.1.tar.gz: size mismatch: expected 116983, actual 109364 After hacking the distfile to match the file on a ftp server: # make ===> License BSD accepted by the user ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by src-petitecloud-aryeh-0.2.1 for building ===> Extracting for src-petitecloud-aryeh-0.2.1 => SHA256 Checksum OK for src-petitecloud-aryeh-0.2.1.tar.gz. ===> Patching for src-petitecloud-aryeh-0.2.1 ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/bin/cook - found ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/openjdk7/bin/java - found ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/share/java/classes/thistest-aryeh-0.1.jar - not found ===> Verifying install for /usr/local/share/java/classes/thistest-aryeh-0.1.jar in /usr/ports/devel/thistest => No directory for /usr/local/share/java/classes/thistest-aryeh-0.1.jar. Skipping.. ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/apache-tomcat-7.0/bin/catalina.sh - found ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/bin/qemu-system-x86_64 - found ===> Configuring for src-petitecloud-aryeh-0.2.1 ===> Building for src-petitecloud-aryeh-0.2.1 --- all --- All work done in install # make install ===> Staging for src-petitecloud-aryeh-0.2.1 ===> Generating temporary packing list ===> Creating users and/or groups. All work done in install cook -nl -s -b src/build/cook/Howto.cook project=o-petitecloud change=26 cook-blank/deploy-local installdir=../stage//usr/local inrelease=true user=aryeh sudo=""; Creating scrap/tmp/keystore Making /vms/cds Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/org/petitecloud/runtime/os/OSCommandParser.java for release Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/test/org/petitecloud/runtime/os/TestOSCommandParser.java for release [...] Preparing scrap/src-petitecloud-aryeh-0.2.1/src/build/aegis/aegis.conf for release Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/org/petitecloud/io/PetiteCloudIOException.java for release Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/org/petitecloud/io/ByteArrayInput.java for release Compiling all java classes for Java 7 warning: [path] bad path element "/usr/local/share/java/classes/thistest-aryeh-0.1.jar": no such file or directory src/java/test/TestMain.java:4: error: package thistest.core does not exist import thistest.core.*; ^ src/java/test/TestMain.java:42: error: cannot find symbol private Result result; ^ symbol: class Result location: class TestMain src/java/test/org/petitecloud/ui/TestAll.java:6: error: package thistest.core does not exist import thistest.core.*; [... followed by lots of these "package thistest.core does not exist" further on ...] Mark From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 00:09:38 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 56CC2230 for ; Thu, 23 Jan 2014 00:09:38 +0000 (UTC) Received: from mail-pa0-x22c.google.com (mail-pa0-x22c.google.com [IPv6:2607:f8b0:400e:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 21F3312FA for ; Thu, 23 Jan 2014 00:09:38 +0000 (UTC) Received: by mail-pa0-f44.google.com with SMTP id kq14so1107492pab.3 for ; Wed, 22 Jan 2014 16:09:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=261O3VvNyWgA3mfCI/6jl9wJeiD9wHE0gtQ+O1iYJEg=; b=t3DA86evix2A0E0orTsnq1I8yoDDeg5E4Hu0cBG8rcyDfelJZVLe0fHDdDgWfjLY0X FgyVo/WJKq2Ki9QVW7yHZzsG4SJC+aCjkWRQ56flGvYHkAkBYPFNSsZd668GMahbCI/2 QtTaYm6hSkMeBXJ18O2AoCaPO7VkS11ZaohTT1uelxaHuk86+TELyUAVqgtfwn6Khb63 IJUgQP8J6iFc3UggvJ618ibXu30WoMn7CZpxK11HfFvms1fSMOg5bf22Exni1bmkgyo/ AiBYmHrDjJckON88xPjo5wIXuceEawG4/XTBqwLFNwQgPdEEuoAd0meYI5SiSRSNYxcV yBVA== MIME-Version: 1.0 X-Received: by 10.66.241.73 with SMTP id wg9mr4695129pac.69.1390435777685; Wed, 22 Jan 2014 16:09:37 -0800 (PST) Received: by 10.68.155.38 with HTTP; Wed, 22 Jan 2014 16:09:37 -0800 (PST) In-Reply-To: References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Date: Wed, 22 Jan 2014 19:09:37 -0500 Message-ID: Subject: Re: emulators/petitecloud 0.2.1 available From: Aryeh Friedman To: Mark Martinec Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 00:09:38 -0000 On Wed, Jan 22, 2014 at 7:03 PM, Mark Martinec wrote: > 2014-01-20 Aryeh Friedman wrote: > >> > Fixed and posted new port files to petitecloud.org... >>>> > side question - should I update the PR for the port or create a new >>>> one? >>>> >>>> >>>> Please update the existing one. >>>> >>> >>> Already done via GNATS >>> >> > > Trying the patch from http://www.freebsd.org/cgi/query-pr.cgi?pr=185362 > > > # make > ===> License BSD accepted by the user > ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/sbin/pkg - > found > ===> Fetching all distfiles required by src-petitecloud-aryeh-0.2.1 for > building > ===> Extracting for src-petitecloud-aryeh-0.2.1 > => SHA256 Checksum mismatch for src-petitecloud-aryeh-0.2.1.tar.gz. > ===> Refetch for 1 more times files: src-petitecloud-aryeh-0.2.1.tar.gz > ===> License BSD accepted by the user > ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/sbin/pkg - > found > => src-petitecloud-aryeh-0.2.1.tar.gz doesn't seem to exist in > /usr/ports/distfiles/. > => Attempting to fetch ftp://ftp.petitecloud.org/ > petitecloud/0.2.1/aryeh/src-petitecloud-aryeh-0.2.1.tar.gz > fetch: ftp://ftp.petitecloud.org/petitecloud/0.2.1/aryeh/src- > petitecloud-aryeh-0.2.1.tar.gz: size mismatch: expected 116983, actual > 109364 > We had a build system bug that did this (updated the release files even when no release was made) it is now solved I will be posting the right dist-info with the patch fixing the below > > > After hacking the distfile to match the file on a ftp server: > > # make > ===> License BSD accepted by the user > ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/sbin/pkg - > found > ===> Fetching all distfiles required by src-petitecloud-aryeh-0.2.1 for > building > ===> Extracting for src-petitecloud-aryeh-0.2.1 > => SHA256 Checksum OK for src-petitecloud-aryeh-0.2.1.tar.gz. > ===> Patching for src-petitecloud-aryeh-0.2.1 > ===> src-petitecloud-aryeh-0.2.1 depends on file: /usr/local/bin/cook - > found > ===> src-petitecloud-aryeh-0.2.1 depends on file: > /usr/local/openjdk7/bin/java - found > ===> src-petitecloud-aryeh-0.2.1 depends on file: > /usr/local/share/java/classes/thistest-aryeh-0.1.jar - not found > ===> Verifying install for /usr/local/share/java/classes/thistest-aryeh-0.1.jar > in /usr/ports/devel/thistest > => No directory for /usr/local/share/java/classes/thistest-aryeh-0.1.jar. > Skipping.. > ===> src-petitecloud-aryeh-0.2.1 depends on file: > /usr/local/apache-tomcat-7.0/bin/catalina.sh - found > ===> src-petitecloud-aryeh-0.2.1 depends on file: > /usr/local/bin/qemu-system-x86_64 - found > ===> Configuring for src-petitecloud-aryeh-0.2.1 > ===> Building for src-petitecloud-aryeh-0.2.1 > --- all --- > All work done in install > > # make install > ===> Staging for src-petitecloud-aryeh-0.2.1 > ===> Generating temporary packing list > ===> Creating users and/or groups. > All work done in install > cook -nl -s -b src/build/cook/Howto.cook project=o-petitecloud change=26 > cook-blank/deploy-local installdir=../stage//usr/local inrelease=true > user=aryeh sudo=""; > Creating scrap/tmp/keystore > Making /vms/cds > Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/org/petitecloud/ > runtime/os/OSCommandParser.java for release > Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/test/org/ > petitecloud/runtime/os/TestOSCommandParser.java for release > [...] > Preparing scrap/src-petitecloud-aryeh-0.2.1/src/build/aegis/aegis.conf > for release > Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/org/petitecloud/io/PetiteCloudIOException.java > for release > Preparing scrap/src-petitecloud-aryeh-0.2.1/src/java/org/petitecloud/io/ByteArrayInput.java > for release > Compiling all java classes for Java 7 > warning: [path] bad path element "/usr/local/share/java/ > classes/thistest-aryeh-0.1.jar": no such file or directory > src/java/test/TestMain.java:4: error: package thistest.core does not exist > import thistest.core.*; > ^ > src/java/test/TestMain.java:42: error: cannot find symbol > private Result result; > ^ > symbol: class Result > location: class TestMain > src/java/test/org/petitecloud/ui/TestAll.java:6: error: package > thistest.core does not exist > import thistest.core.*; > [... followed by lots of these "package thistest.core does not exist" > further on ...] > > You need devel/thistest ( http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/185363)... I am planning on removing this depend in 0.2.2 or 0.2.3 depending on other things -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 01:16:53 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 38002DC7 for ; Thu, 23 Jan 2014 01:16:53 +0000 (UTC) Received: from mail-pa0-f52.google.com (mail-pa0-f52.google.com [209.85.220.52]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0A148191A for ; Thu, 23 Jan 2014 01:16:52 +0000 (UTC) Received: by mail-pa0-f52.google.com with SMTP id bj1so1169275pad.11 for ; Wed, 22 Jan 2014 17:16:46 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to; bh=gpKhbHumBj6iJnucSHvkOR2HTX0B0OMq0hTWv5imvXA=; b=LEaipaqzbV6Wjcs9S7AkguUlp7LW5bZcIO67xHytqB49fiKkB0fHWspkx2dP7BE1uS UVa5fdSqQMJGrMMIz2mSsqKN74HFKNPjbdEN3jF2Ng74CSGauqdiImobpOtoLJKEs59F ci7KZHHvKwxPutHtZ0/tq7OJKRrA3FkN3UgVVwHEk7+AFMwqeVl4+dfG9bHcDaagikXT pfXhB0nzIhO+JCMctINKNjvKOQZq5LY2UU23I8ddOCRbQZpW/8Vikyvul6nb+qk7CaZP 7l+41YVQNFDjOAZqpg9olwQvggYKciC73/kRXL1/A/xIshLNhIFu02rtxpLqXMw39k02 qMeA== X-Gm-Message-State: ALoCoQmZ/jfzkxGjTHQ2UkiWoSdfrKjb/dnFTBRLIXjhsGE/MaHo8/lBGMqCsWAe/HVxI6Vp11gY X-Received: by 10.66.243.103 with SMTP id wx7mr4838143pac.107.1390439806254; Wed, 22 Jan 2014 17:16:46 -0800 (PST) Received: from [172.16.172.183] (209-6-121-211.c3-0.arl-ubr1.sbo-arl.ma.cable.rcn.com. [209.6.121.211]) by mx.google.com with ESMTPSA id de3sm29088219pbb.33.2014.01.22.17.16.43 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 22 Jan 2014 17:16:45 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) Subject: Re: bhyve and legacy From: Tycho Nightingale In-Reply-To: <201401221715.42164.jhb@freebsd.org> Date: Wed, 22 Jan 2014 19:54:47 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <22CF9C41-3320-4E98-A475-A6372799024B@pluribusnetworks.com> References: <201401221715.42164.jhb@freebsd.org> To: John Baldwin X-Mailer: Apple Mail (2.1510) Cc: virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 01:16:53 -0000 Hi, Interest? Yes! Matter of fact, I have some scraps of 8259 support = lying around here if you are keen to have a starting point. Now with respect to bhyveload, while it certainly does have some = FreeBSD-specific uses, it is a bit of a barrier to supporting = non-FreeBSD guests and furthermore supporting them well e.g. reboot = without bhyve exiting. If 'true' support existed for booting from an = iso, then with a quick 'mkisofs' you could achieve the same kernel-to-VM = turnaround without bhyveload. Tycho On Jan 22, 2014, at 5:15 PM, John Baldwin wrote: > Is there any interest in supporting more "legacy" setups via bhyve? = In=20 > particular, I'd like to take a whack at improving the PCI INTx = support, but=20 > that can involve several things such as possibly implementing 8259A = support=20 > and a PCI interrupt router vs always assuming that we have APICs. If = we do=20 > want to support a more legacy route, is there interest in supporting a = BIOS=20 > interface in the VM? I know that one option is to go grab a BIOS ROM = from=20 > something like qemu, but another option is to have the real-mode IDT = vector to=20 > stub routines in a very small ROM that traps to the hypervisor to = implement=20 > BIOS requests. OTOH, that may turn out to be rather messy. >=20 > Finally, I noticed a comment fly by about removing the need for = bhyveload. =20 > One thing I have found useful recently is passing -H to bhyveload. =20 > Specifically, I can build a test kernel outside of the VM on the host = and=20 > access it via the host0 filesystem in bhyveload so I can easily test = kernels=20 > in the VM while still using the host as my development environment. = It would=20 > be nice to retain this ability in some fashion. >=20 > --=20 > John Baldwin > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 02:03:49 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A24CE467 for ; Thu, 23 Jan 2014 02:03:49 +0000 (UTC) Received: from mail.ijs.si (mail.ijs.si [IPv6:2001:1470:ff80::25]) by mx1.freebsd.org (Postfix) with ESMTP id 3055B1DEC for ; Thu, 23 Jan 2014 02:03:49 +0000 (UTC) Received: from amavis-proxy-ori.ijs.si (localhost [IPv6:::1]) by mail.ijs.si (Postfix) with ESMTP id 3f8mxJ1K7QzGMm4; Thu, 23 Jan 2014 03:03:48 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ijs.si; h= user-agent:message-id:references:in-reply-to:organization :subject:subject:from:from:date:date:content-transfer-encoding :content-type:content-type:mime-version:received:received :received:received; s=jakla2; t=1390442626; x=1393034627; bh=gXv qfJwTlLDVZdZ4Nx1/0XAvXZOXkKS9umJd6czKULY=; b=G4RBRQSKp4irGcB5yM5 uUlhjr3sEag9NBVDD4QaoWynzR43T48YqhCRH3N5Za0r0nEckVhJjK0FVCsiEvGt tkzNh0TxgNWRVPwqnm7COzYnkmuv0ugn2IhmsC5oJslMgzO4AFVn9LZJE4P21i54 VJDKk/SySSIXuz5WIEVvD8M8= X-Virus-Scanned: amavisd-new at ijs.si Received: from mail.ijs.si ([IPv6:::1]) by amavis-proxy-ori.ijs.si (mail.ijs.si [IPv6:::1]) (amavisd-new, port 10012) with ESMTP id ggdYsJSEFjgl; Thu, 23 Jan 2014 03:03:46 +0100 (CET) Received: from mildred.ijs.si (mailbox.ijs.si [IPv6:2001:1470:ff80::143:1]) by mail.ijs.si (Postfix) with ESMTP; Thu, 23 Jan 2014 03:03:46 +0100 (CET) Received: from neli.ijs.si (neli.ijs.si [193.2.4.95]) by mildred.ijs.si (Postfix) with ESMTP id 517A1DAB; Thu, 23 Jan 2014 03:03:46 +0100 (CET) Received: from sleepy.ijs.si ([2001:1470:ff80:e001::1:1]) by neli.ijs.si with HTTP (HTTP/1.1 POST); Thu, 23 Jan 2014 03:03:46 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 23 Jan 2014 03:03:46 +0100 From: Mark Martinec To: Aryeh Friedman Subject: Re: emulators/petitecloud 0.2.1 available Organization: J. Stefan Institute In-Reply-To: References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Message-ID: X-Sender: Mark.Martinec+freebsd@ijs.si User-Agent: Roundcube Webmail/0.9.5 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 02:03:49 -0000 2014-01-23 01:09, Aryeh Friedman wrote: >> fetch: ftp://ftp.petitecloud.org/petitecloud/0.2.1/aryeh/src- >> petitecloud-aryeh-0.2.1.tar.gz: size mismatch: expected 116983, actual >> 109364 > > We had a build system bug that did this (updated the release files even > when no release was made) it is now solved I will be posting the right > dist-info with the patch fixing the below Thanks! >> ===> src-petitecloud-aryeh-0.2.1 depends on file: >> /usr/local/share/java/classes/thistest-aryeh-0.1.jar - not found >> ===> Verifying install for >> /usr/local/share/java/classes/thistest-aryeh-0.1.jar >> in /usr/ports/devel/thistest > You need devel/thistest ( > http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/185363) Thanks, got it now patched and installed, after some wrestling with an aryeh/aegis mismatch. Have the tomcat running now, but starting petitecloud has no effect (no new process, no error messages in syslog). Running the java command as seen in /usr/local/etc/rc.d/petitecloud.sh returns to prompt right away. I guess I need to adjust settings in /usr/local/etc/petitecloud/, too late tonight to play with it now. Btw, the '.sh' in /usr/local/etc/rc.d/petitecloud.sh name is unusual, all other start/stop scripts have no '.sh' in their name, and the 'service petitecloud start' complains that a service does not exist. > ... I am planning > on removing this depend in 0.2.2 or 0.2.3 depending on other things Good, thanks. Mark From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 02:48:21 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AC2E6F8D; Thu, 23 Jan 2014 02:48:21 +0000 (UTC) Received: from mail-qc0-x233.google.com (mail-qc0-x233.google.com [IPv6:2607:f8b0:400d:c01::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5C72F1123; Thu, 23 Jan 2014 02:48:21 +0000 (UTC) Received: by mail-qc0-f179.google.com with SMTP id e16so1727386qcx.38 for ; Wed, 22 Jan 2014 18:48:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=KYhd1uTJb1Xw6/0xvEz/byiLHkC0HhRheCZO5TmoE7c=; b=vd4s32mkwzDRmcpQApmYnphfpLSNBNE8YLkqkNvIiZAic3b598fL5SjnRTBYw0G3hN 5KjPjGcIC62FVSSsk/fRjEwpu/Q5+ITozwa2YL88BeD0G1hqmpRACUmiv9MBi+tkbLeh 9+FcoZd1EXe1tjGbtLpPb2c9LyDacrbbcnd9ufjKlTSvKkwE8dMWs0LcJDSqt3d3XsET XFPFlXUicXjvC30eWHkkZzk6djiAAqxZIRzT4swXGdlYFLwIHWtOL1R8qiK9/gEfZ/St 52G5ohtcGbS5w/ojEE8/8Dmuv4I4Dxu/DXS05fZVWVR5oK73n+tvlPn/0+o6mgU2sf6R Vssg== MIME-Version: 1.0 X-Received: by 10.224.97.7 with SMTP id j7mr7811729qan.81.1390445300523; Wed, 22 Jan 2014 18:48:20 -0800 (PST) Received: by 10.140.87.71 with HTTP; Wed, 22 Jan 2014 18:48:20 -0800 (PST) In-Reply-To: <201401221715.42164.jhb@freebsd.org> References: <201401221715.42164.jhb@freebsd.org> Date: Wed, 22 Jan 2014 18:48:20 -0800 Message-ID: Subject: Re: bhyve and legacy From: Neel Natu To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 02:48:21 -0000 Hi John, On Wed, Jan 22, 2014 at 2:15 PM, John Baldwin wrote: > Is there any interest in supporting more "legacy" setups via bhyve? In > particular, I'd like to take a whack at improving the PCI INTx support, but > that can involve several things such as possibly implementing 8259A support > and a PCI interrupt router vs always assuming that we have APICs. If we do I would love to see PCI INTx support so we can do legacy interrupts for the virtio device models. However, does that require going all the way back to 8259 style interrupts? It should work fine with IOAPIC, no? > want to support a more legacy route, is there interest in supporting a BIOS > interface in the VM? I know that one option is to go grab a BIOS ROM from > something like qemu, but another option is to have the real-mode IDT vector to > stub routines in a very small ROM that traps to the hypervisor to implement > BIOS requests. OTOH, that may turn out to be rather messy. > > Finally, I noticed a comment fly by about removing the need for bhyveload. > One thing I have found useful recently is passing -H to bhyveload. > Specifically, I can build a test kernel outside of the VM on the host and > access it via the host0 filesystem in bhyveload so I can easily test kernels > in the VM while still using the host as my development environment. It would > be nice to retain this ability in some fashion. > Yes, absolutely. best Neel > -- > John Baldwin > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 03:04:56 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D50C0662 for ; Thu, 23 Jan 2014 03:04:56 +0000 (UTC) Received: from mail-pa0-x22d.google.com (mail-pa0-x22d.google.com [IPv6:2607:f8b0:400e:c03::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id A04DB1301 for ; Thu, 23 Jan 2014 03:04:56 +0000 (UTC) Received: by mail-pa0-f45.google.com with SMTP id lf10so1257655pab.18 for ; Wed, 22 Jan 2014 19:04:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=QwjPnzzHS2fPmZDVAKgbYJsIJTN5v+u8o0Js3X+crCg=; b=tdHnFpBbQMiUSonWxY9mHH03QyQIvzwKipldeNp6UbZeSYzDVYSgV4jmX77V5CEt1g pGUGNle+S58NtuyBHac7uYto2CToNVJaA71VYJn3VhPt+UfvJPwqRgRp6EKdstjLEd9n fTBHHOLyF1TSCmSizL75H8TXRH/xMbzOzk3hrOJU8Sarr373zaqJVoqN9W/vBKsJS8je rt2D8RsVaIc8IfvPspaZjpPn1hgkb1XZsPZJBJfSU6zA9eNX4Zq66qnIsiZR9kFXxbyl p/oUaGB9q4ts78jyyL5uO8P0whK69LqeP79/gOquq+W2WlhQrD9r3K2PLOPy3kUW67HH Z9Uw== MIME-Version: 1.0 X-Received: by 10.66.241.73 with SMTP id wg9mr5447009pac.69.1390446296237; Wed, 22 Jan 2014 19:04:56 -0800 (PST) Received: by 10.68.155.38 with HTTP; Wed, 22 Jan 2014 19:04:56 -0800 (PST) In-Reply-To: References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Date: Wed, 22 Jan 2014 22:04:56 -0500 Message-ID: Subject: Re: emulators/petitecloud 0.2.1 available From: Aryeh Friedman To: Mark Martinec Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 03:04:57 -0000 On Wed, Jan 22, 2014 at 9:03 PM, Mark Martinec wrote: > 2014-01-23 01:09, Aryeh Friedman wrote: > > You need devel/thistest ( >> http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/185363) >> > > Thanks, got it now patched and installed, after some wrestling with > an aryeh/aegis mismatch. > > Have the tomcat running now, but starting petitecloud has no effect > (no new process, no error messages in syslog). Running the java command > as seen in /usr/local/etc/rc.d/petitecloud.sh returns to prompt right > away. > I guess I need to adjust settings in /usr/local/etc/petitecloud/, > too late tonight to play with it now. > This is correct behavior since there are no long lived processes all running the rc.d does is do some quick system wide inits needed to run vm's correctly (currently it loads vmm, if_tap and aio and also creates the bridge that vm's will be using). This is true for all PetiteCloud commands, namely they do whatever action they need to perform and then die (no long living processes if you don't count the hyperv's or tomcat). > Btw, the '.sh' in /usr/local/etc/rc.d/petitecloud.sh name is unusual, > all other start/stop scripts have no '.sh' in their name, and the > 'service petitecloud start' complains that a service does not exist. Again will get this in the next release (we are planning a set of refactorings to the build system in the next tertiary version or two). BTW if your interested in helping in this area contact me privately and I will help you get our development environment setup on an instance (probally just send you a clone of ours). PetiteCloud would benefit for example from improving it's support for non-bhyve [FB bootonly]/qemu hyperv's (we have other development priorities and thus are unlikely to widen this anytime soon to any great extent). We also have not as much time as we would like for documentation so writing something would also be helpful. -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 03:19:50 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C65B2BDE; Thu, 23 Jan 2014 03:19:50 +0000 (UTC) Received: from mail-pa0-x233.google.com (mail-pa0-x233.google.com [IPv6:2607:f8b0:400e:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 96C411481; Thu, 23 Jan 2014 03:19:50 +0000 (UTC) Received: by mail-pa0-f51.google.com with SMTP id ld10so1281151pab.38 for ; Wed, 22 Jan 2014 19:19:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=XJ2tjffsErAbd95fVl+hiF8mNizsH6+7Xz1QrtovEQw=; b=MFcNkQvBtgMbaH870JV8SUPakJsWgpTQiQFQxOw8uA5mzD7USQjELAaO+nr9jor80Y YjMkVV30ssb4F8FGrY9Wl6hkHoshubYyBMdPG+SxNjNlE/R+4+UyIfVhU5GAFtra+S2D BHkXce1Njvm+HiWxu0GED4zw0ZNP63qifcCujafgvItEz895udMfHn61PJHl2VU1LQhB hPOqssEvsTrOZDMCpjmytdjuBF2tIojAGMK5XNQDEVLdbzZ639n0MJW3g8HFY6uZ2U5n tdB3WckTTfiy+RP7RKZk3KQB8jp2pv+XkpRg5EUwtCk2hq1C6omg1r7ibkKMtM6TPhLA AUVg== MIME-Version: 1.0 X-Received: by 10.66.16.131 with SMTP id g3mr5439579pad.138.1390447189292; Wed, 22 Jan 2014 19:19:49 -0800 (PST) Received: by 10.68.155.38 with HTTP; Wed, 22 Jan 2014 19:19:49 -0800 (PST) In-Reply-To: <22CF9C41-3320-4E98-A475-A6372799024B@pluribusnetworks.com> References: <201401221715.42164.jhb@freebsd.org> <22CF9C41-3320-4E98-A475-A6372799024B@pluribusnetworks.com> Date: Wed, 22 Jan 2014 22:19:49 -0500 Message-ID: Subject: Re: bhyve and legacy From: Aryeh Friedman To: Tycho Nightingale Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 03:19:50 -0000 On Wed, Jan 22, 2014 at 7:54 PM, Tycho Nightingale < tycho.nightingale@pluribusnetworks.com> wrote: Now with respect to bhyveload, while it certainly does have some FreeBSD-specific uses, it is a bit of a barrier to supporting non-FreeBSD guests and furthermore supporting them well e.g. reboot without bhyve exiting. If 'true' support existed for booting from an iso, then with a quick 'mkisofs' you could achieve the same kernel-to-VM turnaround without bhyveload. We (the developers of PetiteCloud) fully agree. In general we feel that bhyve should follow the "wall socket" model, in that it should respond to hardware level state changes the same way a physical PC does. The most glaring shortfall here is bhyve should exit on halt(8) and restart the vm on reboot(8). Unified boot is a good step here since there is likely no way to handle this correctly in all OS's except with unified boot. My suggestion would be: when in doubt on semantics, the QEMU model and/or the wall socket model should be followed. At the present time, PetiteCloud deals with non-FreeBSD guests as follows: All our instance images are raw format and thus will work on any hypervisor (for example I tested QEMU with several instances I made with bhyve). One of the main problems we face in interface design is making sure that you cannot run a non-working instance on the host (e.g. Linux on stock 10-RELEASE bhyve). Keep in mind one of our goals is to make the WebUI so that it is "physically impossible" to enter invalid values (the only place this is currently possible is the instance name and we have a fix for this coming out soon). We are planning to take advantage (and encourage people to play around with the same idea) of using PetiteCloud to either make a starter script you can use for booting (if it is non-standard) instances at host boot time or some other means of the fact we support nothing but raw format by perhaps doing some postprocessing after the install but the first boot. If done right this can lead to some very interesting custom instances that may or may not be distributable depending on what the instance depends on. We have made a start with this with our xAMP image on down2earthcloud.com and in the next day or so expand this with Linux (we are looking at LAMP and DevStack as the two of the first candidates) instead of just FreeBSD images. Another small request to the bhyve developers: making it so bhyve can be run nested would greatly speed the development of PetiteCloud, and we suspect several other projects too. -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 03:30:10 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 15EBE558 for ; Thu, 23 Jan 2014 03:30:10 +0000 (UTC) Received: from mail-pa0-x22c.google.com (mail-pa0-x22c.google.com [IPv6:2607:f8b0:400e:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D4D981598 for ; Thu, 23 Jan 2014 03:30:09 +0000 (UTC) Received: by mail-pa0-f44.google.com with SMTP id kq14so1281971pab.17 for ; Wed, 22 Jan 2014 19:30:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=1ZgUQVwQdUOzkvFGaRrZzZViFuX9r3HABHqKDXXW6mM=; b=jhkwppwfOlGIihtZCcU90UqMCCSTiJogfCSqbTosoxA7+VZ43N0s2woDlnLbgJAklw kpYY1kDiffP2kwak/6Opa30HoBsvdzXPeZ+ko4kPIVBiS1VUmIZK2iO5oOKB1WF4z2/S CaVV7+MsHlbCOWrOrYhUGntua/HFN6i7x22EhTePkGMiJhoos3bgjbAPxhU8xGtqT4Uv +mRn0SuoqVqjqwoph5nzUdtpFDTkHvs5iPXx+fScNcKQkaXewWhc95/vTbyI0JdEaRSt Bt4/62/gxKG1kNmVILakHOOFCS2dskEt7r6ze5ejcqieSGwpNrnOsOA+MC89kZl7+ESx h4xQ== MIME-Version: 1.0 X-Received: by 10.68.43.101 with SMTP id v5mr5463119pbl.149.1390447809372; Wed, 22 Jan 2014 19:30:09 -0800 (PST) Received: by 10.68.155.38 with HTTP; Wed, 22 Jan 2014 19:30:09 -0800 (PST) In-Reply-To: References: <201401171615.51057.Mark.Martinec+freebsd@ijs.si> <275866C0-E379-48BE-BAAD-BF87A307A64E@tamu.edu> <20140119214136.GR86491@e-new.0x20.net> Date: Wed, 22 Jan 2014 22:30:09 -0500 Message-ID: Subject: Re: emulators/petitecloud 0.2.1 available From: Aryeh Friedman To: Mark Martinec Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 03:30:10 -0000 > This is correct behavior since there are no long lived processes all > running the rc.d does is do some quick system wide inits needed to run vm's > correctly (currently it loads vmm, if_tap and aio and also creates the > bridge that vm's will be using). This is true for all PetiteCloud > commands, namely they do whatever action they need to perform and then die > (no long living processes if you don't count the hyperv's or tomcat). > > Forgot to mention you will also need a cd image to install from that is kept in where ever your cdPrefix is (/vms/cds by default but settable in the settings screen or /usr/local/etc/petitecloud/settings.cfg) -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 03:40:22 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A5624841 for ; Thu, 23 Jan 2014 03:40:22 +0000 (UTC) Received: from mail-pb0-x22f.google.com (mail-pb0-x22f.google.com [IPv6:2607:f8b0:400e:c01::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 73C181656 for ; Thu, 23 Jan 2014 03:40:22 +0000 (UTC) Received: by mail-pb0-f47.google.com with SMTP id rp16so1279112pbb.6 for ; Wed, 22 Jan 2014 19:40:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=iPkdryXSJzl37Y6WItFeOCUbbW5cai6waYufCs08qAs=; b=p6d7qOaF9JLxRjwGP4knpLFmOCpFugVq744yluc8C1uaPr+nxdLSV8CgZiv7eO0sIC UJOSzC6t2dpIyVeymkgEPKYNyrjX+QvKybXBGj5Kj7boHa2JD26Wlwz+KTic8K51ksCm x9wSzTyyAmlqz3C5vjauXIds5DckQVPq8vLVB1pE17UFnxh88znbmWH2B9MWuVDc6kth Yg+Y76Ip6zUdH5ljR2ZN6BRfd9MbuqPKocdSeJJZQO1Ja8kqYgwvXm3eWoFfosSD+Id+ 6VeZilAQk5zuZ6L14L4cEO3Qqi8ATuc7uQUrW+1o5rngllSDX9tjsWSMKuoyjdJVWibo POkw== X-Received: by 10.66.253.33 with SMTP id zx1mr5645800pac.28.1390448422028; Wed, 22 Jan 2014 19:40:22 -0800 (PST) Received: from [10.0.1.3] (ip72-209-165-165.ks.ks.cox.net. [72.209.165.165]) by mx.google.com with ESMTPSA id sq7sm30312955pbc.19.2014.01.22.19.40.20 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 22 Jan 2014 19:40:21 -0800 (PST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) Subject: Re: kldload vmm partial lockup From: Joe Maloney In-Reply-To: Date: Wed, 22 Jan 2014 21:40:16 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: <22E3745A-7020-47D7-B4BF-A0FA0232FA6A@gmail.com> References: <9C504625-F183-455E-A0FD-F9A5EC5FA944@gmail.com> <52A1E4D3-9625-40B7-AF4A-2EAFBF3A7025@gmail.com> To: Neel Natu X-Mailer: Apple Mail (2.1827) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 03:40:22 -0000 Hey Neel, I compiled 11-CURRENT and it works now I can kldload vmm with no = problems. Thanks. Joe Maloney On Jan 21, 2014, at 9:01 PM, Neel Natu wrote: > Hi Joe, >=20 > On Tue, Jan 21, 2014 at 6:53 PM, Joe Maloney wrote: >> Neel, >> sorry it took me a day or two to get to test this. The patch = compiles >> cleanly however it fails now trying to build the vmm module. >>=20 >=20 > No worries. >=20 > I committed the patch as r260972: > http://svnweb.freebsd.org/base?view=3Drevision&revision=3D260972 >=20 > Could you get the latest HEAD and see how it works for you? >=20 > best > Neel >=20 > p.s. not sure why the patch is not compiling - perhaps ppt.h did not > get patched properly? >=20 >> Joe Maloney >>=20 >> /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:232:7: error: implicit >> declaration of function 'ppt_avail_devices' is invalid in C99 >> [-Werror,-Wimplicit-function-declaration] >> if (ppt_avail_devices() > 0) >> ^ >> /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:565:6: error: implicit >> declaration of function 'ppt_assigned_devices' is invalid in C99 >> [-Werror,-Wimplicit-function-declaration] >> if (ppt_assigned_devices(vm) =3D=3D 0) { >> ^ >> /usr/src/sys/modules/vmm/../../amd64/vmm/vmm.c:565:6: note: did you = mean >> 'ppt_assign_device'? >> if (ppt_assigned_devices(vm) =3D=3D 0) { >> ^~~~~~~~~~~~~~~~~~~~ >> ppt_assign_device >> /usr/src/sys/modules/vmm/../../amd64/vmm/io/ppt.h:46:5: note: >> 'ppt_assign_device' declared here >> int ppt_assign_device(struct vm *vm, int bus, int slot, int = func); >> ^ >> 2 errors generated. >> *** Error code 1 >>=20 >> Stop. >> make[4]: stopped in /usr/src/sys/modules/vmm >> *** Error code 1 >>=20 >> Stop. >> make[3]: stopped in /usr/src/sys/modules >> *** Error code 1 >>=20 >> Stop. >> make[2]: stopped in /usr/obj/usr/src/sys/GENERIC >> *** Error code 1 >>=20 >> Stop. >> make[1]: stopped in /usr/src >> *** Error code 1 >>=20 >> Stop. >> make: stopped in /usr/src >> root@jmhome-pc:/usr/src # >>=20 >> On Jan 19, 2014, at 8:43 PM, Neel Natu wrote: >>=20 >> Hi Joe, >>=20 >> On Sun, Jan 19, 2014 at 2:21 PM, Joe Maloney = wrote: >>=20 >> I=92ve been trying to get bhyve to work on a system with the = following specs: >>=20 >> FreeBSD 10.0 64 bit >> ASUS P6T Deluxe >> Intel i7 920 >>=20 >> According to what I=92ve researched my cpu should have the VT-D = extensions. >> However many users of this motherboard have complained about ASUS not >> properly supporting VT-D with Xen and something about a problem with = tables >> getting corrupt due to a problem with the bios. On the third link = below >> which is the Xen wiki it even states that this motherboard needs a = bios >> update which is not available to the public. >>=20 >> https://communities.intel.com/thread/28389 >>=20 >> = http://vip.asus.com/forum/view.aspx?id=3D20090402224408018&SLanguage=3Den-= us&board_id=3D1 >>=20 >> http://wiki.xen.org/wiki/VTd_HowTo >>=20 >> I am curious though if this would be what would be causing my problem = with >> bhyve? I suppose I am willing to just by a new motherboard if so. >>=20 >> I can run kldload vmm and I see a bunch of text fly by and then = something >> about uhci interrupt problem. As soon as that happens the messages = repeats >> my network drops and no keyboard input. However the message repeats = and it >> doesn=92t appear that the system has fully locked up otherwise. = However on >> another system that works I notice that kldload VMM does not show = this >> information it just loads the module. >>=20 >> Is there a way I can gather more logs somehow so that I can determine = what >> text is appearing before the uhci errors? Perhaps some kind of dump >> procedure? Or is there a way I can confirm that freebsd can properly = see >> and utilize the VT-D extensions. VirtualBox runs fine with the VT >> extensions enabled. I also made sure VirtualBox wasn=92t installed = or loaded >> before I tried bhyve. I=92ve tried to research for a week or two = before >> posting here. >>=20 >>=20 >> I have a patch to not initialize the iommu unless there are passthru >> devices explicitly configured for bhyve to use. >>=20 >> It is available here: >> http://people.freebsd.org/~neel/patches/bhyve_iommu_init.patch >>=20 >> Could you give it a spin and see if it helps with the ASUS system? >>=20 >> best >> Neel >>=20 >> Joe Maloney >>=20 >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to >> "freebsd-virtualization-unsubscribe@freebsd.org" >>=20 >>=20 From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 07:07:51 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CDD7FCF4 for ; Thu, 23 Jan 2014 07:07:51 +0000 (UTC) Received: from mail-vc0-x235.google.com (mail-vc0-x235.google.com [IPv6:2607:f8b0:400c:c03::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 8C993190C for ; Thu, 23 Jan 2014 07:07:51 +0000 (UTC) Received: by mail-vc0-f181.google.com with SMTP id ie18so835253vcb.12 for ; Wed, 22 Jan 2014 23:07:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=730etIXekO80nhLlLDmluigBcIllSRsGFbFzAhq5Vn8=; b=MWO2IGU+Nb1qWZMTXASEKOi+7Q2CvZVAqGiWf+jXovcOK6QwJ676oild1kgnrDhnyt NWnIkqoqKVG2m0xiKbgD2Gu8rO/4jOpRWWpYneBPNjmBL7JZphiw2NN8m/KNAkrdjkQl ZEVaSMHCcemE3C59rVb8oUVaSDkQEcutwdPETbToNRUcuQWM5gOefxh+kpXyBp45RHeC E0zx/ULAVUEhSmcs8tTLh7CD9SB4Y2gKJYUp91I5TsxbnbMpShyIKhHe8Yb6MnzDhQiR Xt5uQbBODNwJRoEhcuBIfmCd3vVsMTwxvRSWiftMaum8OgdDJs4uuIvBRgkNkEEj08k+ fxwA== MIME-Version: 1.0 X-Received: by 10.220.147.16 with SMTP id j16mr3664473vcv.28.1390460870667; Wed, 22 Jan 2014 23:07:50 -0800 (PST) Received: by 10.220.0.137 with HTTP; Wed, 22 Jan 2014 23:07:50 -0800 (PST) Date: Thu, 23 Jan 2014 08:07:50 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 07:07:51 -0000 Hi. I tried to create an ubunto13.10 image using the bhyve-script (from http://bhyve.org/bhyve-script.tar) without success. Copied vm0 to lin1 and changed VMOS to "linux" and VMOSVER to "ubuntu13.10". Then run: #sh lin1 iso Installation starts and everything looks good until it tries to install the grub boot loader. That last step fails. Exiting the installer and running: #sh lin1 start Gives a grub prompt. Any hints? Best Regards, Jonas From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 07:16:50 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 38605F24 for ; Thu, 23 Jan 2014 07:16:50 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id EBEFF19BC for ; Thu, 23 Jan 2014 07:16:49 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id CE19B12147; Thu, 23 Jan 2014 17:16:47 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRI30696 (AUTH peterg@ptree32.com.au); Thu, 23 Jan 2014 17:16:47 +1000 Message-ID: <52E0C1D4.9000304@freebsd.org> Date: Wed, 22 Jan 2014 23:16:36 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: =?ISO-8859-1?Q?Jonas_B=FClow?= Subject: Re: Linux on BHyVe in 10.0-RELEASE References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 07:16:50 -0000 Hi Jonas, > Installation starts and everything looks good until it tries to install the > grub boot loader. That last step fails. Exiting the installer and running: > #sh lin1 start > Gives a grub prompt. > > Any hints? Are you using a zvol for the guest disk image ? later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 07:26:44 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D37C85A2; Thu, 23 Jan 2014 07:26:44 +0000 (UTC) Received: from mail-ve0-x22e.google.com (mail-ve0-x22e.google.com [IPv6:2607:f8b0:400c:c01::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7DA8D1A8C; Thu, 23 Jan 2014 07:26:44 +0000 (UTC) Received: by mail-ve0-f174.google.com with SMTP id pa12so880850veb.33 for ; Wed, 22 Jan 2014 23:26:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CiKDukR0pyMoD4wIwCvzCnFI0jCeWwbhL/Gjct0l1Yw=; b=fwvu1MkPWzm0K5bYXnLQvwkN7DUIhhKFoQGBrFrc5QSekj9CvCVfwHFKBlvVCsBwKt mRnA8ZA6QiQFdfQ1KcUMl33aFTWhs5Pn1WhsYxUJzDaR0yF9iMz/kO+imXc5MAwxqpcT dBDsJ7YctNlWlDmQKoMLWmhhEF/6ih2QWqflAlIKTJYJhS2YB4g0sj5wvo3bj+IT89QA Qspx9ISg9AaAnr8rFTJhHQnsuVHhqsiXLeIM21FXsgEzXbB+q+IrdBLo9ekhzjjbTMal rx/QDLk1dsfo/pMuQ786FHkM7LQySmoAWvRLuq7MgqugcFpFbzxDyYLyrUH5/BQ/lfec z/0A== MIME-Version: 1.0 X-Received: by 10.58.161.78 with SMTP id xq14mr191496veb.51.1390462003595; Wed, 22 Jan 2014 23:26:43 -0800 (PST) Received: by 10.220.0.137 with HTTP; Wed, 22 Jan 2014 23:26:43 -0800 (PST) In-Reply-To: <52E0C1D4.9000304@freebsd.org> References: <52E0C1D4.9000304@freebsd.org> Date: Thu, 23 Jan 2014 08:26:43 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Peter Grehan Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 07:26:44 -0000 Yes, if "using zvol" is the same thing as using ZFS for the guest image. I tried setting DEVTYPE to "" with the same result. /J On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan wrote: > Hi Jonas, > > > Installation starts and everything looks good until it tries to install >> the >> grub boot loader. That last step fails. Exiting the installer and running: >> #sh lin1 start >> Gives a grub prompt. >> >> Any hints? >> > > Are you using a zvol for the guest disk image ? > > later, > > Peter. > > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 08:24:36 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A614D144 for ; Thu, 23 Jan 2014 08:24:36 +0000 (UTC) Received: from mail-ob0-f180.google.com (mail-ob0-f180.google.com [209.85.214.180]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 66258117A for ; Thu, 23 Jan 2014 08:24:35 +0000 (UTC) Received: by mail-ob0-f180.google.com with SMTP id wp4so1689933obc.39 for ; Thu, 23 Jan 2014 00:24:29 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=ONQdFmKPQcSV5kc0if6KFfLUi36KeJSaGb5mYudE4WA=; b=mV7cgkxwWMNadRIH3ab5rQieND7aYidtXBpq3DygqBl+nwSHZU5hNhlFUKPjkhWVXy KQ0Zkus3sBmwSTaxksgIQK0StB6VyxD2XRn15kwqnO9QQScLhjCFz3vpcUdvHRk3Mq13 74a0Ziw6NQ4vCzCkB8c8WU5Q6J6FgWU79eyu6ucfJHXjBVPZHR+L0XU7KiiEJ/3PyO0x DyAozerx8NucyY5gxyuq7UDzlFxYpn5Kn4MD46II64xXhnfSN24JHXxb8zo9rN5IatDE EetYvMSDkmzza8E0DRmxSRXxcWHEEfDj1xgBe4ngza8Ude4wjQQ4laSQz+RvjeXlf6mG 5kSQ== X-Gm-Message-State: ALoCoQk9eYBry79wbm04tgFiwDwQpVMDbmuV0tBcxqB01J4xGa+QARDLAshRrc2QAn8aEIxcEumW X-Received: by 10.60.65.5 with SMTP id t5mr4937455oes.19.1390465469505; Thu, 23 Jan 2014 00:24:29 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id n5sm54825772oer.5.2014.01.23.00.24.28 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 23 Jan 2014 00:24:29 -0800 (PST) Message-ID: <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 00:24:27 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: =?UTF-8?B?Sm9uYXMgQsO8bG93?= , Peter Grehan Subject: Re: Linux on BHyVe in 10.0-RELEASE References: <52E0C1D4.9000304@freebsd.org> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 08:24:36 -0000 Here's what I've found so far: vmrun.sh does not like zvols and I am hoping for: sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 It gets as far as: Writing partition tables [In Progress ] Initializing ada0p2 [ Failed ] I am trying to figure out why. What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/vm3 using the bhyve-script approach and then boot it as usual. I will include this in an rc version of "bhyve-script" that I hope to release shortly. It may not be worth adding the functionality to bhyve-script as it is EOL. Michael On 1/22/14 11:26 PM, Jonas Bülow wrote: > Yes, if "using zvol" is the same thing as using ZFS for the guest image. > > I tried setting DEVTYPE to "" with the same result. > > /J > > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan wrote: > >> Hi Jonas, >> >> >> Installation starts and everything looks good until it tries to install >>> the >>> grub boot loader. That last step fails. Exiting the installer and running: >>> #sh lin1 start >>> Gives a grub prompt. >>> >>> Any hints? >>> >> >> Are you using a zvol for the guest disk image ? >> >> later, >> >> Peter. >> >> > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 08:37:38 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 00D165A3; Thu, 23 Jan 2014 08:37:37 +0000 (UTC) Received: from mail-ve0-x22d.google.com (mail-ve0-x22d.google.com [IPv6:2607:f8b0:400c:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9C1111286; Thu, 23 Jan 2014 08:37:37 +0000 (UTC) Received: by mail-ve0-f173.google.com with SMTP id oz11so902546veb.4 for ; Thu, 23 Jan 2014 00:37:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=NhzBNJku2DMd3ZQDt05cyEEYjACP5lYZ5hc2dyGRpwM=; b=rgimfB+hnGay7ICEwsp/KwtumWnRMbGuZ8SE60OL9Fz972Q6P6V30cN+RjY8oSa4FD 6Bl+hwbwgUknl0uTQoCc9CuB9fNfRqUe3z2UBiBdpMhrompbcJJm6aA83OZ0dU2i48wD 7Yu+BZP+qAOzWUPvLwOD5vjRsDARYz8pgEBeSQ5YdMCXYfbRhTOpVG+zy8+bxSFWo1xx PCiXBkqdllZGR0ZnkF8OazSvQ1IFLQca4K7GBSr6SxfefiojmYg725rE+E3LPRJ4ufph o4lN56Xs1CAUauX67x6hrbkP6s+9dLB41n95+4NgwzOzWHsYXQY3T0iF3F0hFXj6G0+L hn9A== MIME-Version: 1.0 X-Received: by 10.220.1.131 with SMTP id 3mr3852053vcf.4.1390466256724; Thu, 23 Jan 2014 00:37:36 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 00:37:36 -0800 (PST) In-Reply-To: <52E0D1BB.2050807@callfortesting.org> References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 09:37:36 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Michael Dexter Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 08:37:38 -0000 So, the conclusion is that it's not possible to run Linux on bhyve running on 10.0-RELEASE ? /J On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter wrote: > > Here's what I've found so far: > > vmrun.sh does not like zvols and I am hoping for: > > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 > > It gets as far as: > > Writing partition tables [In Progress ] > Initializing ada0p2 [ Failed ] > > I am trying to figure out why. > > What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/vm3 > using the bhyve-script approach and then boot it as usual. > > I will include this in an rc version of "bhyve-script" that I hope to > release shortly. It may not be worth adding the functionality to > bhyve-script as it is EOL. > > Michael > > On 1/22/14 11:26 PM, Jonas B=FClow wrote: > > Yes, if "using zvol" is the same thing as using ZFS for the guest image= . > > > > I tried setting DEVTYPE to "" with the same result. > > > > /J > > > > > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan > wrote: > > > >> Hi Jonas, > >> > >> > >> Installation starts and everything looks good until it tries to insta= ll > >>> the > >>> grub boot loader. That last step fails. Exiting the installer and > running: > >>> #sh lin1 start > >>> Gives a grub prompt. > >>> > >>> Any hints? > >>> > >> > >> Are you using a zvol for the guest disk image ? > >> > >> later, > >> > >> Peter. > >> > >> > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 08:46:35 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8B8ABC06 for ; Thu, 23 Jan 2014 08:46:35 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 46D10133A for ; Thu, 23 Jan 2014 08:46:35 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id D1690122C4; Thu, 23 Jan 2014 18:46:32 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRI33414 (AUTH peterg@ptree32.com.au); Thu, 23 Jan 2014 18:46:29 +1000 Message-ID: <52E0D6E3.3060903@freebsd.org> Date: Thu, 23 Jan 2014 00:46:27 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: =?ISO-8859-1?Q?Jonas_B=FClow?= Subject: Re: Linux on BHyVe in 10.0-RELEASE References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 08:46:35 -0000 > So, the conclusion is that it's not possible to run Linux on bhyve > running on 10.0-RELEASE ? Not at all - there have been lots of reports of it working. It is known that there is a problem with using zvols for guest images, though this is related to GEOM and not specific to bhyve. We just need to narrow down what's causing the problem with your setup. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 08:46:51 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E8C05C46 for ; Thu, 23 Jan 2014 08:46:50 +0000 (UTC) Received: from mail-pa0-x232.google.com (mail-pa0-x232.google.com [IPv6:2607:f8b0:400e:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B8E5C133D for ; Thu, 23 Jan 2014 08:46:50 +0000 (UTC) Received: by mail-pa0-f50.google.com with SMTP id kp14so1592985pab.9 for ; Thu, 23 Jan 2014 00:46:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=6DlKsp1RT5WBJMNo8XECQYmJ/7ufMuUB3Lw8HWytyBA=; b=TlxYQd7LnZ9B7HRcK60UqJUzy8msqbnbHy7TTjYLkEA23VxyBdrRaDLde01WrTj0Fi 76I1+JGXpaTGbvpdHYlInTbv7rSce6yrx7wVLoQDdFigxv06GhD2lM+8LQqI4iZjD6oA Dv8qxYP66XIpzxmwwZyRoycFrgaKEEKbDEV5mQxDAkuYk1Q66C7e66S3RsUifyOjtTgn AbuBAT1dJtwOqaQ6pqu4jJBa+dQe0/fuTRzlZM8SivljRD7CtX27OfI0Nmn8mco+PcYp A20DkHZzrLuk3M0TlTdLJwH9cHPe+u/gPEsQZf3jRDJnNny9S/6UYOfaISg7NCXk8LbL 5k4A== MIME-Version: 1.0 X-Received: by 10.68.43.101 with SMTP id v5mr6800443pbl.149.1390466810383; Thu, 23 Jan 2014 00:46:50 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 00:46:50 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 03:46:50 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 08:46:51 -0000 I am currently playing with it but from the above I suspect the issue is attempting to use a zvol what happens if you go direct like for example /vms/pri/XXXX (sorry for using petitecloud notatoin but XXX being the location of the raw disk) it should work... I do know when I was playing with QEMU before comiting it to code in PetiteCloud the key to transporting instances back and forth between them was to keep everything as raw disk images.... my guess we some major hacking you could do it out of the box... the real answer though is getting kqemu or vbox working again.... me and Dee (personally and not as the petitecloud development team) would be willing to give $50 to anyone who can get kqemu running on 10 and/or show how to get vbox to work headless On Thu, Jan 23, 2014 at 3:37 AM, Jonas B=FClow wrot= e: > So, the conclusion is that it's not possible to run Linux on bhyve runnin= g > on 10.0-RELEASE ? > > > > /J > > > On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter > wrote: > > > > > Here's what I've found so far: > > > > vmrun.sh does not like zvols and I am hoping for: > > > > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 > > > > It gets as far as: > > > > Writing partition tables [In Progress ] > > Initializing ada0p2 [ Failed ] > > > > I am trying to figure out why. > > > > What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/vm= 3 > > using the bhyve-script approach and then boot it as usual. > > > > I will include this in an rc version of "bhyve-script" that I hope to > > release shortly. It may not be worth adding the functionality to > > bhyve-script as it is EOL. > > > > Michael > > > > On 1/22/14 11:26 PM, Jonas B=FClow wrote: > > > Yes, if "using zvol" is the same thing as using ZFS for the guest > image. > > > > > > I tried setting DEVTYPE to "" with the same result. > > > > > > /J > > > > > > > > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan > > wrote: > > > > > >> Hi Jonas, > > >> > > >> > > >> Installation starts and everything looks good until it tries to > install > > >>> the > > >>> grub boot loader. That last step fails. Exiting the installer and > > running: > > >>> #sh lin1 start > > >>> Gives a grub prompt. > > >>> > > >>> Any hints? > > >>> > > >> > > >> Are you using a zvol for the guest disk image ? > > >> > > >> later, > > >> > > >> Peter. > > >> > > >> > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > > > > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 08:56:15 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BC77DFA6; Thu, 23 Jan 2014 08:56:15 +0000 (UTC) Received: from mail-vb0-x230.google.com (mail-vb0-x230.google.com [IPv6:2607:f8b0:400c:c02::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 61E7A13E6; Thu, 23 Jan 2014 08:56:15 +0000 (UTC) Received: by mail-vb0-f48.google.com with SMTP id q16so866062vbe.21 for ; Thu, 23 Jan 2014 00:56:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=bk1xnsr9VDpvi3ErGPsaLpDs0/8AdAmWNCpQmGMSa1o=; b=LHGBXiwLRAyk+q55JUqz9YrFn1PAeayppvHGRj8mTbLaQGztx42Gcw5BtPdJOSSnnb 3RBvvsztreM8lZrFT0IFx6EaTeL6aHb0vQ67xI2bHL4rVNjH5w7/x8dp5iSmg1+kXt4y ajogcozWKL85riX6TH9ef2DwxfhAqndYB1YJIcaanZtZDj+h9PgRvZMaefmWMqbs5yqU SQj7EiB5ylTUbVOJZVyrRaLKChpZPZFIHbyxI1/2nBAkxLTe/09aHEuYlcnLVrnrLOVP 3N9s+QbcEAnP0Mc0LAL2mBie1bi8Vhyp5YMR5Fig/k+zr8wIbnnStwhsOR0T2alR6uZE +85g== MIME-Version: 1.0 X-Received: by 10.220.161.132 with SMTP id r4mr3841748vcx.29.1390467374461; Thu, 23 Jan 2014 00:56:14 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 00:56:14 -0800 (PST) In-Reply-To: <52E0D1BB.2050807@callfortesting.org> References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 09:56:14 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Michael Dexter Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 08:56:15 -0000 fwiw, I do not have any /dev/zvol in the host. I'm using a vanilla FreeBSD 10.0-Release install using ZFS. /J On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter wrote: > > Here's what I've found so far: > > vmrun.sh does not like zvols and I am hoping for: > > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 > > It gets as far as: > > Writing partition tables [In Progress ] > Initializing ada0p2 [ Failed ] > > I am trying to figure out why. > > What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/vm3 > using the bhyve-script approach and then boot it as usual. > > I will include this in an rc version of "bhyve-script" that I hope to > release shortly. It may not be worth adding the functionality to > bhyve-script as it is EOL. > > Michael > > On 1/22/14 11:26 PM, Jonas B=FClow wrote: > > Yes, if "using zvol" is the same thing as using ZFS for the guest image= . > > > > I tried setting DEVTYPE to "" with the same result. > > > > /J > > > > > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan > wrote: > > > >> Hi Jonas, > >> > >> > >> Installation starts and everything looks good until it tries to insta= ll > >>> the > >>> grub boot loader. That last step fails. Exiting the installer and > running: > >>> #sh lin1 start > >>> Gives a grub prompt. > >>> > >>> Any hints? > >>> > >> > >> Are you using a zvol for the guest disk image ? > >> > >> later, > >> > >> Peter. > >> > >> > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 08:58:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1FAD16C for ; Thu, 23 Jan 2014 08:58:20 +0000 (UTC) Received: from mail-pd0-x22c.google.com (mail-pd0-x22c.google.com [IPv6:2607:f8b0:400e:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E4E561438 for ; Thu, 23 Jan 2014 08:58:19 +0000 (UTC) Received: by mail-pd0-f172.google.com with SMTP id p10so1534762pdj.3 for ; Thu, 23 Jan 2014 00:58:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=iHxAW6EtE1qTzmsaRzHvLGI3m4+4VuNHUbb7PnvCfzA=; b=FPsPvXV9Poi6EcNCv46CYci70liqdYt51slrF7ViIPMu6RV3fSJ0WkIO56m7bXJf2d 8LSv1PnKQqy5drZ9w8XISHcKLvIo25iDI+PXCYp/3hhY5egMh+qycJ1x6vZQ1L0fbRAX Z4C8HntxIk4VJF4Fs24Dt+Teo8J3dAPw1R27exd7//DNOWzlRBG2pSD/f9TTAxDEav5R cOoVokUxwFW1atBQuYHcD6+PcuygNbBYGl2CcLuvc1U6v3LS0D5fAZG7HJJ1QBEJMqew lKbevfBMxqw3ny/gzetLwDOKEIXuKvYWrdpSjjM9t2G792HDXPKXfLKeeDaFfbqGBOxo 4tIw== MIME-Version: 1.0 X-Received: by 10.68.241.234 with SMTP id wl10mr6734192pbc.121.1390467499517; Thu, 23 Jan 2014 00:58:19 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 00:58:19 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 03:58:19 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 08:58:20 -0000 Does using the standard file backed bhye work? On Thu, Jan 23, 2014 at 3:56 AM, Jonas B=FClow wrot= e: > fwiw, I do not have any /dev/zvol in the host. I'm using a vanilla FreeBS= D > 10.0-Release install using ZFS. > > /J > > > On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter > wrote: > > > > > Here's what I've found so far: > > > > vmrun.sh does not like zvols and I am hoping for: > > > > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 > > > > It gets as far as: > > > > Writing partition tables [In Progress ] > > Initializing ada0p2 [ Failed ] > > > > I am trying to figure out why. > > > > What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/vm= 3 > > using the bhyve-script approach and then boot it as usual. > > > > I will include this in an rc version of "bhyve-script" that I hope to > > release shortly. It may not be worth adding the functionality to > > bhyve-script as it is EOL. > > > > Michael > > > > On 1/22/14 11:26 PM, Jonas B=FClow wrote: > > > Yes, if "using zvol" is the same thing as using ZFS for the guest > image. > > > > > > I tried setting DEVTYPE to "" with the same result. > > > > > > /J > > > > > > > > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan > > wrote: > > > > > >> Hi Jonas, > > >> > > >> > > >> Installation starts and everything looks good until it tries to > install > > >>> the > > >>> grub boot loader. That last step fails. Exiting the installer and > > running: > > >>> #sh lin1 start > > >>> Gives a grub prompt. > > >>> > > >>> Any hints? > > >>> > > >> > > >> Are you using a zvol for the guest disk image ? > > >> > > >> later, > > >> > > >> Peter. > > >> > > >> > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > > > > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 09:37:38 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7AB62C8D for ; Thu, 23 Jan 2014 09:37:38 +0000 (UTC) Received: from mail-vb0-x232.google.com (mail-vb0-x232.google.com [IPv6:2607:f8b0:400c:c02::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 306091796 for ; Thu, 23 Jan 2014 09:37:38 +0000 (UTC) Received: by mail-vb0-f50.google.com with SMTP id w8so914830vbj.9 for ; Thu, 23 Jan 2014 01:37:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=+d9KXYW8TzCh21+e5hjKZJJ5NDck9SkliV1nLBXhv+w=; b=P9tlz3bZgNgfCRuYQzUxSlQlTu6lp5rH1yX/zYBYYTHha8lAcFGPYr8uekc1hSjhJV O0ahuJ0bWj2BTjCRRQqCw5bRGV1YgWvgHT2LU6/0z0NYisEyMFbWPEbxpfou4xrzk5Up gQjAC5/mUJNIhfdBgVMI5AtWH2pMWrnbEwgUD1UMINafRx4pVYLqPaZfnYAGqKdEsmA3 y2L6NAmea5DF02K7sMShnW6xmW9WRiJcjmHr7lKcsbDQdAVs61w81D7YmQSksqiI2ORw 81D9NOwqkti57Gxmqsu3r3913Ba4UY3VMSDoeVqMrPvcVYC1pSrjN3m6/k6O4NUlYE86 RaZw== MIME-Version: 1.0 X-Received: by 10.221.66.73 with SMTP id xp9mr3963515vcb.27.1390469857240; Thu, 23 Jan 2014 01:37:37 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 01:37:37 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 10:37:37 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Aryeh Friedman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 09:37:38 -0000 I tried to run from an USB drive with a standard file backend (non ZFS?). Mounted as: /dev/da5p1 on /mnt (ufs, local, soft-updates) Installation of ubuntu still fails when trying to install the grub bootloader. /J On Thu, Jan 23, 2014 at 9:58 AM, Aryeh Friedman w= rote: > Does using the standard file backed bhye work? > > > On Thu, Jan 23, 2014 at 3:56 AM, Jonas B=FClow wro= te: > >> fwiw, I do not have any /dev/zvol in the host. I'm using a vanilla FreeB= SD >> 10.0-Release install using ZFS. >> >> /J >> >> >> On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter >> wrote: >> >> > >> > Here's what I've found so far: >> > >> > vmrun.sh does not like zvols and I am hoping for: >> > >> > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 >> > >> > It gets as far as: >> > >> > Writing partition tables [In Progress ] >> > Initializing ada0p2 [ Failed ] >> > >> > I am trying to figure out why. >> > >> > What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/v= m3 >> > using the bhyve-script approach and then boot it as usual. >> > >> > I will include this in an rc version of "bhyve-script" that I hope to >> > release shortly. It may not be worth adding the functionality to >> > bhyve-script as it is EOL. >> > >> > Michael >> > >> > On 1/22/14 11:26 PM, Jonas B=FClow wrote: >> > > Yes, if "using zvol" is the same thing as using ZFS for the guest >> image. >> > > >> > > I tried setting DEVTYPE to "" with the same result. >> > > >> > > /J >> > > >> > > >> > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan >> > wrote: >> > > >> > >> Hi Jonas, >> > >> >> > >> >> > >> Installation starts and everything looks good until it tries to >> install >> > >>> the >> > >>> grub boot loader. That last step fails. Exiting the installer and >> > running: >> > >>> #sh lin1 start >> > >>> Gives a grub prompt. >> > >>> >> > >>> Any hints? >> > >>> >> > >> >> > >> Are you using a zvol for the guest disk image ? >> > >> >> > >> later, >> > >> >> > >> Peter. >> > >> >> > >> >> > > _______________________________________________ >> > > freebsd-virtualization@freebsd.org mailing list >> > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> > > To unsubscribe, send any mail to " >> > freebsd-virtualization-unsubscribe@freebsd.org" >> > > >> > >> > >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 09:39:22 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5CAA2D27 for ; Thu, 23 Jan 2014 09:39:22 +0000 (UTC) Received: from mail-pd0-x231.google.com (mail-pd0-x231.google.com [IPv6:2607:f8b0:400e:c02::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 2B85F17C2 for ; Thu, 23 Jan 2014 09:39:22 +0000 (UTC) Received: by mail-pd0-f177.google.com with SMTP id x10so1554499pdj.22 for ; Thu, 23 Jan 2014 01:39:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=3dyGiuZtTSnEVs9X0SFHp/GM1073uU9oLDVyGPFKODo=; b=Rb9bdigyVjV8GpnYWst0NCEtsPkhoKRErx0a4krmlBQ+BIvWdO4ptEVXq/GbN0Vq0X ZlV7JRt621ieKD6u2s2t8ZoJfJHIuwZrVTwxdCRxFakkldAaXkeCOCODgSFrIfYT1SSZ +Sdvi/MPWS8lEk2A4y1G5dNKp5GnibErawC74PrNxZQLRt7loMoL8EtUlihAzahy77Xs RxMhEpIzqK/hh1/jf8H7M9K+ez1vEslHdlnZXr7kjSdtjIgcosy6wV6es3rKN1j8T/NU X2DklRRieM/ziVbxdVpHe9wseE/FvN/aLoHP70kHPL3ZvHsiM9x3pWky6fHXg9ZlYMQa /8Hw== MIME-Version: 1.0 X-Received: by 10.68.189.5 with SMTP id ge5mr7090054pbc.42.1390469961802; Thu, 23 Jan 2014 01:39:21 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 01:39:21 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 04:39:21 -0500 Message-ID: Subject: Fwd: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 09:39:22 -0000 ---------- Forwarded message ---------- From: Aryeh Friedman Date: Thu, Jan 23, 2014 at 4:38 AM Subject: Re: Linux on BHyVe in 10.0-RELEASE To: Jonas B=FClow Try: truncat --size 10G disk.img bhyve.... -d disk.img On Thu, Jan 23, 2014 at 4:37 AM, Jonas B=FClow wrot= e: > I tried to run from an USB drive with a standard file backend (non ZFS?). > > Mounted as: > > /dev/da5p1 on /mnt (ufs, local, soft-updates) > > Installation of ubuntu still fails when trying to install the grub > bootloader. > > /J > > > On Thu, Jan 23, 2014 at 9:58 AM, Aryeh Friedman wrote: > >> Does using the standard file backed bhye work? >> >> >> On Thu, Jan 23, 2014 at 3:56 AM, Jonas B=FClow wr= ote: >> >>> fwiw, I do not have any /dev/zvol in the host. I'm using a vanilla >>> FreeBSD >>> 10.0-Release install using ZFS. >>> >>> /J >>> >>> >>> On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter >>> wrote: >>> >>> > >>> > Here's what I've found so far: >>> > >>> > vmrun.sh does not like zvols and I am hoping for: >>> > >>> > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 >>> > >>> > It gets as far as: >>> > >>> > Writing partition tables [In Progress ] >>> > Initializing ada0p2 [ Failed ] >>> > >>> > I am trying to figure out why. >>> > >>> > What does work for me for FreeBSD VM's is to prepare >>> /dev/zvol/zroot/vm3 >>> > using the bhyve-script approach and then boot it as usual. >>> > >>> > I will include this in an rc version of "bhyve-script" that I hope to >>> > release shortly. It may not be worth adding the functionality to >>> > bhyve-script as it is EOL. >>> > >>> > Michael >>> > >>> > On 1/22/14 11:26 PM, Jonas B=FClow wrote: >>> > > Yes, if "using zvol" is the same thing as using ZFS for the guest >>> image. >>> > > >>> > > I tried setting DEVTYPE to "" with the same result. >>> > > >>> > > /J >>> > > >>> > > >>> > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan >>> > wrote: >>> > > >>> > >> Hi Jonas, >>> > >> >>> > >> >>> > >> Installation starts and everything looks good until it tries to >>> install >>> > >>> the >>> > >>> grub boot loader. That last step fails. Exiting the installer and >>> > running: >>> > >>> #sh lin1 start >>> > >>> Gives a grub prompt. >>> > >>> >>> > >>> Any hints? >>> > >>> >>> > >> >>> > >> Are you using a zvol for the guest disk image ? >>> > >> >>> > >> later, >>> > >> >>> > >> Peter. >>> > >> >>> > >> >>> > > _______________________________________________ >>> > > freebsd-virtualization@freebsd.org mailing list >>> > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> > > To unsubscribe, send any mail to " >>> > freebsd-virtualization-unsubscribe@freebsd.org" >>> > > >>> > >>> > >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to " >>> freebsd-virtualization-unsubscribe@freebsd.org" >>> >> >> >> >> -- >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >> > > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 09:51:55 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7ED90C7 for ; Thu, 23 Jan 2014 09:51:55 +0000 (UTC) Received: from mail-pa0-x229.google.com (mail-pa0-x229.google.com [IPv6:2607:f8b0:400e:c03::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4BC0D1924 for ; Thu, 23 Jan 2014 09:51:55 +0000 (UTC) Received: by mail-pa0-f41.google.com with SMTP id fa1so1654217pad.14 for ; Thu, 23 Jan 2014 01:51:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=OhR2sR/uqezIh9oJoraHlOIKtEL1nGCabm2K+psUAuY=; b=F5+qn/F3j7ek53Ff+w95kskzRJ4z8mM//Q62+vxy6fhHt+1P6Dkj8unPJ9l5FHvxoT B8RMbkt0yMxYDAShET5Uvkw5CAtQJRTs9rM44u0n5ble2fnU/yFzlTDdVmrQFS+Xsf92 4RXSwlRlXdjnFW8N6lxGioLVCqzqiz+qOiBUnNRKvF0WVXrUmHnhljWNkbMkgTU+ei24 cAyvK3FMzHTxhQ5KSD5qq9+DpPouqbrrrwPp9caOkvMDSXA57cE+cMK+BlknOqZ4qcY5 AK1sqhkuDsGttJGDfDBNoBGht5qQff5iWr3jbSX7HZrEa8PWv8e+8Pll5R+1YNuFZweE n7Dg== MIME-Version: 1.0 X-Received: by 10.66.179.143 with SMTP id dg15mr7241813pac.52.1390470714856; Thu, 23 Jan 2014 01:51:54 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 01:51:54 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 04:51:54 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: =?ISO-8859-1?Q?Jonas_B=FClow?= , "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 09:51:55 -0000 Sorry for the repost I am currently attempting to import a linux instance into bhyve via petitecloud but here is the script that PC would generate for such a instance tell me if something like it works: (just replace the mentions of freebsd with linux ones): #!/bin/sh pw lock petitecloud truncate -s 10G /vms/pri/jf4aibtonk ifconfig tap202 destroy ifconfig tap202 create ifconfig tap202 up sleep 5 ifconfig bridge0 addm tap202 up /usr/sbin/bhyveload -m 512 -d /vms/cds/FreeBSD-10.0-BETA2-amd64-disc1.iso jf4aibtonk /usr/sbin/bhyve -c 1 -m 512 -AI -H -P -g 0 -s 0:0,hostbridge -s 1:0,virtio-net,tap202 -s 2:0,virtio-blk,/vms/pri/jf4aibtonk -s 3:0,virtio-blk,/vms/cds/FreeBSD-10.0-BETA2-amd64-disc1.iso -S 31,uart,stdio jf4aibtonk echo $!>/var/run/petitecloud/jf4aibtonk ifconfig tap202 destroy ifconfig tap202 create ifconfig tap202 up sleep 5 ifconfig bridge0 addm tap202 up /usr/sbin/bhyveload -m 512 -d /vms/pri/jf4aibtonk jf4aibtonk /usr/sbin/bhyve -c 1 -m 512 -AI -H -P -g 0 -s 0:0,hostbridge -s 1:0,virtio-net,tap202 -s 2:0,virtio-blk,/vms/pri/jf4aibtonk -S 31,uart,stdio jf4aibtonk echo $!>/var/run/petitecloud/jf4aibtonk I suggest try it via PC or some other precanned script and then debug and adopt from there (i.e. use the assumption that everything is file backed not disk backed until you can isolate the issue) On Thu, Jan 23, 2014 at 4:45 AM, Jonas B=FClow wrot= e: > Can you elaborate more what you mean? > > I currently do: > > cp vm0 lin1 > ...edit lin1 and set linux and ubuntu13.10 > sh lin1 iso > =3D> failing install > > /J > > > > On Thu, Jan 23, 2014 at 10:38 AM, Aryeh Friedman > wrote: > >> Try: >> >> truncat --size 10G disk.img >> bhyve.... -d disk.img >> >> >> On Thu, Jan 23, 2014 at 4:37 AM, Jonas B=FClow wr= ote: >> >>> I tried to run from an USB drive with a standard file backend (non ZFS?= ). >>> >>> Mounted as: >>> >>> /dev/da5p1 on /mnt (ufs, local, soft-updates) >>> >>> Installation of ubuntu still fails when trying to install the grub >>> bootloader. >>> >>> /J >>> >>> >>> On Thu, Jan 23, 2014 at 9:58 AM, Aryeh Friedman < >>> aryeh.friedman@gmail.com> wrote: >>> >>>> Does using the standard file backed bhye work? >>>> >>>> >>>> On Thu, Jan 23, 2014 at 3:56 AM, Jonas B=FClow = wrote: >>>> >>>>> fwiw, I do not have any /dev/zvol in the host. I'm using a vanilla >>>>> FreeBSD >>>>> 10.0-Release install using ZFS. >>>>> >>>>> /J >>>>> >>>>> >>>>> On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter >>>>> wrote: >>>>> >>>>> > >>>>> > Here's what I've found so far: >>>>> > >>>>> > vmrun.sh does not like zvols and I am hoping for: >>>>> > >>>>> > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 >>>>> > >>>>> > It gets as far as: >>>>> > >>>>> > Writing partition tables [In Progress ] >>>>> > Initializing ada0p2 [ Failed ] >>>>> > >>>>> > I am trying to figure out why. >>>>> > >>>>> > What does work for me for FreeBSD VM's is to prepare >>>>> /dev/zvol/zroot/vm3 >>>>> > using the bhyve-script approach and then boot it as usual. >>>>> > >>>>> > I will include this in an rc version of "bhyve-script" that I hope = to >>>>> > release shortly. It may not be worth adding the functionality to >>>>> > bhyve-script as it is EOL. >>>>> > >>>>> > Michael >>>>> > >>>>> > On 1/22/14 11:26 PM, Jonas B=FClow wrote: >>>>> > > Yes, if "using zvol" is the same thing as using ZFS for the guest >>>>> image. >>>>> > > >>>>> > > I tried setting DEVTYPE to "" with the same result. >>>>> > > >>>>> > > /J >>>>> > > >>>>> > > >>>>> > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan >>>>> > wrote: >>>>> > > >>>>> > >> Hi Jonas, >>>>> > >> >>>>> > >> >>>>> > >> Installation starts and everything looks good until it tries to >>>>> install >>>>> > >>> the >>>>> > >>> grub boot loader. That last step fails. Exiting the installer a= nd >>>>> > running: >>>>> > >>> #sh lin1 start >>>>> > >>> Gives a grub prompt. >>>>> > >>> >>>>> > >>> Any hints? >>>>> > >>> >>>>> > >> >>>>> > >> Are you using a zvol for the guest disk image ? >>>>> > >> >>>>> > >> later, >>>>> > >> >>>>> > >> Peter. >>>>> > >> >>>>> > >> >>>>> > > _______________________________________________ >>>>> > > freebsd-virtualization@freebsd.org mailing list >>>>> > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>>> > > To unsubscribe, send any mail to " >>>>> > freebsd-virtualization-unsubscribe@freebsd.org" >>>>> > > >>>>> > >>>>> > >>>>> _______________________________________________ >>>>> freebsd-virtualization@freebsd.org mailing list >>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>>> To unsubscribe, send any mail to " >>>>> freebsd-virtualization-unsubscribe@freebsd.org" >>>>> >>>> >>>> >>>> >>>> -- >>>> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >>>> >>> >>> >> >> >> -- >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >> > > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 10:05:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C5EE970F for ; Thu, 23 Jan 2014 10:05:20 +0000 (UTC) Received: from mail-vb0-x22f.google.com (mail-vb0-x22f.google.com [IPv6:2607:f8b0:400c:c02::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7789A1A35 for ; Thu, 23 Jan 2014 10:05:20 +0000 (UTC) Received: by mail-vb0-f47.google.com with SMTP id p6so921962vbe.34 for ; Thu, 23 Jan 2014 02:05:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=MhRSBNOcG2PMZ3Q9qNyS+CXS/p6Jg/7EypEkZuPBn3M=; b=X5QHN6OSqgr2gc7aKN5Wt7KZQTLoPHNy+nnaTQrBY6f/D5ZzQGXpNdMvOkhKJ3cTOn EJ0rDniO5zmWT4v32f/TyiHTo3TkGNfWjxOMtxRri7re6q71JWqY2mbi7+TX8I+XEm3/ tT1eVIV1lo+r4geqztSfCcmet7AbMQEM6QX/9ZNR1Wpde4dkeshliqNI6bY0MSlPlfNK 070rNSX3buLdsNNjmQyEBCW5Huft/mQpznVsE0F04wQH3VuCKHvedU5BgcTjEWsWpPai BNFmswpcjBSi2h6kJjilpcfL3OOwY+3ynWzpmwJjj1b7daTEOfpvlCL+NAx4+LkrDEkT fJEA== MIME-Version: 1.0 X-Received: by 10.220.139.136 with SMTP id e8mr1118236vcu.34.1390471519485; Thu, 23 Jan 2014 02:05:19 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 02:05:19 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 11:05:19 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Aryeh Friedman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 10:05:20 -0000 I do use the precanned bhyve-script "vm0" (if that is what you mean). It explicitly mentions linux support. bhyveload can't be user for other images than FreeBSD so I don't know how to use your script for a linux OS. I assume the image is file backed as I have not assigned a dedicated partition to the vm (and I don't know how to do that). /J On Thu, Jan 23, 2014 at 10:51 AM, Aryeh Friedman wrote: > Sorry for the repost > > I am currently attempting to import a linux instance into bhyve via > petitecloud but here is the script that PC would generate for such a > instance tell me if something like it works: (just replace the mentions o= f > freebsd with linux ones): > > #!/bin/sh > > pw lock petitecloud > truncate -s 10G /vms/pri/jf4aibtonk > ifconfig tap202 destroy > ifconfig tap202 create > ifconfig tap202 up > sleep 5 > ifconfig bridge0 addm tap202 up > > /usr/sbin/bhyveload -m 512 -d /vms/cds/FreeBSD-10.0-BETA2-amd64-disc1.iso > jf4aibtonk > /usr/sbin/bhyve -c 1 -m 512 -AI -H -P -g 0 -s 0:0,hostbridge -s > 1:0,virtio-net,tap202 -s 2:0,virtio-blk,/vms/pri/jf4aibtonk -s > 3:0,virtio-blk,/vms/cds/FreeBSD-10.0-BETA2-amd64-disc1.iso -S > 31,uart,stdio jf4aibtonk > echo $!>/var/run/petitecloud/jf4aibtonk > ifconfig tap202 destroy > ifconfig tap202 create > ifconfig tap202 up > sleep 5 > ifconfig bridge0 addm tap202 up > > /usr/sbin/bhyveload -m 512 -d /vms/pri/jf4aibtonk jf4aibtonk > /usr/sbin/bhyve -c 1 -m 512 -AI -H -P -g 0 -s 0:0,hostbridge -s > 1:0,virtio-net,tap202 -s 2:0,virtio-blk,/vms/pri/jf4aibtonk -S > 31,uart,stdio jf4aibtonk > echo $!>/var/run/petitecloud/jf4aibtonk > > > I suggest try it via PC or some other precanned script and then debug and > adopt from there (i.e. use the assumption that everything is file backed > not disk backed until you can isolate the issue) > > > > > On Thu, Jan 23, 2014 at 4:45 AM, Jonas B=FClow wro= te: > >> Can you elaborate more what you mean? >> >> I currently do: >> >> cp vm0 lin1 >> ...edit lin1 and set linux and ubuntu13.10 >> sh lin1 iso >> =3D> failing install >> >> /J >> >> >> >> On Thu, Jan 23, 2014 at 10:38 AM, Aryeh Friedman < >> aryeh.friedman@gmail.com> wrote: >> >>> Try: >>> >>> truncat --size 10G disk.img >>> bhyve.... -d disk.img >>> >>> >>> On Thu, Jan 23, 2014 at 4:37 AM, Jonas B=FClow w= rote: >>> >>>> I tried to run from an USB drive with a standard file backend (non >>>> ZFS?). >>>> >>>> Mounted as: >>>> >>>> /dev/da5p1 on /mnt (ufs, local, soft-updates) >>>> >>>> Installation of ubuntu still fails when trying to install the grub >>>> bootloader. >>>> >>>> /J >>>> >>>> >>>> On Thu, Jan 23, 2014 at 9:58 AM, Aryeh Friedman < >>>> aryeh.friedman@gmail.com> wrote: >>>> >>>>> Does using the standard file backed bhye work? >>>>> >>>>> >>>>> On Thu, Jan 23, 2014 at 3:56 AM, Jonas B=FClow wrote: >>>>> >>>>>> fwiw, I do not have any /dev/zvol in the host. I'm using a vanilla >>>>>> FreeBSD >>>>>> 10.0-Release install using ZFS. >>>>>> >>>>>> /J >>>>>> >>>>>> >>>>>> On Thu, Jan 23, 2014 at 9:24 AM, Michael Dexter >>>>>> wrote: >>>>>> >>>>>> > >>>>>> > Here's what I've found so far: >>>>>> > >>>>>> > vmrun.sh does not like zvols and I am hoping for: >>>>>> > >>>>>> > sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 >>>>>> > >>>>>> > It gets as far as: >>>>>> > >>>>>> > Writing partition tables [In Progress ] >>>>>> > Initializing ada0p2 [ Failed ] >>>>>> > >>>>>> > I am trying to figure out why. >>>>>> > >>>>>> > What does work for me for FreeBSD VM's is to prepare >>>>>> /dev/zvol/zroot/vm3 >>>>>> > using the bhyve-script approach and then boot it as usual. >>>>>> > >>>>>> > I will include this in an rc version of "bhyve-script" that I hope >>>>>> to >>>>>> > release shortly. It may not be worth adding the functionality to >>>>>> > bhyve-script as it is EOL. >>>>>> > >>>>>> > Michael >>>>>> > >>>>>> > On 1/22/14 11:26 PM, Jonas B=FClow wrote: >>>>>> > > Yes, if "using zvol" is the same thing as using ZFS for the gues= t >>>>>> image. >>>>>> > > >>>>>> > > I tried setting DEVTYPE to "" with the same result. >>>>>> > > >>>>>> > > /J >>>>>> > > >>>>>> > > >>>>>> > > On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan >>>>> > >>>>>> > wrote: >>>>>> > > >>>>>> > >> Hi Jonas, >>>>>> > >> >>>>>> > >> >>>>>> > >> Installation starts and everything looks good until it tries t= o >>>>>> install >>>>>> > >>> the >>>>>> > >>> grub boot loader. That last step fails. Exiting the installer >>>>>> and >>>>>> > running: >>>>>> > >>> #sh lin1 start >>>>>> > >>> Gives a grub prompt. >>>>>> > >>> >>>>>> > >>> Any hints? >>>>>> > >>> >>>>>> > >> >>>>>> > >> Are you using a zvol for the guest disk image ? >>>>>> > >> >>>>>> > >> later, >>>>>> > >> >>>>>> > >> Peter. >>>>>> > >> >>>>>> > >> >>>>>> > > _______________________________________________ >>>>>> > > freebsd-virtualization@freebsd.org mailing list >>>>>> > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>>>> > > To unsubscribe, send any mail to " >>>>>> > freebsd-virtualization-unsubscribe@freebsd.org" >>>>>> > > >>>>>> > >>>>>> > >>>>>> _______________________________________________ >>>>>> freebsd-virtualization@freebsd.org mailing list >>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>>>> To unsubscribe, send any mail to " >>>>>> freebsd-virtualization-unsubscribe@freebsd.org" >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >>>>> >>>> >>>> >>> >>> >>> -- >>> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >>> >> >> > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 10:37:54 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EBA774D3 for ; Thu, 23 Jan 2014 10:37:54 +0000 (UTC) Received: from mail-pb0-x236.google.com (mail-pb0-x236.google.com [IPv6:2607:f8b0:400e:c01::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B85851E32 for ; Thu, 23 Jan 2014 10:37:54 +0000 (UTC) Received: by mail-pb0-f54.google.com with SMTP id uo5so1687508pbc.13 for ; Thu, 23 Jan 2014 02:37:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=bgJMYJKKeiM+k7CsL9/tjybXrQzxbXU60gxLwJ/5CXk=; b=q75jELwWQh7b5orY3WL2ijMwb2hsBPmB/Tpvu6F8s84BaiLJ/0kOCeODkGADqT4mrc Ran7SczcCqy47eohmHvakNm7xoUFqgh0XOfwzJk5W+6U65RvmFjj4hZbbpbXv3wDKGIb XRU+W3QhA5i1IJMw7mEd/QXZJZwKxVGnU8Gj/cOuhNJrnxLc7zdvjIqyjYONxPLicIOG J18yhMxeesfvWSYwO+FbHb9rQKgzfiMWQbL2U8RQg3E+4eIykCthbH1vAKN6jIbVUAQd PLtObopkO+nIbENUB+JawYlou1eSdMaSrsORNMQYxlhhqbsvQYGSJVKFSowW09o7eU5r p4SA== MIME-Version: 1.0 X-Received: by 10.68.171.229 with SMTP id ax5mr7227317pbc.125.1390473474270; Thu, 23 Jan 2014 02:37:54 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 02:37:54 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 05:37:54 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 10:37:55 -0000 On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow wrot= e: > I do use the precanned bhyve-script "vm0" (if that is what you mean). It > explicitly mentions linux support. bhyveload can't be user for other imag= es > than FreeBSD so I don't know how to use your script for a linux OS > Since I have not used bhyve-grub personally yet I can not recommend what the correct loader command line but if bhyve-script is in anyway related to vmrun.sh I would be highly suspicious of any command lines you manage to extract from it since they are often not the ones actual called. > > I assume the image is file backed as I have not assigned a dedicated > partition to the vm (and I don't know how to do that). > You can keep them anywhere no need for a special volume (mater of fact I was just reusing the name of one of the diretoriess that PC creates during install even without it being a different vol [just assumes any FS boundaries are the host OS's problem)... you can put the disk image any where (your home directory would be fine for example) From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 10:53:21 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2B2DE709 for ; Thu, 23 Jan 2014 10:53:21 +0000 (UTC) Received: from mail-vb0-x236.google.com (mail-vb0-x236.google.com [IPv6:2607:f8b0:400c:c02::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D0F0F1F54 for ; Thu, 23 Jan 2014 10:53:20 +0000 (UTC) Received: by mail-vb0-f54.google.com with SMTP id w20so950996vbb.13 for ; Thu, 23 Jan 2014 02:53:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ng5AZOKJSMl8GqIsLGOlm091Snuo1uv1+AEi4izIwws=; b=mSCKsiHBmwtJo/DLd/dnJAy+X4fSAUahSPukGPHITSLvqldQvNuw6/z2kzEeGzZHYb 5/IARZQjVgDMvLgJjhzQWor31BYzcCg9wD8t0v04VeV0bq4iBBJHi8Hlr3NKcP+2/4Mr M4va2EMaA9/J7kT/AoMjz3nBtFAw42mMflZFIw9+TS0AfTlIozbaCNAOecyAxgZsE1r6 9B+rUyXNPBWJOztQsc+HWTrAN9EBgxp8na2tsjuIeG4FjHvQumP8p4ZMXXmq+moZyi81 HTT37CbBGj1eNmstnUSqWjryDjAwODTO9O/ZncWLaQ9jqbB2/gktehU8B475veqLU0Qn HgjQ== MIME-Version: 1.0 X-Received: by 10.58.4.138 with SMTP id k10mr4172129vek.8.1390474399913; Thu, 23 Jan 2014 02:53:19 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 02:53:19 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 11:53:19 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Aryeh Friedman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 10:53:21 -0000 FWIW, I extracted the syslog for the failing ubuntu installation. The failing grub install shows up as: Jan 23 10:51:08 grub-installer: info: architecture: amd64/generic Jan 23 10:51:08 in-target: Reading package lists... Jan 23 10:51:08 in-target: Reading package lists... Jan 23 10:51:08 in-target: Jan 23 10:51:08 in-target: E: Write error - write (28: No space left on dev= ice) Jan 23 10:51:08 in-target: E: Can't mmap an empty file Jan 23 10:51:08 in-target: E: Failed to truncate file - ftruncate (9: Bad file descriptor) Jan 23 10:51:08 in-target: E: The package lists or status file could not be parsed or opened. Jan 23 10:51:08 grub-installer: info: Identified partition label for /dev/vda1: msdos Jan 23 10:51:08 main-menu[211]: (process:18530): chroot: can't execute 'grub-probe': No such file or directory Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No space left on device Jan 23 10:51:08 main-menu[211]: (process:18530): chroot: can't execute 'grub-probe': No such file or directory Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 3 (pipe:[7196]) leaked on lvdisplay invocation. Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: /bin/sh Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 4 (/dev/ttyS0) leaked on lvdisplay invocation. Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: /bin/sh Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 5 (/dev/ttyS0) leaked on lvdisplay invocation. Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: /bin/sh Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 6 (/dev/ttyS0) leaked on lvdisplay invocation. Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: /bin/sh Jan 23 10:51:08 main-menu[211]: (process:18530): Jan 23 10:51:08 main-menu[211]: (process:18530): Volume group "vda" not fou= nd Jan 23 10:51:08 main-menu[211]: (process:18530): Jan 23 10:51:08 main-menu[211]: (process:18530): Jan 23 10:51:08 main-menu[211]: (process:18530): Skipping volume group vda Jan 23 10:51:08 main-menu[211]: (process:18530): Jan 23 10:51:08 main-menu[211]: (process:18530): debconf: DbDriver "config": could not write /var/cache/debconf/config.dat-new: No space left on device Jan 23 10:51:08 main-menu[211]: WARNING **: Configuring 'grub-installer' failed with error code 1 Jan 23 10:51:08 main-menu[211]: WARNING **: Menu item 'grub-installer' fail= ed. Jan 23 10:51:09 main-menu[211]: INFO: Modifying debconf priority limit from 'medium' to 'low' Jan 23 10:51:09 debconf: Setting debconf/priority to low Jan 23 10:51:14 main-menu[211]: INFO: Menu item 'save-logs' selected On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman wrote: > > > > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow wro= te: > >> I do use the precanned bhyve-script "vm0" (if that is what you mean). It >> explicitly mentions linux support. bhyveload can't be user for other ima= ges >> than FreeBSD so I don't know how to use your script for a linux OS >> > > Since I have not used bhyve-grub personally yet I can not recommend what > the correct loader command line but if bhyve-script is in anyway related = to > vmrun.sh I would be highly suspicious of any command lines you manage to > extract from it since they are often not the ones actual called. > > >> >> I assume the image is file backed as I have not assigned a dedicated >> partition to the vm (and I don't know how to do that). >> > > You can keep them anywhere no need for a special volume (mater of fact I > was just reusing the name of one of the diretoriess that PC creates durin= g > install even without it being a different vol [just assumes any FS > boundaries are the host OS's problem)... you can put the disk image any > where (your home directory would be fine for example) > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 10:56:49 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 768C27B5 for ; Thu, 23 Jan 2014 10:56:49 +0000 (UTC) Received: from mail-pa0-x231.google.com (mail-pa0-x231.google.com [IPv6:2607:f8b0:400e:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 419171F75 for ; Thu, 23 Jan 2014 10:56:49 +0000 (UTC) Received: by mail-pa0-f49.google.com with SMTP id hz1so1693310pad.8 for ; Thu, 23 Jan 2014 02:56:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=lm12giqyFGrwi3LqgduKwvvDYo9U6lVVuiU/7Gj+Oz0=; b=NF9dtBKcfvKvNPNYcgLYsTY80tF9pLvMK2odijLNcvSaeqAm0CCdnJXj+cJEuxOzyn 6N7F4MvFYKYr5smvpjQm385EYzK78QPE8f6G5PbwFv6LZagbXic6JHST2aBRawFzEUNY ARCiBXmcfSYNuZq0OXB2DEF2Xgd3RYa9wNR2+sCiHcnEmH8m7Mirco5k8VABrR/AxMgB NODGmCmR1Df9Iy/MRMa7bBs7xDFBkRFOc6sCkIuds1jf0PLRfUwNpR9vIqBC1+zmikpN VPHSo+1SGGoulFZemn+pqUUl81iDyHoAJVxvs94+pXIDBjsGQ7myjuaGNArMdz05Itas TBjw== MIME-Version: 1.0 X-Received: by 10.68.171.229 with SMTP id ax5mr7305313pbc.125.1390474608942; Thu, 23 Jan 2014 02:56:48 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 02:56:48 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 05:56:48 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 10:56:49 -0000 On Thu, Jan 23, 2014 at 5:53 AM, Jonas B=FClow wrot= e: > FWIW, I extracted the syslog for the failing ubuntu installation. The > failing grub install shows up as: > Thanks does not help me immediately (might help someone else) but it will be very helpful over the next few days to a week as we add linux support to bhyve running under PC (we will likely issue a CFT in a few days or so for this) --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 11:38:13 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9AD0D58A for ; Thu, 23 Jan 2014 11:38:13 +0000 (UTC) Received: from mail.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 315C21341 for ; Thu, 23 Jan 2014 11:38:13 +0000 (UTC) Received: from 0x20.net (0x20.net [217.69.76.212]) (Authenticated sender: lala) by mail.0x20.net (Postfix) with ESMTPA id E12D66A6006 for ; Thu, 23 Jan 2014 12:38:09 +0100 (CET) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Thu, 23 Jan 2014 12:38:09 +0100 From: Lars Engels To: freebsd-virtualization@freebsd.org Subject: Re: Linux on BHyVe in 10.0-RELEASE In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Message-ID: <8b9bcc28b7de1b224a1ce249ecda901c@mail.0x20.net> X-Sender: lars.engels@0x20.net User-Agent: Roundcube Webmail/0.7 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 11:38:13 -0000 Am 2014-01-23 11:53, schrieb Jonas Bülow: > FWIW, I extracted the syslog for the failing ubuntu installation. The > failing grub install shows up as: > > Jan 23 10:51:08 grub-installer: info: architecture: amd64/generic > Jan 23 10:51:08 in-target: Reading package lists... > Jan 23 10:51:08 in-target: Reading package lists... > Jan 23 10:51:08 in-target: > Jan 23 10:51:08 in-target: E: Write error - write (28: No space left on > device) > Jan 23 10:51:08 in-target: E: Can't mmap an empty file > Jan 23 10:51:08 in-target: E: Failed to truncate file - ftruncate (9: > Bad file descriptor) > Jan 23 10:51:08 in-target: E: The package lists or status file could > not be parsed or opened. > Jan 23 10:51:08 grub-installer: info: Identified partition label for > /dev/vda1: msdos > Jan 23 10:51:08 main-menu[211]: (process:18530): chroot: can't execute > 'grub-probe': No such file or directory > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No > space left on device > Jan 23 10:51:08 main-menu[211]: (process:18530): chroot: can't execute > 'grub-probe': No such file or directory > Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 3 > (pipe:[7196]) leaked on lvdisplay invocation. > Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: > /bin/sh > Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 4 > (/dev/ttyS0) leaked on lvdisplay invocation. > Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: > /bin/sh > Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 5 > (/dev/ttyS0) leaked on lvdisplay invocation. > Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: > /bin/sh > Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 6 > (/dev/ttyS0) leaked on lvdisplay invocation. > Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: > /bin/sh > Jan 23 10:51:08 main-menu[211]: (process:18530): > Jan 23 10:51:08 main-menu[211]: (process:18530): Volume group "vda" not > found > Jan 23 10:51:08 main-menu[211]: (process:18530): > Jan 23 10:51:08 main-menu[211]: (process:18530): > Jan 23 10:51:08 main-menu[211]: (process:18530): Skipping volume group > vda > Jan 23 10:51:08 main-menu[211]: (process:18530): > Jan 23 10:51:08 main-menu[211]: (process:18530): debconf: DbDriver > "config": could not write /var/cache/debconf/config.dat-new: No space > left on device > Jan 23 10:51:08 main-menu[211]: WARNING **: Configuring > 'grub-installer' failed with error code 1 > Jan 23 10:51:08 main-menu[211]: WARNING **: Menu item 'grub-installer' > failed. > Jan 23 10:51:09 main-menu[211]: INFO: Modifying debconf priority limit > from 'medium' to 'low' > Jan 23 10:51:09 debconf: Setting debconf/priority to low > Jan 23 10:51:14 main-menu[211]: INFO: Menu item 'save-logs' selected > > > Normally you can switch to another virtual console with Alt+F1 to F4 (IIRC), I don't know if that's also possible in bhyve. If it works, please open a shell and see with "df" which filesystem is full. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 11:58:30 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ED7979DC for ; Thu, 23 Jan 2014 11:58:29 +0000 (UTC) Received: from mail-vb0-x229.google.com (mail-vb0-x229.google.com [IPv6:2607:f8b0:400c:c02::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9DA7D1532 for ; Thu, 23 Jan 2014 11:58:29 +0000 (UTC) Received: by mail-vb0-f41.google.com with SMTP id g10so994708vbg.28 for ; Thu, 23 Jan 2014 03:58:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=pNfpbOdXKcSztfs8BydT875Keby0RcJXEgIsdObQnSI=; b=BBehm8tfSNd/IXlv64SrgLm5f5lOm88sH9bx4mzcOYanuIu2hW/2ObNu1o3s6WQk4b Kcqm+gbjDKF2YF6ZqWfBQgFaa24ZKfsk9ouUEljuViyADl/8C7m/YC46tbAuXblj5aQ4 sJiMNsSHKI4sMuA3Qx1v4xMofvEVN+ude46bMrRtw7MdNcsaHHvfk/BWDl7qNzA34eBF FieJ5Tp1Gkwmnao2n2BTnpFxZNTawqyIGpQBuaKnz6U+dszxHIz8zeluf7jyPSpteBGR RzDL2qtbC0XK1io915bgsOPiKyg+uRjytYTEJRuhDsqt6CBq69o9ywJXQEflzRptNIIw xwvA== MIME-Version: 1.0 X-Received: by 10.58.50.71 with SMTP id a7mr4202126veo.32.1390478308704; Thu, 23 Jan 2014 03:58:28 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 03:58:28 -0800 (PST) In-Reply-To: <8b9bcc28b7de1b224a1ce249ecda901c@mail.0x20.net> References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> <8b9bcc28b7de1b224a1ce249ecda901c@mail.0x20.net> Date: Thu, 23 Jan 2014 12:58:28 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Lars Engels Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 11:58:30 -0000 I connect using ssh to a FreeBSD host and run bhyve. so Alt+Fn is not applicable. But your idea is applicable. :-) Running df -h in the "emergency shell" in the ubuntu installer (after it failed installing the grub bootloader) gives: ~ # df -h Filesystem Size Used Available Use% Mounted on none 200.3M 148.0K 200.1M 0% /run devtmpfs 995.7M 0 995.7M 0% /dev /dev/sr0 672.0M 672.0M 0 100% /cdrom /dev/mapper/c--182--181--143--31--vg-root 960.4M 936.1M 0 100% /target /dev/vda1 235.3M 29.1M 194.1M 13% /target/boot /dev/mapper/c--182--181--143--31--vg-home 495.8M 408.0K 459.0M 0% /target/home /dev/sr0 672.0M 672.0M 0 100% /target/media/cdrom devtmpfs 995.7M 0 995.7M 0% /target/dev On Thu, Jan 23, 2014 at 12:38 PM, Lars Engels wrote: > Am 2014-01-23 11:53, schrieb Jonas B=FClow: > > FWIW, I extracted the syslog for the failing ubuntu installation. The >> failing grub install shows up as: >> >> Jan 23 10:51:08 grub-installer: info: architecture: amd64/generic >> Jan 23 10:51:08 in-target: Reading package lists... >> Jan 23 10:51:08 in-target: Reading package lists... >> Jan 23 10:51:08 in-target: >> Jan 23 10:51:08 in-target: E: Write error - write (28: No space left on >> device) >> Jan 23 10:51:08 in-target: E: Can't mmap an empty file >> Jan 23 10:51:08 in-target: E: Failed to truncate file - ftruncate (9: >> Bad file descriptor) >> Jan 23 10:51:08 in-target: E: The package lists or status file could >> not be parsed or opened. >> Jan 23 10:51:08 grub-installer: info: Identified partition label for >> /dev/vda1: msdos >> Jan 23 10:51:08 main-menu[211]: (process:18530): chroot: can't execute >> 'grub-probe': No such file or directory >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): sh: write error: No >> space left on device >> Jan 23 10:51:08 main-menu[211]: (process:18530): chroot: can't execute >> 'grub-probe': No such file or directory >> Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 3 >> (pipe:[7196]) leaked on lvdisplay invocation. >> Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: >> /bin/sh >> Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 4 >> (/dev/ttyS0) leaked on lvdisplay invocation. >> Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: >> /bin/sh >> Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 5 >> (/dev/ttyS0) leaked on lvdisplay invocation. >> Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: >> /bin/sh >> Jan 23 10:51:08 main-menu[211]: (process:18530): File descriptor 6 >> (/dev/ttyS0) leaked on lvdisplay invocation. >> Jan 23 10:51:08 main-menu[211]: (process:18530): Parent PID 18735: >> /bin/sh >> Jan 23 10:51:08 main-menu[211]: (process:18530): >> Jan 23 10:51:08 main-menu[211]: (process:18530): Volume group "vda" not >> found >> Jan 23 10:51:08 main-menu[211]: (process:18530): >> Jan 23 10:51:08 main-menu[211]: (process:18530): >> Jan 23 10:51:08 main-menu[211]: (process:18530): Skipping volume group v= da >> Jan 23 10:51:08 main-menu[211]: (process:18530): >> Jan 23 10:51:08 main-menu[211]: (process:18530): debconf: DbDriver >> "config": could not write /var/cache/debconf/config.dat-new: No space >> left on device >> Jan 23 10:51:08 main-menu[211]: WARNING **: Configuring >> 'grub-installer' failed with error code 1 >> Jan 23 10:51:08 main-menu[211]: WARNING **: Menu item 'grub-installer' >> failed. >> Jan 23 10:51:09 main-menu[211]: INFO: Modifying debconf priority limit >> from 'medium' to 'low' >> Jan 23 10:51:09 debconf: Setting debconf/priority to low >> Jan 23 10:51:14 main-menu[211]: INFO: Menu item 'save-logs' selected >> >> >> >> > Normally you can switch to another virtual console with Alt+F1 to F4 > (IIRC), I don't know if > that's also possible in bhyve. > If it works, please open a shell and see with "df" which filesystem is > full. > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 13:14:06 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 045DC7C5 for ; Thu, 23 Jan 2014 13:14:06 +0000 (UTC) Received: from mail-vc0-x232.google.com (mail-vc0-x232.google.com [IPv6:2607:f8b0:400c:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id AA35B1DB0 for ; Thu, 23 Jan 2014 13:14:05 +0000 (UTC) Received: by mail-vc0-f178.google.com with SMTP id ik5so1044978vcb.9 for ; Thu, 23 Jan 2014 05:14:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=m4Bj+5wEJquBtYyHZ4ewGOQpgR1HzIJUbQmkUEnRLbI=; b=HT+ntTR0VusOuU7YsHF9lOQBCxs8lLRQARHkX1RR0VQoAiU14/spoBwJC2TWx+F3Im DAr/RESn9IJqfAsLK5XxSCvMkSBzdD63bc+LuhTj4H/1GS7fSTS840ZwIXVSG3lRrKxO cp6zNupPcuWZRrnuHu2I5WQ83XFX1iP3raLo0xLrazZsUAgJ5Zm0SR1Lvd2P9hnr5f8W zWelYwYf2JkfJvl7p70yzuFrQnMWB1eV5GJO0WCOE04TyY12TZQHMeIVGeqJ6uXfFPt5 ORW7bTQiGEUB1PGUO/cJXDfKVPTq1bFMw5IzpwcRemI0X6BkBTeOJ7apL73JppzdG+7E 621A== MIME-Version: 1.0 X-Received: by 10.58.146.5 with SMTP id sy5mr84510veb.43.1390482844746; Thu, 23 Jan 2014 05:14:04 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 05:14:04 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 14:14:04 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Aryeh Friedman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 13:14:06 -0000 The commands used are: #grub-bhyve -r cd0 -m ./vm/lin1/device.map -M 4096 lin1 where device.map is: #cat vm/lin1/device.map (hd0) ./vm/lin1/lin1.img (cd0) ./vm/lin1/lin1.iso Bhyve is started with: #/usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s 2,virtio-blk,./vm/lin1/lin1.img -s 3,virtio-net,tap1 -s 4,ahci-cd,./vm/lin1/lin1.iso -S 31,uart,stdio lin1 On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman wrote: > > > > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow wro= te: > >> I do use the precanned bhyve-script "vm0" (if that is what you mean). It >> explicitly mentions linux support. bhyveload can't be user for other ima= ges >> than FreeBSD so I don't know how to use your script for a linux OS >> > > Since I have not used bhyve-grub personally yet I can not recommend what > the correct loader command line but if bhyve-script is in anyway related = to > vmrun.sh I would be highly suspicious of any command lines you manage to > extract from it since they are often not the ones actual called. > > >> >> I assume the image is file backed as I have not assigned a dedicated >> partition to the vm (and I don't know how to do that). >> > > You can keep them anywhere no need for a special volume (mater of fact I > was just reusing the name of one of the diretoriess that PC creates durin= g > install even without it being a different vol [just assumes any FS > boundaries are the host OS's problem)... you can put the disk image any > where (your home directory would be fine for example) > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 14:04:51 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DA7AC674 for ; Thu, 23 Jan 2014 14:04:51 +0000 (UTC) Received: from mail.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9544E11AC for ; Thu, 23 Jan 2014 14:04:51 +0000 (UTC) Received: from 0x20.net (0x20.net [217.69.76.212]) (Authenticated sender: lala) by mail.0x20.net (Postfix) with ESMTPA id 8C6E26A6020; Thu, 23 Jan 2014 15:04:48 +0100 (CET) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Thu, 23 Jan 2014 15:04:48 +0100 From: Lars Engels To: =?UTF-8?Q?Jonas_B=C3=BClow?= Subject: Re: Linux on BHyVe in 10.0-RELEASE In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> <8b9bcc28b7de1b224a1ce249ecda901c@mail.0x20.net> Message-ID: <80f30fee1f728573f5312a2bf998e209@mail.0x20.net> X-Sender: lars.engels@0x20.net User-Agent: Roundcube Webmail/0.7 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 14:04:51 -0000 Am 2014-01-23 12:58, schrieb Jonas Bülow: /dev/mapper/c--182--181--143--31--vg-root 960.4M 936.1M 0 100% /target --> The created partition for / is too small. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 14:24:28 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1FE11DA5 for ; Thu, 23 Jan 2014 14:24:28 +0000 (UTC) Received: from mail-vc0-x22b.google.com (mail-vc0-x22b.google.com [IPv6:2607:f8b0:400c:c03::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C3255136D for ; Thu, 23 Jan 2014 14:24:27 +0000 (UTC) Received: by mail-vc0-f171.google.com with SMTP id le5so1088766vcb.16 for ; Thu, 23 Jan 2014 06:24:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=MrsqHHEffSjeCWAS1BevIvw1Bm9ZavC0j96soUJxgPg=; b=Iv4Pdv5cntNpuOuWLO8EXU/o+w23wrfhzmgUUzacYiXZX6ydZZMU4neE7i5O9M3BCP dsZeUcIhsnHgDjgwQhsNfJ/9fxsEtPWkImdlrrSu8n76JLflenqlAVc7tI80YXAGYl8n 6QImqo2ippfrzbMyo0IzrprtGfeV70QBBEV7sSa1fs67DHaWQXJcJ7212b9bd2Umpmf/ 0KBrmNHAbzHXVfgyx34uR7BBlDX0gxV/zfsjdr2BP4ExYyCVm3DFSFyYR4XISLtFSbL0 FRfJ/ICI5XK7CVotjADLXYdv6yzr0N4E7wfXDmF6eJDVBoOTwH/MJjp5Po7U+zGBOzjv LpRA== MIME-Version: 1.0 X-Received: by 10.220.252.71 with SMTP id mv7mr51339vcb.68.1390487066513; Thu, 23 Jan 2014 06:24:26 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 06:24:26 -0800 (PST) In-Reply-To: <80f30fee1f728573f5312a2bf998e209@mail.0x20.net> References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> <8b9bcc28b7de1b224a1ce249ecda901c@mail.0x20.net> <80f30fee1f728573f5312a2bf998e209@mail.0x20.net> Date: Thu, 23 Jan 2014 15:24:26 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Lars Engels Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-virtualization X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 14:24:28 -0000 Yes, but I don't see why the ubuntu installer creates a partition that is too small. It is too small whatever size I give the vm. On Thu, Jan 23, 2014 at 3:04 PM, Lars Engels wrote: > Am 2014-01-23 12:58, schrieb Jonas B=FClow: > > > /dev/mapper/c--182--181--143--31--vg-root 960.4M 936.1M 0 100% > /target > > --> The created partition for / is too small. > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 14:41:58 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DD8A6579 for ; Thu, 23 Jan 2014 14:41:58 +0000 (UTC) Received: from mail-vb0-x229.google.com (mail-vb0-x229.google.com [IPv6:2607:f8b0:400c:c02::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 8F4A3153A for ; Thu, 23 Jan 2014 14:41:58 +0000 (UTC) Received: by mail-vb0-f41.google.com with SMTP id g10so1099527vbg.0 for ; Thu, 23 Jan 2014 06:41:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=KfOb1BkDM92+M7GOYZcuCO7iYz7Bwk2VeD2OpKvPmVw=; b=mAX7B/Jvpsa/ftdXy95nZ1NkxeJHvzVFNodYtNECJKO6pb+I3rqjX6xZB/P+bq4hRh Xv4ViA3BO3w0rUppoYiGqBva2GZNHgzyLPsinjReCaiXVggIl6kNNut9n14dWo+5HAFZ KXbliFgbNrU13nUk3n5PzxULUVavjRg17GL1BaRudmXyJdxEgAaGBAaC/RhX4iTpep2h 1ELIM2NcNx7HgoTzch3JU5pQrh6a1v/bOFomLl8XxOx/+eV5fXrNcEAF6Fc7TCsILFPz 5zwWL63ne43/ufaRX90WvowOOS3PZluxS/8rzJVjI/ShDKQ/y5CaONan97TrNfol+Exg fCEA== MIME-Version: 1.0 X-Received: by 10.58.37.67 with SMTP id w3mr4720676vej.22.1390488117627; Thu, 23 Jan 2014 06:41:57 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 06:41:57 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 15:41:57 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Aryeh Friedman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 14:41:58 -0000 Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD 10.0-RELEASE. /J On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman wrote: > > > > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow wro= te: > >> I do use the precanned bhyve-script "vm0" (if that is what you mean). It >> explicitly mentions linux support. bhyveload can't be user for other ima= ges >> than FreeBSD so I don't know how to use your script for a linux OS >> > > Since I have not used bhyve-grub personally yet I can not recommend what > the correct loader command line but if bhyve-script is in anyway related = to > vmrun.sh I would be highly suspicious of any command lines you manage to > extract from it since they are often not the ones actual called. > > >> >> I assume the image is file backed as I have not assigned a dedicated >> partition to the vm (and I don't know how to do that). >> > > You can keep them anywhere no need for a special volume (mater of fact I > was just reusing the name of one of the diretoriess that PC creates durin= g > install even without it being a different vol [just assumes any FS > boundaries are the host OS's problem)... you can put the disk image any > where (your home directory would be fine for example) > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 14:44:37 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 98453634 for ; Thu, 23 Jan 2014 14:44:37 +0000 (UTC) Received: from mail-ve0-x236.google.com (mail-ve0-x236.google.com [IPv6:2607:f8b0:400c:c01::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 47E0E1568 for ; Thu, 23 Jan 2014 14:44:37 +0000 (UTC) Received: by mail-ve0-f182.google.com with SMTP id jy13so1158529veb.13 for ; Thu, 23 Jan 2014 06:44:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=KAOnYfKpOxwJ+skjndVXHzum9+HQ79wlz1b+4JY6vw8=; b=vxSiKdfQZEgqBZMRncHE39uWx6An5oqYcL5WeF87uCCySs1W0Fl8ij8W88U7in9SDP iib9K1mf6gFRAOEPmNGITsaRS1N0qlJ1lKeiZpB/zjf/tj/75Xk7Ot3jeNFos841d7kG 6x2FHwQIEynQvRQikE5PPS/IpN6mLpPNhJOV0ccGWWfyv+dRyo9/T423BdX82u3r5NzM XIfgfxcgK8SI9m0oXXUsqo56TOFFP8dVIs9VqsncWvTte4RVmKVITOudPvoBQBWfcnhJ ND3ZbhBl/epXGZRXXVN8KDRV1Q2ABlGi+E8R4TjyKEliSx01LhVsoeq6NWtsRP12FtQa TFJA== X-Received: by 10.221.30.75 with SMTP id sb11mr109242vcb.60.1390488276303; Thu, 23 Jan 2014 06:44:36 -0800 (PST) MIME-Version: 1.0 Received: by 10.59.0.68 with HTTP; Thu, 23 Jan 2014 06:44:05 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> From: Matthias Gamsjager Date: Thu, 23 Jan 2014 15:44:05 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 14:44:37 -0000 Could you elaborate what you did to get it working? On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow wrot= e: > Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD > 10.0-RELEASE. > > > > /J > > > On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman > wrote: > > > > > > > > > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >wrote: > > > >> I do use the precanned bhyve-script "vm0" (if that is what you mean). = It > >> explicitly mentions linux support. bhyveload can't be user for other > images > >> than FreeBSD so I don't know how to use your script for a linux OS > >> > > > > Since I have not used bhyve-grub personally yet I can not recommend wha= t > > the correct loader command line but if bhyve-script is in anyway relate= d > to > > vmrun.sh I would be highly suspicious of any command lines you manage t= o > > extract from it since they are often not the ones actual called. > > > > > >> > >> I assume the image is file backed as I have not assigned a dedicated > >> partition to the vm (and I don't know how to do that). > >> > > > > You can keep them anywhere no need for a special volume (mater of fact = I > > was just reusing the name of one of the diretoriess that PC creates > during > > install even without it being a different vol [just assumes any FS > > boundaries are the host OS's problem)... you can put the disk image any > > where (your home directory would be fine for example) > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 16:00:12 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3D9C0630 for ; Thu, 23 Jan 2014 16:00:12 +0000 (UTC) Received: from mail-vc0-x22f.google.com (mail-vc0-x22f.google.com [IPv6:2607:f8b0:400c:c03::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E10F21D91 for ; Thu, 23 Jan 2014 16:00:11 +0000 (UTC) Received: by mail-vc0-f175.google.com with SMTP id ij19so1168585vcb.34 for ; Thu, 23 Jan 2014 08:00:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=lfPsfl3ph7P0+rhUF68d4+Ya6gDg/ikmPLf08oR2KgQ=; b=qb+xx8TP+bD33CXnW1o3DN683SHBonzAklM2A0bbSVDOQid0OqfytMJqBdSI0yTfiY 3gODCIDXnxMH/FOV9ClITkPMGdB3erFZGQjwr4b6pVTw6DkuhMZDvyl8AWyClHKwd/gi nhE4CxTSZinnArC6jU701sRH+72cWOGCeeNRee8qN7aNtwGIwOFndfNI0rthpynfNLIz pzhB2woo6fmlWbTM02VMq1Og7yVmvLuOydfbtccZZUP/lLVAx5UOTP+TxaCzG/Wd4nTS qcQdod2TCslrDxsxHi217pKH7vDkuctabY+yFwnIh93otfRPsfXt71DwspKIfU0f7T5Y TSKg== MIME-Version: 1.0 X-Received: by 10.220.178.73 with SMTP id bl9mr465426vcb.42.1390492810973; Thu, 23 Jan 2014 08:00:10 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 08:00:10 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 17:00:10 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Matthias Gamsjager Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 16:00:12 -0000 I will describe the steps when I manage to reproduce the installation. Right now I get stuck with undestroyable vm instances: root@bulow:/mnt/bhyve-script # ls /dev/vmm/ lin0 root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 errno =3D 22 On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager w= rote: > Could you elaborate what you did to get it working? > > > On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow wro= te: > >> Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD >> 10.0-RELEASE. >> >> >> >> /J >> >> >> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman >> wrote: >> >> > >> > >> > >> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow > >wrote: >> > >> >> I do use the precanned bhyve-script "vm0" (if that is what you mean). >> It >> >> explicitly mentions linux support. bhyveload can't be user for other >> images >> >> than FreeBSD so I don't know how to use your script for a linux OS >> >> >> > >> > Since I have not used bhyve-grub personally yet I can not recommend wh= at >> > the correct loader command line but if bhyve-script is in anyway >> related to >> > vmrun.sh I would be highly suspicious of any command lines you manage = to >> > extract from it since they are often not the ones actual called. >> > >> > >> >> >> >> I assume the image is file backed as I have not assigned a dedicated >> >> partition to the vm (and I don't know how to do that). >> >> >> > >> > You can keep them anywhere no need for a special volume (mater of fact= I >> > was just reusing the name of one of the diretoriess that PC creates >> during >> > install even without it being a different vol [just assumes any FS >> > boundaries are the host OS's problem)... you can put the disk image an= y >> > where (your home directory would be fine for example) >> > >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> > > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 17:07:19 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D22DE16A for ; Thu, 23 Jan 2014 17:07:19 +0000 (UTC) Received: from mail-qa0-x22b.google.com (mail-qa0-x22b.google.com [IPv6:2607:f8b0:400d:c00::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 84FE313A4 for ; Thu, 23 Jan 2014 17:07:19 +0000 (UTC) Received: by mail-qa0-f43.google.com with SMTP id o15so2551888qap.30 for ; Thu, 23 Jan 2014 09:07:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=QWFlyW/kY+pxwpRJ+AN6MSwOpOJOXfn66CVdCSCMMkI=; b=YEhG7UDWg6VQSL+HzdJ067d1L61OsiNTFRaOYo6NQXNzcktYRZaAIca2qt8tcUiqUG Yjy0Av/JctnJUQ2X4Tbi/cZA+3hcZsOhdM+W2njvQsKDiqRT9VCUelpM8RPUe2WrRaz4 PHJTdgqsHqOez3WoFijLAASfKGErL6bUHk8xOb1LDYoeynCkUGW+GaLEENmwaexLgXAG +RZGPUXum5gufrgIOXox3PaXTw6yYmJLMGB59Su0HdsSKH3EVToMd6vB+4VQLgBQAvE8 1LZVzhZETj7GKb1vS1OrqorcHqtnIjZ+ZJ80o+yrbuFGiCR3avyyKeSQDqtnScBx8Wv7 Lfrg== MIME-Version: 1.0 X-Received: by 10.224.38.137 with SMTP id b9mr13396193qae.38.1390496836991; Thu, 23 Jan 2014 09:07:16 -0800 (PST) Received: by 10.140.87.71 with HTTP; Thu, 23 Jan 2014 09:07:16 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 09:07:16 -0800 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Neel Natu To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 17:07:19 -0000 Hi Jonas, On Thu, Jan 23, 2014 at 8:00 AM, Jonas B=FClow wrot= e: > I will describe the steps when I manage to reproduce the installation. > Right now I get stuck with undestroyable vm instances: > > root@bulow:/mnt/bhyve-script # ls /dev/vmm/ > > lin0 > > root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 > > errno =3D 22 > Hmm=85 can you tell what the bhyve process associated with lin0 is doing from 'top' or 'ps'? What happens if you send a SIGTERM to the bhyve process? best Neel > > On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager wrote: > >> Could you elaborate what you did to get it working? >> >> >> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow wr= ote: >> >>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD >>> 10.0-RELEASE. >>> >>> >>> >>> /J >>> >>> >>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman >>> wrote: >>> >>> > >>> > >>> > >>> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >> >wrote: >>> > >>> >> I do use the precanned bhyve-script "vm0" (if that is what you mean)= . >>> It >>> >> explicitly mentions linux support. bhyveload can't be user for other >>> images >>> >> than FreeBSD so I don't know how to use your script for a linux OS >>> >> >>> > >>> > Since I have not used bhyve-grub personally yet I can not recommend w= hat >>> > the correct loader command line but if bhyve-script is in anyway >>> related to >>> > vmrun.sh I would be highly suspicious of any command lines you manage= to >>> > extract from it since they are often not the ones actual called. >>> > >>> > >>> >> >>> >> I assume the image is file backed as I have not assigned a dedicated >>> >> partition to the vm (and I don't know how to do that). >>> >> >>> > >>> > You can keep them anywhere no need for a special volume (mater of fac= t I >>> > was just reusing the name of one of the diretoriess that PC creates >>> during >>> > install even without it being a different vol [just assumes any FS >>> > boundaries are the host OS's problem)... you can put the disk image a= ny >>> > where (your home directory would be fine for example) >>> > >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to " >>> freebsd-virtualization-unsubscribe@freebsd.org" >>> >> >> > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 17:34:40 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 462D54A1 for ; Thu, 23 Jan 2014 17:34:40 +0000 (UTC) Received: from mail-lb0-x235.google.com (mail-lb0-x235.google.com [IPv6:2a00:1450:4010:c04::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B254C1699 for ; Thu, 23 Jan 2014 17:34:39 +0000 (UTC) Received: by mail-lb0-f181.google.com with SMTP id z5so1674413lbh.26 for ; Thu, 23 Jan 2014 09:34:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=0SLH7cxfXA/RH1D8avw2M2n6nB3Y6cI3jL8ti77FA44=; b=qB/N7ubEiepbzvRfvYlAkY2Iw74b2n+aX3GG9rOW9EWR58Y8TlqRKBOP/FVZ6EyuMS 7FQm4BS9MztgyWs2BUVy0uYwk7iIeCeLG1VjWzZerQ6K7GVHATdjkZWWCo12dX1YFPqb BgQe5YaGGAA2ghNi10c8Zo8Awhl8kFkkbpkbly3B+1AGys7rC3I+Qbgv39dUtvawzZ8Z J7WSQFHBhlD2ieA1/4TqTKCnoHMMnwwZZV1kdz1Ad/hwY/ZSftTp/CjIBDea2g3BCC3Y yVM8AqUYlEF6L9moZAxhsEuwa+HE+TsosiYK+Uv5Gi0jsLzjdbNScfKjkKP6YWzj5mW3 8zVw== X-Received: by 10.152.206.104 with SMTP id ln8mr34382lac.67.1390498477489; Thu, 23 Jan 2014 09:34:37 -0800 (PST) Received: from [10.1.0.66] ([83.233.181.202]) by mx.google.com with ESMTPSA id ri4sm3358209lbb.6.2014.01.23.09.34.35 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 23 Jan 2014 09:34:36 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?utf-8?Q?Jonas_B=C3=BClow?= X-Mailer: iPhone Mail (11B554a) In-Reply-To: Date: Thu, 23 Jan 2014 18:34:32 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> To: Neel Natu Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 17:34:40 -0000 There is no bhyve process when this happens. /j > 23 jan 2014 kl. 18:07 skrev Neel Natu : >=20 > Hi Jonas, >=20 >> On Thu, Jan 23, 2014 at 8:00 AM, Jonas B=C3=BClow = wrote: >> I will describe the steps when I manage to reproduce the installation. >> Right now I get stuck with undestroyable vm instances: >>=20 >> root@bulow:/mnt/bhyve-script # ls /dev/vmm/ >>=20 >> lin0 >>=20 >> root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 >>=20 >> errno =3D 22 >=20 > Hmm=E2=80=A6 can you tell what the bhyve process associated with lin0 is d= oing > from 'top' or 'ps'? >=20 > What happens if you send a SIGTERM to the bhyve process? >=20 > best > Neel >=20 >>=20 >> On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager wrote: >>=20 >>> Could you elaborate what you did to get it working? >>>=20 >>>=20 >>> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=C3=BClow wrote: >>>=20 >>>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD >>>> 10.0-RELEASE. >>>>=20 >>>>=20 >>>>=20 >>>> /J >>>>=20 >>>>=20 >>>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman >>>> wrote: >>>>=20 >>>>>=20 >>>>>=20 >>>>>=20 >>>>> On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=C3=BClow >>>> wrote: >>>>>=20 >>>>>> I do use the precanned bhyve-script "vm0" (if that is what you mean).= >>>> It >>>>>> explicitly mentions linux support. bhyveload can't be user for other >>>> images >>>>>> than FreeBSD so I don't know how to use your script for a linux OS >>>>>=20 >>>>> Since I have not used bhyve-grub personally yet I can not recommend wh= at >>>>> the correct loader command line but if bhyve-script is in anyway >>>> related to >>>>> vmrun.sh I would be highly suspicious of any command lines you manage t= o >>>>> extract from it since they are often not the ones actual called. >>>>>=20 >>>>>=20 >>>>>>=20 >>>>>> I assume the image is file backed as I have not assigned a dedicated >>>>>> partition to the vm (and I don't know how to do that). >>>>>=20 >>>>> You can keep them anywhere no need for a special volume (mater of fact= I >>>>> was just reusing the name of one of the diretoriess that PC creates >>>> during >>>>> install even without it being a different vol [just assumes any FS >>>>> boundaries are the host OS's problem)... you can put the disk image an= y >>>>> where (your home directory would be fine for example) >>>> _______________________________________________ >>>> freebsd-virtualization@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>> To unsubscribe, send any mail to " >>>> freebsd-virtualization-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 19:18:41 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BB2587B for ; Thu, 23 Jan 2014 19:18:41 +0000 (UTC) Received: from mail-qc0-x231.google.com (mail-qc0-x231.google.com [IPv6:2607:f8b0:400d:c01::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6BD731035 for ; Thu, 23 Jan 2014 19:18:41 +0000 (UTC) Received: by mail-qc0-f177.google.com with SMTP id i8so3046270qcq.36 for ; Thu, 23 Jan 2014 11:18:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=Gm05KRkpx93hLWfdEamLUvQrJVqnoCbVuYjYVzO7RfQ=; b=XpM5n7GHNd7FL1ja0C5IzJ+Fiqejbi9q0lZwaBsCETIe17keX2cjJAjBtkZNYCbdgh JNWJze+862UObhgcil8qrso8QzCy0Wsoz81aOn15wqaIs9xpkTg/3qEBIsFKf6U6Pv/a wIAFoARWDXilhGR+JjMujBEzEYX851aSAhlCz4gxc5O0r87kWZcDTJtpJIg7XcB/O/yd JxqS98tIsHtQK847hBy4sJiXw+hoScrC0kiZGoDcdzJsXpkGasIYQGxDKQShRaO0N8F4 84JCxoG48fTan6mCC9qjvfv83LuoAkmyZrsrB+dedjQG+at0HKipcXDccd3bfZhVwiIH TXKg== MIME-Version: 1.0 X-Received: by 10.224.66.134 with SMTP id n6mr14258684qai.39.1390504720631; Thu, 23 Jan 2014 11:18:40 -0800 (PST) Received: by 10.140.87.71 with HTTP; Thu, 23 Jan 2014 11:18:40 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 11:18:40 -0800 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Neel Natu To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 19:18:41 -0000 Hi Jonas, On Thu, Jan 23, 2014 at 9:34 AM, Jonas B=FClow wrot= e: > There is no bhyve process when this happens. > I am at a loss to explain this. Do you happen to have a console log or shell history that may help in figuring this out? Even better would be if you can reproduce this and I can debug this locally based on your steps. best Neel > /j > >> 23 jan 2014 kl. 18:07 skrev Neel Natu : >> >> Hi Jonas, >> >>> On Thu, Jan 23, 2014 at 8:00 AM, Jonas B=FClow = wrote: >>> I will describe the steps when I manage to reproduce the installation. >>> Right now I get stuck with undestroyable vm instances: >>> >>> root@bulow:/mnt/bhyve-script # ls /dev/vmm/ >>> >>> lin0 >>> >>> root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 >>> >>> errno =3D 22 >> >> Hmm=85 can you tell what the bhyve process associated with lin0 is doing >> from 'top' or 'ps'? >> >> What happens if you send a SIGTERM to the bhyve process? >> >> best >> Neel >> >>> >>> On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager wrote: >>> >>>> Could you elaborate what you did to get it working? >>>> >>>> >>>> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow = wrote: >>>> >>>>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD >>>>> 10.0-RELEASE. >>>>> >>>>> >>>>> >>>>> /J >>>>> >>>>> >>>>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman >>>>> wrote: >>>>> >>>>>> >>>>>> >>>>>> >>>>>> On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >>>>> wrote: >>>>>> >>>>>>> I do use the precanned bhyve-script "vm0" (if that is what you mean= ). >>>>> It >>>>>>> explicitly mentions linux support. bhyveload can't be user for othe= r >>>>> images >>>>>>> than FreeBSD so I don't know how to use your script for a linux OS >>>>>> >>>>>> Since I have not used bhyve-grub personally yet I can not recommend = what >>>>>> the correct loader command line but if bhyve-script is in anyway >>>>> related to >>>>>> vmrun.sh I would be highly suspicious of any command lines you manag= e to >>>>>> extract from it since they are often not the ones actual called. >>>>>> >>>>>> >>>>>>> >>>>>>> I assume the image is file backed as I have not assigned a dedicate= d >>>>>>> partition to the vm (and I don't know how to do that). >>>>>> >>>>>> You can keep them anywhere no need for a special volume (mater of fa= ct I >>>>>> was just reusing the name of one of the diretoriess that PC creates >>>>> during >>>>>> install even without it being a different vol [just assumes any FS >>>>>> boundaries are the host OS's problem)... you can put the disk image = any >>>>>> where (your home directory would be fine for example) >>>>> _______________________________________________ >>>>> freebsd-virtualization@freebsd.org mailing list >>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>>> To unsubscribe, send any mail to " >>>>> freebsd-virtualization-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 20:34:43 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 95CAC2E3 for ; Thu, 23 Jan 2014 20:34:43 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6C41717FA for ; Thu, 23 Jan 2014 20:34:43 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 61C3BB99B; Thu, 23 Jan 2014 15:34:42 -0500 (EST) From: John Baldwin To: Neel Natu Subject: Re: bhyve and legacy Date: Thu, 23 Jan 2014 14:54:57 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20130906; KDE/4.5.5; amd64; ; ) References: <201401221715.42164.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201401231454.58012.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 23 Jan 2014 15:34:42 -0500 (EST) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 20:34:43 -0000 On Wednesday, January 22, 2014 9:48:20 pm Neel Natu wrote: > Hi John, > > On Wed, Jan 22, 2014 at 2:15 PM, John Baldwin wrote: > > Is there any interest in supporting more "legacy" setups via bhyve? In > > particular, I'd like to take a whack at improving the PCI INTx support, but > > that can involve several things such as possibly implementing 8259A support > > and a PCI interrupt router vs always assuming that we have APICs. If we do > > I would love to see PCI INTx support so we can do legacy interrupts > for the virtio device models. > > However, does that require going all the way back to 8259 style > interrupts? It should work fine with IOAPIC, no? No, it does not. It was more a question of what was desired. The first step would probably just be to get the IOAPIC case working well and make sure the _PRT is populated in ACPI and MP Table is correct. (For example, in typical systems, ISA IRQs are not used for PCI INTx on an I/O APIC, but interrupt pins above 15 are used). -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 20:34:44 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B9A853B6 for ; Thu, 23 Jan 2014 20:34:44 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9240217FB for ; Thu, 23 Jan 2014 20:34:44 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 76CA6B917; Thu, 23 Jan 2014 15:34:43 -0500 (EST) From: John Baldwin To: Tycho Nightingale Subject: Re: bhyve and legacy Date: Thu, 23 Jan 2014 14:58:23 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20130906; KDE/4.5.5; amd64; ; ) References: <201401221715.42164.jhb@freebsd.org> <22CF9C41-3320-4E98-A475-A6372799024B@pluribusnetworks.com> In-Reply-To: <22CF9C41-3320-4E98-A475-A6372799024B@pluribusnetworks.com> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201401231458.23719.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 23 Jan 2014 15:34:43 -0500 (EST) Cc: virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 20:34:44 -0000 On Wednesday, January 22, 2014 7:54:47 pm Tycho Nightingale wrote: > > Hi, > > Interest? Yes! Matter of fact, I have some scraps of 8259 support lying around here if you are keen to have a starting point. I think most of 8259A could live in the hypervisor in userland. I think all that would be needed in vmm.ko would be a way to do the equivalent of asserting ExtInt with a specific IDT vector value and having the VMM code honor the mask bits on lapic LINT0 and the I/O APIC ExtInt pins for deciding when to deliver it to a CPU. > Now with respect to bhyveload, while it certainly does have some FreeBSD- specific uses, it is a bit of a barrier to supporting non-FreeBSD guests and furthermore supporting them well e.g. reboot without bhyve exiting. If 'true' support existed for booting from an iso, then with a quick 'mkisofs' you could achieve the same kernel-to-VM turnaround without bhyveload. Well, not quite as nice, but close. One nice thing about the current host0: approach is I can actually use 'nextboot -e bootfile=foo' inside the VM to trigger a boot of a test kernel similar to using 'nextboot -k foo' on real hardware. That's not quite as easy to arrange in the ISO case given that ISO's generally only show up if you boot from them. What would be interesting perhaps would be a way to PXE boot from the host. That would be a closer approximation to how bhyveload -H works. -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 21:02:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9F384568 for ; Thu, 23 Jan 2014 21:02:57 +0000 (UTC) Received: from mail-vb0-x230.google.com (mail-vb0-x230.google.com [IPv6:2607:f8b0:400c:c02::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4D0C11AA7 for ; Thu, 23 Jan 2014 21:02:57 +0000 (UTC) Received: by mail-vb0-f48.google.com with SMTP id q16so1351567vbe.21 for ; Thu, 23 Jan 2014 13:02:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=83h4SYrv9HBKdTf6nHDdA2YqIuSsG1KsE8qZC/Vunug=; b=fvpzjLMdZYM8BGMI7GF0wlNZY7Keg1tEODNwHfhSgGl4IJBtyTn5BjQDQWC+yRXtjw VgFdKq8sSD4R2kuVkIBbKioh7A78LTxd1uxs4LmlS+mbzcpFJqeIkhegPumeJpDropL3 9X7bOEG30VKjlQGfNpCHXj6kBvlRfis81sXgGPgPl60TdCBh08WtDzmgjJkzXSOWcnor GOX7Cv0Df8O+Qzk5QIoZkkLlYdn3cjUF24wEgD216cWgcFckqc+FpyHtA2o4QgErc1Pl DRa6hB+7aSWmQFnlzfpZjmmrmmnH7D7eTSeHax3LLnSTDvXUxmrDOFiUNCKxhAZDJUl0 44HQ== MIME-Version: 1.0 X-Received: by 10.58.181.165 with SMTP id dx5mr5456812vec.19.1390510976444; Thu, 23 Jan 2014 13:02:56 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 13:02:56 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 22:02:56 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Matthias Gamsjager Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 21:02:57 -0000 I had one working ubuntu13.10 vm instance but I'm unable to reproduce it. When I try to start the vm I get: /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s 2,virtio-blk,./vm/vm1/vm1.img -s 3,virtio-net,tap1 -s 4,ahci-cd,./vm/vm1/vm1.iso -S 31,uart,stdio vm1 vm exit[0] reason VMX rip 0x0000000000000000 inst_length 0 error 0 exit_reason 33 qualification 0x0000000000000000 /J On Thu, Jan 23, 2014 at 5:00 PM, Jonas B=FClow wrot= e: > I will describe the steps when I manage to reproduce the installation. > Right now I get stuck with undestroyable vm instances: > > root@bulow:/mnt/bhyve-script # ls /dev/vmm/ > > lin0 > > root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 > > errno =3D 22 > > > On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager wrote: > >> Could you elaborate what you did to get it working? >> >> >> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow wr= ote: >> >>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD >>> 10.0-RELEASE. >>> >>> >>> >>> /J >>> >>> >>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman >>> wrote: >>> >>> > >>> > >>> > >>> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >> >wrote: >>> > >>> >> I do use the precanned bhyve-script "vm0" (if that is what you mean)= . >>> It >>> >> explicitly mentions linux support. bhyveload can't be user for other >>> images >>> >> than FreeBSD so I don't know how to use your script for a linux OS >>> >> >>> > >>> > Since I have not used bhyve-grub personally yet I can not recommend >>> what >>> > the correct loader command line but if bhyve-script is in anyway >>> related to >>> > vmrun.sh I would be highly suspicious of any command lines you manage >>> to >>> > extract from it since they are often not the ones actual called. >>> > >>> > >>> >> >>> >> I assume the image is file backed as I have not assigned a dedicated >>> >> partition to the vm (and I don't know how to do that). >>> >> >>> > >>> > You can keep them anywhere no need for a special volume (mater of fac= t >>> I >>> > was just reusing the name of one of the diretoriess that PC creates >>> during >>> > install even without it being a different vol [just assumes any FS >>> > boundaries are the host OS's problem)... you can put the disk image a= ny >>> > where (your home directory would be fine for example) >>> > >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to " >>> freebsd-virtualization-unsubscribe@freebsd.org" >>> >> >> > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 21:45:58 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0880BA89 for ; Thu, 23 Jan 2014 21:45:58 +0000 (UTC) Received: from mail-qa0-x231.google.com (mail-qa0-x231.google.com [IPv6:2607:f8b0:400d:c00::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id AE7B21F71 for ; Thu, 23 Jan 2014 21:45:57 +0000 (UTC) Received: by mail-qa0-f49.google.com with SMTP id w8so2886734qac.8 for ; Thu, 23 Jan 2014 13:45:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=HWBNyR36YuZs+xG66oG4mwbLooTJ6T3Nl1DTLMA9jYY=; b=pncpIQF+/rP6M8dLnY79iRHwkUpY0u8K7Y0he5G/cJRUffR5UOohu3CO9VkGk4HFpV vAbrcOH2KSuz2lbWsVyXJjaQEbBqGed5m01RR+kRxdqFryESeK+xaiQ3YWKC8jiASttM SmpUM0wpL65yT82XfEMp8WTXCweCqKehzewvu3krx8/7bj6Gw4l8x2GEiZsrks4rJA9P E8MW8P0dHTDpYy+2MFhF0NUQE3AtXwdFNoDKFNB8hZwEK0OKOPBhGViB41883T2zWm4l kmVSkBXM/zN4u8NEbx7ctmKDdFxRrJQ+ayA9Zbd6yb8sstgtVyz68gWYZTXLIU6xp9wn os/Q== MIME-Version: 1.0 X-Received: by 10.224.161.75 with SMTP id q11mr15307525qax.69.1390513556342; Thu, 23 Jan 2014 13:45:56 -0800 (PST) Received: by 10.140.87.71 with HTTP; Thu, 23 Jan 2014 13:45:56 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 13:45:56 -0800 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Neel Natu To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 21:45:58 -0000 Hi Jonas, On Thu, Jan 23, 2014 at 1:02 PM, Jonas B=FClow wrot= e: > I had one working ubuntu13.10 vm instance but I'm unable to reproduce it. > When I try to start the vm I get: > > /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s > 2,virtio-blk,./vm/vm1/vm1.img -s 3,virtio-net,tap1 -s > 4,ahci-cd,./vm/vm1/vm1.iso -S 31,uart,stdio vm1 > > vm exit[0] > > reason VMX > > rip 0x0000000000000000 > > > inst_length 0 > > > error 0 > > > exit_reason 33 > > > > qualification 0x0000000000000000 > Looks like you are running into every possible problem there is :-) Anyways, could you confirm that you are loading the guest kernel into 'vm1' using grub-bhyve before executing the command above? best Neel > > > > > /J > > > On Thu, Jan 23, 2014 at 5:00 PM, Jonas B=FClow wr= ote: > >> I will describe the steps when I manage to reproduce the installation. >> Right now I get stuck with undestroyable vm instances: >> >> root@bulow:/mnt/bhyve-script # ls /dev/vmm/ >> >> lin0 >> >> root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 >> >> errno =3D 22 >> >> >> On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager wrote: >> >>> Could you elaborate what you did to get it working? >>> >>> >>> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow w= rote: >>> >>>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBSD >>>> 10.0-RELEASE. >>>> >>>> >>>> >>>> /J >>>> >>>> >>>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman >>>> wrote: >>>> >>>> > >>>> > >>>> > >>>> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >>> >wrote: >>>> > >>>> >> I do use the precanned bhyve-script "vm0" (if that is what you mean= ). >>>> It >>>> >> explicitly mentions linux support. bhyveload can't be user for othe= r >>>> images >>>> >> than FreeBSD so I don't know how to use your script for a linux OS >>>> >> >>>> > >>>> > Since I have not used bhyve-grub personally yet I can not recommend >>>> what >>>> > the correct loader command line but if bhyve-script is in anyway >>>> related to >>>> > vmrun.sh I would be highly suspicious of any command lines you manag= e >>>> to >>>> > extract from it since they are often not the ones actual called. >>>> > >>>> > >>>> >> >>>> >> I assume the image is file backed as I have not assigned a dedicate= d >>>> >> partition to the vm (and I don't know how to do that). >>>> >> >>>> > >>>> > You can keep them anywhere no need for a special volume (mater of fa= ct >>>> I >>>> > was just reusing the name of one of the diretoriess that PC creates >>>> during >>>> > install even without it being a different vol [just assumes any FS >>>> > boundaries are the host OS's problem)... you can put the disk image = any >>>> > where (your home directory would be fine for example) >>>> > >>>> _______________________________________________ >>>> freebsd-virtualization@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>> To unsubscribe, send any mail to " >>>> freebsd-virtualization-unsubscribe@freebsd.org" >>>> >>> >>> >> > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 21:47:27 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8F35EB20 for ; Thu, 23 Jan 2014 21:47:27 +0000 (UTC) Received: from mail-pd0-x234.google.com (mail-pd0-x234.google.com [IPv6:2607:f8b0:400e:c02::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 54E5D1F86 for ; Thu, 23 Jan 2014 21:47:27 +0000 (UTC) Received: by mail-pd0-f180.google.com with SMTP id x10so2303617pdj.39 for ; Thu, 23 Jan 2014 13:47:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=EjE2PXsfuvAfLA2sCMeFoltYPjNy9C1KmV8FOYtY99A=; b=Xfb+edJ8RAiEKG84lFvoZQCVp/M9pOmxwzzD3SnhCOmToGGnwd08KdPIJNieJ9Y8l4 WgpLyBXCVPr0B6ZaV76Xr2v+A04K9K0pGbyTHdQ5pFTQGplkSYr2pvhc3H01q6TAjpBA Y0zXx9/x0ABvoatPTgpkcsLFzfMm7BJ+W1085hcIo6jH7uD/LrLNgz6nlIeLpEvJ+ZDG RcCy8b5FatoRDzt2B4449TyYql3gBHZ3AzFhVLbbi53EJ/ZE2qsQXFxXOmMn2GvVpo+t cNIg/+wJpZ60+alAc9V0PY3Qu7qJrL+uY7hoCOqOGZoLj/8MvBxfohHgfNv7ql6USTyI CymA== MIME-Version: 1.0 X-Received: by 10.68.43.101 with SMTP id v5mr10449219pbl.149.1390513646976; Thu, 23 Jan 2014 13:47:26 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 13:47:26 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 16:47:26 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: Neel Natu Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 21:47:27 -0000 The original err=3D22 sounds like he might of attempted to run as non-root? On Thu, Jan 23, 2014 at 4:45 PM, Neel Natu wrote: > Hi Jonas, > > On Thu, Jan 23, 2014 at 1:02 PM, Jonas B=FClow > wrote: > > I had one working ubuntu13.10 vm instance but I'm unable to reproduce i= t. > > When I try to start the vm I get: > > > > /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s > > 2,virtio-blk,./vm/vm1/vm1.img -s 3,virtio-net,tap1 -s > > 4,ahci-cd,./vm/vm1/vm1.iso -S 31,uart,stdio vm1 > > > > vm exit[0] > > > > reason VMX > > > > rip 0x0000000000000000 > > > > > > inst_length 0 > > > > > > error 0 > > > > > > exit_reason 33 > > > > > > > > qualification 0x0000000000000000 > > > > Looks like you are running into every possible problem there is :-) > > Anyways, could you confirm that you are loading the guest kernel into > 'vm1' using grub-bhyve before executing the command above? > > best > Neel > > > > > > > > > > > /J > > > > > > On Thu, Jan 23, 2014 at 5:00 PM, Jonas B=FClow > wrote: > > > >> I will describe the steps when I manage to reproduce the installation. > >> Right now I get stuck with undestroyable vm instances: > >> > >> root@bulow:/mnt/bhyve-script # ls /dev/vmm/ > >> > >> lin0 > >> > >> root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 > >> > >> errno =3D 22 > >> > >> > >> On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager < > mgamsjager@gmail.com>wrote: > >> > >>> Could you elaborate what you did to get it working? > >>> > >>> > >>> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow >wrote: > >>> > >>>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBS= D > >>>> 10.0-RELEASE. > >>>> > >>>> > >>>> > >>>> /J > >>>> > >>>> > >>>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman > >>>> wrote: > >>>> > >>>> > > >>>> > > >>>> > > >>>> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >>>> >wrote: > >>>> > > >>>> >> I do use the precanned bhyve-script "vm0" (if that is what you > mean). > >>>> It > >>>> >> explicitly mentions linux support. bhyveload can't be user for > other > >>>> images > >>>> >> than FreeBSD so I don't know how to use your script for a linux O= S > >>>> >> > >>>> > > >>>> > Since I have not used bhyve-grub personally yet I can not recommen= d > >>>> what > >>>> > the correct loader command line but if bhyve-script is in anyway > >>>> related to > >>>> > vmrun.sh I would be highly suspicious of any command lines you > manage > >>>> to > >>>> > extract from it since they are often not the ones actual called. > >>>> > > >>>> > > >>>> >> > >>>> >> I assume the image is file backed as I have not assigned a > dedicated > >>>> >> partition to the vm (and I don't know how to do that). > >>>> >> > >>>> > > >>>> > You can keep them anywhere no need for a special volume (mater of > fact > >>>> I > >>>> > was just reusing the name of one of the diretoriess that PC create= s > >>>> during > >>>> > install even without it being a different vol [just assumes any FS > >>>> > boundaries are the host OS's problem)... you can put the disk imag= e > any > >>>> > where (your home directory would be fine for example) > >>>> > > >>>> _______________________________________________ > >>>> freebsd-virtualization@freebsd.org mailing list > >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >>>> To unsubscribe, send any mail to " > >>>> freebsd-virtualization-unsubscribe@freebsd.org" > >>>> > >>> > >>> > >> > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 22:20:53 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 932B5122 for ; Thu, 23 Jan 2014 22:20:53 +0000 (UTC) Received: from mail-ve0-x22b.google.com (mail-ve0-x22b.google.com [IPv6:2607:f8b0:400c:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3EF8612F7 for ; Thu, 23 Jan 2014 22:20:53 +0000 (UTC) Received: by mail-ve0-f171.google.com with SMTP id pa12so1509799veb.16 for ; Thu, 23 Jan 2014 14:20:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=eR+Bg137lBSH/kgZnzSoCVXYU+L9MLr9ACDuEmFMxv0=; b=ZIwGkXSxZ6rL92Cc0PTEmIB1l+V0z4VoQgKGddfJCGDy5hVMjbTlZClIU2iwhAVXKk KRzj7wMT9A0r/Y+KTrBbwF95l5RZ8vqu+QFCx3AJGSmK63Mh7Vt9BmHoPK5DzQaVIyfF XaTXb9EZ5xTZg6iRheuMbDLTULxrvkwQMEs8euX5EOETQlcPXaqYXdtLE2nE5T/zCvUp gSW5TLIkBUD+zT4gYc3kbhx6yUY5trNF5bomgK+CNEFkhcNSY4fYsD1MOjcnOdV5oxTM oqmz9HZNceFCi0Jnl96jByoFh4TdN6wRo9vDaxdvaA0OtnzpJi2hztVoaW1zQbJbACW6 grmQ== MIME-Version: 1.0 X-Received: by 10.221.37.1 with SMTP id tc1mr5776698vcb.32.1390515652408; Thu, 23 Jan 2014 14:20:52 -0800 (PST) Received: by 10.220.0.137 with HTTP; Thu, 23 Jan 2014 14:20:52 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 23:20:52 +0100 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: =?ISO-8859-1?Q?Jonas_B=FClow?= To: Neel Natu Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 22:20:53 -0000 Hi, I managed to get it working again. I did the last grub step wrong. So, the step-by-step instructions how to install ubuntu 13.10 are: kldload vmm kldload if_tap kldload bridgestp kldload if_bridge ifconfig tap0 create ifconfig bridge0 create ifconfig bridge0 up ifconfig bridge0 addm tap0 addm em0 mkdir ubuntu ...fetch ubuntu13.10 iso image and put it in ubuntu/ubuntu.iso create the file ubuntu/device.map with the following content (2 lines): (hd0) ./ubuntu/ubuntu.img (cd0) ./ubuntu/ubuntu.iso truncate -s 8G ubuntu/ubuntu.img grub-bhyve -r cd0 -m ./ubuntu/device.map -M 2048 ubuntu /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s 2,virtio-blk,./ubuntu/ubuntu.img -s 3,virtio-net,tap0 -s 4,ahci-cd,./ubuntu/ubuntu.iso -S 31,uart,stdio ubuntu ...install ubuntu. bhyvectl --destroy --vm=3Dubuntu grub-bhyve -r hd0,msdos1 -m ./ubuntu/device.map -M 2048 ubuntu ...select ubuntu ...see some errors: error: file `/boot/grub/x86_64-emu/all_video.mod' not found. error: file `/boot/grub/x86_64-emu/gzio.mod' not found. error: file `/boot/grub/x86_64-emu/part_msdos.mod' not found. error: file `/boot/grub/x86_64-emu/ext2.mod' not found. /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s 2,virtio-blk,./ubuntu/ubuntu.img -s 3,virtio-net,tap0 -s 4,ahci-cd,./ubuntu/ubuntu.iso -S 31,uart,stdio ubuntu ...boots ...login jonas@ubuntu:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 13.10 Release: 13.10 Codename: saucy jonas@ubuntu:~$ uname -a Linux ubuntu 3.11.0-12-generic #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux Note: there is no clean way of exiting a bhyve vm other than killing it (after halt or shutdown in the guest). The vm must be destroyed before starting it again. Trying to run the same bhyve command line again just hangs (vmidle, high CPU). procstat gives: PID TID COMM TDNAME KSTACK 2381 100531 bhyve mevent 2381 100532 bhyve vtnet-3:0 tx mi_switch sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep do_wait __umtx_op_wait_uint_private amd64_syscall Xfast_syscall 2381 100533 bhyve vcpu 0 mi_switch sleepq_timedwait msleep_spin_sbt vm_run vmmdev_ioctl devfs_ioctl_f kern_ioctl sys_ioctl amd64_syscall Xfast_syscall /J On Thu, Jan 23, 2014 at 10:45 PM, Neel Natu wrote: > Hi Jonas, > > On Thu, Jan 23, 2014 at 1:02 PM, Jonas B=FClow > wrote: > > I had one working ubuntu13.10 vm instance but I'm unable to reproduce i= t. > > When I try to start the vm I get: > > > > /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s > > 2,virtio-blk,./vm/vm1/vm1.img -s 3,virtio-net,tap1 -s > > 4,ahci-cd,./vm/vm1/vm1.iso -S 31,uart,stdio vm1 > > > > vm exit[0] > > > > reason VMX > > > > rip 0x0000000000000000 > > > > > > inst_length 0 > > > > > > error 0 > > > > > > exit_reason 33 > > > > > > > > qualification 0x0000000000000000 > > > > Looks like you are running into every possible problem there is :-) > > Anyways, could you confirm that you are loading the guest kernel into > 'vm1' using grub-bhyve before executing the command above? > > best > Neel > > > > > > > > > > > /J > > > > > > On Thu, Jan 23, 2014 at 5:00 PM, Jonas B=FClow > wrote: > > > >> I will describe the steps when I manage to reproduce the installation. > >> Right now I get stuck with undestroyable vm instances: > >> > >> root@bulow:/mnt/bhyve-script # ls /dev/vmm/ > >> > >> lin0 > >> > >> root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 > >> > >> errno =3D 22 > >> > >> > >> On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager < > mgamsjager@gmail.com>wrote: > >> > >>> Could you elaborate what you did to get it working? > >>> > >>> > >>> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow >wrote: > >>> > >>>> Success. I have a working ubuntu 13.10 running under bhyve on FreeBS= D > >>>> 10.0-RELEASE. > >>>> > >>>> > >>>> > >>>> /J > >>>> > >>>> > >>>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman > >>>> wrote: > >>>> > >>>> > > >>>> > > >>>> > > >>>> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow >>>> >wrote: > >>>> > > >>>> >> I do use the precanned bhyve-script "vm0" (if that is what you > mean). > >>>> It > >>>> >> explicitly mentions linux support. bhyveload can't be user for > other > >>>> images > >>>> >> than FreeBSD so I don't know how to use your script for a linux O= S > >>>> >> > >>>> > > >>>> > Since I have not used bhyve-grub personally yet I can not recommen= d > >>>> what > >>>> > the correct loader command line but if bhyve-script is in anyway > >>>> related to > >>>> > vmrun.sh I would be highly suspicious of any command lines you > manage > >>>> to > >>>> > extract from it since they are often not the ones actual called. > >>>> > > >>>> > > >>>> >> > >>>> >> I assume the image is file backed as I have not assigned a > dedicated > >>>> >> partition to the vm (and I don't know how to do that). > >>>> >> > >>>> > > >>>> > You can keep them anywhere no need for a special volume (mater of > fact > >>>> I > >>>> > was just reusing the name of one of the diretoriess that PC create= s > >>>> during > >>>> > install even without it being a different vol [just assumes any FS > >>>> > boundaries are the host OS's problem)... you can put the disk imag= e > any > >>>> > where (your home directory would be fine for example) > >>>> > > >>>> _______________________________________________ > >>>> freebsd-virtualization@freebsd.org mailing list > >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >>>> To unsubscribe, send any mail to " > >>>> freebsd-virtualization-unsubscribe@freebsd.org" > >>>> > >>> > >>> > >> > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 23 22:26:23 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0D21C2D5 for ; Thu, 23 Jan 2014 22:26:23 +0000 (UTC) Received: from mail-pb0-x22f.google.com (mail-pb0-x22f.google.com [IPv6:2607:f8b0:400e:c01::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C5CEB132E for ; Thu, 23 Jan 2014 22:26:22 +0000 (UTC) Received: by mail-pb0-f47.google.com with SMTP id rp16so2423953pbb.20 for ; Thu, 23 Jan 2014 14:26:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=lyknhuHh4wrgXp+NzPj3xi57s9FGgUX0IaFq9cmGS2c=; b=SIz7bipLCjjdcxgdwfh9kr/pIHit4UQGLKkMmfP9PICDNNgC1Fid2yPrL+LJw3LHCg 8Irehz27Tc0djjpUsC7c2bDXCznPVvsX2Vlu6c7cLEe9rB2D3gsj6PaJ+bFoIM5gY9PT dpWMc1A9s1AHcOChOLmSiUiR3QlourF9Aa7xylEUhHdDYiymL8JdWby4oRPYUwQ9pJav HZon3y33sWTck97PE6OdHwyaBG+44xPaV9akf6jJ7obaMn/XGvm7T0LV0F4tbXXQyz5J HSXnwshyL+Y/bf/XUBlEPt8jaYULNdNU2HsAqaq5rg4xpCWPzzc+GI3jviOX45bfuSMk H1Mg== MIME-Version: 1.0 X-Received: by 10.66.149.37 with SMTP id tx5mr10474379pab.81.1390515979381; Thu, 23 Jan 2014 14:26:19 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 14:26:19 -0800 (PST) In-Reply-To: References: <52E0C1D4.9000304@freebsd.org> <52E0D1BB.2050807@callfortesting.org> Date: Thu, 23 Jan 2014 17:26:19 -0500 Message-ID: Subject: Re: Linux on BHyVe in 10.0-RELEASE From: Aryeh Friedman To: =?ISO-8859-1?Q?Jonas_B=FClow?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2014 22:26:23 -0000 I will have this or something like this encapslated into the petitecloud run scripts by monday (as well fixing the issues in the other thread) On Thu, Jan 23, 2014 at 5:20 PM, Jonas B=FClow wrot= e: > Hi, > > I managed to get it working again. I did the last grub step wrong. So, th= e > step-by-step instructions how to install ubuntu 13.10 are: > > kldload vmm > kldload if_tap > kldload bridgestp > kldload if_bridge > ifconfig tap0 create > ifconfig bridge0 create > ifconfig bridge0 up > ifconfig bridge0 addm tap0 addm em0 > > mkdir ubuntu > ...fetch ubuntu13.10 iso image and put it in ubuntu/ubuntu.iso > create the file ubuntu/device.map with the following content (2 lines): > (hd0) ./ubuntu/ubuntu.img > (cd0) ./ubuntu/ubuntu.iso > > truncate -s 8G ubuntu/ubuntu.img > > grub-bhyve -r cd0 -m ./ubuntu/device.map -M 2048 ubuntu > /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s > 2,virtio-blk,./ubuntu/ubuntu.img -s 3,virtio-net,tap0 -s > 4,ahci-cd,./ubuntu/ubuntu.iso -S 31,uart,stdio ubuntu > > ...install ubuntu. > > bhyvectl --destroy --vm=3Dubuntu > > grub-bhyve -r hd0,msdos1 -m ./ubuntu/device.map -M 2048 ubuntu > ...select ubuntu > ...see some errors: > > error: file `/boot/grub/x86_64-emu/all_video.mod' not found. > > error: file `/boot/grub/x86_64-emu/gzio.mod' not found. > > error: file `/boot/grub/x86_64-emu/part_msdos.mod' not found. > > error: file `/boot/grub/x86_64-emu/ext2.mod' not found. > > /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s > 2,virtio-blk,./ubuntu/ubuntu.img -s 3,virtio-net,tap0 -s > 4,ahci-cd,./ubuntu/ubuntu.iso -S 31,uart,stdio ubuntu > ...boots > ...login > > jonas@ubuntu:~$ lsb_release -a > > No LSB modules are available. > > Distributor ID: Ubuntu > > Description: Ubuntu 13.10 > > Release: 13.10 > > Codename: saucy > > jonas@ubuntu:~$ uname -a > > Linux ubuntu 3.11.0-12-generic #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013 > x86_64 x86_64 x86_64 GNU/Linux > > > Note: there is no clean way of exiting a bhyve vm other than killing it > (after halt or shutdown in the guest). The vm must be destroyed before > starting it again. Trying to run the same bhyve command line again just > hangs (vmidle, high CPU). procstat gives: > > PID TID COMM TDNAME KSTACK > > 2381 100531 bhyve mevent > > 2381 100532 bhyve vtnet-3:0 tx mi_switch > sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep do_wait > __umtx_op_wait_uint_private amd64_syscall Xfast_syscall > > 2381 100533 bhyve vcpu 0 mi_switch sleepq_timedwait > msleep_spin_sbt vm_run vmmdev_ioctl devfs_ioctl_f kern_ioctl sys_ioctl > amd64_syscall Xfast_syscall > > > > /J > > > > > On Thu, Jan 23, 2014 at 10:45 PM, Neel Natu wrote: > > > Hi Jonas, > > > > On Thu, Jan 23, 2014 at 1:02 PM, Jonas B=FClow > > wrote: > > > I had one working ubuntu13.10 vm instance but I'm unable to reproduce > it. > > > When I try to start the vm I get: > > > > > > /usr/sbin/bhyve -c 1 -m 2048 -A -I -H -s 0,hostbridge -s > > > 2,virtio-blk,./vm/vm1/vm1.img -s 3,virtio-net,tap1 -s > > > 4,ahci-cd,./vm/vm1/vm1.iso -S 31,uart,stdio vm1 > > > > > > vm exit[0] > > > > > > reason VMX > > > > > > rip 0x0000000000000000 > > > > > > > > > inst_length 0 > > > > > > > > > error 0 > > > > > > > > > exit_reason 33 > > > > > > > > > > > > qualification 0x0000000000000000 > > > > > > > Looks like you are running into every possible problem there is :-) > > > > Anyways, could you confirm that you are loading the guest kernel into > > 'vm1' using grub-bhyve before executing the command above? > > > > best > > Neel > > > > > > > > > > > > > > > > > /J > > > > > > > > > On Thu, Jan 23, 2014 at 5:00 PM, Jonas B=FClow > > wrote: > > > > > >> I will describe the steps when I manage to reproduce the installatio= n. > > >> Right now I get stuck with undestroyable vm instances: > > >> > > >> root@bulow:/mnt/bhyve-script # ls /dev/vmm/ > > >> > > >> lin0 > > >> > > >> root@bulow:/mnt/bhyve-script # bhyvectl --destroy --vm=3Dlin0 > > >> > > >> errno =3D 22 > > >> > > >> > > >> On Thu, Jan 23, 2014 at 3:44 PM, Matthias Gamsjager < > > mgamsjager@gmail.com>wrote: > > >> > > >>> Could you elaborate what you did to get it working? > > >>> > > >>> > > >>> On Thu, Jan 23, 2014 at 3:41 PM, Jonas B=FClow > >wrote: > > >>> > > >>>> Success. I have a working ubuntu 13.10 running under bhyve on > FreeBSD > > >>>> 10.0-RELEASE. > > >>>> > > >>>> > > >>>> > > >>>> /J > > >>>> > > >>>> > > >>>> On Thu, Jan 23, 2014 at 11:37 AM, Aryeh Friedman > > >>>> wrote: > > >>>> > > >>>> > > > >>>> > > > >>>> > > > >>>> > On Thu, Jan 23, 2014 at 5:05 AM, Jonas B=FClow < > jonas.bulow@gmail.com > > >>>> >wrote: > > >>>> > > > >>>> >> I do use the precanned bhyve-script "vm0" (if that is what you > > mean). > > >>>> It > > >>>> >> explicitly mentions linux support. bhyveload can't be user for > > other > > >>>> images > > >>>> >> than FreeBSD so I don't know how to use your script for a linux > OS > > >>>> >> > > >>>> > > > >>>> > Since I have not used bhyve-grub personally yet I can not > recommend > > >>>> what > > >>>> > the correct loader command line but if bhyve-script is in anyway > > >>>> related to > > >>>> > vmrun.sh I would be highly suspicious of any command lines you > > manage > > >>>> to > > >>>> > extract from it since they are often not the ones actual called. > > >>>> > > > >>>> > > > >>>> >> > > >>>> >> I assume the image is file backed as I have not assigned a > > dedicated > > >>>> >> partition to the vm (and I don't know how to do that). > > >>>> >> > > >>>> > > > >>>> > You can keep them anywhere no need for a special volume (mater o= f > > fact > > >>>> I > > >>>> > was just reusing the name of one of the diretoriess that PC > creates > > >>>> during > > >>>> > install even without it being a different vol [just assumes any = FS > > >>>> > boundaries are the host OS's problem)... you can put the disk > image > > any > > >>>> > where (your home directory would be fine for example) > > >>>> > > > >>>> _______________________________________________ > > >>>> freebsd-virtualization@freebsd.org mailing list > > >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > >>>> To unsubscribe, send any mail to " > > >>>> freebsd-virtualization-unsubscribe@freebsd.org" > > >>>> > > >>> > > >>> > > >> > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 03:44:25 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E0D87E1A; Fri, 24 Jan 2014 03:44:25 +0000 (UTC) Received: from mail-lb0-x233.google.com (mail-lb0-x233.google.com [IPv6:2a00:1450:4010:c04::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 26B411E80; Fri, 24 Jan 2014 03:44:24 +0000 (UTC) Received: by mail-lb0-f179.google.com with SMTP id l4so2162325lbv.10 for ; Thu, 23 Jan 2014 19:44:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=baz+ODQiro/KRUCgMRlm1/uk4nzl+jO2yPyFJ2GZ184=; b=hKknHjFFdits4kKW8Qj+qe9Byphm4n/lrAnj144o4YHEI9mLQ6/xzD3BRgiXD2KZ/6 tzDhz9sfWiyDLxZwYedUJE0t1PQoe/zrNamZoOmTv//uxc0Wsb1nHd4Rlft3lAlVn4PK jLq9dxGHTL/QIQ6n5rl4GPhPNq8MBB6vrQl6dSPCsk7k8Uc2an5A0CUCNPHwUOaTGT3Z oYqbDHeux/2zrE1t6ky58v2smLglfa6Vld1HEmzFoosTvvvTZbpfidujpJybGICqg+Ai ylKQY4gzd0SBRLRu9WuAAvGdMieej1xKjWDFfxbkdaLjJQWEB9T+BObPngeETZLTGbqO 4KJA== MIME-Version: 1.0 X-Received: by 10.112.135.9 with SMTP id po9mr7033289lbb.8.1390535062969; Thu, 23 Jan 2014 19:44:22 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.148.4 with HTTP; Thu, 23 Jan 2014 19:44:22 -0800 (PST) Date: Thu, 23 Jan 2014 19:44:22 -0800 X-Google-Sender-Auth: KzVcRkipI6rzL7k1Up7AnM8tERI Message-ID: Subject: rc.d scripts for starting BHyve from rc.d From: Craig Rodrigues To: "freebsd-virtualization@freebsd.org" , freebsd-rc@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 03:44:26 -0000 Hi, I put together some scripts for starting a BHyve VM when a system boots. When the system boots, the console of the VM uses /dev/nmdm. It is possible to connect to the console of the VM with: cu -l /dev/nmdm0B It is a bit rough, but works nicely. Does someone out there have better scripts for doing this? Can some of the existing rc.d scripts for jails be reused for BHyve? I did the following: == put following entries in /etc/sysctl.conf == # BHyve needs this for tap interfaces net.link.tap.user_open=1 net.link.tap.up_on_open=1 ================================================================= == put following in /etc/rc.conf == ##################################################### # Create tap devices, one tap interface per BHyve VM. # Add the tap interfaces to bridge0 #################################################### cloned_interfaces="bridge0 tap0" autobridge_interfaces="bridge0" # change igb0 to whatever NIC you are using autobridge_bridge0="tap* igb0" == put following file in /usr/local/etc/rc.d/bhyvevm == #!/bin/sh # # $FreeBSD$ # # PROVIDE: bhyvevm # REQUIRE: netif bgfsck sshd LOGIN localpkg # KEYWORD: shutdown # . /etc/rc.subr name="bhyvevm" rcvar="bhyvevm_enable" start_cmd="bhyvevm_start" stop_cmd="bhyvevm_stop" # read configuration and set defaults load_rc_config "$name" : ${bhyvevm_enable="YES"} bhyvevm_start() { /vm/10.0/start_vm.sh } bhyvevm_stop() { /vm/10.0/stop_vm.sh vm1 } run_rc_command "$1" == put following script in /vm/10.0/start_vm.sh == #!/bin/sh VM=vm1 CONS_A=/dev/nmdm0A CONS_B=${CONS_A%%A}B IMG=/vm/10.0/disk.img TAP=tap0 BRIDGE=bridge0 touch ${CONS_A} if [ -e /dev/vmm/${VM} ]; then /usr/sbin/bhyvectl --vm=${VM} --destroy fi echo "Starting BHyve virtual machine named '${VM}'. Use 'cu -l ${CONS_B}' to access console" cmd="/usr/sbin/bhyveload -m 8G -d ${IMG} -c ${CONS_A} ${VM}" $cmd ret=$? if [ $ret -ne 0 ]; then echo "[FAILED]: $cmd" exit $ret fi ifconfig bridge0 up cmd="/usr/sbin/bhyve -c 16 -m 8G -A -H -P -g 0 -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,${TAP} -s 3:0,virtio-blk,${IMG} -l com1,${CONS_A} ${VM}" $cmd & ifconfig bridge0 up sleep 5 echo "~." | cu -l ${CONS_B} ================================================================= ==== put following script in /vm/10.0/stop_vm.sh === #!/bin/sh usage() { echo $0 "[vm name]" } if [ $# -lt 1 ]; then usage exit 1 fi VM=$1 echo "Stopping BHyve virtual machine named '$VM'" PID=`pgrep bhyve` if [ -n "$PID" ]; then kill $PID fi COUNT=0 while [ $COUNT -lt 20 -a -n "$PID" ] ; do PID2=`pgrep bhyve` if [ "$PID" != "$PID2" ]; then break fi sleep 5 done if [ -e /dev/vmm/${VM} ]; then /usr/sbin/bhyvectl --vm=${VM} --destroy fi exit 0 ================================================================= -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 04:01:16 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A5EF8258; Fri, 24 Jan 2014 04:01:16 +0000 (UTC) Received: from mail-pd0-x22f.google.com (mail-pd0-x22f.google.com [IPv6:2607:f8b0:400e:c02::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 707E31F9B; Fri, 24 Jan 2014 04:01:16 +0000 (UTC) Received: by mail-pd0-f175.google.com with SMTP id w10so2615918pde.34 for ; Thu, 23 Jan 2014 20:01:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=+rufZd1bq3fyunkepR3cDCV68zr6J+JnUbUltzTDv4M=; b=oXCucE53sXe07bcWcUPfJaiutmrnUlriGSWWjgDOHLtnfgEK4ZNXDy2kYqrYAiGspc rEszKMb5bt5OCxJNxCnlUlTZI5ruMhZxXhbreUB9orQ8ia38HlLV2go/AhuM6RYW/nGJ Tj1GvRH+zePRF45Ym3ziGU6itGCoqrsd3S9jw2CcO7ombR7tXmH1aHZAgBYzCdc8Kha1 8wOdX0G7WRBQWPLNdH1AWoQ/5m5JdFVFWmljPTSgq2SewNsfn1XBJ49XRM0mJMb8cv7u t3+lLabxeBLf4rqMPD9pqoX26lbU/9el+fsUM3MLu3pDjOtUR7Kc/7ibq9ka83ff3aU2 tfWQ== MIME-Version: 1.0 X-Received: by 10.66.192.74 with SMTP id he10mr12055866pac.126.1390536075908; Thu, 23 Jan 2014 20:01:15 -0800 (PST) Received: by 10.68.155.38 with HTTP; Thu, 23 Jan 2014 20:01:15 -0800 (PST) In-Reply-To: References: Date: Thu, 23 Jan 2014 23:01:15 -0500 Message-ID: Subject: Re: rc.d scripts for starting BHyve from rc.d From: Aryeh Friedman To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-rc@freebsd.org, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 04:01:16 -0000 Except for the consoles petitecloud does it much more smoothly (see thread on getting linux to run on bhyve on -RELEASE for the script).... namely it should not need conditional logic (instead of being autogenerated on demand) On Thu, Jan 23, 2014 at 10:44 PM, Craig Rodrigues wrote: > Hi, > > I put together some scripts for starting a BHyve VM > when a system boots. When the system boots, the console > of the VM uses /dev/nmdm. It is possible to connect > to the console of the VM with: cu -l /dev/nmdm0B > > It is a bit rough, but works nicely. > Does someone out there have better scripts for doing this? > > Can some of the existing rc.d scripts for jails be reused for BHyve? > > > > > I did the following: > > == put following entries in /etc/sysctl.conf == > # BHyve needs this for tap interfaces > net.link.tap.user_open=1 > net.link.tap.up_on_open=1 > ================================================================= > > == put following in /etc/rc.conf == > ##################################################### > # Create tap devices, one tap interface per BHyve VM. > # Add the tap interfaces to bridge0 > #################################################### > cloned_interfaces="bridge0 tap0" > > autobridge_interfaces="bridge0" > # change igb0 to whatever NIC you are using > autobridge_bridge0="tap* igb0" > > > > == put following file in /usr/local/etc/rc.d/bhyvevm == > #!/bin/sh > # > # $FreeBSD$ > # > > # PROVIDE: bhyvevm > # REQUIRE: netif bgfsck sshd LOGIN localpkg > # KEYWORD: shutdown > # > > . /etc/rc.subr > > name="bhyvevm" > rcvar="bhyvevm_enable" > > start_cmd="bhyvevm_start" > stop_cmd="bhyvevm_stop" > > # read configuration and set defaults > load_rc_config "$name" > : ${bhyvevm_enable="YES"} > > > bhyvevm_start() > { > /vm/10.0/start_vm.sh > } > > bhyvevm_stop() > { > /vm/10.0/stop_vm.sh vm1 > } > run_rc_command "$1" > > == put following script in /vm/10.0/start_vm.sh == > #!/bin/sh > VM=vm1 > CONS_A=/dev/nmdm0A > CONS_B=${CONS_A%%A}B > IMG=/vm/10.0/disk.img > TAP=tap0 > BRIDGE=bridge0 > > touch ${CONS_A} > if [ -e /dev/vmm/${VM} ]; then > /usr/sbin/bhyvectl --vm=${VM} --destroy > fi > > echo "Starting BHyve virtual machine named '${VM}'. Use 'cu -l ${CONS_B}' > to access console" > cmd="/usr/sbin/bhyveload -m 8G -d ${IMG} -c ${CONS_A} ${VM}" > $cmd > ret=$? > if [ $ret -ne 0 ]; then > echo "[FAILED]: $cmd" > exit $ret > fi > ifconfig bridge0 up > cmd="/usr/sbin/bhyve -c 16 -m 8G -A -H -P -g 0 -s 0:0,hostbridge -s 1:0,lpc > -s 2:0,virtio-net,${TAP} -s 3:0,virtio-blk,${IMG} -l com1,${CONS_A} ${VM}" > $cmd & > ifconfig bridge0 up > sleep 5 > echo "~." | cu -l ${CONS_B} > ================================================================= > > ==== put following script in /vm/10.0/stop_vm.sh === > #!/bin/sh > > usage() > { > echo $0 "[vm name]" > } > > if [ $# -lt 1 ]; then > usage > exit 1 > fi > VM=$1 > > echo "Stopping BHyve virtual machine named '$VM'" > > PID=`pgrep bhyve` > if [ -n "$PID" ]; then > kill $PID > fi > > COUNT=0 > while [ $COUNT -lt 20 -a -n "$PID" ] ; do > PID2=`pgrep bhyve` > if [ "$PID" != "$PID2" ]; then > break > fi > sleep 5 > done > > if [ -e /dev/vmm/${VM} ]; then > /usr/sbin/bhyvectl --vm=${VM} --destroy > fi > > exit 0 > ================================================================= > > > > -- > Craig > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 09:36:00 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F4198EF for ; Fri, 24 Jan 2014 09:35:59 +0000 (UTC) Received: from mail-oa0-f51.google.com (mail-oa0-f51.google.com [209.85.219.51]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B2CA9183E for ; Fri, 24 Jan 2014 09:35:57 +0000 (UTC) Received: by mail-oa0-f51.google.com with SMTP id h16so3545670oag.10 for ; Fri, 24 Jan 2014 01:35:57 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=8ViQum2CyskpN7GBfEKTYQ6kGLtgOQLcr0CWgEz7OLo=; b=heM2TDuUlde+duepUwTrJZ7/BLNDNAp8sTrsK6ok1mOHCmZJdZoTNab8xYHWF2Vq49 s5GGhpD6m9VK5RFi/msLj9//CpocT9IFFGIN7h/6ugaGfBPC00mmWIH9JLyr2q5HxKwF ykxYZZKPdNlUXsI6A5i1tQaby61w/6b7t26euu7h54Irl87MTySKrHTLgVSbmujUNU/H MvjkSxYhkUX7/881LTdnz/PSnKYbvL5q/gS0GW+k4ZFix6YBcvy32lXfqvulOX6WR0AX iwnzt85ipeLcWzQ1GhsqIbYc/nkD1Xw2CeD6mbsmovjBptwJWx58ogITXzzKap4jQ7Ke v4pw== X-Gm-Message-State: ALoCoQncKJXLC4k7sNsZ/rFyS15SED0yjIO5HWnIxmFRBIwgJMqnFGlJbiAnN2f1DSgYuxtHMm5n X-Received: by 10.182.22.33 with SMTP id a1mr363195obf.60.1390556157013; Fri, 24 Jan 2014 01:35:57 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id oo13sm2136109oeb.0.2014.01.24.01.35.55 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 24 Jan 2014 01:35:56 -0800 (PST) Message-ID: <52E233FA.5010602@callfortesting.org> Date: Fri, 24 Jan 2014 01:35:54 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Aryeh Friedman , Craig Rodrigues Subject: Re: rc.d scripts for starting BHyve from rc.d References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-rc@freebsd.org, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 09:36:00 -0000 On 1/23/14 8:01 PM, Aryeh Friedman wrote: > Except for the consoles petitecloud does it much more smoothly... May I kindly suggest that you not use this list for PR or to slam the work of others? Michael From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 10:24:48 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 89654A30 for ; Fri, 24 Jan 2014 10:24:48 +0000 (UTC) Received: from mail-oa0-f50.google.com (mail-oa0-f50.google.com [209.85.219.50]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4D3E11E31 for ; Fri, 24 Jan 2014 10:24:48 +0000 (UTC) Received: by mail-oa0-f50.google.com with SMTP id n16so3603718oag.9 for ; Fri, 24 Jan 2014 02:24:47 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:content-type:content-transfer-encoding; bh=mcGRGvHadFA1/B46wOkiWqWZZGAfGft9alx1V/QbLnE=; b=aX9fUUvjCfROMcBFhY0qgIXdtF3MNz6GSmBqg6O4xaPY+9+b62mRe1TUqt1hAFi4Yo ehzTaqB7KeL8i498l59SejvxW33oUMmbQUdgMlrvxmYkmC8NSCZYZoiIEzSJIcWXfaWK z4Y/y6ocayTaw9TLocYXPJ4lWSisJ2n7NvXZIJ5IpuGLISw9vWfoVKqDef3PSuh0piaP AZj7DaZzl1rfM0LBsBs8pV0++lN2dM7pFpZZVRVEOLMP64Qr37VC9YfNxfn3jYxbvCBk tTMdPBLd5NuIrEuxKwoWl9ndm0KkXy6iHIiWo+hDEpenDsCqQZJ5+1aJcHyK41V8fzDV tBFw== X-Gm-Message-State: ALoCoQmLiWIVMrF4LmUoOTSl06FggUeDe/IaTPKpQJqmKNL2Q6venRrC/tqpcXfCkdQ/MD8x/+HS X-Received: by 10.60.76.227 with SMTP id n3mr1434825oew.52.1390558684331; Fri, 24 Jan 2014 02:18:04 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id o7sm1287816oed.3.2014.01.24.02.18.03 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 24 Jan 2014 02:18:03 -0800 (PST) Message-ID: <52E23DDB.5040007@callfortesting.org> Date: Fri, 24 Jan 2014 02:18:03 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: Public Service Announcement: The name is "bhyve" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 10:24:48 -0000 Hello all, It was "BHyVe" and Neel and Peter mercifully simplified it to "bhyve". It was never "BHyve" and how they came up with "byhyve" and "byhve" in the same article I do not know: http://www.serverwatch.com/server-news/open-source-freebsd-10-takes-on-virtualization.html Haters gonna hate? Michael From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 10:41:53 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B7545D58 for ; Fri, 24 Jan 2014 10:41:53 +0000 (UTC) Received: from mail.grem.de (outcast.grem.de [213.239.217.27]) by mx1.freebsd.org (Postfix) with SMTP id 06E911F63 for ; Fri, 24 Jan 2014 10:41:52 +0000 (UTC) Received: (qmail 34940 invoked by uid 89); 24 Jan 2014 10:41:44 -0000 Received: from unknown (HELO bsd64.grem.de) (mg@grem.de@88.217.181.240) by mail.grem.de with ESMTPA; 24 Jan 2014 10:41:44 -0000 Date: Fri, 24 Jan 2014 11:41:43 +0100 From: Michael Gmelin To: Michael Dexter Subject: Re: Public Service Announcement: The name is "bhyve" Message-ID: <20140124114143.3730a864@bsd64.grem.de> In-Reply-To: <52E23DDB.5040007@callfortesting.org> References: <52E23DDB.5040007@callfortesting.org> X-Mailer: Claws Mail 3.9.2 (GTK+ 2.24.18; amd64-portbld-freebsd9.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 10:41:53 -0000 On Fri, 24 Jan 2014 02:18:03 -0800 Michael Dexter wrote: > > Hello all, > > It was "BHyVe" and Neel and Peter mercifully simplified it to "bhyve". > > It was never "BHyve" and how they came up with "byhyve" and "byhve" in > the same article I do not know: > > http://www.serverwatch.com/server-news/open-source-freebsd-10-takes-on-virtualization.html > > Haters gonna hate? > Lack of attention to detail != hate. -- Michael Gmelin From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 10:46:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B063BEC0 for ; Fri, 24 Jan 2014 10:46:20 +0000 (UTC) Received: from mail-oa0-f49.google.com (mail-oa0-f49.google.com [209.85.219.49]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 718441F82 for ; Fri, 24 Jan 2014 10:46:15 +0000 (UTC) Received: by mail-oa0-f49.google.com with SMTP id i7so3507854oag.8 for ; Fri, 24 Jan 2014 02:46:08 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=nJuD1foHF4B+uGuSIzEc8UGUZCmMdu5Fyci9QqA1psU=; b=NgJJyPOZxq33F8gLRrY98c/aMkHx5K+usR715M5vJ8CBfjJzBTtWtS+rwEqOZv7uF2 6aLDyH6tqDwsfpJFSteRLLH9zIiUDd3H8lnAlIn8KauI+GfwJjQRSZWEMW/at6nmk4ZJ PXfNmbaR+tsLA5au0U3rVhkUw811faRpXxjmfHisV01qljOn0EfJWUuESm6vNeDcWnvZ NO4Ou8A4p7vlkmivGq0nQDtcHs4x1eD309gldidYUuAd2Tlsjuyvscc1XOIAo4QPuopb BYahrJr23VCQlD10Ey/r6lai9njrkEzQcix0BaEK/qzffyj7we3Ia6EHu7NesrvgsAMD bIVg== X-Gm-Message-State: ALoCoQlt88l87PMaM0FQ6jtPi7L5hXeTLkARioKAn4QK0CcsuuHxGQ/43Lk8SuQ/ipAsfqHP0fRN X-Received: by 10.60.94.196 with SMTP id de4mr70632oeb.63.1390560368042; Fri, 24 Jan 2014 02:46:08 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id ii8sm775021obb.11.2014.01.24.02.46.07 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 24 Jan 2014 02:46:07 -0800 (PST) Message-ID: <52E2446E.9090909@callfortesting.org> Date: Fri, 24 Jan 2014 02:46:06 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Michael Gmelin Subject: Re: Public Service Announcement: The name is "bhyve" References: <52E23DDB.5040007@callfortesting.org> <20140124114143.3730a864@bsd64.grem.de> In-Reply-To: <20140124114143.3730a864@bsd64.grem.de> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 10:46:20 -0000 On 1/24/14 2:41 AM, Michael Gmelin wrote: >> Haters gonna hate? >> > Lack of attention to detail != hate. I guess you didn't see the phoronix.com article on bhyve a few months ago. :) They pulled the worst of it. The whole "BSD is dying" or "is poo" in their case FUD is still very active in various circles and you never know. Michael From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 10:53:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8E79C96 for ; Fri, 24 Jan 2014 10:53:20 +0000 (UTC) Received: from mail.grem.de (outcast.grem.de [213.239.217.27]) by mx1.freebsd.org (Postfix) with SMTP id D0016101D for ; Fri, 24 Jan 2014 10:53:19 +0000 (UTC) Received: (qmail 35034 invoked by uid 89); 24 Jan 2014 10:53:18 -0000 Received: from unknown (HELO bsd64.grem.de) (mg@grem.de@88.217.181.240) by mail.grem.de with ESMTPA; 24 Jan 2014 10:53:18 -0000 Date: Fri, 24 Jan 2014 11:53:17 +0100 From: Michael Gmelin To: Michael Dexter Subject: Re: Public Service Announcement: The name is "bhyve" Message-ID: <20140124115317.3b3b2258@bsd64.grem.de> In-Reply-To: <52E2446E.9090909@callfortesting.org> References: <52E23DDB.5040007@callfortesting.org> <20140124114143.3730a864@bsd64.grem.de> <52E2446E.9090909@callfortesting.org> X-Mailer: Claws Mail 3.9.2 (GTK+ 2.24.18; amd64-portbld-freebsd9.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 10:53:20 -0000 On Fri, 24 Jan 2014 02:46:06 -0800 Michael Dexter wrote: > On 1/24/14 2:41 AM, Michael Gmelin wrote: > >> Haters gonna hate? > >> > > Lack of attention to detail != hate. > > I guess you didn't see the phoronix.com article on bhyve a few months > ago. :) They pulled the worst of it. > > The whole "BSD is dying" or "is poo" in their case FUD is still very > active in various circles and you never know. > Oh I've seen it and I usually ignore Phoronix and its comments for exactly this reason, but in this case serverwatch reported on the topic in a factual/neutral way and just got the details wrong. It doesn't seem like a high margin website to me, so they probably didn't spend much time on it ;) Recent bhyve progress is quite impressive by the way. -- Michael Gmelin From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 11:07:10 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E567A4EF for ; Fri, 24 Jan 2014 11:07:10 +0000 (UTC) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id A605B1154 for ; Fri, 24 Jan 2014 11:07:10 +0000 (UTC) Received: by mail-ob0-f182.google.com with SMTP id wm4so3432781obc.13 for ; Fri, 24 Jan 2014 03:07:09 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=Tru8pqJROE9LzJA5wYSyMnq1A/xSTq34tkDe2VDW3Xg=; b=D4V364IozbBprXDUl8RgeqQHvZkWs7NV1KNBfkWbbKWkktVjkqofLFNTSIy78xzi6y 03oe6nKdioHfNs7YUexjp9k0EaHpIYLiaahfrcsIZasmSQvZxImwzczQc2PDU2FVtlE+ EyLL58rKa9ovD7tyOF8Bv2Xib5c6IJJW5+XhkhoyUKo4Fqb0bJF3TU9DmSaj/J+cjHvV sMPtBRA6IPtpq/n6lzm7pDqRddeSfW6E7jzOaEb+LagCx4K5YvtVoL1goTfvIxU5U225 ij7K9WEe6N5sqK+/SEZYagQPDUr7cJBnIYRjU/lAwET+9oCX4gOjBEfyHXYPLNS6sXgU /QDg== X-Gm-Message-State: ALoCoQlX6Cye/y3Wvx6DluUcs08c2+z8wI3jAtf/XWRSubTbCCYvLxJulQhSlp2to0Thm3/NHs/O X-Received: by 10.60.45.38 with SMTP id j6mr2366880oem.2.1390561308429; Fri, 24 Jan 2014 03:01:48 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id oo13sm3395815oeb.0.2014.01.24.03.01.47 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 24 Jan 2014 03:01:48 -0800 (PST) Message-ID: <52E2481A.10902@callfortesting.org> Date: Fri, 24 Jan 2014 03:01:46 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Michael Gmelin Subject: Re: Public Service Announcement: The name is "bhyve" References: <52E23DDB.5040007@callfortesting.org> <20140124114143.3730a864@bsd64.grem.de> <52E2446E.9090909@callfortesting.org> <20140124115317.3b3b2258@bsd64.grem.de> In-Reply-To: <20140124115317.3b3b2258@bsd64.grem.de> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 11:07:11 -0000 On 1/24/14 2:53 AM, Michael Gmelin wrote: > Recent bhyve progress is quite impressive by the way. If it hasn't been said... HUGE thanks to Neel, Peter, John, and Bryan, none of whom want huge, embarrassing thanks. Also many thanks to Anish, Allan, Devin, Paul, Baptiste, Peter, NYC*BUG, Misha and everyone else who has beta tested, presented or helped out bringing bhyve from a purpose-built blunt instrument to an amazing, portable technology with many exciting things in store. Hopefully the first four aren't following this thread. :) Michael From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 12:30:31 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 05C42330 for ; Fri, 24 Jan 2014 12:30:31 +0000 (UTC) Received: from mail-ob0-f181.google.com (mail-ob0-f181.google.com [209.85.214.181]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id BAFEB17A3 for ; Fri, 24 Jan 2014 12:30:23 +0000 (UTC) Received: by mail-ob0-f181.google.com with SMTP id va2so3507204obc.40 for ; Fri, 24 Jan 2014 04:30:16 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=i9E12sWh6lbkfGqwioeP3g2TSi1pRRyoUReNp+XPm94=; b=e3BEusHItwa+CwMumQlyErdPlFHIBrsiu2s+IGuJr1sOsAmESYOOMZxl7vbbpKskbX tnSOD+5ocNsXNvaMQqvYQwpmKdQ/DJiBa+hFDErLDZOq3Di5HX4BaVb4DefWhtn4BdgM fPm2ES54R6vTEyrGxCtCRUmGZGl2Vj2KhKasIm3QeHk5r+/AYvggPc/taeoIjZ/+vUUQ gQXMTXNdrxeX1MzdCAaTnnvjKfKHfIE1lYyRItzjLTLeM3Fxhx6h0a56v86qStCLMcnv fxvl/u44IVxWsTFIuYf8wIjZ+pG6ePJXdFb7W2l1CXFdi7jJZlV1DAYpIyt6BgnNCLdS 0iew== X-Gm-Message-State: ALoCoQnIQcI9Jc0+iIQJTkvTa0Er1rYx1Y/JsbY/XbuXxdwnQZQDo8hqLyy+66nm//wgVupzXzPg X-Received: by 10.60.52.14 with SMTP id p14mr2406482oeo.28.1390562897509; Fri, 24 Jan 2014 03:28:17 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id m4sm3672591oen.7.2014.01.24.03.28.16 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 24 Jan 2014 03:28:17 -0800 (PST) Message-ID: <52E24E4F.7060804@callfortesting.org> Date: Fri, 24 Jan 2014 03:28:15 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Michael Gmelin Subject: Re: Public Service Announcement: The name is "bhyve" References: <52E23DDB.5040007@callfortesting.org> <20140124114143.3730a864@bsd64.grem.de> <52E2446E.9090909@callfortesting.org> <20140124115317.3b3b2258@bsd64.grem.de> In-Reply-To: <20140124115317.3b3b2258@bsd64.grem.de> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 12:30:31 -0000 On 1/24/14 2:53 AM, Michael Gmelin wrote: > Recent bhyve progress is quite impressive by the way. The curse of making a list is... Tycho definitely deserves a huge thanks for his work and we all owe our thanks the original vendor that supported Neel and Peter's work on bhvye because they: 1. Wanted it to be a FreeBSD project, rather than a project 2. They could have thrown it over the wall and not allowed the developers to make it more suitable for our needs on the outside 3. They could have gone with a more restrictive license 4. They could have gone open core 5. They could have patent-encumbered it at length This is a historic change of strategy in the world of open source. Michael From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 24 15:33:52 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6D846569; Fri, 24 Jan 2014 15:33:52 +0000 (UTC) Received: from mail-pa0-x232.google.com (mail-pa0-x232.google.com [IPv6:2607:f8b0:400e:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3675C18D6; Fri, 24 Jan 2014 15:33:52 +0000 (UTC) Received: by mail-pa0-f50.google.com with SMTP id kp14so3381033pab.23 for ; Fri, 24 Jan 2014 07:33:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=I3AVCP6PFdvG82h9HjShiLZn+SgoxbsiDrVEqvhui9g=; b=ZgJi7lHdS5ac4e81HX/RngcV0w3C6ZLcH3LWpBVMdHKREhXhtB6NK4NORNA3ctTSIc X1dXI2B4DURnRb55MWuZkzUcoDh8SamU3Ggcn6G2oQswz0bqN0JVZzScCqiWEiMkjBu4 +0137egrYw1tY7fsQOXWSZ8T/ETdAj09GKmlg/mMcab1OcyB4nAw+QU4WFZ6FZT8kx4G +RWqocXVplXGALeqMWzElwj4xeheqsCbar+aQ3P3LAUuFOwpF3Z4EpWnPxwnrUIdw/tV psGESGVy94qBdnxe4+JljXbPhwXaezZTBSqQhmWGr3cm9QIu5tAYmyezVssES0nExTiT UkPg== MIME-Version: 1.0 X-Received: by 10.68.230.137 with SMTP id sy9mr14996281pbc.126.1390577631294; Fri, 24 Jan 2014 07:33:51 -0800 (PST) Received: by 10.68.155.38 with HTTP; Fri, 24 Jan 2014 07:33:51 -0800 (PST) In-Reply-To: <52E233FA.5010602@callfortesting.org> References: <52E233FA.5010602@callfortesting.org> Date: Fri, 24 Jan 2014 10:33:51 -0500 Message-ID: Subject: Re: rc.d scripts for starting BHyve from rc.d From: Aryeh Friedman To: Michael Dexter Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-rc@freebsd.org, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 15:33:52 -0000 On Fri, Jan 24, 2014 at 4:35 AM, Michael Dexter wrote: > On 1/23/14 8:01 PM, Aryeh Friedman wrote: > > Except for the consoles petitecloud does it much more smoothly... > > May I kindly suggest that you not use this list for PR or to slam the > work of others? > > Michael > 1. My comment was a complement not a criticism (the consoles likely make it a better script functionality wise then petitecloud's [see below]). I was only offering an alternative approach which is to generate it as needed thus avoiding the need for conditionals (since this is the method petitecloud uses it is highly unlikely our scripts are at all portable except as starter scripts for someone to hand modify). 2. I was responding to his request for if anyone had anything better and stating that from a control flow (and control flow only) POV ours are slightly (and only slightly) better. But the need to have console far out ways that (our scripts do not attempt to give console access except during OS install). I suspect that our goals are also quiet different in that Craig is likely looking for something that is meant to be used locally such as a NAS and the owner will thus always have console access. PetiteCloud makes the assumption that the most typical use of virtualization is cloud computing and in this case local access is often impossible. This means any console access has to allow for remote operation. Like I said in an other thread I think the only long term solution to this problem is to add VNC to bhyve. -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 11:58:52 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 25585BB4 for ; Sat, 25 Jan 2014 11:58:52 +0000 (UTC) Received: from us3.route.mx (us3.route.mx [107.21.107.127]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E41B71A61 for ; Sat, 25 Jan 2014 11:58:51 +0000 (UTC) Received: (route-mx 87507 invoked from network); 25 Jan 2014 11:52:08 -0000 Received: from unknown (HELO [192.168.1.100]) (nbari@inbox.im@route.mx) (envelope-sender ) by us3.route.mx (route-mx) with AES128-SHA encrypted SMTP for ; 25 Jan 2014 11:52:08 -0000 From: Nicolas de Bari Embriz Garcia Rojas Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: bhyve with Xorg/kde Message-Id: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> Date: Sat, 25 Jan 2014 11:52:02 +0000 To: "freebsd-virtualization@freebsd.org" Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) X-Mailer: Apple Mail (2.1827) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 11:58:52 -0000 Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 instance = running from bhyve? regards= From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 12:04:25 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E8C5BCBF for ; Sat, 25 Jan 2014 12:04:25 +0000 (UTC) Received: from mail-pd0-x232.google.com (mail-pd0-x232.google.com [IPv6:2607:f8b0:400e:c02::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id BE4381AE1 for ; Sat, 25 Jan 2014 12:04:25 +0000 (UTC) Received: by mail-pd0-f178.google.com with SMTP id y13so4071960pdi.23 for ; Sat, 25 Jan 2014 04:04:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=wq+a8jhsuMz4mNcOrgESdevKV6ma6saGFkGiBeJdfHo=; b=zbj6P4uLJV15NW0//PoHwaQaUc1fYMEHLiKLfhKDaXqK9/1e4jDRK4Uuc1UGRWR007 RJjKm+g6oNaVOQq619544kQppzlDrAcr3DmB8ePtcgAEFr9OmJsIFvQDjca1M8YaPrfP mkWQfJ+c7sDaaxqHVUX5TBVD6JSEg1VTGh7wLEKgfrNqzd6eki8/5owiaPsma2Mdn2al ATydhdNSloHEO1rGcDr2e8TJ5VF/7HYHeCCfS1vg5dlMUT0wEKcca0q3yr+rntOh9W8V MTvnSaMuNtgGH7d9Zkz8puPPL3lb3WaWOtDnE/26TFZSpwVXfu7Q3Xyd43OR3cJLe36+ I4hQ== MIME-Version: 1.0 X-Received: by 10.68.212.10 with SMTP id ng10mr19709866pbc.95.1390651465407; Sat, 25 Jan 2014 04:04:25 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sat, 25 Jan 2014 04:04:25 -0800 (PST) In-Reply-To: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> Date: Sat, 25 Jan 2014 07:04:25 -0500 Message-ID: Subject: Re: bhyve with Xorg/kde From: Aryeh Friedman To: Nicolas de Bari Embriz Garcia Rojas Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 12:04:26 -0000 Not possible bhyve does not have mouse pointer intergration On Sat, Jan 25, 2014 at 6:52 AM, Nicolas de Bari Embriz Garcia Rojas < nbari@inbox.im> wrote: > Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 instance > running from bhyve? > > regards > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 18:24:55 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 28CE5800 for ; Sat, 25 Jan 2014 18:24:55 +0000 (UTC) Received: from mail-pa0-f51.google.com (mail-pa0-f51.google.com [209.85.220.51]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EF21416E6 for ; Sat, 25 Jan 2014 18:24:54 +0000 (UTC) Received: by mail-pa0-f51.google.com with SMTP id ld10so4485295pab.10 for ; Sat, 25 Jan 2014 10:24:48 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=H68CDfIiaZkzoCbJr20a8B9N0XniFf0y0YHlOS0zXVQ=; b=M/1ytbhqLY3NWj0300XLUPi+Fk6QKN2TdmE4R27CTFPn5n3D24qu+4RsOBTnyU4n95 XD7ZgcD02+6K9JTRWs7zxFnc+lEUTZ+E8Wd5HRsn/hvgEq37wcRm9oVxKu3VUSomNeLn x3Z0pwISgrOGviyqtXMNWPPWbKK6ThMZ98ftuz4etx7EGs911U+ABA0JSx/wBcH6xvJi X1Oov6JjYEgvbE+cLlETGIqWymxoOPZziuEHu8R9vRirfYaMIGo7i3Q7LEuAMioU4q7v 5W1ik09leFUnN+VLMPFLwjx6Llsej8ocFOyBiROhMbXdQUhaA/lgTh8L7MZej9JfbFDi fzmQ== X-Gm-Message-State: ALoCoQklrXBGms62laLdapq9haovU2yqoxcyMwsR/Adi9bg7cmHaEHGh9PLSfNW8xZRcelnrAcj9 X-Received: by 10.68.231.5 with SMTP id tc5mr21083847pbc.154.1390674288416; Sat, 25 Jan 2014 10:24:48 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id qq5sm15264985pbb.24.2014.01.25.10.24.47 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 25 Jan 2014 10:24:47 -0800 (PST) Message-ID: <52E40170.5080405@callfortesting.org> Date: Sat, 25 Jan 2014 10:24:48 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve with Xorg/kde References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> In-Reply-To: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 18:24:55 -0000 On 1/25/14 3:52 AM, Nicolas de Bari Embriz Garcia Rojas wrote: > Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 > instance running from bhyve? X has been designed for network use from day one. Try searching for "Headless Xorg" and suggestions along the lines of: http://forums.freebsd.org/viewtopic.php?t=34923 Michael From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 18:29:56 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 69393BAF for ; Sat, 25 Jan 2014 18:29:56 +0000 (UTC) Received: from mail-pd0-x22e.google.com (mail-pd0-x22e.google.com [IPv6:2607:f8b0:400e:c02::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3F82F1723 for ; Sat, 25 Jan 2014 18:29:56 +0000 (UTC) Received: by mail-pd0-f174.google.com with SMTP id z10so4235735pdj.5 for ; Sat, 25 Jan 2014 10:29:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=hXDoY+b76fMUf2bOr9vFr4oNaxJEcox/JoSsGHm/WqA=; b=OMUYW0g1DmOc7PXVtMKPnsiqC48Hr+cIwUcd1yhAsXsmI3YuBLwQWYhMMQMkYpQktB ZN0yPs8gXzmOUt2dVWUpHborugUNdE9S3MqnMqCku+bVpwpF2JGurIHbDe3xyLRN0il0 IZpuuCcF+gh7tErN8oveG65tem+szdX/VNv254eWeDZLukPkqwDXVeP8JsSnrI3jhqCA OEELz3dA2dsZfqVru6G9WSz8b2DDUGb+/k6kAukpSlfJneSffT/ByjFieRjuaUAoOzjm Lp1PhCRlaqZMk8+a7BUDlYDu5RYHRvyVJ+0vDxXmWuFESP2cT367wxHpjmEVGs/9/gkf OH4w== MIME-Version: 1.0 X-Received: by 10.68.96.99 with SMTP id dr3mr21193635pbb.40.1390674595860; Sat, 25 Jan 2014 10:29:55 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sat, 25 Jan 2014 10:29:55 -0800 (PST) In-Reply-To: <52E40170.5080405@callfortesting.org> References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> <52E40170.5080405@callfortesting.org> Date: Sat, 25 Jan 2014 13:29:55 -0500 Message-ID: Subject: Re: bhyve with Xorg/kde From: Aryeh Friedman To: Michael Dexter Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 18:29:56 -0000 On Sat, Jan 25, 2014 at 1:24 PM, Michael Dexter wrote: > On 1/25/14 3:52 AM, Nicolas de Bari Embriz Garcia Rojas wrote: > > Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 > > instance running from bhyve? > > X has been designed for network use from day one. > > Try searching for "Headless Xorg" and suggestions along the lines of: > > http://forums.freebsd.org/viewtopic.php?t=34923 > This only works if you want to use X enabled commands but if you want an actual desktop no dice -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 18:42:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 14DFA1CD for ; Sat, 25 Jan 2014 18:42:57 +0000 (UTC) Received: from mail-wg0-x22a.google.com (mail-wg0-x22a.google.com [IPv6:2a00:1450:400c:c00::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id A1DD01883 for ; Sat, 25 Jan 2014 18:42:56 +0000 (UTC) Received: by mail-wg0-f42.google.com with SMTP id l18so2918236wgh.3 for ; Sat, 25 Jan 2014 10:42:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=mVlpxieRIAERc3owv5xqSQUYOBUrbkvVMrfkkXnprdQ=; b=AiMFi+6yV8vCVoVV6S+UnyI5+I1o2OJTY9JZMFlChcz8z1ZZmdFBwUpdyQrmpPGU7D VmoPxhII3gDyhWDywJtcsa4C0tRz3WSNuzO/fJbPl0zsves4BfRpfFn1qFwWPEJbAzLq Xxg614enDF8Q9qPP08hPiwRmxz2pNbKZMM44uInMMCnO6d+HwUv7YbYSNxfJiL150Us6 qFHD2DQsZWEvhaUy3YYtDRHS7yADENVYFAGV+0WIDWo2qB3DtvJ0sBsdn91R2SgZ65bX ewSRXc2/Rkt/1/y4AmWWpiL1ZqR/mM5MiaW3hW0RxXvxUqGLS3vrPHxQ1qrBB46si/2P pTUw== MIME-Version: 1.0 X-Received: by 10.180.81.38 with SMTP id w6mr6955482wix.27.1390675375109; Sat, 25 Jan 2014 10:42:55 -0800 (PST) Received: by 10.227.1.71 with HTTP; Sat, 25 Jan 2014 10:42:55 -0800 (PST) In-Reply-To: References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> <52E40170.5080405@callfortesting.org> Date: Sat, 25 Jan 2014 20:42:55 +0200 Message-ID: Subject: Re: bhyve with Xorg/kde From: Markiyan Kushnir To: Aryeh Friedman Content-Type: text/plain; charset=ISO-8859-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 18:42:57 -0000 If you plug an extra video card and a mouse, you might try to pass them through to a bhyve instance? -- Markiyan. 2014/1/25 Aryeh Friedman : > On Sat, Jan 25, 2014 at 1:24 PM, Michael Dexter > wrote: > >> On 1/25/14 3:52 AM, Nicolas de Bari Embriz Garcia Rojas wrote: >> > Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 >> > instance running from bhyve? >> >> X has been designed for network use from day one. >> >> Try searching for "Headless Xorg" and suggestions along the lines of: >> >> http://forums.freebsd.org/viewtopic.php?t=34923 >> > > > This only works if you want to use X enabled commands but if you want an > actual desktop no dice > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 18:45:53 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 99668399 for ; Sat, 25 Jan 2014 18:45:53 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 599D018AF for ; Sat, 25 Jan 2014 18:45:53 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 761CD12303; Sun, 26 Jan 2014 04:45:51 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-69-181-164-196.hsd1.ca.comcast.net [69.181.164.196]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRJ14379 (AUTH peterg@ptree32.com.au); Sun, 26 Jan 2014 04:45:50 +1000 Message-ID: <52E4065B.6000603@freebsd.org> Date: Sat, 25 Jan 2014 10:45:47 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: Nicolas de Bari Embriz Garcia Rojas , "freebsd-virtualization@freebsd.org" Subject: Re: bhyve with Xorg/kde References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> In-Reply-To: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 18:45:53 -0000 Hi, > any idea of how to make Xorg + KDE run within an FreeBSD 10 instance > running from bhyve? The only current way is to setup X in the guest to display remotely. I've done this with Linux and it worked well. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 18:56:04 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 098C1559 for ; Sat, 25 Jan 2014 18:56:04 +0000 (UTC) Received: from mail-pb0-f43.google.com (mail-pb0-f43.google.com [209.85.160.43]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id CC43D193F for ; Sat, 25 Jan 2014 18:56:03 +0000 (UTC) Received: by mail-pb0-f43.google.com with SMTP id md12so4432201pbc.30 for ; Sat, 25 Jan 2014 10:55:57 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=vYIMSn+S3X3lbPpO8NltAstOqhXJJCggv94pP3w1eXo=; b=F3jNgUVIC5qDe+d5c+o5bYltBh9jrn1UBc3k5DglvjIwnZxW72Mo7Ly9mYXAuzj4Ii lk/aqSQ1GaDSI4wTI4tZBoSTARbTVWHvbT6dgAzRm7rKAonZxQH4FftyZx4EzFp7/p9d gxTDU2rEhBkPcNkXeY81OoLVZyMdbZBkAaGizpqmWWvP9mZ5aQsRuDRV7fq9wHPDUbfV CXeZ2YqcEyunXhRqS7z+94B3g0JKW8iaAFufoX4fWGh3Uyy7vTucU/00zEQK5Emi7OLB G0YbM2oIBfCn2/rZVL3rjMyHwFXnaIbur5U7Q0CT+Ktp+4QwwtPom4lynmN5x7GNRfI5 Wysg== X-Gm-Message-State: ALoCoQmCYYsYnRVFd8JBz7Bb0CdIAHiNotK6hyL9Iph966NhQBNM0Slab2NOy8W3tqzREt9uZAMe X-Received: by 10.68.136.162 with SMTP id qb2mr21496312pbb.88.1390676157657; Sat, 25 Jan 2014 10:55:57 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id xn12sm39895239pac.12.2014.01.25.10.55.56 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 25 Jan 2014 10:55:57 -0800 (PST) Message-ID: <52E408BE.40903@callfortesting.org> Date: Sat, 25 Jan 2014 10:55:58 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org, Nicolas de Bari Embriz Garcia Rojas Subject: Re: bhyve with Xorg/kde References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> In-Reply-To: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 18:56:04 -0000 On 1/25/14 3:52 AM, Nicolas de Bari Embriz Garcia Rojas wrote: > Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 instance running from bhyve? This is good reason to see what can and can't be done with PC-BSD/TrueOS under bhyve: http://iso.cdn.pcbsd.org/10.0-RELEASE/amd64/ Note that PC-BSD 10.0 is a great way to run bhyve given that it is is simply based on FreeBSD 10.0. Warden/bhyve integration is reportedly in the works along with FreeNAS 10.0 bhyve integration due in a month or two. Michael From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 19:04:10 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 84E5D940 for ; Sat, 25 Jan 2014 19:04:10 +0000 (UTC) Received: from eu.route.mx (eu.route.mx [46.137.95.40]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E7B7019E9 for ; Sat, 25 Jan 2014 19:04:09 +0000 (UTC) Received: (route-mx 3045 invoked from network); 25 Jan 2014 18:57:26 -0000 Received: from 89-181-199-57.net.novis.pt (HELO [192.168.1.100]) (nbari@inbox.im@[89.181.199.57]) (envelope-sender ) by eu.route.mx (route-mx) with AES128-SHA encrypted SMTP for ; 25 Jan 2014 18:57:25 -0000 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) Subject: Re: bhyve with Xorg/kde From: Nicolas de Bari Embriz Garcia Rojas In-Reply-To: <52E4065B.6000603@freebsd.org> Date: Sat, 25 Jan 2014 18:57:20 +0000 Content-Transfer-Encoding: quoted-printable Message-Id: <93902334-8299-43A1-80DE-F1944CA80783@inbox.im> References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> <52E4065B.6000603@freebsd.org> To: Peter Grehan X-Mailer: Apple Mail (2.1827) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 19:04:10 -0000 I can run apps like, firefox, xterm, etc, but not a desktop. my idea was to use bhyve as a remote workstation and be available to = export the full environments (kde/xfce etc) how much helps adding a graphic card to the server and =93share it=94 = among the instances ? can it be emulated ? regards On Jan 25, 2014, at 6:45 PM, Peter Grehan wrote: > Hi, >=20 >> any idea of how to make Xorg + KDE run within an FreeBSD 10 instance >> running from bhyve? >=20 > The only current way is to setup X in the guest to display remotely. = I've done this with Linux and it worked well. >=20 > later, >=20 > Peter. >=20 From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 19:17:26 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1BB77DD4; Sat, 25 Jan 2014 19:17:26 +0000 (UTC) Received: from mail-pb0-x234.google.com (mail-pb0-x234.google.com [IPv6:2607:f8b0:400e:c01::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DE4B01AB8; Sat, 25 Jan 2014 19:17:25 +0000 (UTC) Received: by mail-pb0-f52.google.com with SMTP id jt11so4470857pbb.11 for ; Sat, 25 Jan 2014 11:17:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=A+cgysQtE9HgAvDcp+sjGfXrYxUOL/RXi53H2Xz15lo=; b=W1Np1r2AAUO9tzG7IAx+JYdD5lwnZ5loGYHuoFdrNSv8nKnTecmQB87nvt1Tl56SXd POgyMQ2I9ABkS700EUn+iw8rSUOxbHVSJnxvd24Mihlw0QvSivnJOegpzF/TJn+UG2lY 5iBxf3enOR53lZA4xZp6yeowTtuisiOhsWjk+CvC2CNoFdmAaHTRLhNy4Na/KvxghItV eJCye4aZV7qF9IvJjpVN/g1kAz6G2afIhg7Gvm/EQH1JP0+4ZS0XTasKxTkDo3MPJsZJ z5J3etXfgsbM+6hdSYL2Nr6Oi4TXCwHqL2lg4zoZ4fat4lTDfnsOpbKQIkJQXCYMp/Io NRrA== MIME-Version: 1.0 X-Received: by 10.68.226.200 with SMTP id ru8mr21308125pbc.77.1390677445512; Sat, 25 Jan 2014 11:17:25 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sat, 25 Jan 2014 11:17:25 -0800 (PST) In-Reply-To: <93902334-8299-43A1-80DE-F1944CA80783@inbox.im> References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> <52E4065B.6000603@freebsd.org> <93902334-8299-43A1-80DE-F1944CA80783@inbox.im> Date: Sat, 25 Jan 2014 14:17:25 -0500 Message-ID: Subject: Re: bhyve with Xorg/kde From: Aryeh Friedman To: Nicolas de Bari Embriz Garcia Rojas Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 19:17:26 -0000 On Sat, Jan 25, 2014 at 1:57 PM, Nicolas de Bari Embriz Garcia Rojas < nbari@inbox.im> wrote: > I can run apps like, firefox, xterm, etc, but not a desktop. > > my idea was to use bhyve as a remote workstation and be available to > export the full environments (kde/xfce etc) > > how much helps adding a graphic card to the server and =93share it=94 amo= ng > the instances ? can it be emulated ? > Not likely unless bhyve adds vnc or the equiv. --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 19:20:33 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2AC00F3A for ; Sat, 25 Jan 2014 19:20:33 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id DF4401AD9 for ; Sat, 25 Jan 2014 19:20:32 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 276AA12303; Sun, 26 Jan 2014 05:20:31 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-69-181-164-196.hsd1.ca.comcast.net [69.181.164.196]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRJ14902 (AUTH peterg@ptree32.com.au); Sun, 26 Jan 2014 05:20:30 +1000 Message-ID: <52E40E7C.1050205@freebsd.org> Date: Sat, 25 Jan 2014 11:20:28 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: Nicolas de Bari Embriz Garcia Rojas Subject: Re: bhyve with Xorg/kde References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> <52E4065B.6000603@freebsd.org> <93902334-8299-43A1-80DE-F1944CA80783@inbox.im> In-Reply-To: <93902334-8299-43A1-80DE-F1944CA80783@inbox.im> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 19:20:33 -0000 Hi, > I can run apps like, firefox, xterm, etc, but not a desktop. > > my idea was to use bhyve as a remote workstation and be available to > export the full environments (kde/xfce etc) I admit I've not tried this with a FreeBSD guest, but with an Ubuntu guest I was able to start KDE and send the display to a mac running X11. I also tried Xvnc on the Linux guest - this worked, but was a lot slower than remote X. > how much helps adding a graphic card to the server and “share it” > among the instances ? I'm not sure how that would work. It may be possible to use pass-thru for a graphics card to a single guest, but I don't think even that would work as expected due to the fixed <1MB VGA address space that can't be shared amongst guests/the host card. > can it be emulated ? There will be VGA emulation in bhyve at some point - don't know exactly then that will be. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Sat Jan 25 19:33:59 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B3D4A523; Sat, 25 Jan 2014 19:33:59 +0000 (UTC) Received: from mail-pa0-x236.google.com (mail-pa0-x236.google.com [IPv6:2607:f8b0:400e:c03::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 832451D0B; Sat, 25 Jan 2014 19:33:59 +0000 (UTC) Received: by mail-pa0-f54.google.com with SMTP id fa1so4476385pad.13 for ; Sat, 25 Jan 2014 11:33:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=TR6MHe9puWRafGe1N+DVNuOIq+gpFqqnREv1EUWwb44=; b=b4sK3tWqaEdoSq/W7Zv0aSBHZqwd6bKawShCs0mqmegQTIQbAbd3ziAKfzfRZlFaZV 9u0Ob64DF9ealqCpK+FcOj05cU9fnFkcJQF6KY8HP7NgTLg5uLwG3Em6nOPjYcBtEK3m o4B2mSrvJAvOwOc2HKP1jt1vEUCOfGpex0cFgeGZvFa71yTFtW2F6BIvg53Ou3bC/mmG 435TReKN5aGSl8WPdAQjYP/SSuxrceWyNtBPdNBhndru7+uc5WkT56AaWxPaXjOsc0MS TgMbZY7T6hSHP/w7dfp1+gY/mHbNrOHqh/cKDObPOlPZo5v+l/aMKs0ur2wxutTZb7Rm 87lQ== MIME-Version: 1.0 X-Received: by 10.66.145.199 with SMTP id sw7mr21151087pab.143.1390678439105; Sat, 25 Jan 2014 11:33:59 -0800 (PST) Received: by 10.68.155.38 with HTTP; Sat, 25 Jan 2014 11:33:59 -0800 (PST) In-Reply-To: <52E40E7C.1050205@freebsd.org> References: <2EEDE84D-388C-441F-969E-F6DF87CFF7BE@inbox.im> <52E4065B.6000603@freebsd.org> <93902334-8299-43A1-80DE-F1944CA80783@inbox.im> <52E40E7C.1050205@freebsd.org> Date: Sat, 25 Jan 2014 14:33:59 -0500 Message-ID: Subject: Re: bhyve with Xorg/kde From: Aryeh Friedman To: Peter Grehan Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jan 2014 19:33:59 -0000 On Sat, Jan 25, 2014 at 2:20 PM, Peter Grehan wrote: > > > can it be emulated ? > > There will be VGA emulation in bhyve at some point - don't know exactly > then that will be. > Will it support remote operation or just local? -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org