From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 00:20:49 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 062D7325; Sun, 26 Oct 2014 00:20:49 +0000 (UTC) Received: from mail-qg0-x22a.google.com (mail-qg0-x22a.google.com [IPv6:2607:f8b0:400d:c04::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 96BE1E11; Sun, 26 Oct 2014 00:20:48 +0000 (UTC) Received: by mail-qg0-f42.google.com with SMTP id z60so2554880qgd.15 for ; Sat, 25 Oct 2014 17:20:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=SQ83G/29GkhbXUxXZdNnIJ17AXVtmNSOGj5xKmqeMts=; b=i/mYuHgZlwrKB2SzaPDBE8cINT981cXjXnZ5D1WnSlO7+Ltwmev5PSr9fWTdJxIcnc vp42otvI49vOSMW2ATCINuPPz5R3f6ae05lJOhxS9wxEXrbNIO937p8wmkZlkYHaoP8F k5Y2jQnJSBoOXwjs5OdB+jL12RDoZ/rjUT/hjdy1DG0zg7z+zPBgfFkGHceBOavLZnpL PPF2TVpWm4eDvqq5UdK0qGjZOsZoxrXwKeIrWGES+pTFDxznYxrrtiAVUkGoHwPddbv+ OFygmlBjtt2jJyKyn2PyeGe3bkXGByaIeBnEi7oIHJjj61jTdhMbGT+S63MV2m/xpJa5 4Oig== MIME-Version: 1.0 X-Received: by 10.229.53.133 with SMTP id m5mr19814856qcg.28.1414282847680; Sat, 25 Oct 2014 17:20:47 -0700 (PDT) Received: by 10.140.85.83 with HTTP; Sat, 25 Oct 2014 17:20:47 -0700 (PDT) In-Reply-To: References: <154A442D-7814-4618-9AFC-6F9FB3F5DFD3@gmail.com> <5443A89F.8050801@digiware.nl> Date: Sat, 25 Oct 2014 17:20:47 -0700 Message-ID: Subject: Re: HEADS UP: Merging projects/bhyve_svm to HEAD From: Neel Natu To: Zaphod Beeblebrox Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-current , Neel Natu , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 00:20:49 -0000 Hi, On Sat, Oct 25, 2014 at 3:50 PM, Zaphod Beeblebrox wrot= e: > I tried to integrate this patch into 10.1_RC3 and I failed. Is there a > timeframe to MFC this to 10.1 or 10-STABLE? > It will be MFCed to 10-STABLE but I don't have a specific time frame in min= d. I'll guess that it'll be towards the end of November but can be accelerated if someone has a need for this in 10-STABLE sooner. best Neel > On Sun, Oct 19, 2014 at 4:04 PM, Benjamin Perrault > wrote: >> >> After a few days of extensive testing and abuse, i=E2=80=99ve run into n= o new >> issues or unknowns what so ever. Everything that worked before still wor= ks >> now ( and a few bugs from fixed from HEAD ). >> >> Thus, I have gone ahead and pushed r273182 w/ Neel=E2=80=99s patch out t= o about 80 >> of the assorted AMD boxes in the production and dev pods that I care for= . If >> end users see something, I=E2=80=99ll let you know, but I have a feeling= they won=E2=80=99t. >> >> Again - Excellent work. >> >> cheers, >> -bp >> >> > On Oct 19, 2014, at 5:03 AM, Willem Jan Withagen >> > wrote: >> > >> > On 16-10-2014 5:00, Anish Gupta wrote: >> >> Hi all, >> >> >> >> The projects/bhyve_svm branch is ready to be merged to HEAD. >> >> >> >> This branch contains patches to bhyve to enable it to work on AMD >> >> processors with SVM/AMD-V hardware extensions[1]. Pretty much any AMD >> >> processor since 2010 will have the features required by bhyve. >> >> >> >> bhyve on AMD supports (almost) all the features available with Intel >> >> [2]. All guest OSes supported on Intel are supported on AMD. All the >> >> bhyve-related utilities function similarly on both Intel and AMD >> >> platforms [3]. >> >> >> >> The patch against HEAD revision 273066 is available for review and >> >> testing: >> >> https://people.freebsd.org/~neel/bhyve/bhyve_svm.diff [Neel=E2=80=99s= web >> >> directory] >> >> >> >> [1]: http://en.wikipedia.org/wiki/X86_virtualization >> >> [2]: bhyve doesn't support PCI passthru on AMD at this time >> >> [3]: bhyvectl has grown some processor-specific options >> > >> > Fetched the patch and compiled. >> > Now running: HEAD r273066M and I was able to throw at it all the tests >> > and images that in the past works. And perhaps even better. >> > >> > Great work. >> > --WjW >> > >> > >> > _______________________________________________ >> > freebsd-virtualization@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> > To unsubscribe, send any mail to >> > "freebsd-virtualization-unsubscribe@freebsd.org" >> >> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.or= g" > > From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 00:44:58 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3D1B3624 for ; Sun, 26 Oct 2014 00:44:58 +0000 (UTC) Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com [IPv6:2a00:1450:4010:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B973FFCF for ; Sun, 26 Oct 2014 00:44:57 +0000 (UTC) Received: by mail-la0-f42.google.com with SMTP id gf13so5047862lab.1 for ; Sat, 25 Oct 2014 17:44:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=+5I98JNAVJjaEHgKKSbLtDJxsLW3ptE0NdAUBDgt87A=; b=g8xjS0PpF2ff0eYHoGFVoewiFFDy7m2zrMDcMUkBf3QqFiVdjR3T7U6aXejT2CcU28 I+RySWF6Vl481nfuUpHGOGMmNvdsZJl2WLIIil86rs2vF4JFe9slIUHRVdGqp9AwSyEy Q5ijbxg6xYa5r3SSHqa/rTXYhZS+JLs8sBT6f4DXGJN/MYxVhla3+msSFZy239e+Wrol GCd5fnQ4LDEoCZX+lITNVTka8/90oRRLezDw+FCxkZZZjjPZOJ8y82K0fkSMMuNb2GXX nz6rpex9oKEArYMuaLBUZxgNUI42SzD/mi7bmD6rGyOjn7iwn+KkdjrIaj3wowRDJk6n Yo9A== MIME-Version: 1.0 X-Received: by 10.152.30.9 with SMTP id o9mr13921767lah.8.1414284295596; Sat, 25 Oct 2014 17:44:55 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.84.197 with HTTP; Sat, 25 Oct 2014 17:44:55 -0700 (PDT) In-Reply-To: <544C28C8.2060108@digiware.nl> References: <544C28C8.2060108@digiware.nl> Date: Sat, 25 Oct 2014 17:44:55 -0700 X-Google-Sender-Auth: RUsbTjKdZ6f2s2NJ4dGKV5TgbuA Message-ID: Subject: Re: Looking for a Libvirt example xml file From: Craig Rodrigues To: Willem Jan Withagen Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 00:44:58 -0000 On Sat, Oct 25, 2014 at 3:48 PM, Willem Jan Withagen wrote: > > So I was wondering if somebody would like to share his working example? > > Hi, Take a look at these slides: http://www.slideshare.net/CraigRodrigues1/libvirt-bhyve on slide 8, I have a pointer to a working libvirt xml example. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 01:43:14 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 58330EEF for ; Sun, 26 Oct 2014 01:43:14 +0000 (UTC) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 15921786 for ; Sun, 26 Oct 2014 01:43:13 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 89D9F1534C4; Sun, 26 Oct 2014 02:43:10 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qsmq41XBahwZ; Sun, 26 Oct 2014 02:42:52 +0100 (CET) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id DC247153416; Sun, 26 Oct 2014 02:42:52 +0100 (CET) Message-ID: <544C519F.5070202@digiware.nl> Date: Sun, 26 Oct 2014 02:42:55 +0100 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Conrad Meyer Subject: Re: Looking for a Libvirt example xml file References: <544C28C8.2060108@digiware.nl> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 01:43:14 -0000 On 26-10-2014 1:37, Conrad Meyer wrote: > On Sat, Oct 25, 2014 at 6:48 PM, Willem Jan Withagen wrote: >> Hoi >> >> I tried the version on the libvirt.org/bhyve page. >> But that returns: >> >> freetest# virsh -c "bhyve:///system" domxml-to-native \\ >> --format bhyve-argv --xml /root/libvirt-example.xml >> error: unsupported configuration: unsupported disk device >> >> So I was wondering if somebody would like to share his working example? > > > Hi Willem, > > What do your sections look like? I am using basically the same > configuration from libvirt's bhyve page as well and have no such issue > (however, I am on recent git which is ~1.2.10, versus the 1.2.6 in > ports). Example: > > > > > > > > For what it's worth, If you do not specify a bus, libvirt will choose > 'ide' and libvirt-bhyve only supports SATA. Seems that my CDrom block was a problem. But the disk is already build, so I just skipped that. But thing do not generate a lot of logging. :( Not even with debug on 4 --WjW From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 02:38:28 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8066DCDA for ; Sun, 26 Oct 2014 02:38:28 +0000 (UTC) Received: from mail-vc0-x231.google.com (mail-vc0-x231.google.com [IPv6:2607:f8b0:400c:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 40BBEB3F for ; Sun, 26 Oct 2014 02:38:28 +0000 (UTC) Received: by mail-vc0-f177.google.com with SMTP id hq11so1390819vcb.22 for ; Sat, 25 Oct 2014 19:38:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=qFzINciFPaeLxxWEX7P4aJ/YUxK0Ifyp8/N1TY03ADQ=; b=wUOihN62ZYmLcJo6FQjoHRqi0+VlrbgMkl/sugPXwHDophEg9ZYHA4tse/TP3qlmJn up/sLmZCS7vD1H/3J5xksbTxJgoqdDGD+8mt62s9DPJLY2Cs+wVR9ytleX4TpoiMJ6x+ WD63tCcd5xyydpkPwmhMMHpNSFS89YnTNOHN0noJTo+pZNsOL+o72Pz67wB4AyxPsqDy xZW2hQXaSc2YMEG6SLUE11fHGYsMX2c33m/XQAeEUsESzA7U5gcf0onU1zPjRQHWqOul MvcMBHL9v++eRL6OMwvyEPQ7W9gnB5fcyBlEOtk3KtayRzumB7gMgIA11s4Bn0jaLnyR woQQ== MIME-Version: 1.0 X-Received: by 10.221.20.198 with SMTP id qp6mr10038857vcb.18.1414291106915; Sat, 25 Oct 2014 19:38:26 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Sat, 25 Oct 2014 19:38:26 -0700 (PDT) In-Reply-To: <544C519F.5070202@digiware.nl> References: <544C28C8.2060108@digiware.nl> <544C519F.5070202@digiware.nl> Date: Sat, 25 Oct 2014 22:38:26 -0400 Message-ID: Subject: Re: Looking for a Libvirt example xml file From: Conrad Meyer To: Willem Jan Withagen Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 02:38:28 -0000 On Sat, Oct 25, 2014 at 9:42 PM, Willem Jan Withagen wrote: > Seems that my CDrom block was a problem. > But the disk is already build, so I just skipped that. Yes, even in git libvirt-bhyve doesn't work well with >1 disk :-(. > But thing do not generate a lot of logging. :( > Not even with debug on 4 Log-level in libvirtd is backwards, you probably want 2. 1 is very very spammy. >From libvirtd.conf.sample: "# Logging level: 4 errors, 3 warnings, 2 information, 1 debug" Best, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 09:49:28 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CDB14AAA for ; Sun, 26 Oct 2014 09:49:28 +0000 (UTC) Received: from mail-lb0-x22b.google.com (mail-lb0-x22b.google.com [IPv6:2a00:1450:4010:c04::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FD9A2A2 for ; Sun, 26 Oct 2014 09:49:28 +0000 (UTC) Received: by mail-lb0-f171.google.com with SMTP id z11so937680lbi.2 for ; Sun, 26 Oct 2014 02:49:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=vp1SXWjtKULZ00sSyo6fUSJAs51OhRdp0dhONIEt75w=; b=zXA/tS/3MXBv3v+Ri218Ar2fVeZTX3bVg0JNUSM4Ss5MrZ3206S8rwBplhhYLzznM9 +ZQxJe6ipsBcjcwiKwy/ivSmOaYdUf0a7dvbYK0BTAahxyvjon717iujb8bPwOyxcrNe FVJGfhCJzA0hSBC/Ul+AsXqmkCPZ2hFmXAF8LsAAJqp36oHQSmysu9nRS49/OmvjDEdc G/p4iYxRQenBLoYjIImrDMxJMzgpzLW8pNI6BS0/3u4zrQvDyAVIxrxx3w6H18Tr+Lu4 LMvS/M0luTOel32ffxCebcxwcs0NuC2SG1mnCHl0MQD1ev62q8JkEgyLc/if/LgUXqr6 2esQ== X-Received: by 10.112.44.229 with SMTP id h5mr1826552lbm.86.1414316966141; Sun, 26 Oct 2014 02:49:26 -0700 (PDT) Received: from kloomba ([31.29.239.123]) by mx.google.com with ESMTPSA id pf1sm3776982lbc.0.2014.10.26.02.49.24 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 26 Oct 2014 02:49:25 -0700 (PDT) Sender: Roman Bogorodskiy Date: Sun, 26 Oct 2014 12:49:19 +0300 From: Roman Bogorodskiy To: Conrad Meyer Subject: Re: Looking for a Libvirt example xml file Message-ID: <20141026094917.GA1940@kloomba> References: <544C28C8.2060108@digiware.nl> <544C519F.5070202@digiware.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zYM0uCDKw75PZbzx" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 09:49:28 -0000 --zYM0uCDKw75PZbzx Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Conrad Meyer wrote: > On Sat, Oct 25, 2014 at 9:42 PM, Willem Jan Withagen wr= ote: > > Seems that my CDrom block was a problem. > > But the disk is already build, so I just skipped that. >=20 > Yes, even in git libvirt-bhyve doesn't work well with >1 disk :-(. Hi! Could you please provide more details on the issues you're seeing with that? Roman Bogorodskiy --zYM0uCDKw75PZbzx Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (FreeBSD) iQEcBAEBAgAGBQJUTMOdAAoJEMltX/4IwiJqiggIAKPzwHtVBrKsE8hPVipmOgdv qXsVil/L28CQNxCfmnAdoEKVDwWVED7O/MpVr03nKEqrQXAm0cIwqKG56S1JY3fZ XYTfId3upjSrUa9QE+zuNI/s/OjFLK3I328gdCX9O/ZUcu7HphPpN4wdLBduBlPe 1ky51fYaT0jKL5INdoe4wPSbExvUfe0oiFjrZyYEzYUulGQJhx1zgl0nJjZP748Y uDkUBJXj03R9KB465ZUYah1qRuKVuRbVUAnWaCsQzsTgcO7HEkzOFe408OJY/M/P w+XhekkBFRCFdy3K3fZ7+TpeHXNBlYGRx8pZQ2j/0CH+mpA9vv4W2M01vRPm1mw= =iCCw -----END PGP SIGNATURE----- --zYM0uCDKw75PZbzx-- From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 12:35:59 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7B0E6EF; Sun, 26 Oct 2014 12:35:59 +0000 (UTC) Received: from mail-vc0-x234.google.com (mail-vc0-x234.google.com [IPv6:2607:f8b0:400c:c03::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 282BC258; Sun, 26 Oct 2014 12:35:59 +0000 (UTC) Received: by mail-vc0-f180.google.com with SMTP id hy10so287850vcb.39 for ; Sun, 26 Oct 2014 05:35:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=bcshjibZ/TuuAw+z5YFGYazpjbdXJOVa9EEqyokv+Z8=; b=Qure9KfA95EVSXyPhCNcmoAsBMLaIvj+eoXek4rftp1VNTExAn0gU/s7fYha3k+NTC CH8ysza/wkABdoEZfKxrf64mCGf4ImmaApyrbKA2gslNzAI1RhJgh7OL1evqbAnJ1W4S vn40dSq/oFcE1aJkmsjWaKlYvvEyyaFtE7drSAzkzqhgc6/72efmJSK8p5cEaxfPkHA+ xAieCw5arq0oJeewugftwmRVXEksbXFEBiytEjA/PD/fl9Sa20YeEM/VUbpfeL8u48Ln 8QgUOELlzCr18kQZHs3jDrAjpt5M7c7OkDAyllgamUokr3hmeqBvu2bDfNR9nIlyzC0B Rf+w== MIME-Version: 1.0 X-Received: by 10.221.28.137 with SMTP id ru9mr5599245vcb.19.1414326958152; Sun, 26 Oct 2014 05:35:58 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Sun, 26 Oct 2014 05:35:58 -0700 (PDT) In-Reply-To: <20141026094917.GA1940@kloomba> References: <544C28C8.2060108@digiware.nl> <544C519F.5070202@digiware.nl> <20141026094917.GA1940@kloomba> Date: Sun, 26 Oct 2014 08:35:58 -0400 Message-ID: Subject: Re: Looking for a Libvirt example xml file From: Conrad Meyer To: Roman Bogorodskiy Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 12:35:59 -0000 On Sun, Oct 26, 2014 at 5:49 AM, Roman Bogorodskiy wrote: > Conrad Meyer wrote: > >> On Sat, Oct 25, 2014 at 9:42 PM, Willem Jan Withagen wrote: >> > Seems that my CDrom block was a problem. >> > But the disk is already build, so I just skipped that. >> >> Yes, even in git libvirt-bhyve doesn't work well with >1 disk :-(. > > Hi! > > Could you please provide more details on the issues you're seeing with > that? Hi Roman, As far as I can tell, libvirt-bhyve will only boot from the first disk, and ignores libvirt's boot ordering stuff. Unless libvirt sorts the disks array by bootorder before passing to the driver? I had trouble getting it to boot a select disk when I included both a cdrom and hdd in my testing the other day. E.g. in git master: 297 virCommandPtr 298 virBhyveProcessBuildLoadCmd(virConnectPtr conn, 299 virDomainDefPtr def) 300 { ... 310 disk = def->disks[0]; ... 329 cmd = virCommandNew(BHYVELOAD); ... 337 virCommandAddArg(cmd, "-d"); 338 virCommandAddArg(cmd, virDomainDiskGetSource(disk)); Libvirt lets you specify some sort of boot ordering in domain XML inside /domain/os[0]: Although now that I am looking more closely it appears that ordering is basically ignored for same-bus devices :-(. That may explain my test results... So, I guess the right way to do it is to slap "" inside elements. I didn't try that and don't know if libvirt sorts those before handing off to driver. [0]: http://libvirt.org/formatdomain.html#elementsOS Thanks, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 14:21:24 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 658B7497; Sun, 26 Oct 2014 14:21:24 +0000 (UTC) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 231BCD5D; Sun, 26 Oct 2014 14:21:23 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 23EF01534C7; Sun, 26 Oct 2014 15:21:20 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8J5HwY2mmIzr; Sun, 26 Oct 2014 15:20:58 +0100 (CET) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 94C531534C0; Sun, 26 Oct 2014 15:11:16 +0100 (CET) Message-ID: <544D0105.2060701@digiware.nl> Date: Sun, 26 Oct 2014 15:11:17 +0100 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Conrad Meyer , Roman Bogorodskiy Subject: Re: Looking for a Libvirt example xml file References: <544C28C8.2060108@digiware.nl> <544C519F.5070202@digiware.nl> <20141026094917.GA1940@kloomba> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 14:21:24 -0000 On 26-10-2014 13:35, Conrad Meyer wrote: > On Sun, Oct 26, 2014 at 5:49 AM, Roman Bogorodskiy wrote: >> Conrad Meyer wrote: >> >>> On Sat, Oct 25, 2014 at 9:42 PM, Willem Jan Withagen wrote: >>>> Seems that my CDrom block was a problem. >>>> But the disk is already build, so I just skipped that. >>> >>> Yes, even in git libvirt-bhyve doesn't work well with >1 disk :-(. >> >> Hi! >> >> Could you please provide more details on the issues you're seeing with >> that? > > > Hi Roman, > > As far as I can tell, libvirt-bhyve will only boot from the first > disk, and ignores libvirt's boot ordering stuff. Unless libvirt sorts > the disks array by bootorder before passing to the driver? I had > trouble getting it to boot a select disk when I included both a cdrom > and hdd in my testing the other day. E.g. in git master: > > 297 virCommandPtr > 298 virBhyveProcessBuildLoadCmd(virConnectPtr conn, > 299 virDomainDefPtr def) > 300 { > ... > 310 disk = def->disks[0]; > ... > 329 cmd = virCommandNew(BHYVELOAD); > ... > 337 virCommandAddArg(cmd, "-d"); > 338 virCommandAddArg(cmd, virDomainDiskGetSource(disk)); > > Libvirt lets you specify some sort of boot ordering in domain XML > inside /domain/os[0]: > > > > > Although now that I am looking more closely it appears that ordering > is basically ignored for same-bus devices :-(. That may explain my > test results... > > So, I guess the right way to do it is to slap "" > inside elements. I didn't try that and don't know if libvirt > sorts those before handing off to driver. > > [0]: http://libvirt.org/formatdomain.html#elementsOS Are there any FBSD directions online to actually get libvirt to build after you did git clone?? --WjW From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 14:27:40 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EBC3772F; Sun, 26 Oct 2014 14:27:40 +0000 (UTC) Received: from mail-vc0-x231.google.com (mail-vc0-x231.google.com [IPv6:2607:f8b0:400c:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9834CD88; Sun, 26 Oct 2014 14:27:40 +0000 (UTC) Received: by mail-vc0-f177.google.com with SMTP id hq11so1618538vcb.36 for ; Sun, 26 Oct 2014 07:27:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=m3JtgVdyOrWoMbs+PcrfhfTxnSNDvQMdFoR/0Sf4ES4=; b=iazhrGv+55qs9At7yulLwWSn7hGozNndVh3NhnB+VfB6q85Xeki4pxjjUOzXpvX/ol xBoJEEGkoir7fOQd0SzXSkEdR46u8kd7yQfa5wddpR9P3jola8GjCZtTVFAYaFtpTWZ3 FAcadK8uOkdBw+VuyFZb8wplLkQY5e7sUoDxHiWIsfFXPy5uutlitfA3IVmVtk3C+PRr zfRDaTK+hE0tT/FQBCiccp10WkShFYTWup+FUO2gCKzpOqJYxa0vChvojviirre+chmQ Ygxn9lk+ttHHU+6aIKZcxDQYNe8qO7d1JLB1fCayE86Tj3hq+VaDPENFe210fKOtqC2+ CzlQ== MIME-Version: 1.0 X-Received: by 10.221.36.73 with SMTP id sz9mr12233062vcb.17.1414333659598; Sun, 26 Oct 2014 07:27:39 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Sun, 26 Oct 2014 07:27:39 -0700 (PDT) In-Reply-To: <544D0105.2060701@digiware.nl> References: <544C28C8.2060108@digiware.nl> <544C519F.5070202@digiware.nl> <20141026094917.GA1940@kloomba> <544D0105.2060701@digiware.nl> Date: Sun, 26 Oct 2014 10:27:39 -0400 Message-ID: Subject: Re: Looking for a Libvirt example xml file From: Conrad Meyer To: Willem Jan Withagen Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 14:27:41 -0000 On Sun, Oct 26, 2014 at 10:11 AM, Willem Jan Withagen wrote: > Are there any FBSD directions online to actually get libvirt to build > after you did git clone?? See README-hacking[0] and checkout pkgng poudriere logs[1] for options to ./configure. After that it's just "gmake -j" and "gmake install". Best, Conrad [0]: http://libvirt.org/git/?p=libvirt.git;a=blob;f=README-hacking;h=4e02fd854c4cdbdd40bfc2e29382342419645aae;hb=HEAD [1]: http://beefy4.isc.freebsd.org/data/head-amd64-default-ssp/2014-10-22_14h32m42s/logs/libvirt-1.2.6_3.log From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 15:06:30 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6AF12EB2; Sun, 26 Oct 2014 15:06:30 +0000 (UTC) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 231ED11F; Sun, 26 Oct 2014 15:06:29 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 586E2153416; Sun, 26 Oct 2014 16:06:27 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wFPa951galjk; Sun, 26 Oct 2014 16:05:58 +0100 (CET) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 263EB1534C0; Sun, 26 Oct 2014 15:35:11 +0100 (CET) Message-ID: <544D06A0.1060506@digiware.nl> Date: Sun, 26 Oct 2014 15:35:12 +0100 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Conrad Meyer Subject: Re: Looking for a Libvirt example xml file References: <544C28C8.2060108@digiware.nl> <544C519F.5070202@digiware.nl> <20141026094917.GA1940@kloomba> <544D0105.2060701@digiware.nl> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 15:06:30 -0000 On 26-10-2014 15:27, Conrad Meyer wrote: > On Sun, Oct 26, 2014 at 10:11 AM, Willem Jan Withagen wrote: >> Are there any FBSD directions online to actually get libvirt to build >> after you did git clone?? > > > See README-hacking[0] and checkout pkgng poudriere logs[1] for options > to ./configure. After that it's just "gmake -j" and "gmake > install". Following another path, but that may very well bomb: next to the requirements from the ports/libvirt/Makefile also installed form ports: gnulib git-merge-changelog And running autogen.sh and then went: gmake And it is still building. But I'm certainly going to take a look at your links as well. Thanx, --WjW > > Best, > Conrad > > [0]: http://libvirt.org/git/?p=libvirt.git;a=blob;f=README-hacking;h=4e02fd854c4cdbdd40bfc2e29382342419645aae;hb=HEAD > [1]: http://beefy4.isc.freebsd.org/data/head-amd64-default-ssp/2014-10-22_14h32m42s/logs/libvirt-1.2.6_3.log > From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 21:45:22 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9BF90C05 for ; Sun, 26 Oct 2014 21:45:22 +0000 (UTC) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 59A5DB60 for ; Sun, 26 Oct 2014 21:45:21 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id CDB99153416 for ; Sun, 26 Oct 2014 22:45:18 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZZ8hROnalRDX; Sun, 26 Oct 2014 22:45:17 +0100 (CET) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id CFCA4153411 for ; Sun, 26 Oct 2014 22:45:17 +0100 (CET) Message-ID: <544D6B6F.8020004@digiware.nl> Date: Sun, 26 Oct 2014 22:45:19 +0100 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: Re: Looking for a Libvirt example xml file References: <544C28C8.2060108@digiware.nl> In-Reply-To: <544C28C8.2060108@digiware.nl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 21:45:22 -0000 On 26-10-2014 0:48, Willem Jan Withagen wrote: > Hoi > > I tried the version on the libvirt.org/bhyve page. > But that returns: > > freetest# virsh -c "bhyve:///system" domxml-to-native \\ > --format bhyve-argv --xml /root/libvirt-example.xml > error: unsupported configuration: unsupported disk device > > So I was wondering if somebody would like to share his working example? After building libvirt 1.2.10 I was able to load this XML: /usr/sbin/bhyveload -m 214 -d /home/bhyve/FreeBSD/freebsd-head.disk bhyveCD /usr/sbin/bhyve -c 1 -m 214 -A -I -H -P -s 0:0,hostbridge -s 2:0,virtio-net,tap0,mac=52:54:00:63:43:69 -s 3:0,virtio-blk,/home/bhyve/FreeBSD/freebsd-head.disk -s 4:0,ahci-cd,/home/bhyve/FreeBSD/freebsd-head.iso bhyveCD --WjW From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 22:36:11 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4760ADE for ; Sun, 26 Oct 2014 22:36:11 +0000 (UTC) Received: from mail-pa0-x22c.google.com (mail-pa0-x22c.google.com [IPv6:2607:f8b0:400e:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1EA5CF1F for ; Sun, 26 Oct 2014 22:36:11 +0000 (UTC) Received: by mail-pa0-f44.google.com with SMTP id bj1so654486pad.31 for ; Sun, 26 Oct 2014 15:36:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=R8HiYCvfir/ON1MaqtBCbJGZ7gyXmaI0/iwtrbi/lcs=; b=ts3Zjl+tf47UoYcAC0eyNFCInJd2IRrtfZKr1ixVNek3hSXJ2t6zL9Qo/JhxRHKVGV vST6P8+ETDuyKaFB3jdTHGQKd0dWW7PiMh55qOm2VWXIxZDv6ALbugJycpd6ygg4ifRm aPdeyWcz/G4OiokWF5G6sOWt9y3AkXLaQqllUbf5jvsl/GemIxZrncK3hdOsWzfSJr4G JCGScrInQRGUb5q6A3crXDF8IkiZtme+JRW89YgSWqMPQBHa4bhDAQzFOwqEzWceuThV rqE7i42wpzH9VRbT/GEDi8Fi+5fo7MJTj4zB0irWoSQu/Q7UoBMbakDRxDYl5fA8caeS h2IQ== X-Received: by 10.70.88.174 with SMTP id bh14mr20426490pdb.24.1414362970730; Sun, 26 Oct 2014 15:36:10 -0700 (PDT) Received: from neil.creepingfur.org (ashpool.creepingfur.is. [70.36.196.189]) by mx.google.com with ESMTPSA id o5sm9141560pdc.24.2014.10.26.15.36.09 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 26 Oct 2014 15:36:09 -0700 (PDT) From: Benjamin Perrault Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: No bhyve guests can reach the network after update. Message-Id: Date: Sun, 26 Oct 2014 15:36:05 -0700 To: freebsd-virtualization@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\)) X-Mailer: Apple Mail (2.1990.1) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 22:36:11 -0000 Hi all, So I just update one of my systems to 10-STABLE r273710 ( GENERIC kernel = config ) and now all the bhyve guests are unable to connect to the = network ( be it linux, freebsd, or openbsd ). They guests see their = network interfaces fine - but they are unable to connect to anything. = Additionally on the host, the tap interfaces appear to be connecting = just fine.=20 Everything appears fine on the host and it=E2=80=99s reporting no = errors. The networking is working/performing as normal. There has been no configuration changes. Here is the relevant networks = stuff ( that=E2=80=99s been working reliably since 10-RELEASE, and is = running fine on 10.1-RC2 and -current just fine. ). =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D ifconfig_em0=3D"up -txcsum=E2=80=9D ifconfig_igb0=3D"up -txcsum=E2=80=9D defaultrouter=3D=E2=80=9C10.0.x.x" cloned_interfaces=3D"lagg0 bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 = tap7 tap8 tap9=E2=80=9D ifconfig_lagg0=3D"laggproto lacp laggport em0 laggport igb0 = 10.0.x.x/24=E2=80=9D ifconfig_bridge0=3D"addm lagg0 addm tap0 addm tap1 addm tap2 addm tap3 = addm tap4 addm tap5 addm tap6 addm tap7 addm tap8 addm tap9=E2=80=9D =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D Any one have any ideas or suggestions? I always get spooked/bothered = when something that was working fine just sort of breaks.. cheers and thanks, -bp From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 22:40:53 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E1D3D221; Sun, 26 Oct 2014 22:40:53 +0000 (UTC) Received: from mail-vc0-x231.google.com (mail-vc0-x231.google.com [IPv6:2607:f8b0:400c:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7761BF43; Sun, 26 Oct 2014 22:40:53 +0000 (UTC) Received: by mail-vc0-f177.google.com with SMTP id hq11so1779492vcb.8 for ; Sun, 26 Oct 2014 15:40:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=7Gqi+/UZbvXi9ZA0YjwjFpApB5JG0iMBXFM601QkTR4=; b=CXJy4f7jeKiAR8Etf/gCPuA4Cg20MW7d8JFlnbw8wT7F4HVmhfzLAuGTy7fslmKkZa 5YGVTeJh3hhN9z4Pv2eScEpySdHqtO5nDibzifrzjOal+xb24FbbPs1JH6Dy+Dm85Mv3 PbnqBZ0mpbbnD5HuqF0Vtq5tgQc660CjCp5JR1b+A+iyrlcweII5ZNS3bF/wHkvlzbgh 82kOdzwiKQNNjjNuIOSc9bw8fRNt50B3I2qVWXXQOxv7TmlRHckABe2CLylxqJRc40Dl Ao3NpEUZCIFMew+l0GP43yor0MyxEqMSdBJUsFzS1dVeNPI2ltBbQLSVZ+KWfpIyrnxG 8z5Q== MIME-Version: 1.0 X-Received: by 10.52.96.228 with SMTP id dv4mr5929080vdb.9.1414363252592; Sun, 26 Oct 2014 15:40:52 -0700 (PDT) Received: by 10.220.118.73 with HTTP; Sun, 26 Oct 2014 15:40:52 -0700 (PDT) In-Reply-To: References: <154A442D-7814-4618-9AFC-6F9FB3F5DFD3@gmail.com> <5443A89F.8050801@digiware.nl> Date: Sun, 26 Oct 2014 18:40:52 -0400 Message-ID: Subject: Re: HEADS UP: Merging projects/bhyve_svm to HEAD From: Zaphod Beeblebrox To: Neel Natu Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-current , Neel Natu , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 22:40:54 -0000 I would be using such a patch as soon as it was available. On a friend's advice, I upgraded a ZFS server here at home with an AMD 9590 and 32Gig of RAM. I'd dearly like to use it to track down the netgraph bug (see my other recent posts), but it doesn't currently qualify. On Sat, Oct 25, 2014 at 8:20 PM, Neel Natu wrote: > Hi, > > On Sat, Oct 25, 2014 at 3:50 PM, Zaphod Beeblebrox > wrote: > > I tried to integrate this patch into 10.1_RC3 and I failed. Is there a > > timeframe to MFC this to 10.1 or 10-STABLE? > > > > It will be MFCed to 10-STABLE but I don't have a specific time frame in > mind. > > I'll guess that it'll be towards the end of November but can be > accelerated if someone has a need for this in 10-STABLE sooner. > > best > Neel > > > On Sun, Oct 19, 2014 at 4:04 PM, Benjamin Perrault < > ben.perrault@gmail.com> > > wrote: > >> > >> After a few days of extensive testing and abuse, i=E2=80=99ve run into= no new > >> issues or unknowns what so ever. Everything that worked before still > works > >> now ( and a few bugs from fixed from HEAD ). > >> > >> Thus, I have gone ahead and pushed r273182 w/ Neel=E2=80=99s patch out= to about > 80 > >> of the assorted AMD boxes in the production and dev pods that I care > for. If > >> end users see something, I=E2=80=99ll let you know, but I have a feeli= ng they > won=E2=80=99t. > >> > >> Again - Excellent work. > >> > >> cheers, > >> -bp > >> > >> > On Oct 19, 2014, at 5:03 AM, Willem Jan Withagen > >> > wrote: > >> > > >> > On 16-10-2014 5:00, Anish Gupta wrote: > >> >> Hi all, > >> >> > >> >> The projects/bhyve_svm branch is ready to be merged to HEAD. > >> >> > >> >> This branch contains patches to bhyve to enable it to work on AMD > >> >> processors with SVM/AMD-V hardware extensions[1]. Pretty much any A= MD > >> >> processor since 2010 will have the features required by bhyve. > >> >> > >> >> bhyve on AMD supports (almost) all the features available with Inte= l > >> >> [2]. All guest OSes supported on Intel are supported on AMD. All th= e > >> >> bhyve-related utilities function similarly on both Intel and AMD > >> >> platforms [3]. > >> >> > >> >> The patch against HEAD revision 273066 is available for review and > >> >> testing: > >> >> https://people.freebsd.org/~neel/bhyve/bhyve_svm.diff [Neel=E2=80= =99s web > >> >> directory] > >> >> > >> >> [1]: http://en.wikipedia.org/wiki/X86_virtualization > >> >> [2]: bhyve doesn't support PCI passthru on AMD at this time > >> >> [3]: bhyvectl has grown some processor-specific options > >> > > >> > Fetched the patch and compiled. > >> > Now running: HEAD r273066M and I was able to throw at it all the tes= ts > >> > and images that in the past works. And perhaps even better. > >> > > >> > Great work. > >> > --WjW > >> > > >> > > >> > _______________________________________________ > >> > freebsd-virtualization@freebsd.org mailing list > >> > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> > To unsubscribe, send any mail to > >> > "freebsd-virtualization-unsubscribe@freebsd.org" > >> > >> _______________________________________________ > >> freebsd-current@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-current > >> To unsubscribe, send any mail to " > freebsd-current-unsubscribe@freebsd.org" > > > > > From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 22:42:36 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 89C5B470 for ; Sun, 26 Oct 2014 22:42:36 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 4BB7EFE9 for ; Sun, 26 Oct 2014 22:42:35 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 4100265845 for ; Sun, 26 Oct 2014 22:42:28 +0000 (UTC) Message-ID: <544D78EF.4010205@freebsd.org> Date: Sun, 26 Oct 2014 18:42:55 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: No bhyve guests can reach the network after update. References: In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ELqB8v5e1AaasVIERtr0gOWgK28GCTU9N" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 22:42:36 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --ELqB8v5e1AaasVIERtr0gOWgK28GCTU9N Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2014-10-26 18:36, Benjamin Perrault wrote: > Hi all, >=20 > So I just update one of my systems to 10-STABLE r273710 ( GENERIC kerne= l config ) and now all the bhyve guests are unable to connect to the netw= ork ( be it linux, freebsd, or openbsd ). They guests see their network i= nterfaces fine - but they are unable to connect to anything. Additionally= on the host, the tap interfaces appear to be connecting just fine.=20 >=20 > Everything appears fine on the host and it=E2=80=99s reporting no error= s. The networking is working/performing as normal. >=20 > There has been no configuration changes. Here is the relevant networks = stuff ( that=E2=80=99s been working reliably since 10-RELEASE, and is run= ning fine on 10.1-RC2 and -current just fine. ). >=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D > ifconfig_em0=3D"up -txcsum=E2=80=9D > ifconfig_igb0=3D"up -txcsum=E2=80=9D > defaultrouter=3D=E2=80=9C10.0.x.x" > cloned_interfaces=3D"lagg0 bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 t= ap7 tap8 tap9=E2=80=9D >=20 > ifconfig_lagg0=3D"laggproto lacp laggport em0 laggport igb0 10.0.x.x/24= =E2=80=9D >=20 > ifconfig_bridge0=3D"addm lagg0 addm tap0 addm tap1 addm tap2 addm tap3 = addm tap4 addm tap5 addm tap6 addm tap7 addm tap8 addm tap9=E2=80=9D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >=20 > Any one have any ideas or suggestions? I always get spooked/bothered wh= en something that was working fine just sort of breaks.. >=20 > cheers and thanks, > -bp >=20 >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 try: ifconfig bridge0 up and make sure your tap interfaces are up as well (sysctl net.link.tap.up_on_open=3D1 is useful) --=20 Allan Jude --ELqB8v5e1AaasVIERtr0gOWgK28GCTU9N Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUTXjzAAoJEJrBFpNRJZKfdlgP/2+UXOwERgc1qExTc4Xe/y23 wRpTcKOsdELRotlBCJ1etfY8AU+DskFaBS9HQUnkjEvEciAVwy59x9wIA1rXhQAr nhJRTLxELgYjBMfKzInUmU/b83RA/mUjPq0qkdGYz02ZBS8/DiqtHtQ2GIj66r6b DXMuhlaN9XayVQSAQPt7x3dQTyz2xjFHBGDo2afgs+w9MfM82JyVoXl2fIhs3pGA bPAWeE/fvRCYYZe+UqqMDHgf91qDRwSUy+jleC3yJEOL5svg+y1knAKJTD/iQWFB pxiLimXVXY3n0H6tcklMVYDF+O0QnDl6YOXyRJ5/kMUyG7pAEyOdRGgK7D341G4M G8lwgUc8aNVNYleIKw1salyL91DCykhygF/3wjpJxC+9KxpuiP5DIHkIa6zKBF++ LRtU4tj/iRa2JXfVdw5gvCsHFIqdxuCixD5L+DxGU7tAqqEKMRqL73lJEDa0Bupx LNBgLNrNlfo4mAkZyyvNjeACVjhGpsR6ElFlbZjwSOvlSDP1uXMnoGCYUnF0dzHy t9ms9I2nZMhVwvVKIdVeGjmTmodrv8VlFUNKeRJ8cHV11oGpZVGt+iTF524/NnKf AFNB9lHlj3LKX+q0S1RYyEkUCAVRAVPKfAKvii4RGyRVk5FgeWA8tinyHPHiEkMu DpYEPv8Yvswt3QMyUWVA =FMc4 -----END PGP SIGNATURE----- --ELqB8v5e1AaasVIERtr0gOWgK28GCTU9N-- From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 26 22:50:40 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C15C3515; Sun, 26 Oct 2014 22:50:40 +0000 (UTC) Received: from mail-pa0-x232.google.com (mail-pa0-x232.google.com [IPv6:2607:f8b0:400e:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 91B0F85; Sun, 26 Oct 2014 22:50:40 +0000 (UTC) Received: by mail-pa0-f50.google.com with SMTP id eu11so4231634pac.37 for ; Sun, 26 Oct 2014 15:50:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=6//3dlJFXpcev2iwZfacIPpka8BiOyaUl6tnlSw3hYI=; b=N5ScZAOPLgVpyEiWCIh9f26vCx+R1OT9bj70zMW/ZOpjEHRVRp+koPgGcBZ3kiaUJZ lCg4naHT/4Y+HaL7d5EAcScgrhFeZ1grsG52PfzOlC3XH76fvHCLfxIpnnYhz/hYWVMA m6T6aw2WtSvDmxG5Pm2xHytCgf9lqSwyyalVijYLwgOi1KRk2kCKa5Er0AvFgnIR9cnc QyIcWUrMwQmu+D24wg704sqxC/IBGbdA1H5/iRW1LJr7vAMTQuyTGC0xd0TeC31zJvTE Aw3Q7b3/ou1Yct/IUXcduDPTOp4sBBSFcM+vPzUWOrS8KKecZHgJTfdea2mc28ZE3frX n5qw== X-Received: by 10.66.140.8 with SMTP id rc8mr20368014pab.83.1414363840142; Sun, 26 Oct 2014 15:50:40 -0700 (PDT) Received: from neil.creepingfur.org (tessier.creepingfur.is. [70.36.196.188]) by mx.google.com with ESMTPSA id jq5sm9120374pbc.32.2014.10.26.15.50.38 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 26 Oct 2014 15:50:39 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\)) Subject: Re: No bhyve guests can reach the network after update. From: Benjamin Perrault In-Reply-To: <544D78EF.4010205@freebsd.org> Date: Sun, 26 Oct 2014 15:50:32 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <53C7A7C9-A563-4975-9974-99630FA057A1@gmail.com> References: <544D78EF.4010205@freebsd.org> To: Allan Jude X-Mailer: Apple Mail (2.1990.1) Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2014 22:50:40 -0000 Thank you! I feel like an idiot now.. it seems I did indeed = somehow/accidently mergemastered out my usual sysctl.conf for the stock = one. I should have checked that first.=20 Setting sysctl net.link.tap.up_on_open=3D1 seems to have done it.=20 sorry for the noise.. cheers, -bp > On Oct 26, 2014, at 3:42 PM, Allan Jude wrote: >=20 > On 2014-10-26 18:36, Benjamin Perrault wrote: >> Hi all, >>=20 >> So I just update one of my systems to 10-STABLE r273710 ( GENERIC = kernel config ) and now all the bhyve guests are unable to connect to = the network ( be it linux, freebsd, or openbsd ). They guests see their = network interfaces fine - but they are unable to connect to anything. = Additionally on the host, the tap interfaces appear to be connecting = just fine.=20 >>=20 >> Everything appears fine on the host and it=E2=80=99s reporting no = errors. The networking is working/performing as normal. >>=20 >> There has been no configuration changes. Here is the relevant = networks stuff ( that=E2=80=99s been working reliably since 10-RELEASE, = and is running fine on 10.1-RC2 and -current just fine. ). >>=20 >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D >> ifconfig_em0=3D"up -txcsum=E2=80=9D >> ifconfig_igb0=3D"up -txcsum=E2=80=9D >> defaultrouter=3D=E2=80=9C10.0.x.x" >> cloned_interfaces=3D"lagg0 bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 = tap7 tap8 tap9=E2=80=9D >>=20 >> ifconfig_lagg0=3D"laggproto lacp laggport em0 laggport igb0 = 10.0.x.x/24=E2=80=9D >>=20 >> ifconfig_bridge0=3D"addm lagg0 addm tap0 addm tap1 addm tap2 addm = tap3 addm tap4 addm tap5 addm tap6 addm tap7 addm tap8 addm tap9=E2=80=9D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>=20 >> Any one have any ideas or suggestions? I always get spooked/bothered = when something that was working fine just sort of breaks.. >>=20 >> cheers and thanks, >> -bp >>=20 >>=20 >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" >>=20 >=20 > try: ifconfig bridge0 up >=20 > and make sure your tap interfaces are up as well (sysctl > net.link.tap.up_on_open=3D1 is useful) >=20 > --=20 > Allan Jude >=20 From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 00:30:26 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A15BD98B for ; Mon, 27 Oct 2014 00:30:26 +0000 (UTC) Received: from mail-vc0-x231.google.com (mail-vc0-x231.google.com [IPv6:2607:f8b0:400c:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 62902B77 for ; Mon, 27 Oct 2014 00:30:26 +0000 (UTC) Received: by mail-vc0-f177.google.com with SMTP id hq11so1841962vcb.36 for ; Sun, 26 Oct 2014 17:30:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=DvL++njfNleTTNlS4ihAfi0WnTAG1nwkKD9N815yjjA=; b=jCBgjD+Kqr/q2w/eRgpLugE4cCFAewpUqYD0s9MBA0SrDjvG6I6DLKMxgItfK989Wd R2MREbwvC2BOvNbfXIpGbcgW7iBPS3qZE/r01r5elvPkc/6OFjA/ucR/UhoBtn6y7ZnO pqtBQUkpQksqqIAmhOzFGt5ljI8d/mbJQGRrM0IPc0pi9+OHOsSCrSr0lNSwk4HTAgLl O1jmXmiX8QYPl3wR6Anu8CiN0mPbqxByL15GhRAntriaGE3kp52yMjCWBdOOSImFQnCO vC8IEe/DIsHXnNvoHqwFHNp2j+eYzvs1amxWRXrRmm6CRBNOW0Te+vR/VTM6x+dppd6E x81w== MIME-Version: 1.0 X-Received: by 10.220.14.194 with SMTP id h2mr14290310vca.9.1414369825476; Sun, 26 Oct 2014 17:30:25 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Sun, 26 Oct 2014 17:30:25 -0700 (PDT) In-Reply-To: <544D6B6F.8020004@digiware.nl> References: <544C28C8.2060108@digiware.nl> <544D6B6F.8020004@digiware.nl> Date: Sun, 26 Oct 2014 20:30:25 -0400 Message-ID: Subject: Re: Looking for a Libvirt example xml file From: Conrad Meyer To: Willem Jan Withagen Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 00:30:26 -0000 On Sun, Oct 26, 2014 at 5:45 PM, Willem Jan Withagen wrote: > On 26-10-2014 0:48, Willem Jan Withagen wrote: >> Hoi >> >> I tried the version on the libvirt.org/bhyve page. >> But that returns: >> >> freetest# virsh -c "bhyve:///system" domxml-to-native \\ >> --format bhyve-argv --xml /root/libvirt-example.xml >> error: unsupported configuration: unsupported disk device >> >> So I was wondering if somebody would like to share his working example? > > After building libvirt 1.2.10 > > I was able to load this XML: > /usr/sbin/bhyveload -m 214 -d /home/bhyve/FreeBSD/freebsd-head.disk bhyveCD > /usr/sbin/bhyve -c 1 -m 214 -A -I -H -P -s 0:0,hostbridge -s > 2:0,virtio-net,tap0,mac=52:54:00:63:43:69 -s > 3:0,virtio-blk,/home/bhyve/FreeBSD/freebsd-head.disk -s > 4:0,ahci-cd,/home/bhyve/FreeBSD/freebsd-head.iso bhyveCD Hi Willem, It appears 1.2.6 is too old. Please chime in on https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192441 , let's get this updated to 1.2.9 (latest release). And then we should figure out if the port maintainer needs a comaintainer to help keep this up to date. I've got some patches pending upstream that should really improve libvirt-bhyve integration when they land (which will be in 1.2.10 or later). Thanks, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 10:08:54 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E19EE66E; Mon, 27 Oct 2014 10:08:54 +0000 (UTC) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.redhat.com", Issuer "DigiCert SHA2 Extended Validation Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9B8E0BC4; Mon, 27 Oct 2014 10:08:54 +0000 (UTC) Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id s9RA8lD9013559 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Mon, 27 Oct 2014 06:08:48 -0400 Received: from redhat.com (vpn1-4-213.ams2.redhat.com [10.36.4.213]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id s9RA8hd2020812 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Mon, 27 Oct 2014 06:08:46 -0400 Date: Mon, 27 Oct 2014 10:08:43 +0000 From: "Daniel P. Berrange" To: Craig Rodrigues Subject: Re: [libvirt] [PATCHv2 1/2] bhyve: Support /domain/bootloader configuration for non-FreeBSD guests. Message-ID: <20141027100843.GB19714@redhat.com> Reply-To: "Daniel P. Berrange" References: <1414106923-32313-1-git-send-email-cse.cem@gmail.com> <1414106923-32313-2-git-send-email-cse.cem@gmail.com> <20141024045844.GA12422@dev.san.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22 Cc: libvir-list@redhat.com, Roman Bogorodskiy , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 10:08:55 -0000 On Fri, Oct 24, 2014 at 03:28:33PM -0700, Craig Rodrigues wrote: > On Fri, Oct 24, 2014 at 6:11 AM, Conrad Rad wrote: > > > > > Any idea how soon? Months? A year? 5 years? I'm not comfortable > > postponing improvements indefinitely for vaporware. In the wonderful > > bhyve-UEFI future, we can ignore/warn about . > > > > > Hi, > > I have to agree with Conrad here. I hope that any perceived future > direction of bhyve is not going to be used as an excuse to block > some of the libvirt patches that Conrad is submitting. The stuff > that Conrad is working on overlaps some of the shortcomings in > libvirt/bhyve that > I mentioned here: > https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002857.html > > Fixing these issues in libvirt will make libvirt + bhyve more usable > today. When the bhyve-UEFI stuff comes out in future, > that will be even better, Libvirt has a goal that we never break application compatibility, which includes the way the XML is configured for guests. So when reviewing patches like this series it is important to try to have an awareness of what further patches may be coming down the pipe in the future, so we can avoid painting ourselves into a corner. So this question of Roman's isn't really about blocking patches for future vapourware, but rather about making sure that decisions we make today don't cause us undue problems with UEFI does arrive at some point later. Regards, Daniel -- |: http://berrange.com -o- http://www.flickr.com/photos/dberrange/ :| |: http://libvirt.org -o- http://virt-manager.org :| |: http://autobuild.org -o- http://search.cpan.org/~danberr/ :| |: http://entangle-photo.org -o- http://live.gnome.org/gtk-vnc :| From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 16:29:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 32CBCC84; Mon, 27 Oct 2014 16:29:20 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0DBCFE7F; Mon, 27 Oct 2014 16:29:20 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-70-85-31.nwrknj.fios.verizon.net [173.70.85.31]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 3EE3AB93C; Mon, 27 Oct 2014 12:29:18 -0400 (EDT) From: John Baldwin To: freebsd-virtualization@freebsd.org Subject: Rework hypervisor detection Date: Mon, 27 Oct 2014 12:28:46 -0400 Message-ID: <3183374.mZUFeIh4pp@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-PRERELEASE; KDE/4.14.2; amd64; ; ) MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 27 Oct 2014 12:29:18 -0400 (EDT) Cc: delphij@freebsd.org, Jung-uk Kim X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 16:29:20 -0000 The current code to detect a hypervisor in FreeBSD is a git gross. First, it's x86-specific, but stored in MI code. Second, it does not follow the best practice of using cpuid info but only depends on DMI/SMBIOS strings. The patch below attempts to improve this. We might want to move the VM_GUEST_HV detection into this new function as well. https://reviews.freebsd.org/D1010 -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 16:29:20 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4E900C87 for ; Mon, 27 Oct 2014 16:29:20 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 275E3E80 for ; Mon, 27 Oct 2014 16:29:20 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-70-85-31.nwrknj.fios.verizon.net [173.70.85.31]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id D283DB941; Mon, 27 Oct 2014 12:29:18 -0400 (EDT) From: John Baldwin To: freebsd-virtualization@freebsd.org Subject: Re: NATed or Private Network Setups Date: Mon, 27 Oct 2014 12:21:52 -0400 Message-ID: <1666962.21oQs0XfTB@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-PRERELEASE; KDE/4.14.2; amd64; ; ) In-Reply-To: <544ADBEB.2030907@nomadlogic.org> References: <544ADBEB.2030907@nomadlogic.org> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 27 Oct 2014 12:29:18 -0400 (EDT) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 16:29:20 -0000 On Friday, October 24, 2014 04:08:27 PM Pete Wright wrote: > Hi All, > Has anyone deployed bhyve using NAT'd or private network setups? I've > been able to deploy bridged interfaces, but I was wondering if anyone > has done other network topologies. Is there anything preventing this > from happening code wise? I reckon it could be achieved by creating a > pseudo interface? I setup a bridge on my laptop and add all the tap interfaces for VMs as members to the bridge. I use a /24 for the internal "LAN" for these interfaces and assign the .1 to the bridge0 interface itself. I then run dnsmasq to provide DHCP/DNS to the VMs and use natd (ipfw_nat would also work) to allow the VMs NAT access to the outside world. There are more details in an article in the most recent issue of the FreeBSD Journal, but I'll push that into the regular FreeBSD docs at some point as well. With the dnsmasq setup, I put the vmname as the hostname so that it is sent in the dhclient request. dnsmasq then adds local overrides for VMs while they are active. (So you can 'ssh vm0' on the host, or from another vm.) The 'host' entry in /etc/hosts is also snarfed up by dnsmasq so that within a vm I can use 'host' as a hostname (e.g. for NFS mounting something off of my laptop). Some config file snippets: /etc/sysctl.conf: net.link.tap.up_on_open=1 /etc/rc.conf: # bhyve setup autobridge_interfaces="bridge0" autobridge_bridge0="tap*" cloned_interfaces="bridge0 tap0 tap1 tap2" ifconfig_bridge0="inet 192.168.16.1/24" gateway_enable="YES" natd_enable="YES" natd_interface="wlan0" dnsmasq_enable="YES" firewall_enable="YES" firewall_type="/etc/rc.firewall.pippin" /etc/hosts: 192.168.16.1 host /etc/resolvconf.conf: name_servers=127.0.0.1 dnsmasq_conf=/etc/dnsmasq-conf.conf dnsmasq_resolv=/etc/dnsmasq-resolv.conf /usr/local/etc/dnsmasq.conf: domain-needed bogus-priv resolv-file=/etc/dnsmasq-resolv.conf interface=bridge0 dhcp-range=192.168.16.10,192.168.16.200,12h conf-file=/etc/dnsmasq-conf.conf /etc/rc.firewall.pippin: # prevent inbound traffic for our guest /24 add deny all from any to 192.168.16.0/24 via em0 add deny all from any to 192.168.16.0/24 via wlan0 # divert packets between guest and outside world to natd add divert natd all from any to any via wlan0 # prevent outbound traffic for our guest /24 add deny all from 192.168.16.0/24 to any via em0 add deny all from 192.168.16.0/24 to any via wlan0 # pass everything else add allow all from any to any (I have not figured out a way to have the NAT prefer em0 if present and fail over to wlan0 if not, etc.) -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 16:47:15 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 11A02C34; Mon, 27 Oct 2014 16:47:15 +0000 (UTC) Received: from mail-vc0-x229.google.com (mail-vc0-x229.google.com [IPv6:2607:f8b0:400c:c03::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 91F3A15A; Mon, 27 Oct 2014 16:47:14 +0000 (UTC) Received: by mail-vc0-f169.google.com with SMTP id id10so506989vcb.28 for ; Mon, 27 Oct 2014 09:47:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=4DbBGwFY7gibefrVKUJ3o27eebTu9Dw2KAZGMRrpTxg=; b=hqYw2YnVOJCfjh1VXOLUxXNmMyZChiRndjy77pcJtNhIe9Enh/+cJqH0dxzobHoMvF 9qReyKl1NlNGL8Dr0slFv4/G+YS8h5r5CRC6sUgI+hy1Jte2WO8+/q+aQZijGu4UABc1 zPDSO1qH8c3tlyQ7HHH4GKT16QshqazSsF5KMLT6OFc6cZTDdt9lYjrkuEsC+wN8B8ae Z+wNw7Z6Euf3eYYZT1P8WLBboYVJK208d809Qqe/lKVYJAfPSZSsRHf5lUuFwlRhmhOJ vgMxfaYmLKZPQeYWtgxoax25GtQHJwux4zjeeIt1dHTWmD1DWV/6AADe5FL7bHRk15D5 Hjyg== MIME-Version: 1.0 X-Received: by 10.220.87.68 with SMTP id v4mr17454984vcl.8.1414428433560; Mon, 27 Oct 2014 09:47:13 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Mon, 27 Oct 2014 09:47:13 -0700 (PDT) In-Reply-To: <3183374.mZUFeIh4pp@ralph.baldwin.cx> References: <3183374.mZUFeIh4pp@ralph.baldwin.cx> Date: Mon, 27 Oct 2014 12:47:13 -0400 Message-ID: Subject: Re: Rework hypervisor detection From: Conrad Meyer To: John Baldwin Content-Type: text/plain; charset=UTF-8 Cc: delphij@freebsd.org, Jung-uk Kim , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 16:47:15 -0000 Hi John, I don't have access to phabricator so I'll try and review in email. > +#ifdef XEN > +int vm_guest = VM_GUEST_XEN; > +#else > +int vm_guest = VM_GUEST_NO; /* Running as virtual machine guest? */ > +#endif The whitespace between 'int' and 'vm_guest' in the second line seems wrong (extra space?). For vmware_hvcall() in x86/include/vmware.h, are you sure the inline assembly is correct? Have you tried the detection on a VMware VM? VMware's documentation specifies the arguments in a different order[0], and at Isilon when we tried the port-based detection in a slightly older revision of CURRENT, it didn't work (IIRC). Everything else looks good to me, thanks. [0]: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1009458 Best, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 17:16:46 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from hammer.pct.niksun.com (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by hub.freebsd.org (Postfix) with ESMTP id E1597999; Mon, 27 Oct 2014 17:16:45 +0000 (UTC) Message-ID: <544E7DFD.2040408@FreeBSD.org> Date: Mon, 27 Oct 2014 13:16:45 -0400 From: Jung-uk Kim User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Conrad Meyer , John Baldwin Subject: Re: Rework hypervisor detection References: <3183374.mZUFeIh4pp@ralph.baldwin.cx> In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Cc: delphij@freebsd.org, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 17:16:46 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 2014-10-27 12:47:13 -0400, Conrad Meyer wrote: > Hi John, > > I don't have access to phabricator so I'll try and review in > email. > >> +#ifdef XEN +int vm_guest = VM_GUEST_XEN; +#else +int vm_guest = >> VM_GUEST_NO; /* Running as virtual machine guest? */ +#endif > > The whitespace between 'int' and 'vm_guest' in the second line > seems wrong (extra space?). > > For vmware_hvcall() in x86/include/vmware.h, are you sure the > inline assembly is correct? Have you tried the detection on a > VMware VM? VMware's documentation specifies the arguments in a > different order[0], and at Isilon when we tried the port-based > detection in a slightly older revision of CURRENT, it didn't work > (IIRC). > > Everything else looks good to me, thanks. > > [0]: > http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1009458 I > wrote the code and it worked for me at the time. I'll try again soon. Jung-uk Kim -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEbBAEBAgAGBQJUTn39AAoJEHyflib82/FGWt8H+IoPF03arSi2lAgT+LnVrKgj x+r/yKfQ4+5/nxwRfvu/6FER+AUCWRYt+C12vnYdJwpx4iyspNi9FLDgyqpgtmgA FQQr1ZYuOG8fHDln5gGxXG8p3VQBce5zaVHK7CHaLrgPMM1qY6OE35aSplzCIpsH 9QmlokW5gjaPvCt/EdCnbHB3nBZ2O8gpkd1GCr4OZwNerkmUmDL3dM08DgKVQsED eeYhOKP6e4cLNG/1VGLqcMpMH93CYFmukOcLMpiNNaFwC2zEusah6X5e98bzeVxk HcgMvB451OWEVoM93CoV86q3DTlxRthpwnuB06LfSDHSZRrRO4IqYR9Sj3OYFQ== =/9eJ -----END PGP SIGNATURE----- From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 17:36:15 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 40B8CFF; Mon, 27 Oct 2014 17:36:15 +0000 (UTC) Received: from mail.nomadlogic.org (mail.nomadlogic.org [IPv6:2607:f2f8:a098::4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1C1B68F3; Mon, 27 Oct 2014 17:36:15 +0000 (UTC) Received: from mail.nomadlogic.org (localhost [127.0.0.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPS id CB726125EE1; Mon, 27 Oct 2014 10:36:08 -0700 (PDT) Received: from pop.rubicorp.com (unknown [72.34.113.100]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPSA id BA8A7125EBA; Mon, 27 Oct 2014 10:36:08 -0700 (PDT) Message-ID: <544E8288.9020001@nomadlogic.org> Date: Mon, 27 Oct 2014 10:36:08 -0700 From: Pete Wright User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: John Baldwin , freebsd-virtualization@freebsd.org Subject: Re: NATed or Private Network Setups References: <544ADBEB.2030907@nomadlogic.org> <1666962.21oQs0XfTB@ralph.baldwin.cx> In-Reply-To: <1666962.21oQs0XfTB@ralph.baldwin.cx> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 17:36:15 -0000 On 10/27/14 09:21, John Baldwin wrote: > On Friday, October 24, 2014 04:08:27 PM Pete Wright wrote: >> Hi All, >> Has anyone deployed bhyve using NAT'd or private network setups? I've >> been able to deploy bridged interfaces, but I was wondering if anyone >> has done other network topologies. Is there anything preventing this >> from happening code wise? I reckon it could be achieved by creating a >> pseudo interface? > > I setup a bridge on my laptop and add all the tap interfaces for VMs as > members to the bridge. I use a /24 for the internal "LAN" for these > interfaces and assign the .1 to the bridge0 interface itself. I then run > dnsmasq to provide DHCP/DNS to the VMs and use natd (ipfw_nat would also work) > to allow the VMs NAT access to the outside world. There are more details in > an article in the most recent issue of the FreeBSD Journal, but I'll push that > into the regular FreeBSD docs at some point as well. > > With the dnsmasq setup, I put the vmname as the hostname so that it is sent in > the dhclient request. dnsmasq then adds local overrides for VMs while they > are active. (So you can 'ssh vm0' on the host, or from another vm.) The > 'host' entry in /etc/hosts is also snarfed up by dnsmasq so that within a vm I > can use 'host' as a hostname (e.g. for NFS mounting something off of my > laptop). > > Some config file snippets: > > /etc/sysctl.conf: > > net.link.tap.up_on_open=1 > > /etc/rc.conf: > > # bhyve setup > autobridge_interfaces="bridge0" > autobridge_bridge0="tap*" > cloned_interfaces="bridge0 tap0 tap1 tap2" > ifconfig_bridge0="inet 192.168.16.1/24" > gateway_enable="YES" > natd_enable="YES" > natd_interface="wlan0" > dnsmasq_enable="YES" > firewall_enable="YES" > firewall_type="/etc/rc.firewall.pippin" > > /etc/hosts: > > 192.168.16.1 host > > /etc/resolvconf.conf: > > name_servers=127.0.0.1 > dnsmasq_conf=/etc/dnsmasq-conf.conf > dnsmasq_resolv=/etc/dnsmasq-resolv.conf > > /usr/local/etc/dnsmasq.conf: > > domain-needed > bogus-priv > resolv-file=/etc/dnsmasq-resolv.conf > interface=bridge0 > dhcp-range=192.168.16.10,192.168.16.200,12h > conf-file=/etc/dnsmasq-conf.conf > > /etc/rc.firewall.pippin: > > # prevent inbound traffic for our guest /24 > add deny all from any to 192.168.16.0/24 via em0 > add deny all from any to 192.168.16.0/24 via wlan0 > > # divert packets between guest and outside world to natd > add divert natd all from any to any via wlan0 > > # prevent outbound traffic for our guest /24 > add deny all from 192.168.16.0/24 to any via em0 > add deny all from 192.168.16.0/24 to any via wlan0 > > # pass everything else > add allow all from any to any > > (I have not figured out a way to have the NAT prefer em0 if present and fail > over to wlan0 if not, etc.) > Thanks for this detailed explanation John! Using dnsmasq sounds great, especially for my environment since we already leverage it for openstack on our linux systems extensively. Cheers, -pete -- Pete Wright pete@nomadlogic.org twitter => @nomadlogicLA From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 18:29:48 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 81D1AFD4; Mon, 27 Oct 2014 18:29:48 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 59B5EE97; Mon, 27 Oct 2014 18:29:48 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-70-85-31.nwrknj.fios.verizon.net [173.70.85.31]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id F3ACAB94E; Mon, 27 Oct 2014 14:29:46 -0400 (EDT) From: John Baldwin To: Conrad Meyer Subject: Re: Rework hypervisor detection Date: Mon, 27 Oct 2014 14:27:36 -0400 Message-ID: <1436499.c107WK3AT0@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-PRERELEASE; KDE/4.14.2; amd64; ; ) In-Reply-To: References: <3183374.mZUFeIh4pp@ralph.baldwin.cx> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 27 Oct 2014 14:29:47 -0400 (EDT) Cc: delphij@freebsd.org, Jung-uk Kim , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 18:29:48 -0000 On Monday, October 27, 2014 12:47:13 PM Conrad Meyer wrote: > Hi John, > > I don't have access to phabricator so I'll try and review in email. > > > +#ifdef XEN > > +int vm_guest = VM_GUEST_XEN; > > +#else > > +int vm_guest = VM_GUEST_NO; /* Running as virtual machine guest? */ > > +#endif > > The whitespace between 'int' and 'vm_guest' in the second line seems > wrong (extra space?). Yep, fixed. > For vmware_hvcall() in x86/include/vmware.h, are you sure the inline > assembly is correct? Have you tried the detection on a VMware VM? > VMware's documentation specifies the arguments in a different > order[0], and at Isilon when we tried the port-based detection in a > slightly older revision of CURRENT, it didn't work (IIRC). I don't have VMware handy, but it is a simple copy and paste of existing code in tsc.c. -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 18:30:53 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from hammer.pct.niksun.com (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by hub.freebsd.org (Postfix) with ESMTP id 583251FD; Mon, 27 Oct 2014 18:30:53 +0000 (UTC) Message-ID: <544E8F5C.6070009@FreeBSD.org> Date: Mon, 27 Oct 2014 14:30:52 -0400 From: Jung-uk Kim User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Conrad Meyer , John Baldwin Subject: Re: Rework hypervisor detection References: <3183374.mZUFeIh4pp@ralph.baldwin.cx> <544E7DFD.2040408@FreeBSD.org> In-Reply-To: <544E7DFD.2040408@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Cc: delphij@freebsd.org, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 18:30:53 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 2014-10-27 13:16:45 -0400, Jung-uk Kim wrote: 2014년 10월 27일 13:16에 Jung-uk Kim 이(가) 쓴 글:> On 2014-10-27 12:47:13 -0400, Conrad Meyer wrote: >> Hi John, > >> I don't have access to phabricator so I'll try and review in >> email. > >>> +#ifdef XEN +int vm_guest = VM_GUEST_XEN; +#else +int vm_guest >>> = VM_GUEST_NO; /* Running as virtual machine guest? */ +#endif > >> The whitespace between 'int' and 'vm_guest' in the second line >> seems wrong (extra space?). > >> For vmware_hvcall() in x86/include/vmware.h, are you sure the >> inline assembly is correct? Have you tried the detection on a >> VMware VM? VMware's documentation specifies the arguments in a >> different order[0], and at Isilon when we tried the port-based >> detection in a slightly older revision of CURRENT, it didn't >> work (IIRC). > >> Everything else looks good to me, thanks. > >> [0]: >> http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1009458 > >> > I wrote the code and it worked for me at the time. I'll try again > soon. I just tested the function and it still works well. Jung-uk Kim -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBAgAGBQJUTo9cAAoJEHyflib82/FGLOAIAJYFN2KVlaLgmVTtOX5uU/yf gjazSIRLzQopS/yMUDvZ0hSJovoqFtHpUHTWwIMhqbpKD0u2OehTVWrt+frYrrG1 R0DHlWXIeBkfgdp3fD/6jW5Bbq1yNidn6arquSbbhxLROOTkuE0jiHUHYhgkD89a ZluWuHfuNCPrAYEfLKAOs739ocQO+xZe+jeS2lae74bSgE06kRnQgx72Cv7ZZU35 l3C152sJKuDR+P9DOxi/mLdWcNXO76YFXkmt2JvIey2FUsw3fCIYXbN0FOz/dWD6 q8DaSCWjxYHs1TLPCueBrOgOyIzDQ5Ky4l1V/8aBROigtgmVsxv0U/rKZO5pSSs= =dG0n -----END PGP SIGNATURE----- From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 23:43:03 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4F469138; Mon, 27 Oct 2014 23:43:03 +0000 (UTC) Received: from mail-lb0-x232.google.com (mail-lb0-x232.google.com [IPv6:2a00:1450:4010:c04::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5E90C839; Mon, 27 Oct 2014 23:43:02 +0000 (UTC) Received: by mail-lb0-f178.google.com with SMTP id f15so3035039lbj.23 for ; Mon, 27 Oct 2014 16:42:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=jLxlJImGK/mdvrc4s9ZJgf2hzd0Z2XnjfAWa86+8krc=; b=gIPoI9aFxNzvmlJVRB6hHK2bTw7kF0QKYkB0K7f5c/NpOG9KNvsvdfju45yMabQhtf iKCxTd4d+KqYWQjSuS2fDufNU0mvb1/DQW4DOWKhd5wr33Q795leBGPSCiEAcT1ZsMKe sGmsklN0QdIzpsXpOVBAIb28qfT3MhofkzjUqZw8GV5zZWSJzIIOpM++4u1M0EH89j6e gov2o2ftHn8ZQInXE+OzDoNybkbmnaeSq81098ZnCrOuh+oK+juryxFiUl6k0BdAeuod BkLozhE+lxO9B2y/SS5dYlrvOqV5X3b+ovoLOJALQ2ilWWteB8OGlhMyr7cZFSbOSSRL sPFQ== MIME-Version: 1.0 X-Received: by 10.112.225.225 with SMTP id rn1mr6640441lbc.98.1414453379125; Mon, 27 Oct 2014 16:42:59 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.84.197 with HTTP; Mon, 27 Oct 2014 16:42:58 -0700 (PDT) In-Reply-To: <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com> References: <5449C81B.8080008@freebsd.org> <5449DB7C.9080107@xinuos.com> <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com> <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com> Date: Mon, 27 Oct 2014 16:42:58 -0700 X-Google-Sender-Auth: on84ll1GpO2p1hbmo-9AeDvZW3E Message-ID: Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins From: Craig Rodrigues To: Susan Stanziano Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: John Wolfe , "freebsd-virtualization@freebsd.org" , "freebsd-testing@freebsd.org" , Eric@xinuos.com, Allan Jude , Cheryl Blain , Andy Nagle X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 23:43:03 -0000 Susan, In addition to the slides which I previously mentioned, you and your colleagues at Xinuos may wish to take a quick read of this document which I wrote, the "Kyua Quickstart Guide": https://github.com/rodrigc/kyua/wiki/Quickstart-Guide kyua is the test harness that is used to run the tests in the /usr/tests directory in FreeBSD. That doc is a very quick guide on how to run tests under kyua, and also how to write tests which can be run under kyua. Getting any feedback on this would be very useful. Does that doc make sense to a newcomer? Are there typos? I want the FreeBSD project to get to the point where: (1) anybody can download the FreeBSD tests (2) anybody can run the tests (3) people can easily figure out how to write new tests and contribute them back (if they wish) to FreeBSD Better documentation will hopefully help with this. Thanks. -- Craig On Fri, Oct 24, 2014 at 1:37 PM, Susan Stanziano wrote: > Hello Craig, > > I have been reading through your slides and your website announcement, as > requested, and have a few questions. (I have also subscribed to the > mailing list as suggested). > > (1) The slides indicate that with a FreeBSD10 and lower OS, I should be > able to build tests already included with FreeBSD. I have created a VM on > FreeBSD10.0 but do not have the /etc/make.conf file necessary to build and > install the tests. This may be that I am missing some set-up steps > required but not covered in the slide presentation. > > (2) Does the test build require the use of the "Build Flow Plugin" or can > the tests be run independent of the "continuous build" model? > > (3) Can the tests only be run under Bhyve as described in the announcement? > > I would be happy to exchange emails with you or skype as I investigate > this work further. > > Regards, > > Susan > > ------------------------------ > *From: *"Craig Rodrigues" > *To: *Eric@xinuos.com > *Cc: *"Allan Jude" , "John Wolfe" , > freebsd-virtualization@freebsd.org, freebsd-testing@freebsd.org, "Susan > Stanziano" , "Cheryl Blain" < > cheryl.blain@xinuos.com>, "Andy Nagle" > *Sent: *Friday, October 24, 2014 7:09:04 AM > *Subject: *Re: Re: Automatically running /usr/tests on stable/10 branch > under Jenkins > > > > > On Fri, Oct 24, 2014 at 1:11 AM, Eric le Blan wrote: > >> Allan, >> >> >> >> Always happy to discuss testing. I believe that Susan Stanziono of Xinuos >> system test team already spoke to some of you. Please do not hesitate to >> reach her for any specific needs. Also, Cheryl Blain - Xinuos VP of >> operations - will be at the MeetBSD vendor summit on Nov 3-4 and can reach >> to Craig. > > > > It would be helpful if someone (or some people) from Xinuous could do the > following: > > (1) Subscribe to freebsd-testing@freebsd.org at > https://lists.freebsd.org/mailman/listinfo/freebsd-testing to start > monitoring the discussions on that list. > > (2) Review this announcement: > http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing > > (3) Review these slides: > http://www.slideshare.net/CraigRodrigues1/kyua-jenkins > > (4) Talk to me at MeetBSD Vendor Summit > > I have not been given a long timeslot to give a presentation, so reviewing > those links before MeetBSD would > be helpful. Long term, any testing of FreeBSD will only succeed if there > is > an ecosystem of people working together and sharing common scripts and > information for testing FreeBSD. > > Any help that Xinuous (or any other company) can provide would be welcome. > > -- > Craig > > From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 28 18:15:17 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E1ADFB56 for ; Tue, 28 Oct 2014 18:15:17 +0000 (UTC) Received: from mail.nomadlogic.org (mail.nomadlogic.org [IPv6:2607:f2f8:a098::4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C590F115 for ; Tue, 28 Oct 2014 18:15:17 +0000 (UTC) Received: from mail.nomadlogic.org (localhost [127.0.0.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPS id 20AB5125EE1 for ; Tue, 28 Oct 2014 11:15:17 -0700 (PDT) Received: from pop.rubicorp.com (unknown [72.34.113.100]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPSA id 112A1125EBA for ; Tue, 28 Oct 2014 11:15:17 -0700 (PDT) Message-ID: <544FDD34.7070506@nomadlogic.org> Date: Tue, 28 Oct 2014 11:15:16 -0700 From: Pete Wright User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: core dump after centos-6.5 install Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2014 18:15:18 -0000 just had bhyve coredump on me and was wondering if anyone else had seen this behavior: > uname -ar FreeBSD pop.rubicorp.com 10.1-RC3 FreeBSD 10.1-RC3 #0 r273437: Tue Oct 21 23:55:15 UTC 2014 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > pkg info|grep grub2 grub2-bhyve-0.24 Grub-emu loader for bhyve I was following the instructions on this page to use grub-bhyve to install CentOS-6.5_amd64 on my 10.1-RC3 hypervisor: https://www.monkeybrains.net/support/bhyve The installation went through as expected. I ran grub-bhyve w/o issues, then executed the bhyve command and installation proceeded without issue. When bhyve exited I re-ran my bhyve command to start my VM resulting in this: > sudo /tmp/cmd.sh Assertion failed: (error == 0), function fbsdrun_addcpu, file /usr/src/usr.sbin/bhyve/bhyverun.c, line 266. Abort trap (core dumped) I have run gdb against the resulting core file, but since there are no debug symbols in there I don't think it's useful. Please let me know if this is a pebkac event, or if I should file a PR. Thanks! -pete -- Pete Wright pete@nomadlogic.org twitter => @nomadlogicLA From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 28 18:25:54 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D9A7FDDC for ; Tue, 28 Oct 2014 18:25:54 +0000 (UTC) Received: from fallback1.mail.ru (fallback1.mail.ru [94.100.181.184]) by mx1.freebsd.org (Postfix) with ESMTP id 99930211 for ; Tue, 28 Oct 2014 18:25:53 +0000 (UTC) Received: from f87.i.mail.ru (f87.i.mail.ru [128.140.169.159]) by fallback1.mail.ru (mPOP.Fallback_MX) with ESMTP id 6F5A24306B7F for ; Tue, 28 Oct 2014 21:25:46 +0300 (MSK) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=inbox.ru; s=mail; h=Content-Type:Message-ID:Reply-To:Date:MIME-Version:Subject:To:From; bh=G6g5UktB5tncbzbufGzuHvEIDCsdyVhUlCajCljCXgg=; b=A799stV/nHmZCXQP/QMFmxfJMWmHTlQoqnpYbLiBgByGjkpcRnsk4u+5p6OpPGGuhlGSWA+Qhc9MkkohD/6Hy/5zO+tnSBTRVqXaq17JGBOYTEksTNDLZlqhiOTkLc4e0GqiNsGDuXV29p6ikX68bJy/Hbem+W8MKVCBwgqQ2k0=; Received: from [31.172.196.149] (ident=mail) by f87.i.mail.ru with local (envelope-from ) id 1XjBSb-0000Z7-Va for freebsd-virtualization@freebsd.org; Tue, 28 Oct 2014 21:25:38 +0300 Received: from [31.172.196.149] by e.mail.ru with HTTP; Tue, 28 Oct 2014 21:25:37 +0300 From: =?UTF-8?B?RGVuaXMgTWVuc2hpa292?= To: freebsd-virtualization@freebsd.org Subject: =?UTF-8?B?bGlidm1tYXBpLnNvIGFuZCBQZXJsIChsaWJ2bW1hcGkucG0p?= MIME-Version: 1.0 X-Mailer: Mail.Ru Mailer 1.0 X-Originating-IP: [31.172.196.149] Date: Tue, 28 Oct 2014 21:25:37 +0300 Reply-To: =?UTF-8?B?RGVuaXMgTWVuc2hpa292?= X-Priority: 3 (Normal) Message-ID: <1414520737.969914831@f87.i.mail.ru> Content-Type: multipart/mixed; boundary="----XXvdJgHcp9govgfmSN0iCXkpSrpWZSjW-0MOcnNVHcOfCzm1n:1414520737" X-Mras: Ok X-Spam: undefined X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2014 18:25:55 -0000 ------XXvdJgHcp9govgfmSN0iCXkpSrpWZSjW-0MOcnNVHcOfCzm1n:1414520737 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 IEdvb2QgZGF5IQoKSSdtIHRyeWluZyB0byBiaW5kIHRvIGxpYnZtbWFwaS5zbyBvbiBQZXJsLiBG b3IgdGhpcyBwdXJwb3NlIEkgdXNlIHN3aWcgKHBvcnRlZCB0byBGcmVlQlNEIDEwKS4gCkFsbCBt eSBtYW5pcHVsYXRpb25zIEkgZG8gaW4gdGhlIHRlc3QgZGlyZWN0b3J5IGluIHdoaWNoIHlvdSBl eHRyYWN0ZWQgdGhlIGFyY2hpdmUgc3JjLnR4eiwgaW4gdGhlIGRpcmVjdG9yeSAvdG1wL3Rlc3Qv dXNyL3NyYy9saWIvbGlidm1tYXBpLyAuwqAKCnVzZXIjIGxzCgpNYWtlZmlsZcKgCmxpYnZtbWFw aS5pwqAKbGlidm1tYXBpLnBtIHZtbWFwaS5jCmxpYnZtbWFwaV93cmFwLmMgdm1tYXBpLmgKdm1t YXBpX2ZyZWVic2QuYwoKVXNlIHRoZSBmb2xsb3dpbmcgc3dpZyBpbnRlcmZhY2UgZmlsZToKCiVt b2R1bGUgbGlidm1tYXBpCiV7CiNpbmNsdWRlICJ2bW1hcGkuaCIKJX0KJWluY2x1ZGUgInZtbWFw aS5oIgoKCgpPdXRwdXQgZXJyb3JzIG9mIHRoZSBmb2xsb3dpbmcgdHlwZSAoRmlsZSAxKToKCmxp YnZtbWFwaV93cmFwLmM6MjY2NzoyNDogZXJyb3I6IHZhcmlhYmxlIGhhcyBpbmNvbXBsZXRlIHR5 cGUKJ2VudW0gdm1fZXZlbnRfdHlwZScKZW51bSB2bV9ldmVudF90eXBlIGFyZzMgOwpeCmxpYnZt bWFwaV93cmFwLmM6MjY2NzoxMDogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBvZiAnZW51bQp2 bV9ldmVudF90eXBlJwplbnVtIHZtX2V2ZW50X3R5cGUgYXJnMyA7Cl4KbGlidm1tYXBpX3dyYXAu YzoyNjk4OjEyOiBlcnJvcjogY2FzdCB0byBpbmNvbXBsZXRlIHR5cGUKJ2VudW0gdm1fZXZlbnRf dHlwZScKYXJnMyA9IChlbnVtIHZtX2V2ZW50X3R5cGUpKHZhbDMpOwpeCmxpYnZtbWFwaV93cmFw LmM6MjY2NzoxMDogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBvZiAnZW51bQp2bV9ldmVudF90 eXBlJwplbnVtIHZtX2V2ZW50X3R5cGUgYXJnMyA7Cl4KbGlidm1tYXBpX3dyYXAuYzoyNzI1OjI0 OiBlcnJvcjogdmFyaWFibGUgaGFzIGluY29tcGxldGUgdHlwZQonZW51bSB2bV9ldmVudF90eXBl JwplbnVtIHZtX2V2ZW50X3R5cGUgYXJnMyA7Cl4KbGlidm1tYXBpX3dyYXAuYzoyNzI1OjEwOiBu b3RlOiBmb3J3YXJkIGRlY2xhcmF0aW9uIG9mICdlbnVtCnZtX2V2ZW50X3R5cGUnCmVudW0gdm1f ZXZlbnRfdHlwZSBhcmczIDsKXgpsaWJ2bW1hcGlfd3JhcC5jOjI3NTk6MTI6IGVycm9yOiBjYXN0 IHRvIGluY29tcGxldGUgdHlwZQonZW51bSB2bV9ldmVudF90eXBlJwphcmczID0gKGVudW0gdm1f ZXZlbnRfdHlwZSkodmFsMyk7ClRoZW4sSSBzdWdnZXN0ZWQgdGhhdCBlbnVtICdlbnVtIHZtX2V2 ZW50X3R5cGUnIGlzIG5vdCBkZWZpbmVkLiBCZWNhdXNlIHRoZSBmaWxlIHZtbWFwaS5jIGluY2x1 ZGVzIHZtbS5oIEkgZm91bmQgdGhlIGRlZmluaXRpb24gb2YgdGhlIGVudW1lcmF0aW9uLCBhbmQg Y2hhbmdlZCB0aGUgaW50ZXJmYWNlIGZpbGUuCgolbW9kdWxlIGxpYnZtbWFwaQolewojaW5jbHVk ZSAidm1tYXBpLmgiCiNpbmNsdWRlICJ2bW0uaCIKJX0KJWluY2x1ZGUgInZtbWFwaS5oIgolaW5j bHVkZSAidm1tLmgiCkluY2x1ZGUgdm1tLmggKGNvcHlpbmcgaXQgaW50byB0aGUgd29yayAodGVz dCkgZGlyZWN0b3J5ICkgaGFkLCBBcyBpdCBpcyBkZWZpbmVkIGVudW0gdm1fZXZlbnRfdHlwZS4K Ck5vdyB3ZSBoYXZlIHRoZSBlcnJvciBvZiBvbmx5IG9uZSB0eXBlIChGaWxlIDIpOgoKbGlidm1t YXBpX3dyYXAuYzoyNzg5OjQ1OiBlcnJvcjogYXJndW1lbnQgdHlwZSAnZW51bQp2bV9ldmVudF90 eXBlJyBpcyBpbmNvbXBsZXRlCnJlc3VsdCA9IChpbnQpdm1faW5qZWN0X2V2ZW50KGFyZzEsYXJn MixhcmczLGFyZzQpOwpefn5+Ci4vdm1tYXBpLmg6NjU6NTU6IG5vdGU6IGZvcndhcmQgZGVjbGFy YXRpb24gb2YgJ2VudW0Kdm1fZXZlbnRfdHlwZScKLi4udm1jdHggKmN0eCwgaW50IHZjcHUsIGVu dW0gdm1fZXZlbnRfdHlwZSB0eXBlLApeCmxpYnZtbWFwaV93cmFwLmM6Mjg1NTo0NjogZXJyb3I6 IGFyZ3VtZW50IHR5cGUgJ2VudW0Kdm1fZXZlbnRfdHlwZScgaXMgaW5jb21wbGV0ZQpyZXN1bHQg PSAoaW50KXZtX2luamVjdF9ldmVudDIoYXJnMSxhcmcyLGFyZzMsYXJnNCxhcmc1KTsKXn5+fgou L3ZtbWFwaS5oOjY3OjU2OiBub3RlOiBmb3J3YXJkIGRlY2xhcmF0aW9uIG9mICdlbnVtCnZtX2V2 ZW50X3R5cGUnCi4uLnZtY3R4ICpjdHgsIGludCB2Y3B1LCBlbnVtIHZtX2V2ZW50X3R5cGUgdHlw ZSwKSSBkb24ndCB1bmRlcnN0YW5kIHdoeSAnYXJnMycgaXMgdGhlIGFyZ3VtZW50IG9mIGluY29t cGxldGUgdHlwZSAnZW51bSB2bV9ldmVudF90eXBlJyBhbm5vdW5jZWQuIFRoYW5rIHlvdS7CoApQ LlMuCkkgaG9wZSB0aGUgcXVlc3Rpb24gaXMgbm90IG9mZnRvcGljLiAtLSAKV2l0aCBiZXN0IHJl Z2FyZHMsIMKgRGVuaXMgTWVuc2hpa292 ------XXvdJgHcp9govgfmSN0iCXkpSrpWZSjW-0MOcnNVHcOfCzm1n:1414520737 Content-Type: application/octet-stream; name="=?UTF-8?B?MQ==?=" Content-Disposition: attachment Content-Transfer-Encoding: base64 Y2xhbmcgLWZQSUMgLWMgbGlidm1tYXBpX3dyYXAuYyAtSS91c3IvbG9jYWwvbGliL3Blcmw1LzUu MTYvbWFjaC9DT1JFIC1EYm9vbD1jaGFyCkluIGZpbGUgaW5jbHVkZWQgZnJvbSBsaWJ2bW1hcGlf d3JhcC5jOjE1MzM6Ci4vdm1tYXBpLmg6NjM6MTY6IHdhcm5pbmc6IGRlY2xhcmF0aW9uIG9mICdz dHJ1Y3Qgdm1fZXhpdCcKICAgICAgd2lsbCBub3QgYmUgdmlzaWJsZSBvdXRzaWRlIG9mIHRoaXMg ZnVuY3Rpb24KICAgICAgWy1XdmlzaWJpbGl0eV0KICAgICAgICAgICAgICAgc3RydWN0IHZtX2V4 aXQgKnJldF92bWV4aXQpOwogICAgICAgICAgICAgICAgICAgICAgXgouL3ZtbWFwaS5oOjY1OjU1 OiB3YXJuaW5nOiBkZWNsYXJhdGlvbiBvZgogICAgICAnZW51bSB2bV9ldmVudF90eXBlJyB3aWxs IG5vdCBiZSB2aXNpYmxlIG91dHNpZGUgb2YKICAgICAgdGhpcyBmdW5jdGlvbiBbLVd2aXNpYmls aXR5XQogIC4uLnZtY3R4ICpjdHgsIGludCB2Y3B1LCBlbnVtIHZtX2V2ZW50X3R5cGUgdHlwZSwK ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBeCi4vdm1tYXBpLmg6Njc6NTY6IHdhcm5p bmc6IGRlY2xhcmF0aW9uIG9mCiAgICAgICdlbnVtIHZtX2V2ZW50X3R5cGUnIHdpbGwgbm90IGJl IHZpc2libGUgb3V0c2lkZSBvZgogICAgICB0aGlzIGZ1bmN0aW9uIFstV3Zpc2liaWxpdHldCiAg Li4udm1jdHggKmN0eCwgaW50IHZjcHUsIGVudW0gdm1fZXZlbnRfdHlwZSB0eXBlLAogICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgIF4KLi92bW1hcGkuaDo3Mzo1Nzogd2FybmluZzogZGVj bGFyYXRpb24gb2YgJ2VudW0gdm1fY2FwX3R5cGUnCiAgICAgIHdpbGwgbm90IGJlIHZpc2libGUg b3V0c2lkZSBvZiB0aGlzIGZ1bmN0aW9uCiAgICAgIFstV3Zpc2liaWxpdHldCiAgLi4udm1jdHgg KmN0eCwgaW50IHZjcHUsIGVudW0gdm1fY2FwX3R5cGUgY2FwLAogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIF4KLi92bW1hcGkuaDo3NTo1Nzogd2FybmluZzogZGVjbGFyYXRpb24gb2Yg J2VudW0gdm1fY2FwX3R5cGUnCiAgICAgIHdpbGwgbm90IGJlIHZpc2libGUgb3V0c2lkZSBvZiB0 aGlzIGZ1bmN0aW9uCiAgICAgIFstV3Zpc2liaWxpdHldCiAgLi4udm1jdHggKmN0eCwgaW50IHZj cHUsIGVudW0gdm1fY2FwX3R5cGUgY2FwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IF4KbGlidm1tYXBpX3dyYXAuYzoyNjEwOjQxOiB3YXJuaW5nOiBpbmNvbXBhdGlibGUgcG9pbnRl ciB0eXBlcwogICAgICBwYXNzaW5nICdzdHJ1Y3Qgdm1fZXhpdCAqJyB0byBwYXJhbWV0ZXIgb2Yg dHlwZQogICAgICAnc3RydWN0IHZtX2V4aXQgKicgWy1XaW5jb21wYXRpYmxlLXBvaW50ZXItdHlw ZXNdCiAgICByZXN1bHQgPSAoaW50KXZtX3J1bihhcmcxLGFyZzIsYXJnMyxhcmc0KTsKICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIF5+fn4KLi92bW1hcGkuaDo2MzoyNTog bm90ZTogcGFzc2luZyBhcmd1bWVudCB0byBwYXJhbWV0ZXIKICAgICAgJ3JldF92bWV4aXQnIGhl cmUKICAgICAgICAgICAgICAgc3RydWN0IHZtX2V4aXQgKnJldF92bWV4aXQpOwogICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgXgpsaWJ2bW1hcGlfd3JhcC5jOjI2Njc6MjQ6IGVycm9yOiB2 YXJpYWJsZSBoYXMgaW5jb21wbGV0ZSB0eXBlCiAgICAgICdlbnVtIHZtX2V2ZW50X3R5cGUnCiAg ICBlbnVtIHZtX2V2ZW50X3R5cGUgYXJnMyA7CiAgICAgICAgICAgICAgICAgICAgICAgXgpsaWJ2 bW1hcGlfd3JhcC5jOjI2Njc6MTA6IG5vdGU6IGZvcndhcmQgZGVjbGFyYXRpb24gb2YgJ2VudW0K ICAgICAgdm1fZXZlbnRfdHlwZScKICAgIGVudW0gdm1fZXZlbnRfdHlwZSBhcmczIDsKICAgICAg ICAgXgpsaWJ2bW1hcGlfd3JhcC5jOjI2OTg6MTI6IGVycm9yOiBjYXN0IHRvIGluY29tcGxldGUg dHlwZQogICAgICAnZW51bSB2bV9ldmVudF90eXBlJwogICAgYXJnMyA9IChlbnVtIHZtX2V2ZW50 X3R5cGUpKHZhbDMpOwogICAgICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoyNjY3OjEwOiBub3Rl OiBmb3J3YXJkIGRlY2xhcmF0aW9uIG9mICdlbnVtCiAgICAgIHZtX2V2ZW50X3R5cGUnCiAgICBl bnVtIHZtX2V2ZW50X3R5cGUgYXJnMyA7CiAgICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoyNzI1 OjI0OiBlcnJvcjogdmFyaWFibGUgaGFzIGluY29tcGxldGUgdHlwZQogICAgICAnZW51bSB2bV9l dmVudF90eXBlJwogICAgZW51bSB2bV9ldmVudF90eXBlIGFyZzMgOwogICAgICAgICAgICAgICAg ICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoyNzI1OjEwOiBub3RlOiBmb3J3YXJkIGRlY2xhcmF0 aW9uIG9mICdlbnVtCiAgICAgIHZtX2V2ZW50X3R5cGUnCiAgICBlbnVtIHZtX2V2ZW50X3R5cGUg YXJnMyA7CiAgICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoyNzU5OjEyOiBlcnJvcjogY2FzdCB0 byBpbmNvbXBsZXRlIHR5cGUKICAgICAgJ2VudW0gdm1fZXZlbnRfdHlwZScKICAgIGFyZzMgPSAo ZW51bSB2bV9ldmVudF90eXBlKSh2YWwzKTsKICAgICAgICAgICBeCmxpYnZtbWFwaV93cmFwLmM6 MjcyNToxMDogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBvZiAnZW51bQogICAgICB2bV9ldmVu dF90eXBlJwogICAgZW51bSB2bV9ldmVudF90eXBlIGFyZzMgOwogICAgICAgICBeCmxpYnZtbWFw aV93cmFwLmM6MjkzNjoyMjogZXJyb3I6IHZhcmlhYmxlIGhhcyBpbmNvbXBsZXRlIHR5cGUKICAg ICAgJ2VudW0gdm1fY2FwX3R5cGUnCiAgICBlbnVtIHZtX2NhcF90eXBlIGFyZzMgOwogICAgICAg ICAgICAgICAgICAgICBeCmxpYnZtbWFwaV93cmFwLmM6MjkzNjoxMDogbm90ZTogZm9yd2FyZCBk ZWNsYXJhdGlvbiBvZgogICAgICAnZW51bSB2bV9jYXBfdHlwZScKICAgIGVudW0gdm1fY2FwX3R5 cGUgYXJnMyA7CiAgICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoyOTY3OjEyOiBlcnJvcjogY2Fz dCB0byBpbmNvbXBsZXRlIHR5cGUKICAgICAgJ2VudW0gdm1fY2FwX3R5cGUnCiAgICBhcmczID0g KGVudW0gdm1fY2FwX3R5cGUpKHZhbDMpOwogICAgICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoy OTM2OjEwOiBub3RlOiBmb3J3YXJkIGRlY2xhcmF0aW9uIG9mCiAgICAgICdlbnVtIHZtX2NhcF90 eXBlJwogICAgZW51bSB2bV9jYXBfdHlwZSBhcmczIDsKICAgICAgICAgXgpsaWJ2bW1hcGlfd3Jh cC5jOjI5OTQ6MjI6IGVycm9yOiB2YXJpYWJsZSBoYXMgaW5jb21wbGV0ZSB0eXBlCiAgICAgICdl bnVtIHZtX2NhcF90eXBlJwogICAgZW51bSB2bV9jYXBfdHlwZSBhcmczIDsKICAgICAgICAgICAg ICAgICAgICAgXgpsaWJ2bW1hcGlfd3JhcC5jOjI5OTQ6MTA6IG5vdGU6IGZvcndhcmQgZGVjbGFy YXRpb24gb2YKICAgICAgJ2VudW0gdm1fY2FwX3R5cGUnCiAgICBlbnVtIHZtX2NhcF90eXBlIGFy ZzMgOwogICAgICAgICBeCmxpYnZtbWFwaV93cmFwLmM6MzAyNToxMjogZXJyb3I6IGNhc3QgdG8g aW5jb21wbGV0ZSB0eXBlCiAgICAgICdlbnVtIHZtX2NhcF90eXBlJwogICAgYXJnMyA9IChlbnVt IHZtX2NhcF90eXBlKSh2YWwzKTsKICAgICAgICAgICBeCmxpYnZtbWFwaV93cmFwLmM6Mjk5NDox MDogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBvZgogICAgICAnZW51bSB2bV9jYXBfdHlwZScK ICAgIGVudW0gdm1fY2FwX3R5cGUgYXJnMyA7CiAgICAgICAgIF4KbGlidm1tYXBpX3dyYXAuYzoz NjI2OjIzOiBlcnJvcjogdmFyaWFibGUgaGFzIGluY29tcGxldGUgdHlwZQogICAgICAnZW51bSB4 MmFwaWNfc3RhdGUnCiAgICBlbnVtIHgyYXBpY19zdGF0ZSBhcmczIDsKICAgICAgICAgICAgICAg ICAgICAgIF4KLi92bW1hcGkuaDozMzo2OiBub3RlOiBmb3J3YXJkIGRlY2xhcmF0aW9uIG9mCiAg ICAgICdlbnVtIHgyYXBpY19zdGF0ZScKZW51bSB4MmFwaWNfc3RhdGU7CiAgICAgXgpsaWJ2bW1h cGlfd3JhcC5jOjM2NTQ6MTI6IGVycm9yOiBjYXN0IHRvIGluY29tcGxldGUgdHlwZQogICAgICAn ZW51bSB4MmFwaWNfc3RhdGUnCiAgICBhcmczID0gKGVudW0geDJhcGljX3N0YXRlKSh2YWwzKTsK ICAgICAgICAgICBeCi4vdm1tYXBpLmg6MzM6Njogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBv ZgogICAgICAnZW51bSB4MmFwaWNfc3RhdGUnCmVudW0geDJhcGljX3N0YXRlOwogICAgIF4KNiB3 YXJuaW5ncyBhbmQgMTAgZXJyb3JzIGdlbmVyYXRlZC4K ------XXvdJgHcp9govgfmSN0iCXkpSrpWZSjW-0MOcnNVHcOfCzm1n:1414520737 Content-Type: application/octet-stream; name="=?UTF-8?B?Mg==?=" Content-Disposition: attachment Content-Transfer-Encoding: base64 Y2xhbmcgLWZQSUMgLWMgbGlidm1tYXBpX3dyYXAuYyAtSS91c3IvbG9jYWwvbGliL3Blcmw1LzUu MTYvbWFjaC9DT1JFIC1EYm9vbD1jaGFyCkluIGZpbGUgaW5jbHVkZWQgZnJvbSBsaWJ2bW1hcGlf d3JhcC5jOjE1NDM6Ci4vdm1tYXBpLmg6NjM6MTY6IHdhcm5pbmc6IGRlY2xhcmF0aW9uIG9mICdz dHJ1Y3Qgdm1fZXhpdCcKICAgICAgd2lsbCBub3QgYmUgdmlzaWJsZSBvdXRzaWRlIG9mIHRoaXMg ZnVuY3Rpb24KICAgICAgWy1XdmlzaWJpbGl0eV0KICAgICAgICAgICAgICAgc3RydWN0IHZtX2V4 aXQgKnJldF92bWV4aXQpOwogICAgICAgICAgICAgICAgICAgICAgXgouL3ZtbWFwaS5oOjY1OjU1 OiB3YXJuaW5nOiBkZWNsYXJhdGlvbiBvZgogICAgICAnZW51bSB2bV9ldmVudF90eXBlJyB3aWxs IG5vdCBiZSB2aXNpYmxlIG91dHNpZGUgb2YKICAgICAgdGhpcyBmdW5jdGlvbiBbLVd2aXNpYmls aXR5XQogIC4uLnZtY3R4ICpjdHgsIGludCB2Y3B1LCBlbnVtIHZtX2V2ZW50X3R5cGUgdHlwZSwK ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBeCi4vdm1tYXBpLmg6Njc6NTY6IHdhcm5p bmc6IGRlY2xhcmF0aW9uIG9mCiAgICAgICdlbnVtIHZtX2V2ZW50X3R5cGUnIHdpbGwgbm90IGJl IHZpc2libGUgb3V0c2lkZSBvZgogICAgICB0aGlzIGZ1bmN0aW9uIFstV3Zpc2liaWxpdHldCiAg Li4udm1jdHggKmN0eCwgaW50IHZjcHUsIGVudW0gdm1fZXZlbnRfdHlwZSB0eXBlLAogICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgIF4KLi92bW1hcGkuaDo3Mzo1Nzogd2FybmluZzogZGVj bGFyYXRpb24gb2YgJ2VudW0gdm1fY2FwX3R5cGUnCiAgICAgIHdpbGwgbm90IGJlIHZpc2libGUg b3V0c2lkZSBvZiB0aGlzIGZ1bmN0aW9uCiAgICAgIFstV3Zpc2liaWxpdHldCiAgLi4udm1jdHgg KmN0eCwgaW50IHZjcHUsIGVudW0gdm1fY2FwX3R5cGUgY2FwLAogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIF4KLi92bW1hcGkuaDo3NTo1Nzogd2FybmluZzogZGVjbGFyYXRpb24gb2Yg J2VudW0gdm1fY2FwX3R5cGUnCiAgICAgIHdpbGwgbm90IGJlIHZpc2libGUgb3V0c2lkZSBvZiB0 aGlzIGZ1bmN0aW9uCiAgICAgIFstV3Zpc2liaWxpdHldCiAgLi4udm1jdHggKmN0eCwgaW50IHZj cHUsIGVudW0gdm1fY2FwX3R5cGUgY2FwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IF4KbGlidm1tYXBpX3dyYXAuYzoyNjk1OjQxOiB3YXJuaW5nOiBpbmNvbXBhdGlibGUgcG9pbnRl ciB0eXBlcwogICAgICBwYXNzaW5nICdzdHJ1Y3Qgdm1fZXhpdCAqJyB0byBwYXJhbWV0ZXIgb2Yg dHlwZQogICAgICAnc3RydWN0IHZtX2V4aXQgKicgWy1XaW5jb21wYXRpYmxlLXBvaW50ZXItdHlw ZXNdCiAgICByZXN1bHQgPSAoaW50KXZtX3J1bihhcmcxLGFyZzIsYXJnMyxhcmc0KTsKICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIF5+fn4KLi92bW1hcGkuaDo2MzoyNTog bm90ZTogcGFzc2luZyBhcmd1bWVudCB0byBwYXJhbWV0ZXIKICAgICAgJ3JldF92bWV4aXQnIGhl cmUKICAgICAgICAgICAgICAgc3RydWN0IHZtX2V4aXQgKnJldF92bWV4aXQpOwogICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgXgpsaWJ2bW1hcGlfd3JhcC5jOjI3ODk6NDU6IGVycm9yOiBh cmd1bWVudCB0eXBlICdlbnVtCiAgICAgIHZtX2V2ZW50X3R5cGUnIGlzIGluY29tcGxldGUKICAg IHJlc3VsdCA9IChpbnQpdm1faW5qZWN0X2V2ZW50KGFyZzEsYXJnMixhcmczLGFyZzQpOwogICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIF5+fn4KLi92bW1hcGkuaDo2 NTo1NTogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBvZiAnZW51bQogICAgICB2bV9ldmVudF90 eXBlJwogIC4uLnZtY3R4ICpjdHgsIGludCB2Y3B1LCBlbnVtIHZtX2V2ZW50X3R5cGUgdHlwZSwK ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBeCmxpYnZtbWFwaV93cmFwLmM6Mjg1NTo0 NjogZXJyb3I6IGFyZ3VtZW50IHR5cGUgJ2VudW0KICAgICAgdm1fZXZlbnRfdHlwZScgaXMgaW5j b21wbGV0ZQogICAgcmVzdWx0ID0gKGludCl2bV9pbmplY3RfZXZlbnQyKGFyZzEsYXJnMixhcmcz LGFyZzQsYXJnNSk7CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IF5+fn4KLi92bW1hcGkuaDo2Nzo1Njogbm90ZTogZm9yd2FyZCBkZWNsYXJhdGlvbiBvZiAnZW51 bQogICAgICB2bV9ldmVudF90eXBlJwogIC4uLnZtY3R4ICpjdHgsIGludCB2Y3B1LCBlbnVtIHZt X2V2ZW50X3R5cGUgdHlwZSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBeCmxpYnZt bWFwaV93cmFwLmM6MzA1ODo0NzogZXJyb3I6IGFyZ3VtZW50IHR5cGUKICAgICAgJ2VudW0gdm1f Y2FwX3R5cGUnIGlzIGluY29tcGxldGUKICAgIHJlc3VsdCA9IChpbnQpdm1fZ2V0X2NhcGFiaWxp dHkoYXJnMSxhcmcyLGFyZzMsYXJnNCk7CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBefn5+Ci4vdm1tYXBpLmg6NzM6NTc6IG5vdGU6IGZvcndhcmQgZGVjbGFy YXRpb24gb2YKICAgICAgJ2VudW0gdm1fY2FwX3R5cGUnCiAgLi4udm1jdHggKmN0eCwgaW50IHZj cHUsIGVudW0gdm1fY2FwX3R5cGUgY2FwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IF4KbGlidm1tYXBpX3dyYXAuYzozMTE2OjQ3OiBlcnJvcjogYXJndW1lbnQgdHlwZQogICAgICAn ZW51bSB2bV9jYXBfdHlwZScgaXMgaW5jb21wbGV0ZQogICAgcmVzdWx0ID0gKGludCl2bV9zZXRf Y2FwYWJpbGl0eShhcmcxLGFyZzIsYXJnMyxhcmc0KTsKICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIF5+fn4KLi92bW1hcGkuaDo3NTo1Nzogbm90ZTogZm9yd2Fy ZCBkZWNsYXJhdGlvbiBvZgogICAgICAnZW51bSB2bV9jYXBfdHlwZScKICAuLi52bWN0eCAqY3R4 LCBpbnQgdmNwdSwgZW51bSB2bV9jYXBfdHlwZSBjYXAsCiAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgXgo2IHdhcm5pbmdzIGFuZCA0IGVycm9ycyBnZW5lcmF0ZWQuCg== ------XXvdJgHcp9govgfmSN0iCXkpSrpWZSjW-0MOcnNVHcOfCzm1n:1414520737-- From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 28 18:30:47 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 53CDE50D for ; Tue, 28 Oct 2014 18:30:47 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 25FE627F for ; Tue, 28 Oct 2014 18:30:46 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 5AABB66A13 for ; Tue, 28 Oct 2014 18:30:40 +0000 (UTC) Message-ID: <544FE0D2.4090704@freebsd.org> Date: Tue, 28 Oct 2014 14:30:42 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: core dump after centos-6.5 install References: <544FDD34.7070506@nomadlogic.org> In-Reply-To: <544FDD34.7070506@nomadlogic.org> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VGWCknfCSsw6oLLHoipacmF4xfan0Ll03" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2014 18:30:47 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --VGWCknfCSsw6oLLHoipacmF4xfan0Ll03 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2014-10-28 14:15, Pete Wright wrote: > just had bhyve coredump on me and was wondering if anyone else had seen= > this behavior: >=20 >> uname -ar > FreeBSD pop.rubicorp.com 10.1-RC3 FreeBSD 10.1-RC3 #0 r273437: Tue Oct > 21 23:55:15 UTC 2014 > root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >> pkg info|grep grub2 > grub2-bhyve-0.24 Grub-emu loader for bhyve >=20 > I was following the instructions on this page to use grub-bhyve to > install CentOS-6.5_amd64 on my 10.1-RC3 hypervisor: > https://www.monkeybrains.net/support/bhyve >=20 > The installation went through as expected. I ran grub-bhyve w/o issues= , > then executed the bhyve command and installation proceeded without > issue. When bhyve exited I re-ran my bhyve command to start my VM > resulting in this: >=20 >=20 >> sudo /tmp/cmd.sh > Assertion failed: (error =3D=3D 0), function fbsdrun_addcpu, file > /usr/src/usr.sbin/bhyve/bhyverun.c, line 266. > Abort trap (core dumped) >=20 >=20 > I have run gdb against the resulting core file, but since there are no > debug symbols in there I don't think it's useful. Please let me know i= f > this is a pebkac event, or if I should file a PR. >=20 > Thanks! > -pete >=20 After the first run, before the second, did you bhyvectl --destroy --vm=3D= blah and then do the grub-bhyve step again (off the disk instead of the install image this time) --=20 Allan Jude --VGWCknfCSsw6oLLHoipacmF4xfan0Ll03 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUT+DVAAoJEJrBFpNRJZKfkakQAKunSGEFyZu8QKr1L71yBrXh 0Kgz1+6W2X9wAsNNccFL3vCKcqVO927ie6WvTm74hFsU2mXiuELyAWO0c7aJaFyn c+rIkT9VfxTrTXH2lGNxOg/uigbxeU8Z0fRnSsoeSjr6BOMO61jkgDfAUZ5hrSAI dKUZBvcsIXgY8D9sWHMeTEOEjT/7EaA7z3rfq8A6sdLLQUz8WrQ5ftEV1uElRgeL uDyAK1pSrAYVLIao6f59oywelAeRjKfMN8Kow4nxeeAdyKh4MMm+0qz4mS7keh5x lOTkT826C0BoDBG17rdjFdajY6n4sweBz2WhEbEE3nEQxkaKBvEQIYwTMZRdbszu 062akmptx3lV7mEb87Khrpbh7VMSJP/KgwW09IxWCod/Vbmx5XBKapIQZL8UGHoG RSaJMmbg1i3C/0quCSSGKuXRqpkYOv/N5/mHjFGl8zwMv02oK+ZibkEBtAnuVqq0 /UrrGR/qHEmtUPTPIKNPNGOkinQgmXIJE+wCZKKgO6pqjLceV4Cta5sQJljW0KfP UQSoH07D34oOuEVJK3IzEgF7AFsbrcuhvPNBpRER8ndXJbgjR6Cun1irs7VY21TG on4M1M/V1xV0SWEcKU1O08uEY/X70TUndXPDBS8yqtacAjteGqhjTTjoGwN5ZjpD IuNU/qcWjCRbsTI/EKkf =Juwl -----END PGP SIGNATURE----- --VGWCknfCSsw6oLLHoipacmF4xfan0Ll03-- From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 28 18:40:08 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A763A907 for ; Tue, 28 Oct 2014 18:40:08 +0000 (UTC) Received: from mail.nomadlogic.org (mail.nomadlogic.org [IPv6:2607:f2f8:a098::4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6309260C for ; Tue, 28 Oct 2014 18:40:08 +0000 (UTC) Received: from mail.nomadlogic.org (localhost [127.0.0.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPS id AF667125EE1 for ; Tue, 28 Oct 2014 11:40:07 -0700 (PDT) Received: from pop.rubicorp.com (unknown [72.34.113.100]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPSA id 9B9BD125EBA for ; Tue, 28 Oct 2014 11:40:07 -0700 (PDT) Message-ID: <544FE307.70200@nomadlogic.org> Date: Tue, 28 Oct 2014 11:40:07 -0700 From: Pete Wright User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: core dump after centos-6.5 install References: <544FDD34.7070506@nomadlogic.org> <544FE0D2.4090704@freebsd.org> In-Reply-To: <544FE0D2.4090704@freebsd.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2014 18:40:08 -0000 On 10/28/14 11:30, Allan Jude wrote: > On 2014-10-28 14:15, Pete Wright wrote: >> just had bhyve coredump on me and was wondering if anyone else had seen >> this behavior: >> >>> uname -ar >> FreeBSD pop.rubicorp.com 10.1-RC3 FreeBSD 10.1-RC3 #0 r273437: Tue Oct >> 21 23:55:15 UTC 2014 >> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >>> pkg info|grep grub2 >> grub2-bhyve-0.24 Grub-emu loader for bhyve >> >> I was following the instructions on this page to use grub-bhyve to >> install CentOS-6.5_amd64 on my 10.1-RC3 hypervisor: >> https://www.monkeybrains.net/support/bhyve >> >> The installation went through as expected. I ran grub-bhyve w/o issues, >> then executed the bhyve command and installation proceeded without >> issue. When bhyve exited I re-ran my bhyve command to start my VM >> resulting in this: >> >> >>> sudo /tmp/cmd.sh >> Assertion failed: (error == 0), function fbsdrun_addcpu, file >> /usr/src/usr.sbin/bhyve/bhyverun.c, line 266. >> Abort trap (core dumped) >> >> >> I have run gdb against the resulting core file, but since there are no >> debug symbols in there I don't think it's useful. Please let me know if >> this is a pebkac event, or if I should file a PR. >> >> Thanks! >> -pete >> > > After the first run, before the second, did you bhyvectl --destroy --vm=blah > > and then do the grub-bhyve step again (off the disk instead of the > install image this time) > > Thanks Allan - I misread the instructions on the site - makes sense. I am working through getting centos to boot now. unfortunately the kernel is not named vmlinuz by default IIRC. -pete -- Pete Wright pete@nomadlogic.org twitter => @nomadlogicLA From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 28 18:41:31 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 89BA4AFC for ; Tue, 28 Oct 2014 18:41:31 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 445DD639 for ; Tue, 28 Oct 2014 18:41:30 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 2FF9E66A9B for ; Tue, 28 Oct 2014 18:41:30 +0000 (UTC) Message-ID: <544FE35C.4020509@freebsd.org> Date: Tue, 28 Oct 2014 14:41:32 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: core dump after centos-6.5 install References: <544FDD34.7070506@nomadlogic.org> <544FE0D2.4090704@freebsd.org> <544FE307.70200@nomadlogic.org> In-Reply-To: <544FE307.70200@nomadlogic.org> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="MEeJiQ5MlNPjJNccKfmJWj26welHvTNbt" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2014 18:41:31 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --MEeJiQ5MlNPjJNccKfmJWj26welHvTNbt Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2014-10-28 14:40, Pete Wright wrote: >=20 >=20 > On 10/28/14 11:30, Allan Jude wrote: >> On 2014-10-28 14:15, Pete Wright wrote: >>> just had bhyve coredump on me and was wondering if anyone else had se= en >>> this behavior: >>> >>>> uname -ar >>> FreeBSD pop.rubicorp.com 10.1-RC3 FreeBSD 10.1-RC3 #0 r273437: Tue Oc= t >>> 21 23:55:15 UTC 2014 >>> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >>>> pkg info|grep grub2 >>> grub2-bhyve-0.24 Grub-emu loader for bhyve >>> >>> I was following the instructions on this page to use grub-bhyve to >>> install CentOS-6.5_amd64 on my 10.1-RC3 hypervisor: >>> https://www.monkeybrains.net/support/bhyve >>> >>> The installation went through as expected. I ran grub-bhyve w/o issu= es, >>> then executed the bhyve command and installation proceeded without >>> issue. When bhyve exited I re-ran my bhyve command to start my VM >>> resulting in this: >>> >>> >>>> sudo /tmp/cmd.sh >>> Assertion failed: (error =3D=3D 0), function fbsdrun_addcpu, file >>> /usr/src/usr.sbin/bhyve/bhyverun.c, line 266. >>> Abort trap (core dumped) >>> >>> >>> I have run gdb against the resulting core file, but since there are n= o >>> debug symbols in there I don't think it's useful. Please let me know= if >>> this is a pebkac event, or if I should file a PR. >>> >>> Thanks! >>> -pete >>> >> >> After the first run, before the second, did you bhyvectl --destroy --v= m=3Dblah >> >> and then do the grub-bhyve step again (off the disk instead of the >> install image this time) >> >> >=20 > Thanks Allan - I misread the instructions on the site - makes sense. I= > am working through getting centos to boot now. unfortunately the kerne= l > is not named vmlinuz by default IIRC. >=20 > -pete >=20 >=20 If you follow my instructions here: http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/virtualization-= host-bhyve.html#virtualization-bhyve-linux it walks you through using 'ls' in grub to find the correct name of the kernel files. --=20 Allan Jude --MEeJiQ5MlNPjJNccKfmJWj26welHvTNbt Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUT+NeAAoJEJrBFpNRJZKfdLcQAINHNh/u2U2owhwFIxqaS09H QcY42lXzLdzte/49uot3CL4A3+CYMxW8ETBL7TFuRF7K1sMDYSPQx/95lcSfhzm4 6qTGK2xRnOehJNOd8pQmoKrwmI7t31G0I822LMfrIaGWjO/heUE+hNCFDO3WyHlJ J8GHUYaspTxtOoC/ZA8E+TYok1ypx71H59AzcQjalWBTXYJMyCt6O3FRluHfxOZ/ SUK6Db6AY0Wj/GpHqWmM7lPFZOr7HVFjcEWvcjRWYlSAhw4IGm3Ch1hllMGLVas+ I3uVk6ui6OInDO0pmt9Pj4ntKoUQU+M/tCtaOX/ikT2M1bOT2KEqPLd+Oz/BVURy JjA4eMsWnytQO2nf8XW69PtRu+zDusl/GEOT0YUhwZWkeST9yT+MEHIbBJGSv89C lv3UMd+BTzxfe2NdcNO7fT8KUCGbVHcnOFtzLiNI0ngJpKPlS5DtOC/WEVYjYgEm izPdpTXVVyw8OuwVqUo/InHQAcxH1ueZD2vBAA6SwzaqrZB2qaq5zXDNPIIhYLrr WnSryts4hDipOJjc7vZp/nqD/0i5nyoRxLN8X5GEguTcSbiFmoQB+uJbTT6N4Rrd 8zlCes0KwlEPpEBL1Y8rDNJMGK9qu1I2yT1oHf/RNEcCwlqZF0SsdPcuk4cG7hkL ItzAHKZifR9hdn/TDIKn =6bVO -----END PGP SIGNATURE----- --MEeJiQ5MlNPjJNccKfmJWj26welHvTNbt-- From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 28 18:47:12 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C99A5BA5 for ; Tue, 28 Oct 2014 18:47:12 +0000 (UTC) Received: from mail.nomadlogic.org (mail.nomadlogic.org [IPv6:2607:f2f8:a098::4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9BF39679 for ; Tue, 28 Oct 2014 18:47:12 +0000 (UTC) Received: from mail.nomadlogic.org (localhost [127.0.0.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPS id 6232E125EE1 for ; Tue, 28 Oct 2014 11:47:12 -0700 (PDT) Received: from pop.rubicorp.com (unknown [72.34.113.100]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPSA id 55AC9125EBA for ; Tue, 28 Oct 2014 11:47:12 -0700 (PDT) Message-ID: <544FE4B0.4030302@nomadlogic.org> Date: Tue, 28 Oct 2014 11:47:12 -0700 From: Pete Wright User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: core dump after centos-6.5 install References: <544FDD34.7070506@nomadlogic.org> <544FE0D2.4090704@freebsd.org> <544FE307.70200@nomadlogic.org> <544FE35C.4020509@freebsd.org> In-Reply-To: <544FE35C.4020509@freebsd.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2014 18:47:12 -0000 On 10/28/14 11:41, Allan Jude wrote: > On 2014-10-28 14:40, Pete Wright wrote: >> >> >> On 10/28/14 11:30, Allan Jude wrote: >>> On 2014-10-28 14:15, Pete Wright wrote: >>>> just had bhyve coredump on me and was wondering if anyone else had seen >>>> this behavior: >>>> >>>>> uname -ar >>>> FreeBSD pop.rubicorp.com 10.1-RC3 FreeBSD 10.1-RC3 #0 r273437: Tue Oct >>>> 21 23:55:15 UTC 2014 >>>> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >>>>> pkg info|grep grub2 >>>> grub2-bhyve-0.24 Grub-emu loader for bhyve >>>> >>>> I was following the instructions on this page to use grub-bhyve to >>>> install CentOS-6.5_amd64 on my 10.1-RC3 hypervisor: >>>> https://www.monkeybrains.net/support/bhyve >>>> >>>> The installation went through as expected. I ran grub-bhyve w/o issues, >>>> then executed the bhyve command and installation proceeded without >>>> issue. When bhyve exited I re-ran my bhyve command to start my VM >>>> resulting in this: >>>> >>>> >>>>> sudo /tmp/cmd.sh >>>> Assertion failed: (error == 0), function fbsdrun_addcpu, file >>>> /usr/src/usr.sbin/bhyve/bhyverun.c, line 266. >>>> Abort trap (core dumped) >>>> >>>> >>>> I have run gdb against the resulting core file, but since there are no >>>> debug symbols in there I don't think it's useful. Please let me know if >>>> this is a pebkac event, or if I should file a PR. >>>> >>>> Thanks! >>>> -pete >>>> >>> >>> After the first run, before the second, did you bhyvectl --destroy --vm=blah >>> >>> and then do the grub-bhyve step again (off the disk instead of the >>> install image this time) >>> >>> >> >> Thanks Allan - I misread the instructions on the site - makes sense. I >> am working through getting centos to boot now. unfortunately the kernel >> is not named vmlinuz by default IIRC. >> >> -pete >> >> > > If you follow my instructions here: > > http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/virtualization-host-bhyve.html#virtualization-bhyve-linux > > it walks you through using 'ls' in grub to find the correct name of the > kernel files. > > ah so much fail - not sure why i didn't read the handbook first :( ok i think i've got this sorted out on my end - thanks for the help/time! -p -- Pete Wright pete@nomadlogic.org twitter => @nomadlogicLA From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 29 00:19:36 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1E7FABD0 for ; Wed, 29 Oct 2014 00:19:36 +0000 (UTC) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.redhat.com", Issuer "DigiCert SHA2 Extended Validation Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D0785D96 for ; Wed, 29 Oct 2014 00:19:35 +0000 (UTC) Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id s9T0JTCn015655 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 28 Oct 2014 20:19:29 -0400 Received: from [10.14.16.179] (dhcp-16-179.sjc.redhat.com [10.14.16.179]) by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id s9T0JSVZ018936; Tue, 28 Oct 2014 20:19:29 -0400 Message-ID: <54503290.1020005@redhat.com> Date: Wed, 29 Oct 2014 01:19:28 +0100 From: Michal Privoznik User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Conrad Meyer , libvir-list@redhat.com Subject: Re: [libvirt] [PATCH 2/2] Generated PO files for 'bhyve: Support /domain/bootloader' References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com> <1414094284-29055-3-git-send-email-cse.cem@gmail.com> In-Reply-To: <1414094284-29055-3-git-send-email-cse.cem@gmail.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24 Cc: Conrad Meyer , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2014 00:19:36 -0000 On 23.10.2014 21:58, Conrad Meyer wrote: > Sponsored by: EMC / Isilon storage division > > Signed-off-by: Conrad Meyer > --- > po/af.po | 4 ++++ > po/am.po | 4 ++++ > po/ar.po | 4 ++++ > po/as.po | 4 ++++ > po/be.po | 4 ++++ > po/bg.po | 4 ++++ > po/bn.po | 4 ++++ > po/bn_IN.po | 4 ++++ > po/bo.po | 4 ++++ > po/bs.po | 4 ++++ > po/ca.po | 4 ++++ > po/cs.po | 4 ++++ > po/cy.po | 4 ++++ > po/da.po | 4 ++++ > po/de.po | 4 ++++ > po/el.po | 4 ++++ > po/en_GB.po | 4 ++++ > po/es.po | 4 ++++ > po/et.po | 4 ++++ > po/eu_ES.po | 4 ++++ > po/fa.po | 4 ++++ > po/fi.po | 4 ++++ > po/fr.po | 4 ++++ > po/gl.po | 4 ++++ > po/gu.po | 4 ++++ > po/he.po | 4 ++++ > po/hi.po | 4 ++++ > po/hr.po | 4 ++++ > po/hu.po | 4 ++++ > po/hy.po | 4 ++++ > po/id.po | 4 ++++ > po/is.po | 4 ++++ > po/it.po | 4 ++++ > po/ja.po | 4 ++++ > po/ka.po | 4 ++++ > po/kn.po | 4 ++++ > po/ko.po | 4 ++++ > po/ku.po | 4 ++++ > po/lo.po | 4 ++++ > po/lt.po | 4 ++++ > po/lv.po | 4 ++++ > po/mk.po | 4 ++++ > po/ml.po | 4 ++++ > po/mr.po | 4 ++++ > po/ms.po | 4 ++++ > po/my.po | 4 ++++ > po/nb.po | 4 ++++ > po/nl.po | 4 ++++ > po/nn.po | 4 ++++ > po/nso.po | 4 ++++ > po/or.po | 4 ++++ > po/pa.po | 4 ++++ > po/pl.po | 4 ++++ > po/pt.po | 4 ++++ > po/pt_BR.po | 4 ++++ > po/ro.po | 4 ++++ > po/ru.po | 4 ++++ > po/si.po | 4 ++++ > po/sk.po | 4 ++++ > po/sl.po | 4 ++++ > po/sq.po | 4 ++++ > po/sr.po | 4 ++++ > po/sr@latin.po | 4 ++++ > po/sv.po | 4 ++++ > po/ta.po | 4 ++++ > po/te.po | 4 ++++ > po/th.po | 4 ++++ > po/tr.po | 4 ++++ > po/uk.po | 4 ++++ > po/ur.po | 4 ++++ > po/vi.po | 4 ++++ > po/vi_VN.po | 4 ++++ > po/zh_CN.po | 4 ++++ > po/zh_TW.po | 4 ++++ > po/zu.po | 4 ++++ > 75 files changed, 300 insertions(+) Again, this is not needed. Michal From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 29 00:19:37 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A85E1BD2 for ; Wed, 29 Oct 2014 00:19:37 +0000 (UTC) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.redhat.com", Issuer "DigiCert SHA2 Extended Validation Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 80B42D98 for ; Wed, 29 Oct 2014 00:19:37 +0000 (UTC) Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id s9T0JVaa015661 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 28 Oct 2014 20:19:31 -0400 Received: from [10.14.16.179] (dhcp-16-179.sjc.redhat.com [10.14.16.179]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id s9T0JUQw007067; Tue, 28 Oct 2014 20:19:30 -0400 Message-ID: <54503292.9040907@redhat.com> Date: Wed, 29 Oct 2014 01:19:30 +0100 From: Michal Privoznik User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Conrad Meyer , libvir-list@redhat.com Subject: Re: [libvirt] [PATCH 1/2] bhyve: Support /domain/bootloader configuration for non-FreeBSD guests. References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com> <1414094284-29055-2-git-send-email-cse.cem@gmail.com> In-Reply-To: <1414094284-29055-2-git-send-email-cse.cem@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.68 on 10.5.11.26 Cc: Conrad Meyer , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2014 00:19:37 -0000 On 23.10.2014 21:58, Conrad Meyer wrote: > Also, flip Bhyve /domain/os/type support from HVM to Xen. Bhyve only > supports paravirtualized guests, and 'xen' is closest to that. We still > default to bhyveloader(1) if no explicit bootloader configuration is > supplied in the domain. > > If the /domain/bootloader looks like grub-bhyve and the user doesn't > supply /domain/bootloader_args, we make an intelligent guess and try > chainloading the first partition on the disk. > > Caveats: > - We can't install from CD without explicit bootloader_args. > - We leave a device.map file lying around in /tmp. I don't see a good > way not to do so without reworking the API somewhat. > > Sponsored by: EMC / Isilon storage division > > Signed-off-by: Conrad Meyer > --- > docs/drvbhyve.html.in | 30 +++++- > docs/formatdomain.html.in | 4 +- > po/libvirt.pot | 4 + > src/bhyve/bhyve_capabilities.c | 2 +- > src/bhyve/bhyve_command.c | 107 +++++++++++++++++++-- > tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml | 2 +- > tests/bhyvexml2argvdata/bhyvexml2argv-base.xml | 2 +- > tests/bhyvexml2argvdata/bhyvexml2argv-console.xml | 2 +- > .../bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml | 2 +- > .../bhyvexml2argv-disk-virtio.xml | 2 +- > tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml | 2 +- > tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml | 2 +- > tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml | 2 +- > .../bhyvexml2xmlout-metadata.xml | 2 +- > 14 files changed, 139 insertions(+), 26 deletions(-) > > diff --git a/docs/drvbhyve.html.in b/docs/drvbhyve.html.in > index 39afdf5..c6c79d7 100644 > --- a/docs/drvbhyve.html.in > +++ b/docs/drvbhyve.html.in > @@ -37,8 +37,7 @@ bhyve+ssh://root@example.com/system (remote access, SSH tunnelled) >

Example config

>

> The bhyve driver in libvirt is in its early stage and under active development. So it supports > -only limited number of features bhyve provides. All the supported features could be found > -in this sample domain XML. > +only limited number of features bhyve provides. >

> >

> @@ -50,13 +49,13 @@ up to 31 PCI devices. > > 

>   <domain type='bhyve'>
> -  <name>bhyve</name>
> -  <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
> +    <name>bhyve</name>
> +    <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
>       <memory>219136</memory>
>       <currentMemory>219136</currentMemory>
>       <vcpu>1</vcpu>
>       <os>
> -       <type>hvm</type>
> +       <type>xen</type>
>       </os>
>       <features>
>         <apic/>
> @@ -157,5 +156,26 @@ An example of domain XML device entry for that will look like:

>   
Please refer to the Storage documentation for more details on storage
>   management.

>
> +
Using grub2-bhyve or Alternative Bootloaders

> +
> +
It's possible to boot non-FreeBSD guests by specifying an explicit
> +bootloader, e.g. grub-bhyve(1). Arguments to the bootloader may be
> +specified as well. If no arguments are given and bootloader is
> +grub-bhyve, libvirt will try and boot from the first partition of
> +the disk image.

> +
> +
> +  ...
> +    <bootloader>/usr/local/sbin/grub-bhyve</bootloader>
> +    <bootloader_args>...</bootloader_args>
> +  ...
> +

> +
> +
(Of course, to install from a CD a user will have to supply explicit
> +arguments to grub-bhyve.)

> +
> +
Caveat: bootloader_args does not support any quoting.
> +Filenames, etc, must not have spaces or they will be tokenized incorrectly.

> +
>     
>   
> diff --git a/docs/formatdomain.html.in b/docs/formatdomain.html.in
> index 0099ce7..b7b6c46 100644
> --- a/docs/formatdomain.html.in
> +++ b/docs/formatdomain.html.in
> @@ -217,7 +217,9 @@
>         a BIOS, and instead the host is responsible to kicking off the
>         operating system boot. This may use a pseudo-bootloader in the
>         host to provide an interface to choose a kernel for the guest.
> -      An example is pygrub with Xen.
> +      An example is pygrub with Xen. The Bhyve hypervisor
> +      also uses a host bootloader, either bhyveload or
> +      grub-bhyve.
>       

>
>   
> diff --git a/po/libvirt.pot b/po/libvirt.pot
> index 0b44ad7..d8c9a4d 100644
> --- a/po/libvirt.pot
> +++ b/po/libvirt.pot
> @@ -851,6 +851,10 @@ msgstr ""
>   msgid "domain should have at least one disk defined"
>   msgstr ""
>
> +#: src/bhyve/bhyve_command.c:407
> +msgid "Custom loader requires explicit %s configuration"
> +msgstr ""
> +
>   #: src/bhyve/bhyve_device.c:50
>   msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
>   msgstr ""

There's no need for this. The po/* files are regenerated on the release.

> diff --git a/src/bhyve/bhyve_capabilities.c b/src/bhyve/bhyve_capabilities.c
> index 132ce91..b37a24f 100644
> --- a/src/bhyve/bhyve_capabilities.c
> +++ b/src/bhyve/bhyve_capabilities.c
> @@ -85,7 +85,7 @@ virBhyveCapsBuild(void)
>                                      false, false)) == NULL)
>           return NULL;
>
> -    if ((guest = virCapabilitiesAddGuest(caps, "hvm",
> +    if ((guest = virCapabilitiesAddGuest(caps, "xen",
>                                            VIR_ARCH_X86_64,
>                                            "bhyve",
>                                            NULL, 0, NULL)) == NULL)
> diff --git a/src/bhyve/bhyve_command.c b/src/bhyve/bhyve_command.c
> index bea4a59..99956ae 100644
> --- a/src/bhyve/bhyve_command.c
> +++ b/src/bhyve/bhyve_command.c
> @@ -300,6 +300,7 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
>   {
>       virCommandPtr cmd;
>       virDomainDiskDefPtr disk;
> +    bool bhyveload, grub_bhyve;
>
>       if (def->ndisks < 1) {
>           virReportError(VIR_ERR_CONFIG_UNSUPPORTED, "%s",
> @@ -326,19 +327,105 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
>           return NULL;
>       }
>
> -    cmd = virCommandNew(BHYVELOAD);
> +    if (def->os.bootloader == NULL) {
> +        bhyveload = true;
> +        grub_bhyve = false;
> +        cmd = virCommandNew(BHYVELOAD);
> +    } else {
> +        bhyveload = false;
> +        if (strstr(def->os.bootloader, "grub-bhyve") == 0)
> +            grub_bhyve = true;
> +        cmd = virCommandNew(def->os.bootloader);
> +    }
>
> -    /* Memory */
> -    virCommandAddArg(cmd, "-m");
> -    virCommandAddArgFormat(cmd, "%llu",
> -                           VIR_DIV_UP(def->mem.max_balloon, 1024));
> +    if (bhyveload && def->os.bootloaderArgs == NULL) {
> +        VIR_DEBUG("%s: bhyveload with default arguments", __func__);

VIR_DEBUG() itself will report what function has it been called from.

> +
> +        /* Memory (MB) */
> +        virCommandAddArg(cmd, "-m");
> +        virCommandAddArgFormat(cmd, "%llu",
> +                               VIR_DIV_UP(def->mem.max_balloon, 1024));
> +
> +        /* Image path */
> +        virCommandAddArg(cmd, "-d");
> +        virCommandAddArg(cmd, virDomainDiskGetSource(disk));
> +
> +        /* VM name */
> +        virCommandAddArg(cmd, def->name);
> +    } else if (grub_bhyve && def->os.bootloaderArgs == NULL) {
> +        char tmpmapfile[128] = "/tmp/grub-bhyve-device.map_XXXXXX";

This doesn't look nice. I'd prefer char *tmpmapfile combined with 
virAsprintf() and VIR_FREE().

> +        FILE *f;
> +        int fd;
> +
> +        VIR_DEBUG("%s: grub-bhyve with default arguments", __func__);
> +
> +        /*
> +         * XXX Default grub-bhyve has some BIG caveats, but MAY work for some
> +         * typical configurations. In particular:
> +         *
> +         *   - Can't create a new VM this way (no CD, no boot from CD)
> +         *   - Assumes a GRUB install on hd0,msdos1
> +         */
>
> -    /* Image path */
> -    virCommandAddArg(cmd, "-d");
> -    virCommandAddArg(cmd, virDomainDiskGetSource(disk));
> +        /* XXX cleanup this file. */
> +        fd = mkstemp(tmpmapfile);

No, we use mkostemp( .. , O_CLOEXEC) instead.

> +        if (fd < 0) {
> +                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
> +                goto error;
> +        }
> +
> +        f = VIR_FDOPEN(fd, "wb+");
> +        if (f == NULL) {
> +                VIR_FORCE_CLOSE(fd);
> +                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
> +                goto error;
> +        }
> +
> +        /* Grub device.map */
> +        fprintf(f, "(hd0) %s\n", virDomainDiskGetSource(disk));
> +        /* XXX CDs would look like: "(cd0) /path/to/CD" */
> +
> +        if (VIR_FCLOSE(f) < 0) {
> +                virReportSystemError(errno, "%s", _("failed to close file"));
> +                goto error;
> +        }
>
> -    /* VM name */
> -    virCommandAddArg(cmd, def->name);
> +
> +        virCommandAddArg(cmd, "--device-map");
> +        virCommandAddArg(cmd, tmpmapfile);
> +
> +        /* Memory in MB */
> +        virCommandAddArg(cmd, "--memory");
> +        virCommandAddArgFormat(cmd, "%llu",
> +                               VIR_DIV_UP(def->mem.max_balloon, 1024));
> +
> +        /* To boot from CD, "cd0" here. */
> +        virCommandAddArg(cmd, "--root");
> +        virCommandAddArg(cmd, "hd0,msdos1");
> +
> +        /* VM name */
> +        virCommandAddArg(cmd, def->name);
> +    } else if (def->os.bootloaderArgs == NULL) {
> +        virReportError(VIR_ERR_CONFIG_UNSUPPORTED,
> +                       _("Custom loader requires explicit %s configuration"),
> +                       "bootloader_args");
> +        goto error;
> +    } else {
> +        char **blargs, **arg;
> +
> +        VIR_DEBUG("%s: custom loader '%s' with arguments", __func__,
> +                  def->os.bootloader);
> +
> +        /* XXX: Handle quoted? */
> +        blargs = virStringSplit(def->os.bootloaderArgs, " ", 0);
> +        for (arg = blargs; *arg; arg++)
> +                virCommandAddArg(cmd, *arg);
> +        virStringFreeList(blargs);

I don't think it's safe to pass arbitrary arguments from XML. I find 
this too critical to ACK the patch, buy maybe further discussion can 
change my mind.

> +    }
>
>       return cmd;
> +
> +error:
> +    virCommandFree(cmd);
> +    return NULL;

Michal

From owner-freebsd-virtualization@FreeBSD.ORG  Wed Oct 29 01:01:21 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id D1221278
 for ; Wed, 29 Oct 2014 01:01:21 +0000 (UTC)
Received: from mail-vc0-x229.google.com (mail-vc0-x229.google.com
 [IPv6:2607:f8b0:400c:c03::229])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 8F194216
 for ; Wed, 29 Oct 2014 01:01:21 +0000 (UTC)
Received: by mail-vc0-f169.google.com with SMTP id hy4so924073vcb.0
 for ; Tue, 28 Oct 2014 18:01:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=WAaVLxbiMPjHtSNXexvdb0of/rF+9Nz/5GH8oBN8Vp4=;
 b=ZQzt04RMEZQ8XwTNMrTaQZhAloydPVeH+Za8UsmmYqTvd/mMg7HWE1mwZopiJmBvvc
 98IEcJpBLBJs4eogxtdS+CUeuZvH6gCjK/PM7w+LO48+pNffj0RHKE053C8qJ5dTes8X
 eTxVO9em5mSWH5NlvUCm7U+x49ddYC5dWKxw4E9jtj8HlIgeXj476akfLVj2BW3od3wR
 HOZy1UVBWIdyWaOeNFqDPEFc0rjp3ApQgRueg60wxV03A0T+lawvuQpvhtUlh5fnMxVe
 3tV6oh9v8Dft0hKRPzewmY+EBpvpo8w2s5DKw2VZirrqnXw7mfJWpleZqayZwAPPmHd9
 WUbg==
MIME-Version: 1.0
X-Received: by 10.52.129.230 with SMTP id nz6mr620616vdb.67.1414544480442;
 Tue, 28 Oct 2014 18:01:20 -0700 (PDT)
Received: by 10.220.150.68 with HTTP; Tue, 28 Oct 2014 18:01:20 -0700 (PDT)
In-Reply-To: <54503292.9040907@redhat.com>
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
 <54503292.9040907@redhat.com>
Date: Tue, 28 Oct 2014 21:01:20 -0400
Message-ID: 
Subject: Re: [libvirt] [PATCH 1/2] bhyve: Support /domain/bootloader
 configuration for non-FreeBSD guests.
From: Conrad Meyer 
To: Michal Privoznik 
Content-Type: text/plain; charset=UTF-8
Cc: libvir-list@redhat.com,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Wed, 29 Oct 2014 01:01:21 -0000

> I don't think it's safe to pass arbitrary arguments from XML. I find this
> too critical to ACK the patch, buy maybe further discussion can change my
> mind.

Michal,

You're reviewing a 4-revision old version of this patch, see v5 for
the most recent set. However, this bit is still present in v5. What is
 in the XML is for, if not arbitrary arguments?


Thanks,
Conrad

From owner-freebsd-virtualization@FreeBSD.ORG  Wed Oct 29 02:58:33 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 71082684
 for ; Wed, 29 Oct 2014 02:58:33 +0000 (UTC)
Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "mx1.redhat.com",
 Issuer "DigiCert SHA2 Extended Validation Server CA" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 47742E96
 for ; Wed, 29 Oct 2014 02:58:33 +0000 (UTC)
Received: from int-mx11.intmail.prod.int.phx2.redhat.com
 (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24])
 by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id s9T2wVA6004649
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL);
 Tue, 28 Oct 2014 22:58:32 -0400
Received: from [10.3.234.242] (vpn-234-242.phx2.redhat.com [10.3.234.242])
 by int-mx11.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id
 s9T2wUZG013572; Tue, 28 Oct 2014 22:58:31 -0400
Message-ID: <545057D6.1010402@redhat.com>
Date: Wed, 29 Oct 2014 03:58:30 +0100
From: Michal Privoznik 
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: Conrad Meyer 
Subject: Re: [libvirt] [PATCH 1/2] bhyve: Support /domain/bootloader
 configuration for non-FreeBSD guests.
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>	<1414094284-29055-2-git-send-email-cse.cem@gmail.com>	<54503292.9040907@redhat.com>
 
In-Reply-To: 
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.24
Cc: libvir-list@redhat.com,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Wed, 29 Oct 2014 02:58:33 -0000

On 29.10.2014 02:01, Conrad Meyer wrote:
>> I don't think it's safe to pass arbitrary arguments from XML. I find this
>> too critical to ACK the patch, buy maybe further discussion can change my
>> mind.
>
> Michal,
>
> You're reviewing a 4-revision old version of this patch, see v5 for
> the most recent set. However, this bit is still present in v5. What is
>  in the XML is for, if not arbitrary arguments?
>

Oh right. I was getting through a lot of e-mails and I didn't notice 
you've posted v5. And yes, you're right -  is designed 
for that. Okay then. Let me see how v5 went.

Michal

From owner-freebsd-virtualization@FreeBSD.ORG  Wed Oct 29 05:44:08 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 3127B5C8;
 Wed, 29 Oct 2014 05:44:08 +0000 (UTC)
Received: from mail-wg0-x232.google.com (mail-wg0-x232.google.com
 [IPv6:2a00:1450:400c:c00::232])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 41AA9199;
 Wed, 29 Oct 2014 05:44:07 +0000 (UTC)
Received: by mail-wg0-f50.google.com with SMTP id z12so2504578wgg.9
 for ; Tue, 28 Oct 2014 22:44:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=date:from:to:cc:subject:message-id:references:mime-version
 :content-type:content-disposition:in-reply-to:user-agent;
 bh=wD9/ZBSYbsqHP+ml+7rtKw/NTuD/0yHRNj0snrwI1sU=;
 b=CdzH2wYy6BOns1gDm4ruWrqO6R/xnGVodAa+B1PtpkI43BXb1h3XPr7Uvmv+rQbWbl
 8s/02edfnka8NFjgmG3w4GPLoAr9wQVDvh2r1t0X4YRn+jAmlCA+1llSIbyz02vq50BA
 j/xwmHJhtVd/tXDjNF6CVKBhnXgwHIMJFi7eWNKPdadwzEHBGL6fVaPKy0yN/W3B9s4f
 KpKFpGOiW8tfTOKu/klCegsi1JhCmqotxFQN4zK/tkaBsJjfg2lzjGDQncBqk6ttsKfz
 hX1bv9lFNZG2yvgPy+FuJfC5ehysyz+ciG42KNjI/bA0nrj0O6B1HArAoQmSe7M5kOYi
 emmg==
X-Received: by 10.180.221.229 with SMTP id qh5mr21827079wic.25.1414561445403; 
 Tue, 28 Oct 2014 22:44:05 -0700 (PDT)
Received: from dft-labs.eu (n1x0n-1-pt.tunnel.tserv5.lon1.ipv6.he.net.
 [2001:470:1f08:1f7::2])
 by mx.google.com with ESMTPSA id n4sm7490100wiz.17.2014.10.28.22.44.03
 for 
 (version=TLSv1.2 cipher=RC4-SHA bits=128/128);
 Tue, 28 Oct 2014 22:44:04 -0700 (PDT)
Date: Wed, 29 Oct 2014 06:44:02 +0100
From: Mateusz Guzik 
To: Craig Rodrigues 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
Message-ID: <20141029054401.GC12014@dft-labs.eu>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: 
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Wed, 29 Oct 2014 05:44:08 -0000

On Fri, Oct 24, 2014 at 09:09:48PM -0700, Craig Rodrigues wrote:
> On Thu, Oct 23, 2014 at 10:36 PM, Mateusz Guzik  wrote:
> 
> > > (1)  does a buildworld/buildkernel on amd64 when someone checks new
> > >       code into the stable/10 branch
> >
> > Is not this excessive?
> 
> 
> It has not been a problem.  For example, when a build occurs on the HEAD in
> svn,
> if further commits come in on HEAD, we have Jenkins configured so that it
> will not trigger another build on HEAD until the build in progress is done.
> It has been working fine.
> 

Ok.

> If no commits
> 
> 
> > > (2)  Creates a bootable UFS image with makefs
> >
> > any chance zfs will be used as well?
> >
> 
> Sure, we can look at that as well, but as I said earlier,
> there need to be more bodies working on setting up builds and
> configurations for this
> to happen.
> 

I can't help with that, sorry.

> 
> >
> > would be nice to run some kind of stress testing. buildworld with a high
> > -j is an example of a general purpose test. This could be done with
> > different frequency than regular tests.
> >
> >
> Are you volunteering to write the scripts that incorporate any stress
> testing
> that you think should be done?  We would welcome any contributions.
> 
> 

Are you aware of e.g. stress2 by pho?

https://people.freebsd.org/~pho/stress/index.html

Plugging this in should not be hard for someone who knows jenkins.

That's not me though. :)

> > Do you have crashdumps configured in case stuff goes wrong?
> >
> >
> 
> No.
> 
> You can look at our scripts used to build and boot the various VM's:
> 
> https://wiki.freebsd.org/Jenkins#Repositories
> 
> It's all on github, so if you think you have new scripts to add, or fixes
> to existing scripts,
> you can feel free to do a github pull request to contribute.
> 
> --
> Craig

-- 
Mateusz Guzik 

From owner-freebsd-virtualization@FreeBSD.ORG  Wed Oct 29 05:49:43 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 4D76B770;
 Wed, 29 Oct 2014 05:49:43 +0000 (UTC)
Received: from mail-ig0-x235.google.com (mail-ig0-x235.google.com
 [IPv6:2607:f8b0:4001:c05::235])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 07EC01C6;
 Wed, 29 Oct 2014 05:49:43 +0000 (UTC)
Received: by mail-ig0-f181.google.com with SMTP id l13so2717845iga.2
 for ; Tue, 28 Oct 2014 22:49:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=Ir3Q46OOKAlwXJ2n3Bugq5nAv+kFjDdrDo2MxU/ex0g=;
 b=zxJb+cjJ59EmtqgoOahQfJgzcvBE8KxH5zuBYBY5t1fCSO6C34iH50LQlDlgG53GBZ
 keyWxCsr20zt2HRlVn4DNgfYttXNTV35DdEzyeRWxgVHEQk3PYoRay3lsdPUJp6C2m5j
 mOhHnBlDItehkLEvKmOnGm45EJpYVCMO2m+dBYUYJ1z9fipuphz2vsW6euu5xFruMuNm
 nSJ9QFnRPoPgu+yARwEfg4cQDu9J1wKckGQLFwbH4Pt4Y9d839O7aFq8tAA+1fMqXNj0
 dg+espyw/gFr3f6Gyv55Z4nmum1iqjkmpmds4df2m8I+xD+MR7fCdvZcrNWeWKGnDPvS
 0x4A==
MIME-Version: 1.0
X-Received: by 10.50.78.195 with SMTP id d3mr35194340igx.26.1414561782250;
 Tue, 28 Oct 2014 22:49:42 -0700 (PDT)
Received: by 10.50.193.135 with HTTP; Tue, 28 Oct 2014 22:49:42 -0700 (PDT)
In-Reply-To: <20141029054401.GC12014@dft-labs.eu>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 <20141029054401.GC12014@dft-labs.eu>
Date: Tue, 28 Oct 2014 22:49:42 -0700
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: NGie Cooper 
To: Mateusz Guzik 
Content-Type: text/plain; charset=UTF-8
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Wed, 29 Oct 2014 05:49:43 -0000

On Tue, Oct 28, 2014 at 10:44 PM, Mateusz Guzik  wrote:

...

> Are you aware of e.g. stress2 by pho?
>
> https://people.freebsd.org/~pho/stress/index.html

+1 for this, but I don't have cycles to implement it in Jenkins. All
I'll say is that using stress2 won't work with your existing
preconditions based on how it gathers crash dumps, how long some of
the tests may take, etc. But you could effectively script pho's magic
to some degree.

> Plugging this in should not be hard for someone who knows jenkins.

Plugging it in should be relatively easy. Babysitting it will be a lot
more entertaining. There's a reason why we don't run it in our default
test runs at Isilon ;)...

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 04:21:03 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 6D1D1710;
 Thu, 30 Oct 2014 04:21:03 +0000 (UTC)
Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com
 [IPv6:2a00:1450:4010:c03::22a])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 8F53FB3A;
 Thu, 30 Oct 2014 04:21:02 +0000 (UTC)
Received: by mail-la0-f42.google.com with SMTP id gq15so3724207lab.29
 for ; Wed, 29 Oct 2014 21:21:00 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=Xb+reV2cXXpFJcNCEEM6/jQa/9gUXVaNXlvyJNNFLtA=;
 b=R+v95IQ7lJX6QtjEIkU5OlTzqOGYdNd4a/BnFURKSmMhOJ6jj/bhSa1w0EXpWqZJDn
 o6P9TiyiNvdn9+BTk+39+SCcgMxhkpRcUQdD22YxBNntjYDbEQvamj+eowH5wjXCYGZ9
 rx5SNoG5k6mvefvcVBF7j6pDI/1KZmI30GxHug5OXmdwsAY0ioVaogiSql3Eb0jBf6qp
 DwRO3yvkSBAp2SiJkM+bV7HsbFXShulpVa9Vz5ucVXdFHVeuQoKOMuUtTXc/uQHL882S
 sk6F+u1KKrRMvnQnDkLpyslArHT/7Su/0l14vgOor7LVJYgGpxjYKsnOOJ6EUBznmSrh
 SO6A==
MIME-Version: 1.0
X-Received: by 10.152.27.134 with SMTP id t6mr15751207lag.17.1414642860351;
 Wed, 29 Oct 2014 21:21:00 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Wed, 29 Oct 2014 21:21:00 -0700 (PDT)
In-Reply-To: <20141029054401.GC12014@dft-labs.eu>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 <20141029054401.GC12014@dft-labs.eu>
Date: Wed, 29 Oct 2014 21:21:00 -0700
X-Google-Sender-Auth: 6xfKa9OZrLvSrURca6Nj-oKjoGM
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: Mateusz Guzik 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 04:21:03 -0000

On Tue, Oct 28, 2014 at 10:44 PM, Mateusz Guzik  wrote:

> On Fri, Oct 24, 2014 at 09:09:48PM -0700, Craig Rodrigues wrote:
>
> Are you aware of e.g. stress2 by pho?
>
> https://people.freebsd.org/~pho/stress/index.html
>
> Plugging this in should not be hard for someone who knows jenkins.
>
> That's not me though. :)
>


Since you are making some good suggestions, would you be interested
in learning enough about Jenkins on your own machine first,
and and see if you can get a successful integration of stress2?
Setting up Jenkins is quite easy under FreeBSD.  There are a lot of howto's
on the web for
how to do it, and I have given multiple presentations:
https://wiki.freebsd.org/Jenkins#Presentations_and_Working_Groups

I don't mind when people make good suggestions, but
when the good suggestions are not backed up by concrete offers to
help out, then that doesn't look so good.  We need more people contributing
actual scripts
and tests.   There are plenty of people contributing suggestions. :)

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 04:34:25 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id CBA999BB
 for ; Thu, 30 Oct 2014 04:34:25 +0000 (UTC)
Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "funkthat.com", Issuer "funkthat.com" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id 93B58C3A
 for ; Thu, 30 Oct 2014 04:34:25 +0000 (UTC)
Received: from h2.funkthat.com (localhost [127.0.0.1])
 by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9U4YMAN011035
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO)
 for ; Wed, 29 Oct 2014 21:34:22 -0700 (PDT)
 (envelope-from jmg@h2.funkthat.com)
Received: (from jmg@localhost)
 by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9U4YMM3011034
 for freebsd-virtualization@freebsd.org; Wed, 29 Oct 2014 21:34:22 -0700 (PDT)
 (envelope-from jmg)
Date: Wed, 29 Oct 2014 21:34:22 -0700
From: John-Mark Gurney 
To: freebsd-virtualization@freebsd.org
Subject: how to for making bhyve images (using makefs + mkimg)
Message-ID: <20141030043421.GA8852@funkthat.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: Mutt/1.4.2.3i
X-Operating-System: FreeBSD 7.2-RELEASE i386
X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88  9322 9CB1 8F74 6D3F A396
X-Files: The truth is out there
X-URL: http://resnet.uoregon.edu/~gurney_j/
X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html
X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE
X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger?
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2
 (h2.funkthat.com [127.0.0.1]); Wed, 29 Oct 2014 21:34:22 -0700 (PDT)
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 04:34:25 -0000

So, Michael Dexter prodded me to document how I'm doing it, so I put
up a blog post at:
http://blog.funkthat.com/2014/10/building-bhyve-images-using-makefs-and.html

It's a quick guide on how to build images using makefs and mkimg.  Only
time you need root is when you run the VM...

btw, thanks for getting bhyve running on AMD! :)

-- 
  John-Mark Gurney				Voice: +1 415 225 5579

     "All that I will do, has been done, All that I have, has not."

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 07:35:14 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 2FAB5B3C;
 Thu, 30 Oct 2014 07:35:14 +0000 (UTC)
Received: from mail-wi0-x232.google.com (mail-wi0-x232.google.com
 [IPv6:2a00:1450:400c:c05::232])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 49A467D;
 Thu, 30 Oct 2014 07:35:13 +0000 (UTC)
Received: by mail-wi0-f178.google.com with SMTP id q5so6534438wiv.17
 for ; Thu, 30 Oct 2014 00:35:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=date:from:to:cc:subject:message-id:references:mime-version
 :content-type:content-disposition:in-reply-to:user-agent;
 bh=1OVcV3o3amhGah0EZA93W3O2AFxGgWrNdyjbg0qzaBk=;
 b=sXHgV8hohzbaQmfFx7jnVaaBFSqUUN14v4Ks4EiIg1K3D81l/fP4S8iDJ4glXx/EKi
 saCaEPqT18iRl95tSD/pyMBYlbkd27QPKQqj3ONVd2Dj6g0SdOSnPaUYfCEW1EKbvqCL
 Bot3nCsA9t6z584l239WaKCAvGafd5FPm8V0infEKgGSOl6OimsfNABkBaYUYJU43rOz
 N+h4y8EZFX+vrkJDgbtbUkVFfP+YTjyYqrIOGXG/ItREirQo15plW2Zn2qd18o33Vpap
 sJOMmm7KvBcX15PMHCtc4uf4RUkUZgmQh/JNT8ZZaS4E2PRZ6fsAKvcyn1eQCu7GLUDK
 kNtw==
X-Received: by 10.180.77.170 with SMTP id t10mr8645341wiw.57.1414654511050;
 Thu, 30 Oct 2014 00:35:11 -0700 (PDT)
Received: from dft-labs.eu (n1x0n-1-pt.tunnel.tserv5.lon1.ipv6.he.net.
 [2001:470:1f08:1f7::2])
 by mx.google.com with ESMTPSA id q5sm21223109wiy.16.2014.10.30.00.35.09
 for 
 (version=TLSv1.2 cipher=RC4-SHA bits=128/128);
 Thu, 30 Oct 2014 00:35:10 -0700 (PDT)
Date: Thu, 30 Oct 2014 08:35:07 +0100
From: Mateusz Guzik 
To: Craig Rodrigues 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
Message-ID: <20141030073507.GA24415@dft-labs.eu>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 <20141029054401.GC12014@dft-labs.eu>
 
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: 
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 07:35:14 -0000

On Wed, Oct 29, 2014 at 09:21:00PM -0700, Craig Rodrigues wrote:
> On Tue, Oct 28, 2014 at 10:44 PM, Mateusz Guzik  wrote:
> 
> > On Fri, Oct 24, 2014 at 09:09:48PM -0700, Craig Rodrigues wrote:
> >
> > Are you aware of e.g. stress2 by pho?
> >
> > https://people.freebsd.org/~pho/stress/index.html
> >
> > Plugging this in should not be hard for someone who knows jenkins.
> >
> > That's not me though. :)
> >
> 
> 
> Since you are making some good suggestions, would you be interested
> in learning enough about Jenkins on your own machine first,
> and and see if you can get a successful integration of stress2?
> Setting up Jenkins is quite easy under FreeBSD.  There are a lot of howto's
> on the web for
> how to do it, and I have given multiple presentations:
> https://wiki.freebsd.org/Jenkins#Presentations_and_Working_Groups
> 
> I don't mind when people make good suggestions, but
> when the good suggestions are not backed up by concrete offers to
> help out, then that doesn't look so good.  We need more people contributing
> actual scripts
> and tests.   There are plenty of people contributing suggestions. :)
> 

I'm not really interested in learning jenkins, got enough backlog as it
is.

I'm just putting stuff out in case it sounds ok and someone wants to do
it.

-- 
Mateusz Guzik 

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 14:37:20 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 0740DA1
 for ; Thu, 30 Oct 2014 14:37:20 +0000 (UTC)
Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89])
 (using TLSv1 with cipher RC4-SHA (128/128 bits))
 (Client CN "mail.citrix.com",
 Issuer "Cybertrust Public SureServer SV CA" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 5F185230
 for ; Thu, 30 Oct 2014 14:37:18 +0000 (UTC)
X-IronPort-AV: E=Sophos;i="5.07,286,1413244800"; d="scan'208";a="186515465"
Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.78)
 with Microsoft SMTP Server id 14.3.181.6;
 Thu, 30 Oct 2014 10:33:30 -0400
Message-ID: <54524C36.8050203@citrix.com>
Date: Thu, 30 Oct 2014 15:33:26 +0100
From: =?windows-1252?Q?Roger_Pau_Monn=E9?= 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: Andy Lutomirski , Linux Virtualization
 
Subject: Re: [Xen-devel] [RFC] Hypervisor RNG and enumeration
References: 
In-Reply-To: 
Content-Type: text/plain; charset="windows-1252"
Content-Transfer-Encoding: 7bit
X-DLP: MIA2
X-Mailman-Approved-At: Thu, 30 Oct 2014 18:30:07 +0000
Cc: Mathew John , Theodore Ts'o ,
 Jim Mattson , kvm list ,
 Gleb Natapov , Niels Ferguson ,
 David Hepkin , Doug Covelli ,
 freebsd-virtualization@freebsd.org, Paolo Bonzini ,
 Christopher Covington ,
 Jun Nakajima , "H. Peter Anvin" ,
 Jake Oshins , xen-devel@lists.xenproject.org,
 Alok Kataria , KY Srinivasan ,
 John Starks 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 14:37:20 -0000

Adding the bhyve guys.

El 29/10/14 a les 6.19, Andy Lutomirski ha escrit:
> Here's a draft CommonHV spec.  It's also on github:
> 
> https://github.com/amluto/CommonHV
> 
> So far, this provides a two-way RNG interface, a way to detect it, and
> a way to detect other hypervisor leaves.  The latter is because, after
> both the enormous public thread and some private discussions, it seems
> that detection of existing CPUID paravirt leaves is annoying and
> inefficient.  If we're going to define some cross-vendor CPUID leaves,
> it seems like it would be useful to offer a way to quickly enumerate
> other leaves.
> 
> I've been told the AMD intends to update their manual to match Intel's
> so that hypervisors can use the entire 0x4F?????? CPUID range.  I have
> intentionally not fixed an MSR value for the RNG because the range of
> allowed MSRs is very small in both the Intel and AMD manuals.  If any
> given hypervisor wants to ignore that small range and advertise a
> higher-numbered MSR, it is welcome to, but I don't want to codify
> something that doesn't comply with the manuals.
> 
> Here's the draft.  Comments?  To the people who work on various
> hypervisors: Would you implement this?  Do you like it?  Is there
> anything, major or minor, that you'd like to see changed?  Do you
> think that this is a good idea at all?
> 
> I've tried to get good coverage of various hypervisors.  There are
> Hyper-V, VMWare, KVM, and Xen people on the cc list.
> 
> Thanks,
> Andy
> 
> 
> 
> CommonHV, a common hypervisor interface
> =======================================
> 
> This is CommonHV draft 1.
> 
> The CommonHV specification is Copyright (c) 2014 Andrew Lutomirski.
> 
> Licensing will be determined soon.  The license is expected to be extremely
> liberal.  I am currently leaning towards CC-BY-SA for the specification and
> an explicit license permitting anyone to implement the specification
> with no restrictions whatsoever.
> 
> I have not patented, nor do I intend to patent, anything required to implement
> this specification.  I am not aware of any current or future intellectual
> property rights that would prevent a royalty-free implementation of
> this specification.
> 
> I would like to find a stable, neutral steward of this specification
> going forward.  Help with this would be much appreciated.
> 
> Scope
> -----
> 
> CommonHV is a simple interface for communication
> between hypervisors and their guests.
> 
> CommonHV is intended to be very simple and to avoid interfering with
> existing paravirtual interfaces.  To that end, its scope is limited.
> CommonHV does only two types of things:
> 
>   * It provides a way to enumerate other paravirtual interfaces.
>   * It provides a small, extensible set of paravirtual features that do not
>     modify or replace standard system functionality.
> 
> For example, CommonHV does not and will not define anything related to
> interrupt handling or virtual CPU management.
> 
> For now, CommonHV is only applicable to the x86 platform.
> 
> Discovery
> ---------
> 
> A CommonHV hypervisor MUST set the hypervisor bit (bit 31 in CPUID.1H.0H.ECX)
> and provide the CPUID leaf 4F000000H, containing:
> 
>   * CPUID.4F000000H.0H.EAX = max_commonhv_leaf
>   * CPUID.4F000000H.0H.EBX = 0x6D6D6F43
>   * CPUID.4F000000H.0H.ECX = 0x56486E6F
>   * CPUID.4F000000H.0H.EDX = 0x66746e49
> 
> EBX, ECX, and EDX form the string "CommonHVIntf" in little-endian ASCII.
> 
> max_commonhv_leaf MUST be a number between 0x4F000000 and 0x4FFFFFFF.  It
> indicates the largest leaf defined in this specification that is provided.
> Any leaves described in this specification with EAX values that exceed
> max_commonhv_leaf MUST be handled by guests as though they contain
> all zeros.
> 
> CPUID leaf 4F000001H: hypervisor interface enumeration
> ------------------------------------------------------
> 
> If max_commonhv_leaf >= 0x4F000001, CommonHV provides a list of tuples
> (location, signature).  Each tuple indicates the presence of another
> paravirtual interface identified by the signature at the indicated
> CPUID location.  It is expected that CPUID.location.0H will have
> (EBX, ECX, EDX) == signature, although whether this is required
> is left to the specification associated with the given signature.
> 
> If the list contains N tuples, then, for each 0 <= i < N:
> 
>   * CPUID.4F000001H.i.EBX, CPUID.4F000001H.i.ECX, and CPUID.4F000001H.i.EDX
>     are the signature.
>   * CPUID.4F000001H.i.EAX is the location.
> 
> CPUID with EAX = 0x4F000001 and ECX >= N MUST return all zeros.
> 
> To the extent that the hypervisor prefers a given interface, it should
> specify that interface earlier in the list.  For example, KVM might place
> its "KVMKVMKVM" signature first in the list to indicate that it should be
> used by guests in preference to other supported interfaces.  Other hypervisors
> would likely use a different order.
> 
> The exact semantics of the ordering of the list is beyond the scope of
> this specification.
> 
> CPUID leaf 4F000002H: miscellaneous features
> --------------------------------------------
> 
> CPUID.4F000002H.EAX is nonzero if the CommonHV RNG interface is available.
> CPUID.4F000002H.EBX, CPUID.4F000002H.ECX, and CPUID.4F000002H.EDX are reserved
> and must be zero in hypervisors compliant with this version of the CommonHV
> specification.
> 
> ### CommonHV RNG
> 
> If CPUID.4F000002H.EAX is nonzero, then it contains an MSR index used to
> communicate with a hypervisor random number generator.  This MSR is
> referred to as MSR_COMMONHV_RNG.
> 
> rdmsr(MSR_COMMONHV_RNG) returns a 64-bit best-effort random number.  If the
> hypervisor is able to generate a 64-bit cryptographically secure random number,
> it SHOULD return it.  If not, then the hypervisor SHOULD do its best to return
> a random number suitable for seeding a cryptographic RNG.
> 
> A guest is expected to read MSR_COMMONHV_RNG several times in a row.
> The hypervisor SHOULD return different values each time.
> 
> rdmsr(MSR_COMMONHV_RNG) MUST NOT result in an exception, but guests MUST
> NOT assume that its return value is indeed secure.  For example, a hypervisor
> is free to return zero in response to rdmsr(MSR_COMMONHV_RNG).
> 
> wrmsr(MSR_COMMONHV_RNG) offers the hypervisor up to 64 bits of entropy.
> The hypervisor MAY use it as it sees fit to improve its own random number
> generator.  A hypervisor SHOULD make a reasonable effort to avoid making
> values written to MSR_COMMONHV_RNG visible to untrusted parties, but
> guests SHOULD NOT write sensitive values to wrmsr(MSR_COMMONHV_RNG).
> 
> A hypervisor is free to ignore wrmsr(MSR_COMMONHV_RNG), but wrmsr to
> MSR_COMMONHV_RNG MUST NOT result in an exception.
> 
> Note that the CommonHV RNG is not intended to replace stronger, asynchronous
> paravirtual random number generator interfaces.  It is intended primarily
> for seeding guest RNGs early in boot.
> 
> Future extension
> ----------------
> 
> CPUID leaves beyond those defined in this version of the CommonHV specification
> should be ignored by guests written for this version of the specification.
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel
> 


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 20:18:48 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id E9EAEC46
 for ; Thu, 30 Oct 2014 20:18:48 +0000 (UTC)
Received: from potassio.roma.schema31.it (85-18-162-231.ip.fastwebnet.it
 [85.18.162.231])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 7154DD3E
 for ; Thu, 30 Oct 2014 20:18:46 +0000 (UTC)
Received: from [10.33.100.192] ([10.33.100.192])
 by potassio.roma.schema31.it (8.14.4/8.14.4) with ESMTP id s9UKCFmW028729
 for ; Thu, 30 Oct 2014 21:12:16 +0100 (CET)
 (envelope-from abrancatelli@schema31.it)
From: Andrea Brancatelli 
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Subject: bhyve machine not starting after upgrading
Message-Id: 
Date: Thu, 30 Oct 2014 21:12:15 +0100
To: freebsd-virtualization@freebsd.org
Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\))
X-Mailer: Apple Mail (2.1990.1)
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 20:18:49 -0000

Hello guys.

I had some wonderfully working machines with bhyve with a plain 10.0-p4. =
I just upgraded to 10.1-RC3 and now the VMs won=E2=80=99t boot anymore: =
they get just stuck with "unable to load kernel=E2=80=9D. After some =
trials and errors I think I traced it to user boot getting confused by a =
ZFS partition inside the VM.

I did some experiments with set currdev and got the kernel loaded but =
then the machine just hangs.

Please give me some advice :-)

Here=E2=80=99s a capture of the machine and what i did to get it =
working. Any idea is welcome. Thanks

=3D=3D=3D=3D

STARTING VM...
Consoles: userboot

FreeBSD/amd64 User boot, Revision 1.1
(root@releng1.nyi.freebsd.org, Tue Oct 21 23:49:55 UTC 2014)
-
can't load 'kernel'

Type '?' for a list of commands, 'help' for more detailed help.
OK lsdev
host devices:
    host0:   Host filesystem
disk devices:
    disk0:   Guest drive image
      disk0p1: FreeBSD boot
      disk0p2: FreeBSD UFS
      disk0p3: FreeBSD swap
      disk0p4: FreeBSD ZFS
zfs devices:
    zfs:repository
OK show
LINES=3D24
boot_serial=3D1
console=3Duserboot
currdev=3Dzfs:repository:
interpret=3DOK
loaddev=3Dzfs:repository:
prompt=3D${interpret}
smbios.bios.vendor=3DBHYVE
OK set currdev=3Ddisk0p2:
OK set rootdev=3Ddisk0p2:
OK boot
/boot/kernel/kernel text=3D0xed9008 data=3D0x117d28+0x176650 =
syms=3D[0x8+0x137988+0x8+0x1515f8]
\
=3D=3D=3D=3D=3D

-------
Andrea Brancatelli





From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 21:58:10 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id AD43BC45
 for ; Thu, 30 Oct 2014 21:58:10 +0000 (UTC)
Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net
 [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 6DB2F91A
 for ; Thu, 30 Oct 2014 21:58:09 +0000 (UTC)
Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28])
 (Authenticated sender: allanjude.freebsd@scaleengine.com)
 by mx1.scaleengine.net (Postfix) with ESMTPSA id CD79E67A26
 for ; Thu, 30 Oct 2014 21:58:01 +0000 (UTC)
Message-ID: <5452B474.4050107@freebsd.org>
Date: Thu, 30 Oct 2014 17:58:12 -0400
From: Allan Jude 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: freebsd-virtualization@freebsd.org
Subject: Re: bhyve machine not starting after upgrading
References: 
In-Reply-To: 
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="1vqOwVvi21iBbMiA6AtkUc0uGADQFCXXv"
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 21:58:10 -0000

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--1vqOwVvi21iBbMiA6AtkUc0uGADQFCXXv
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On 2014-10-30 16:12, Andrea Brancatelli wrote:
> Hello guys.
>=20
> I had some wonderfully working machines with bhyve with a plain 10.0-p4=
=2E I just upgraded to 10.1-RC3 and now the VMs won=E2=80=99t boot anymor=
e: they get just stuck with "unable to load kernel=E2=80=9D. After some t=
rials and errors I think I traced it to user boot getting confused by a Z=
FS partition inside the VM.
>=20
> I did some experiments with set currdev and got the kernel loaded but t=
hen the machine just hangs.
>=20
> Please give me some advice :-)
>=20
> Here=E2=80=99s a capture of the machine and what i did to get it workin=
g. Any idea is welcome. Thanks
>=20
> =3D=3D=3D=3D
>=20
> STARTING VM...
> Consoles: userboot
>=20
> FreeBSD/amd64 User boot, Revision 1.1
> (root@releng1.nyi.freebsd.org, Tue Oct 21 23:49:55 UTC 2014)
> -
> can't load 'kernel'
>=20
> Type '?' for a list of commands, 'help' for more detailed help.
> OK lsdev
> host devices:
>     host0:   Host filesystem
> disk devices:
>     disk0:   Guest drive image
>       disk0p1: FreeBSD boot
>       disk0p2: FreeBSD UFS
>       disk0p3: FreeBSD swap
>       disk0p4: FreeBSD ZFS
> zfs devices:
>     zfs:repository
> OK show
> LINES=3D24
> boot_serial=3D1
> console=3Duserboot
> currdev=3Dzfs:repository:
> interpret=3DOK
> loaddev=3Dzfs:repository:
> prompt=3D${interpret}
> smbios.bios.vendor=3DBHYVE
> OK set currdev=3Ddisk0p2:
> OK set rootdev=3Ddisk0p2:
> OK boot
> /boot/kernel/kernel text=3D0xed9008 data=3D0x117d28+0x176650 syms=3D[0x=
8+0x137988+0x8+0x1515f8]
> \
> =3D=3D=3D=3D=3D
>=20
> -------
> Andrea Brancatelli
>=20
>=20
>=20
>=20
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr=
eebsd.org"
>=20

Is the disk for this VM a ZFS zvol?

You might need to set the 'vol mode' to make GEOM not steal the disk.

--=20
Allan Jude


--1vqOwVvi21iBbMiA6AtkUc0uGADQFCXXv
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQIcBAEBAgAGBQJUUrR5AAoJEJrBFpNRJZKfUfIP/0wo/zGFH+sLQ3ky6m8wLub9
O+wy3uZNjHbhVGwlS47joqpplsKwbCykD1eo4J786Wmi+p3VBU7sZudWfT/TieWS
3rchRtVhZYgXn/F6HdrqgZNljppmOFr5l5AUz/aXKtKlkJJ3dhL3++oRhMcUDS/j
2KH9qjrzXhABhLilC1FzijLCV8IuFj3POK3mG9yFp4Zpf9ZyXW8nownMbyaZQZ4v
LVcrhSnLcvsUAmKLSUrCN9bo7Zc3UZa3hs40VQG5nvDkMldYOJn4yn6Us312lBC9
W0LxuShHN/QFaS8kHdQOxqQL92h8zy3My8UzpNMjR5HxVXLV6T8eCZnmfLzJfSST
MQcOHxTUwenRRtImflUuiIroPXHAW/KlXvvpHiA+pBufS4BLH2x9WU6ooG3shQYD
3yr0LxeLqZOmDf0931Oozpi9UUGIdUraSmflfXfiIlgM9x2xIRG8wfBJ4DRE6Cpt
MoWFMHOlncBE2F59IVTuNqZZC3TITIMmIAe/bWuoh6jVI6sK6xk8sgtE+xbraAKF
Bu0gRqmG3SL+p/8JFL7ehV4nDczKRKq0cuOlk9poJv6sITpaQbpZm8SCSgo5H32j
MzV5p1SyFu9YnIJBBZT6Uz/+tW5EKezUKs2s21t7LP1aVnVFvx+LrEwC5yu5UlEq
QOTGC759xen7qOYEl6FQ
=UsAX
-----END PGP SIGNATURE-----

--1vqOwVvi21iBbMiA6AtkUc0uGADQFCXXv--

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 22:17:05 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 514A5276
 for ; Thu, 30 Oct 2014 22:17:05 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id 13620AC9
 for ; Thu, 30 Oct 2014 22:17:04 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id 64CEE126E1;
 Fri, 31 Oct 2014 08:16:56 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local
 (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZI37077 (AUTH peterg@ptree32.com.au);
 Fri, 31 Oct 2014 08:16:54 +1000
Message-ID: <5452B8D4.4070204@freebsd.org>
Date: Thu, 30 Oct 2014 15:16:52 -0700
From: Peter Grehan 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Andrea Brancatelli 
Subject: Re: bhyve machine not starting after upgrading
References: 
In-Reply-To: 
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 22:17:05 -0000

Hi Andrea,

> I had some wonderfully working machines with bhyve with a plain
> 10.0-p4. I just upgraded to 10.1-RC3 and now the VMs won’t boot
> anymore: they get just stuck with "unable to load kernel”. After some
> trials and errors I think I traced it to user boot getting confused
> by a ZFS partition inside the VM.
>
> I did some experiments with set currdev and got the kernel loaded but
> then the machine just hangs.
>
> Please give me some advice :-)

  This was reported by Craig Rodrigues a while back - the email thread is at

 
http://docs.freebsd.org/cgi/mid.cgi?CAG=rPVd5OQ1Gw6q-e94Ffnk_zPxkFvjaR5bpOOjMg7j-9AvSdw

  I never got around to implementing the flag to disable ZFS boot, but 
you may be able to use an alternate workaround. From your manual fix:

OK set currdev=disk0p2:
OK set rootdev=disk0p2:

  Env variables can be set from the bhyveload command line using "-e 
=". Now, I'm not sure that currdev and rootdev can be set 
that early in the boot, but it's worth a try e.g. add these:

  -e currdev="disk0p2:" -e rootdev="disk0p2:"

later,

Peter.

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 22:46:26 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 00277E16;
 Thu, 30 Oct 2014 22:46:25 +0000 (UTC)
Received: from potassio.roma.schema31.it (85-18-162-231.ip.fastwebnet.it
 [85.18.162.231])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 6A6DEDC0;
 Thu, 30 Oct 2014 22:46:24 +0000 (UTC)
Received: from [172.16.11.38] ([172.16.11.38])
 by potassio.roma.schema31.it (8.14.4/8.14.4) with ESMTP id s9UMkMNh088967;
 Thu, 30 Oct 2014 23:46:22 +0100 (CET)
 (envelope-from abrancatelli@schema31.it)
Content-Type: text/plain; charset=utf-8
Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\))
Subject: Re: bhyve machine not starting after upgrading
From: Andrea Brancatelli 
In-Reply-To: <5452B474.4050107@freebsd.org>
Date: Thu, 30 Oct 2014 23:46:21 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <4F74F2E4-3A59-4CB6-AB99-3B3F7D7A5B33@schema31.it>
References: 
 <5452B474.4050107@freebsd.org>
To: Allan Jude 
X-Mailer: Apple Mail (2.1990.1)
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 22:46:26 -0000


>> OK set currdev=3Ddisk0p2:
>> OK set rootdev=3Ddisk0p2:
>> OK boot
>> /boot/kernel/kernel text=3D0xed9008 data=3D0x117d28+0x176650 =
syms=3D[0x8+0x137988+0x8+0x1515f8]
>> \
>> =3D=3D=3D=3D=3D
>=20
> Is the disk for this VM a ZFS zvol?
>=20

No, it=E2=80=99s a standard =E2=80=9CIMG=E2=80=9D as usual. There=E2=80=99=
s a ZFS inside of the VM.

> You might need to set the 'vol mode' to make GEOM not steal the disk.
>=20

No that=E2=80=99s not the case but thanks :-)


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 22:49:09 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 9EFFDFC5;
 Thu, 30 Oct 2014 22:49:09 +0000 (UTC)
Received: from potassio.roma.schema31.it (85-18-162-231.ip.fastwebnet.it
 [85.18.162.231])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 2F45ADD9;
 Thu, 30 Oct 2014 22:49:08 +0000 (UTC)
Received: from [172.16.11.38] ([172.16.11.38])
 by potassio.roma.schema31.it (8.14.4/8.14.4) with ESMTP id s9UMn6br090201;
 Thu, 30 Oct 2014 23:49:06 +0100 (CET)
 (envelope-from abrancatelli@schema31.it)
Content-Type: text/plain; charset=utf-8
Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\))
Subject: Re: bhyve machine not starting after upgrading
From: Andrea Brancatelli 
In-Reply-To: <5452B8D4.4070204@freebsd.org>
Date: Thu, 30 Oct 2014 23:49:06 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <7931E297-104B-4BCA-BA08-D425DE7D85A7@schema31.it>
References: 
 <5452B8D4.4070204@freebsd.org>
To: Peter Grehan 
X-Mailer: Apple Mail (2.1990.1)
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 22:49:09 -0000

>>=20
>> I did some experiments with set currdev and got the kernel loaded but
>> then the machine just hangs.
>>=20
>> Please give me some advice :-)
>=20
> This was reported by Craig Rodrigues a while back - the email thread =
is at
>=20
> =
http://docs.freebsd.org/cgi/mid.cgi?CAG=3DrPVd5OQ1Gw6q-e94Ffnk_zPxkFvjaR5b=
pOOjMg7j-9AvSdw
>=20
> I never got around to implementing the flag to disable ZFS boot, but =
you may be able to use an alternate workaround. =46rom your manual fix:
>=20
> OK set currdev=3Ddisk0p2:
> OK set rootdev=3Ddisk0p2:
>=20
> Env variables can be set from the bhyveload command line using "-e =
=3D". Now, I'm not sure that currdev and rootdev can be set =
that early in the boot, but it's worth a try e.g. add these:
>=20
> -e currdev=3D"disk0p2:" -e rootdev=3D"disk0p2:"
>=20
> later,

Wait! I think I didn=E2=80=99t make it clear enough: the machine =
doesn=E2=80=99t boot. After I specify the currdev and rootdev the =
machine can successfully =E2=80=9Cload=E2=80=9D the kernel but then it =
all totally freezes at the spinning wheel=E2=80=A6

I=E2=80=99ll try with the -e on the command line but I think the problem =
is a bit beyond that.


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 22:56:41 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 4519E2A4;
 Thu, 30 Oct 2014 22:56:41 +0000 (UTC)
Received: from potassio.roma.schema31.it (85-18-162-231.ip.fastwebnet.it
 [85.18.162.231])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id C49ABE98;
 Thu, 30 Oct 2014 22:56:40 +0000 (UTC)
Received: from [172.16.11.38] ([172.16.11.38])
 by potassio.roma.schema31.it (8.14.4/8.14.4) with ESMTP id s9UMubUo093572;
 Thu, 30 Oct 2014 23:56:38 +0100 (CET)
 (envelope-from abrancatelli@schema31.it)
Content-Type: text/plain; charset=utf-8
Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\))
Subject: Re: bhyve machine not starting after upgrading
From: Andrea Brancatelli 
In-Reply-To: <7931E297-104B-4BCA-BA08-D425DE7D85A7@schema31.it>
Date: Thu, 30 Oct 2014 23:56:37 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <62FFE74F-E824-4159-A953-2080D40535A1@schema31.it>
References:  <5452B8D4.
 4070204@freebsd.org> <7931E297-104B-4BCA-BA08-D425DE7D85A7@schema31.it>
To: Peter Grehan 
X-Mailer: Apple Mail (2.1990.1)
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 22:56:41 -0000

>> Env variables can be set from the bhyveload command line using "-e =
=3D". Now, I'm not sure that currdev and rootdev can be set =
that early in the boot, but it's worth a try e.g. add these:
>> -e currdev=3D"disk0p2:" -e rootdev=3D"disk0p2:"
>=20
> I=E2=80=99ll try with the -e on the command line but I think the =
problem is a bit beyond that.

Mmmm Peter, the -e seems to be totally ignored.

[root@environment-rm-02 /san_storage/OG/DEV]# /usr/sbin/bhyveload -m =
2048 -e currdev=3D"disk0p2:" -e rootdev=3D"disk0p2" -d =
/san_storage/OG/DEV/og-mysql-dev/og-mysql-dev.img og-mysql-dev
Consoles: userboot =20

FreeBSD/amd64 User boot, Revision 1.1
(root@releng1.nyi.freebsd.org, Tue Oct 21 23:49:55 UTC 2014)
-
can't load 'kernel'

Type '?' for a list of commands, 'help' for more detailed help.
OK show
LINES=3D24
boot_serial=3D1
console=3Duserboot
currdev=3Dzfs:repository:
interpret=3DOK
loaddev=3Dzfs:repository:
prompt=3D${interpret}
rootdev=3Ddisk0p2
smbios.bios.vendor=3DBHYVE
OK=20


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 23:35:37 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 627B7854
 for ; Thu, 30 Oct 2014 23:35:37 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id 22F94274
 for ; Thu, 30 Oct 2014 23:35:36 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id 76EB0123AB;
 Fri, 31 Oct 2014 09:35:34 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local
 (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZI42815 (AUTH peterg@ptree32.com.au);
 Fri, 31 Oct 2014 09:35:33 +1000
Message-ID: <5452CB43.8000602@freebsd.org>
Date: Thu, 30 Oct 2014 16:35:31 -0700
From: Peter Grehan 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Andrea Brancatelli 
Subject: Re: bhyve machine not starting after upgrading
References:  <5452B8D4.
 4070204@freebsd.org> <7931E297-104B-4BCA-BA08-D425DE7D85A7@schema31.it>
 <62FFE74F-E824-4159-A953-2080D40535A1@schema31.it>
In-Reply-To: <62FFE74F-E824-4159-A953-2080D40535A1@schema31.it>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 23:35:37 -0000

Hi Andrea,

> Mmmm Peter, the -e seems to be totally ignored.

  Ok, looks like the ZFS probe code will override those :(

> Type '?' for a list of commands, 'help' for more detailed help.
> OK show
> LINES=24
> boot_serial=1
> console=userboot
> currdev=zfs:repository:
> interpret=OK
> loaddev=zfs:repository:
> prompt=${interpret}
> rootdev=disk0p2
> smbios.bios.vendor=BHYVE
> OK

  How about if you set loaddev to disk0p2, and see if that allows a boot ?

  Another solution, though not pretty, is to build a version of userboot 
that doesn't have ZFS enabled. Modify 
sys/boot/userboot/userboot/Makefile and remove the MK_ZFS section, and 
copy userboot.so from the build to /boot/userboot.so and the host. This 
should give you back the behaviour from 10.0.

later,

Peter.


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 23:50:42 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 23BF3C31
 for ; Thu, 30 Oct 2014 23:50:42 +0000 (UTC)
Received: from zhost.uxsglobal.com (zhost.xinuos.com [144.202.236.63])
 by mx1.freebsd.org (Postfix) with ESMTP id E5DC161E
 for ; Thu, 30 Oct 2014 23:50:41 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id 1F6948C03A7
 for ; Thu, 30 Oct 2014 19:50:40 -0400 (EDT)
Received: from zhost.uxsglobal.com ([127.0.0.1])
 by localhost (zhost.uxsglobalhost.com [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id p1v-ifWGCpR5 for ;
 Thu, 30 Oct 2014 19:50:40 -0400 (EDT)
Received: from zhost.uxsglobal.com (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id E82D98C03A4
 for ; Thu, 30 Oct 2014 19:50:39 -0400 (EDT)
Received: from zhost.uxsglobalhost.com (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id DEB578C038B
 for ; Thu, 30 Oct 2014 19:50:39 -0400 (EDT)
Date: Thu, 30 Oct 2014 19:50:39 -0400 (EDT)
From: Susan Stanziano 
To: freebsd-virtualization@freebsd.org
Message-ID: <906438638.1188356.1414713039788.JavaMail.zimbra@xinuos.com>
In-Reply-To: 
References: <1332647925.1184837.1414700255905.JavaMail.zimbra@xinuos.com>
 <926516146.1185082.1414701141476.JavaMail.zimbra@xinuos.com>
 
Subject: Fwd: Help with Bhyve VM install
MIME-Version: 1.0
X-Originating-IP: [71.125.64.86]
X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - GC38 (Win)/8.0.6_GA_5922)
Thread-Topic: Help with Bhyve VM install
Thread-Index: J3LOJaYMVt13BNTRy3SMEELpZckvJw==
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 30 Oct 2014 23:50:42 -0000



----- Forwarded Message -----

From: "NGie Cooper"  
To: "Susan Stanziano"  
Cc: freebsd-testing@freebsd.org 
Sent: Thursday, October 30, 2014 6:03:56 PM 
Subject: Re: Help with Bhyve VM install 

On Thu, Oct 30, 2014 at 1:32 PM, Susan Stanziano 
 wrote: 
> 
> 
> I have a system installed with releng10.1 (with tests configured) and am trying to create a VM under Bhyve. 
> 
> I want to know which image to use for the VM install, specifically will the : 
> 
> FreeBSD-10.1-RC3-amd64-bootonly.iso 
> 
> install with the /usr/tests directory created? Or, should I use FreeBSD-10.1-RC3-amd64-disc1.iso ? 
> 
> Thanks, and any further advice would be appreciated also, 

Hi Susan, 
Please try asking this question on the freebsd-virtualization@ list instead. 
Thank you! 


From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 31 00:05:11 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 6F710DB7;
 Fri, 31 Oct 2014 00:05:11 +0000 (UTC)
Received: from potassio.roma.schema31.it (85-18-162-231.ip.fastwebnet.it
 [85.18.162.231])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id EE60C78F;
 Fri, 31 Oct 2014 00:05:09 +0000 (UTC)
Received: from [172.16.11.38] ([172.16.11.38])
 by potassio.roma.schema31.it (8.14.4/8.14.4) with ESMTP id s9V057jD047704;
 Fri, 31 Oct 2014 01:05:07 +0100 (CET)
 (envelope-from abrancatelli@schema31.it)
Content-Type: text/plain; charset=utf-8
Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\))
Subject: Re: bhyve machine not starting after upgrading
From: Andrea Brancatelli 
In-Reply-To: <5452CB43.8000602@freebsd.org>
Date: Fri, 31 Oct 2014 01:05:07 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <3C8C9082-8C66-4B52-8763-DCD3A9ACE408@schema31.it>
References:  <5452B8D4.
 4070204@freebsd.org> <7931E297-104B-4BCA-BA08-D425DE7D85A7@schema31.it> <
 62FFE74F-E824-4159-A953-2080D40535A1@schema31.it>
 <5452CB43.8000602@freebsd.org>
To: Peter Grehan 
X-Mailer: Apple Mail (2.1990.1)
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 31 Oct 2014 00:05:11 -0000

>> Type '?' for a list of commands, 'help' for more detailed help.
>> OK show
>> LINES=3D24
>> boot_serial=3D1
>> console=3Duserboot
>> currdev=3Dzfs:repository:
>> interpret=3DOK
>> loaddev=3Dzfs:repository:
>> prompt=3D${interpret}
>> rootdev=3Ddisk0p2
>> smbios.bios.vendor=3DBHYVE
>> OK
>=20
> How about if you set loaddev to disk0p2, and see if that allows a boot =
?

=E2=80=9Cloaddev" seems to be a read only property=E2=80=A6 :(

> Another solution, though not pretty, is to build a version of userboot =
that doesn't have ZFS enabled. Modify =
sys/boot/userboot/userboot/Makefile and remove the MK_ZFS section, and =
copy userboot.so from the build to /boot/userboot.so and the host. This =
should give you back the behaviour from 10.0.

OK, I had no sources to compile so I did a very bad thing and I know =
I=E2=80=99ll go in hell for this but=E2=80=A6

I copied userboot.so from another FreeBSD 10.0 machine and substituted =
/boot/userboot.so from the host. Restarted the VM and it worked like a =
charm.

You=E2=80=99re going to fix this before 10.1 final, RIGHT?? :-)

Do you think this modification may result in a non-booting host machine?=

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 31 02:39:56 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id DDBB54C8;
 Fri, 31 Oct 2014 02:39:56 +0000 (UTC)
Received: from mail-lb0-x235.google.com (mail-lb0-x235.google.com
 [IPv6:2a00:1450:4010:c04::235])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 39CB76D6;
 Fri, 31 Oct 2014 02:39:56 +0000 (UTC)
Received: by mail-lb0-f181.google.com with SMTP id w7so5420497lbi.12
 for ; Thu, 30 Oct 2014 19:39:54 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=sfuOR7CL115vhmX3U5MBpHBSDVvFBGXZtpJyTM9yrv8=;
 b=yV5nGk5uYZzYLAlZL5jC6JnnIf2elo8p0FjMjGfjFPEofqeFJkbXxcnw6giDCI1CwB
 0hraasRxgLHM0BcqU12DMojVp9b2KV9zrTpesBeOWT1BOCJVHGzXOUkAdS8iefCp7Gqo
 Ro8fHEdUrdaHhL18G/OWPAPv+ug6rhmB2n+9xqHUGkDfKNx5k21vm0y172P6H4KlEDKu
 fw+X98dYedftHcdvLoxcMzI8o+8zsIjFwLiJK0YrbRL6tnvoZ1/RFsJtl8/T4B1Oyq9q
 VrJSGFKeoxt6S3DI1Rn904TASruwWfPq8PJZFMXpNG7gDLnenYOPdskaxUpftQMatBV1
 f4Ag==
MIME-Version: 1.0
X-Received: by 10.112.54.229 with SMTP id m5mr22939283lbp.11.1414723194074;
 Thu, 30 Oct 2014 19:39:54 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Thu, 30 Oct 2014 19:39:54 -0700 (PDT)
In-Reply-To: <926516146.1185082.1414701141476.JavaMail.zimbra@xinuos.com>
References: <1332647925.1184837.1414700255905.JavaMail.zimbra@xinuos.com>
 <926516146.1185082.1414701141476.JavaMail.zimbra@xinuos.com>
Date: Thu, 30 Oct 2014 19:39:54 -0700
X-Google-Sender-Auth: DX3fZZy1Oo8Hls1QpIh6qTMpS9E
Message-ID: 
Subject: Re: Help with Bhyve VM install
From: Craig Rodrigues 
To: Susan Stanziano 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 31 Oct 2014 02:39:57 -0000

On Thu, Oct 30, 2014 at 1:32 PM, Susan Stanziano  wrote:

>
> I have a system installed with releng10.1 (with tests configured) and am
> trying to create a VM under Bhyve.
>
> I want to know which image to use for the VM install, specifically will
> the :
>
> FreeBSD-10.1-RC3-amd64-bootonly.iso
>
> install with the /usr/tests directory created? Or, should I use
> FreeBSD-10.1-RC3-amd64-disc1.iso ?
>


Hi Susan,

I'm not sure why Garrett felt it was necessary to redirect you
to the freebsd-virtualization list.   Although you are using bhyve,
there is nothing specific to bhyve in your questions.  No harm done,
though, since I'm on both lists, and will answer your questions.

FreeBSD 10.1 does not have /usr/tests populated by default.

You have a few options

OPTION 1:   FreeBSD 10.1 ISO
=======================

(1)  Install FreeBSD-10.1-RC3-amd64-disc1.iso into a bhyve VM
(2)  Make sure that in the install menus you specify to install sources,
      which will be under /usr/src
(3)  Boot the VM
(4)  Create a file /etc/make.conf with this line:

WITH_TESTS="yes"

(5)  Follow these steps 1-11 for rebuilding the binaries on your system
from the source code in /usr/src:

https://svnweb.freebsd.org/base/head/Makefile?revision=271168&view=markup#l70

(6)  reboot the VM

Tests will be available under /usr/tests



OPTION 2:  FreeBSD-CURRENT ISO
===========================

(1)  Download
ftp://ftp.freebsd.org/pub/FreeBSD/snapshots/ISO-IMAGES/11.0/FreeBSD-11.0-CURRENT-amd64-20141025-r273635-bootonly.iso
(2)  Install in a bhyve VM.
(3)  Make sure that in the installer you specify to install the tests
(4)  Reboot the VM
(5)  Tests will be available in /usr/tests


OPTION 3:  FreeBSD-CURRENT VM image
================================

(1)  Download the pre-built "raw" VM disk image from:
ftp://ftp.freebsd.org/pub/FreeBSD/snapshots/VM-IMAGES/11.0-CURRENT/amd64/Latest/FreeBSD-11.0-CURRENT-amd64.raw.xz
(2) Use "unxz" to decompress it.
(3) Boot the FreeBSD-11.0-CURRENT-amd64.raw image in bhyve
(4)  Tests will be available in /usr/tests

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 31 05:37:02 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 7BBB8E03
 for ; Fri, 31 Oct 2014 05:37:02 +0000 (UTC)
Received: from elvis.mu.org (elvis.mu.org [IPv6:2001:470:1f05:b76::196])
 by mx1.freebsd.org (Postfix) with ESMTP id 68BD88FA
 for ; Fri, 31 Oct 2014 05:37:02 +0000 (UTC)
Received: from u10-2-32-011.office.norse-data.com (unknown [50.204.88.51])
 by elvis.mu.org (Postfix) with ESMTPSA id 5DEBC341F85D;
 Thu, 30 Oct 2014 22:37:02 -0700 (PDT)
Message-ID: <54531FFE.7000409@freebsd.org>
Date: Thu, 30 Oct 2014 22:37:02 -0700
From: Alfred Perlstein 
Organization: FreeBSD
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: John-Mark Gurney , 
 freebsd-virtualization@freebsd.org
Subject: Re: how to for making bhyve images (using makefs + mkimg)
References: <20141030043421.GA8852@funkthat.com>
In-Reply-To: <20141030043421.GA8852@funkthat.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 31 Oct 2014 05:37:02 -0000


On 10/29/14 9:34 PM, John-Mark Gurney wrote:
> So, Michael Dexter prodded me to document how I'm doing it, so I put
> up a blog post at:
> http://blog.funkthat.com/2014/10/building-bhyve-images-using-makefs-and.html
>
> It's a quick guide on how to build images using makefs and mkimg.  Only
> time you need root is when you run the VM...
>
> btw, thanks for getting bhyve running on AMD! :)
>
John-Mark, very cool.

Thanks for pointing me at mkimg, will have to look at porting our build 
to use that as opposed to "mdconfig".

-Alfred

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 31 05:47:33 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 90EF9213;
 Fri, 31 Oct 2014 05:47:33 +0000 (UTC)
Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "funkthat.com", Issuer "funkthat.com" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id 086389C4;
 Fri, 31 Oct 2014 05:47:32 +0000 (UTC)
Received: from h2.funkthat.com (localhost [127.0.0.1])
 by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9V5lVrt034345
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
 Thu, 30 Oct 2014 22:47:31 -0700 (PDT)
 (envelope-from jmg@h2.funkthat.com)
Received: (from jmg@localhost)
 by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9V5lVox034344;
 Thu, 30 Oct 2014 22:47:31 -0700 (PDT) (envelope-from jmg)
Date: Thu, 30 Oct 2014 22:47:31 -0700
From: John-Mark Gurney 
To: Alfred Perlstein 
Subject: Re: how to for making bhyve images (using makefs + mkimg)
Message-ID: <20141031054731.GL8852@funkthat.com>
References: <20141030043421.GA8852@funkthat.com> <54531FFE.7000409@freebsd.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <54531FFE.7000409@freebsd.org>
User-Agent: Mutt/1.4.2.3i
X-Operating-System: FreeBSD 7.2-RELEASE i386
X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88  9322 9CB1 8F74 6D3F A396
X-Files: The truth is out there
X-URL: http://resnet.uoregon.edu/~gurney_j/
X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html
X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE
X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger?
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2
 (h2.funkthat.com [127.0.0.1]); Thu, 30 Oct 2014 22:47:31 -0700 (PDT)
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 31 Oct 2014 05:47:33 -0000

Alfred Perlstein wrote this message on Thu, Oct 30, 2014 at 22:37 -0700:
> On 10/29/14 9:34 PM, John-Mark Gurney wrote:
> >So, Michael Dexter prodded me to document how I'm doing it, so I put
> >up a blog post at:
> >http://blog.funkthat.com/2014/10/building-bhyve-images-using-makefs-and.html
> >
> >It's a quick guide on how to build images using makefs and mkimg.  Only
> >time you need root is when you run the VM...
> >
> >btw, thanks for getting bhyve running on AMD! :)
> >
> John-Mark, very cool.
> 
> Thanks for pointing me at mkimg, will have to look at porting our build 
> to use that as opposed to "mdconfig".

np...  It's cool..  though things get built a bit different w/ mkimg
wrt to partiion alignment.. so make sure things are good, i.e. 4k
aligned for most hard drives...  One easy way to do this is to use
-P 4k...

Enjoy!

-- 
  John-Mark Gurney				Voice: +1 415 225 5579

     "All that I will do, has been done, All that I have, has not."