From owner-freebsd-virtualization@freebsd.org Mon Jul 13 08:06:11 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38A4899B5E7; Mon, 13 Jul 2015 08:06:11 +0000 (UTC) (envelope-from weh@microsoft.com) Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1on0110.outbound.protection.outlook.com [157.56.110.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B28691A94; Mon, 13 Jul 2015 08:06:10 +0000 (UTC) (envelope-from weh@microsoft.com) Received: from BY1PR03MB1434.namprd03.prod.outlook.com (10.162.127.152) by BY1PR03MB1434.namprd03.prod.outlook.com (10.162.127.152) with Microsoft SMTP Server (TLS) id 15.1.213.14; Mon, 13 Jul 2015 08:06:01 +0000 Received: from BY1PR03MB1434.namprd03.prod.outlook.com ([10.162.127.152]) by BY1PR03MB1434.namprd03.prod.outlook.com ([10.162.127.152]) with mapi id 15.01.0213.000; Mon, 13 Jul 2015 08:06:01 +0000 From: Wei Hu To: Pavel Timofeev , Slawa Olhovchenkov CC: "freebsd-current@freebsd.org" , "freebsd-virtualization@freebsd.org" Subject: RE: MS DNS doesn't answer to CURRENT under Hyper-V Thread-Topic: MS DNS doesn't answer to CURRENT under Hyper-V Thread-Index: AQHQuKsxHCAHG2fAnE6RlFoo4JehXp3P+tkAgAAgVgCAAAxjAIABENiAgAfXc/A= Date: Mon, 13 Jul 2015 08:06:01 +0000 Message-ID: References: <20150707130902.GA41189@zxy.spb.ru> <20150707154906.GA44094@zxy.spb.ru> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: gmail.com; dkim=none (message not signed) header.d=none; x-originating-ip: [167.220.232.8] x-microsoft-exchange-diagnostics: 1; BY1PR03MB1434; 5:Yh7r75WgXSJoXoYdCFVL6mIAISCz94ylXd7eTaTIuOskKhWjrEJrwzCSBXAk5bFt4hcq4F1OOmcXHCnh2/+uXB4IxEc5IXtQEuLv5xZRLeAxIahwqstF29RuoLzM8oIavnoPM0M4wtxs+cYgow8C1Q==; 24:8zLBs1T+eBLKi6hNLJUgusjmM4oG5XsBVvHd1IvWyngLvSKmfl8ndIKLCOMqmlLmwqGIjct5COA12K49sayun1cp/tN+dlOcS8f+WZOB9Iw=; 20:L3Ew4ZMO61jhmBJ7wKk7Y1d5xn7tjL8bdxfS+rGjzOEGEBRd85hQ4K9TahVvZ9bXNyxwfeEpm1MpEjmX8xmxIQ== x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(42134001)(42139001); SRVR:BY1PR03MB1434; by1pr03mb1434: X-MS-Exchange-Organization-RulesExecuted x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401001)(5005006)(3002001); SRVR:BY1PR03MB1434; BCL:0; PCL:0; RULEID:; SRVR:BY1PR03MB1434; x-forefront-prvs: 0636271852 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(979002)(6009001)(24454002)(377424004)(51704005)(13464003)(377454003)(54356999)(99286002)(86612001)(33656002)(76576001)(1720100001)(189998001)(86362001)(5002640100001)(92566002)(5003600100002)(77156002)(74316001)(2950100001)(122556002)(19580405001)(2900100001)(19580395003)(230673001)(40100003)(15975445007)(102836002)(5001960100002)(77096005)(62966003)(50986999)(5001770100001)(46102003)(76176999)(87936001)(2656002)(93886004)(66066001)(4477795004)(106116001)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1102; SCL:1; SRVR:BY1PR03MB1434; H:BY1PR03MB1434.namprd03.prod.outlook.com; FPR:; SPF:None; MLV:ovrnspm; PTR:InfoNoRecords; LANG:en; Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Jul 2015 08:06:01.2679 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY1PR03MB1434 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Jul 2015 08:06:11 -0000 We have root caused the problem. This issue happens on the Hyper-Vs on Wind= ows Server 2012 (Win 8.0) and earlier releases. On these releases, the UPD = checksum offloading on host side does not work properly. The workaround is = to disable UPD checksum offloading in the FreeBSD guest through 'ifconfig'.= We are also working on a patch to turn off UPD checksum offloading in the = netvsc driver when detecting the Hyper-V releases.=20 The UDP checksum offloading works fine on Windows Server 2012R2 and Win 8.1= hosts.=20 Thanks Pavel and Slawa for the support. Wei > -----Original Message----- > From: owner-freebsd-virtualization@freebsd.org [mailto:owner-freebsd- > virtualization@freebsd.org] On Behalf Of Pavel Timofeev > Sent: Wednesday, July 8, 2015 4:06 PM > To: Slawa Olhovchenkov > Cc: freebsd-current@freebsd.org; freebsd-virtualization@freebsd.org > Subject: Re: MS DNS doesn't answer to CURRENT under Hyper-V >=20 > Ok, r284746 is the root of the problem. MS DNS works under r284745 and > doesn't work under r284746. > Slawa, what should I look at in wireshark output? >=20 >=20 > 2015-07-07 18:49 GMT+03:00 Slawa Olhovchenkov : > > On Tue, Jul 07, 2015 at 06:04:46PM +0300, Pavel Timofeev wrote: > > > >> Well, turning off checksum offloading by `ifconfig hn0 -txcsum > >> -rxcsum` definitely helps. > >> > >> As for tcpdump I'm not completely sure if I did it right, but I see > >> "bad udp cksum" phrase: > >> > >> # tcpdump -i hn0 -vvv -nn udp dst port 53 > >> tcpdump: listening on hn0, link-type EN10MB (Ethernet), capture size > >> 262144 bytes > >> 18:01:19.139994 IP (tos 0x0, ttl 64, id 61218, offset 0, flags > >> [none], proto UDP (17), length 51) > >> 192.168.25.26.45683 > 192.168.25.3.53: [bad udp cksum 0xb39e -> > >> 0xf210!] 52886+ A? ya.ru. (23) > >> 18:01:24.140544 IP (tos 0x0, ttl 64, id 17293, offset 0, flags > >> [none], proto UDP (17), length 51) > >> 192.168.25.26.12575 > 192.168.25.3.53: [bad udp cksum 0xb39e -> > >> 0x7365!] 52886+ A? ya.ru. (23) > > > > tcpdump "bad udp cksum" is normal on FreeBSD host in case checksum > > offload (and may be need only for help finding issuse in code). Need > > wireshark capturing from MS DNS host (or from mirroring port). > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Mon Jul 13 08:13:11 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C69F399B828 for ; Mon, 13 Jul 2015 08:13:11 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-oi0-x234.google.com (mail-oi0-x234.google.com [IPv6:2607:f8b0:4003:c06::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8F8CC1055 for ; Mon, 13 Jul 2015 08:13:11 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by oiab3 with SMTP id b3so130427300oia.1 for ; Mon, 13 Jul 2015 01:13:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=pFMYeJwd8fqxWIcr/9g/6Dr/WVfjzHHZOHizZ6cd7q8=; b=hM9Z5x60ShdAJHV2G/a5zoj6Kqfu/GdWhOZWKL77lYwN8+iJan4mWKuXQmxsiVwtkw aenUBcc4qT9k466iheHvWDyV5LFx/WcUx4+usdeNmIE+RAITySuDBrZRYTJ1aiv2DA7a 3WVqWvDbKo92TRFO54qy31h/amobQA4nqg7rdy8rTuGbzB8poeOptSAJxq9i2QSZ7YHi Kfio6ta2kksUwHdPJxYs1FdnqHnH4cuCrUNZlI94lYE3mjEROecKLOfC0EVEYswG7x40 qLKarBF//7YCFQcA78/FrjwnZiHqsOjM/2NrnuI99Q2zPA617WR8DeaomIlvvZrvn/gr 7gcQ== MIME-Version: 1.0 X-Received: by 10.202.9.11 with SMTP id 11mr19587921oij.123.1436775190847; Mon, 13 Jul 2015 01:13:10 -0700 (PDT) Received: by 10.60.233.38 with HTTP; Mon, 13 Jul 2015 01:13:10 -0700 (PDT) Date: Mon, 13 Jul 2015 04:13:10 -0400 Message-ID: Subject: bhyve not working on a machine it used to work on From: Aryeh Friedman To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Jul 2015 08:13:11 -0000 I had to reinstall the OS on a AMD machine that had bhyve running under 11-CURRENT just fine but when I reinstalled I got "device not configured" on bhyveload.... do I need revert to r273375 or is there something else I need to to... ideally I would like to make it run 10.1-RELEASE with the correct patches to run RVI.... vmm, bridge, tap are all loaded -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Mon Jul 13 14:22:36 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94FF899963D for ; Mon, 13 Jul 2015 14:22:36 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) by mx1.freebsd.org (Postfix) with ESMTP id 68B091D2F for ; Mon, 13 Jul 2015 14:22:36 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (unknown [10.1.1.2]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 6E4849455 for ; Mon, 13 Jul 2015 14:22:29 +0000 (UTC) Message-ID: <55A3C9A6.7070107@freebsd.org> Date: Mon, 13 Jul 2015 10:22:30 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve not working on a machine it used to work on References: In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="CtMNxKGbJXL4KhIo2XxJcGEPXihlTknW1" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Jul 2015 14:22:36 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --CtMNxKGbJXL4KhIo2XxJcGEPXihlTknW1 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2015-07-13 04:13, Aryeh Friedman wrote: > I had to reinstall the OS on a AMD machine that had bhyve running under= > 11-CURRENT just fine but when I reinstalled I got "device not configure= d" > on bhyveload.... do I need revert to r273375 > > or is there something else I need to to... ideally I would like to make= it > run 10.1-RELEASE with the correct patches to run RVI.... vmm, bridge, t= ap > are all loaded >=20 Maybe you have a computer virus that is adding/replacing links in your email to paleodiet.com--health.tv --=20 Allan Jude --CtMNxKGbJXL4KhIo2XxJcGEPXihlTknW1 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJVo8mrAAoJEBmVNT4SmAt+QtIQAOfND53a7Lhsu75U+oE4G4Rj kXV+pI6QdhO9YK5c469/KAPbubR6eVW+h8II3L2oUztkFCJHzJLYUCfohYW/YGbT /OeNIfpYhJLR1e6PsGJMS/60rYiW1BmDrqsreKw8flAssl3KzLmzkOTuCnhv13Li yll5LCeg12WFZEzUZ2HjHyn96UeV4t5pYXf4Osfds7jmXYxeNnozzLhSH83TX9j/ 3qTxM6LESZLnxLdS6aynB+sX04luOA0zfcfELh4Xxne/MVHlhERDHex+0pZj77HG +Z5yq5RhIwscTHLiEZILceIgKNySmLQi+U0VtamZv6IUDes40W4FGmKY3py38sY6 mnA3sAMVe/K/1UImLtqTfHOFJyqwSA1LUZ6XVHw1xTq5V4Kd3A9xpT7aixjF/uAH YkSf+b7L6sjcjluRZZTtat0DdtTCL9yk/G+a58TP53Vc3JTN4MZMQdjdUrmXkrf3 B+BaDjDbUQsmeFhm0z9jEyNTgoDMRdmKdi1pX6CBwaG2MRYWaCihstcaC1RISgds o0dTo/7GcZ0KtMkHG5Wv8IVngO04iewe2WNDxZ/M93TpwlqFQcipvD81Ryz3F026 G+GzVBFBoYtOVk9QPeGYPnrM/xC4wgBHbm0CTbMuDC92BGyGP9+5LHhqCnUNE10T TX6uVYRJV/2/zq/dE3wB =3V9m -----END PGP SIGNATURE----- --CtMNxKGbJXL4KhIo2XxJcGEPXihlTknW1-- From owner-freebsd-virtualization@freebsd.org Tue Jul 14 08:34:07 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1B32699CE5D for ; Tue, 14 Jul 2015 08:34:07 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 3D6A4B17 for ; Tue, 14 Jul 2015 08:34:05 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id LAA08164 for ; Tue, 14 Jul 2015 11:34:03 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ZEvf8-0000I0-UG for freebsd-virtualization@freebsd.org; Tue, 14 Jul 2015 11:34:02 +0300 Message-ID: <55A4C942.8060007@FreeBSD.org> Date: Tue, 14 Jul 2015 11:33:06 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: bhyve vs host suspend/resume Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 08:34:07 -0000 Not sure if there is anything that bhyve can do about the following, but maybe it can. It seems that that after a host is suspended for several hours and resumed while a bhyve VM is running, then time counting becomes rather broken in the VM. With Linux VMs I observe that date(1) keeps reporting stale pre-suspend time and thread scheduling is broken, new processes can not be started, etc. -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Tue Jul 14 08:37:02 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3E31B99CED1 for ; Tue, 14 Jul 2015 08:37:02 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 5E980BBF for ; Tue, 14 Jul 2015 08:37:00 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id LAA08226 for ; Tue, 14 Jul 2015 11:36:59 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ZEvhz-0000IK-AS for freebsd-virtualization@freebsd.org; Tue, 14 Jul 2015 11:36:59 +0300 Message-ID: <55A4C9F3.9060003@FreeBSD.org> Date: Tue, 14 Jul 2015 11:36:03 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: bhyve vs signals Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 08:37:02 -0000 I couldn't find any information in bhyve(8) on how bhyve responds to various signals. It seems that at least SIGTERM is intercepted and translated to an ACPI power event. How about other signals? What's the best signal to use to kill a hung VM that can not be stopped gracefully? -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Tue Jul 14 09:33:43 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 57A6799CF66 for ; Tue, 14 Jul 2015 09:33:43 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 919C7E20 for ; Tue, 14 Jul 2015 09:33:42 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id MAA09092 for ; Tue, 14 Jul 2015 12:33:41 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ZEwaq-0000MT-Rn for freebsd-virtualization@freebsd.org; Tue, 14 Jul 2015 12:33:40 +0300 Message-ID: <55A4D73D.3000308@FreeBSD.org> Date: Tue, 14 Jul 2015 12:32:45 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: grub-bhyve: editing boot commands Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 09:33:43 -0000 In the grub-bhyve menu of boot entries I can press 'e' and enter a screen where I can modify boot commands for that entry. The screen has the following help information at the bootom: Minimum Emacs-like screen editing is supported. TAB lists completions. Press Ctrl-x or F10 to boot, Ctrl-c or F2 for a command-line or ESC to discard edits and return to the GRUB menu. I can make any edits in that screen, but of the mentioned key presses only TAB and ESC work as advertised. Ctrl-x, F10, Ctrl-c, F2 are all ignored. Is there a way to make them work? P.S. I tried running grub-bhyve in KDE's konsole and xterm. -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Tue Jul 14 13:56:30 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CBA4C99BE1F for ; Tue, 14 Jul 2015 13:56:30 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 100429FD for ; Tue, 14 Jul 2015 13:56:29 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id QAA12591; Tue, 14 Jul 2015 16:56:26 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ZF0h8-0000fW-Cw; Tue, 14 Jul 2015 16:56:26 +0300 Message-ID: <55A514D1.7040805@FreeBSD.org> Date: Tue, 14 Jul 2015 16:55:29 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: Re: bhyve: centos 7.1 with multiple virtual processors References: <5587EE05.2020001@FreeBSD.org> <558900A7.40609@FreeBSD.org> <55891335.5090403@FreeBSD.org> In-Reply-To: <55891335.5090403@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 13:56:30 -0000 On 23/06/2015 11:05, Andriy Gapon wrote: > On 23/06/2015 10:26, Neel Natu wrote: [snip] >> Does this ever happen with a single vcpu guest? > > Never seen the problem with a single CPU so far. > Also, never had that problem with FreeBSD guests. > >> The other mystery is the NMIs the host is receiving. I (re)verified to >> make sure that bhyve/vmm.ko do not assert NMIs so it has to be >> something else on the host that's doing it ... > > But the correlation with the multi-CPU non-FreeBSD guests seems to be significant. Today I've got another NMI with a Linux guest, but a few things were different: - the host was fresh after a reboot - the guest was single CPU - the NMI happened during boot up of the very first VM kernel: NMI ISA 2c, EISA ff kernel: NMI ... going to debugger Not what causes those NMIs but when they happen they always happen during a bhyve guest boot... -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Tue Jul 14 14:44:51 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 12C389A1FB1 for ; Tue, 14 Jul 2015 14:44:51 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by mx1.freebsd.org (Postfix) with ESMTP id C3BC9230 for ; Tue, 14 Jul 2015 14:44:50 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id ED88112774 for ; Wed, 15 Jul 2015 00:44:47 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id E87FB280F8B for ; Wed, 15 Jul 2015 00:44:47 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6Bw-qFmMqJco for ; Wed, 15 Jul 2015 00:44:47 +1000 (AEST) Received: from Peters-MacBook-Pro.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 26358280F57; Wed, 15 Jul 2015 00:44:45 +1000 (AEST) Message-ID: <55A5205D.3050202@freebsd.org> Date: Tue, 14 Jul 2015 07:44:45 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: Andriy Gapon CC: "freebsd-virtualization@freebsd.org" Subject: Re: grub-bhyve: editing boot commands References: <55A4D73D.3000308@FreeBSD.org> In-Reply-To: <55A4D73D.3000308@FreeBSD.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 14:44:51 -0000 Hi Andriy, > In the grub-bhyve menu of boot entries I can press 'e' and enter a screen where > I can modify boot commands for that entry. > The screen has the following help information at the bootom: > Minimum Emacs-like screen editing is supported. > TAB lists completions. > Press Ctrl-x or F10 to boot, Ctrl-c or F2 for a command-line > or ESC to discard edits and return to the GRUB menu. > > I can make any edits in that screen, but of the mentioned key presses only TAB > and ESC work as advertised. Ctrl-x, F10, Ctrl-c, F2 are all ignored. > Is there a way to make them work? > > P.S. I tried running grub-bhyve in KDE's konsole and xterm. I've never been able to get those to work. I suspect it's that the curses terminal code hasn't been exercised a lot. I'll have a look. later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Jul 14 18:17:38 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49B979A16A7 for ; Tue, 14 Jul 2015 18:17:38 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: from mail-wi0-x22d.google.com (mail-wi0-x22d.google.com [IPv6:2a00:1450:400c:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DABA1B4F; Tue, 14 Jul 2015 18:17:37 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: by widjy10 with SMTP id jy10so107091049wid.1; Tue, 14 Jul 2015 11:17:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=jWaT9JTDl1wS4ouTD2pMluevtQw2xYRPQlMQirflmlw=; b=NlN184YR8HLdoSKBYPnxwEZyIrnw5BIpY7eiBcQFAoqv+I2tndNE4enLFvwCu7Yd2P Xsxt1UrSWSDtopi0QKLMWN+Pnd9HVwe47hcwKJ5bpSlvOzyM/T+6QVExjQ5FQOWen38w oxDtylEqYRUEiM3H2uCNHHlwttP5QiCfyRCyV6i0fGsJ1UYjIsn0fLTiyvNO6mmFUD8B nM8EAwnM9sNCfSr4fkXS8T+ZgQgAy/tRBoVIz4+z2Wi4+VIs9XFf5tzpJoNtTcEJB640 ErEHxOEhCkul/E6fu7T7di/0bq6wI4icN01i5Rj6Wudf50imGdHe7FDaBMa3Qfv8g4Wt Qomw== MIME-Version: 1.0 X-Received: by 10.180.189.40 with SMTP id gf8mr8024116wic.32.1436897856218; Tue, 14 Jul 2015 11:17:36 -0700 (PDT) Received: by 10.27.214.139 with HTTP; Tue, 14 Jul 2015 11:17:36 -0700 (PDT) In-Reply-To: <55A4C9F3.9060003@FreeBSD.org> References: <55A4C9F3.9060003@FreeBSD.org> Date: Tue, 14 Jul 2015 11:17:36 -0700 Message-ID: Subject: Re: bhyve vs signals From: Neel Natu To: Andriy Gapon Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 18:17:38 -0000 Hi Andriy, On Tue, Jul 14, 2015 at 1:36 AM, Andriy Gapon wrote: > > I couldn't find any information in bhyve(8) on how bhyve responds to various > signals. It seems that at least SIGTERM is intercepted and translated to an > ACPI power event. How about other signals? What's the best signal to use to > kill a hung VM that can not be stopped gracefully? > 'bhyvectl --force-poweroff --vm=vmname' is a good way to forcibly kill a wedged VM. best Neel > -- > Andriy Gapon > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Wed Jul 15 07:02:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ECA329A2BAE for ; Wed, 15 Jul 2015 07:02:18 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: from mail-wg0-x22e.google.com (mail-wg0-x22e.google.com [IPv6:2a00:1450:400c:c00::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 87E4F1C66; Wed, 15 Jul 2015 07:02:18 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: by wgjx7 with SMTP id x7so25422307wgj.2; Wed, 15 Jul 2015 00:02:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=aJdGqZ8pMDuvzQEosCufAZsWd2zOotPAAe+R9HTllyY=; b=RCihH0N5Ks4+PlJbL1qi/lkM3xUWUmIO/7mFdeK80+wbyb0YhG6LQSrtLqkyBz4gfa 080tUfFK7sVV1zTfbXmTVK3IBGs/AKNW1XUYJ8U87XnL3sT7J9fJgyBFOiEZ8oyYgQJ/ ZbFVIBB8ZPh+r+eFdU/ZKlPaBcK7cL8PFQLsS/jIYix014k9VYkBtH6NdQK7tjOUMjHB oL9fVOHvkMGuzRtPBvDm4WgPkGQDlcU36RrRgQu1XpxX3sw2pJVKpECbYaHLfb/QQCYH ZwVn7OE6464xjxnzJU1SVpERkgaC4p0DFI7eTlJr9ZFVhFnH+AHSpgE5rNb0x9vrqmkz nkKA== MIME-Version: 1.0 X-Received: by 10.194.60.131 with SMTP id h3mr5161286wjr.156.1436943737092; Wed, 15 Jul 2015 00:02:17 -0700 (PDT) Received: by 10.27.214.139 with HTTP; Wed, 15 Jul 2015 00:02:17 -0700 (PDT) In-Reply-To: <55A514D1.7040805@FreeBSD.org> References: <5587EE05.2020001@FreeBSD.org> <558900A7.40609@FreeBSD.org> <55891335.5090403@FreeBSD.org> <55A514D1.7040805@FreeBSD.org> Date: Wed, 15 Jul 2015 00:02:17 -0700 Message-ID: Subject: Re: bhyve: centos 7.1 with multiple virtual processors From: Neel Natu To: Andriy Gapon Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Jul 2015 07:02:19 -0000 Hi Andriy, On Tue, Jul 14, 2015 at 6:55 AM, Andriy Gapon wrote: > On 23/06/2015 11:05, Andriy Gapon wrote: >> On 23/06/2015 10:26, Neel Natu wrote: > [snip] >>> Does this ever happen with a single vcpu guest? >> >> Never seen the problem with a single CPU so far. >> Also, never had that problem with FreeBSD guests. >> >>> The other mystery is the NMIs the host is receiving. I (re)verified to >>> make sure that bhyve/vmm.ko do not assert NMIs so it has to be >>> something else on the host that's doing it ... >> >> But the correlation with the multi-CPU non-FreeBSD guests seems to be significant. > > Today I've got another NMI with a Linux guest, but a few things were different: > - the host was fresh after a reboot > - the guest was single CPU > - the NMI happened during boot up of the very first VM > > kernel: NMI ISA 2c, EISA ff > kernel: NMI ... going to debugger > > Not what causes those NMIs but when they happen they always happen during a > bhyve guest boot... > Could you update the host with the following patch? https://people.freebsd.org/~neel/patches/ktr_stray_nmi.patch It enables KTR_GEN logging by default and turns it off when a VM-exit due to NMI is detected. If there is a pattern to the NMIs then it can be correlated with the guest activity around that time. best Neel > -- > Andriy Gapon From owner-freebsd-virtualization@freebsd.org Thu Jul 16 18:35:13 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 427C49A3F52 for ; Thu, 16 Jul 2015 18:35:13 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) by mx1.freebsd.org (Postfix) with ESMTP id 2AB951E7F for ; Thu, 16 Jul 2015 18:35:13 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by phabric-backend.isc.freebsd.org (Postfix, from userid 1346) id 294EDE707; Thu, 16 Jul 2015 18:35:13 +0000 (UTC) Date: Thu, 16 Jul 2015 18:35:13 +0000 To: freebsd-virtualization@freebsd.org From: "robak (Bartek Rutkowski)" Reply-to: D1944+333+b09c6235d993877b@FreeBSD.org Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <4fc9bbdb584a628336da60c50b312f67@localhost.localdomain> X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFWn+WE= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Jul 2015 18:35:13 -0000 robak added a comment. Is there any update on those fixes? REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, kristof, gnn, glebius, rodrigc Cc: julian, robak, freebsd-virtualization-list, freebsd-pf-list, freebsd-net-list From owner-freebsd-virtualization@freebsd.org Thu Jul 16 18:36:19 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1EDE19A30EC for ; Thu, 16 Jul 2015 18:36:19 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) by mx1.freebsd.org (Postfix) with ESMTP id 076B116DD for ; Thu, 16 Jul 2015 18:36:19 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by phabric-backend.isc.freebsd.org (Postfix, from userid 1346) id 03A6BE7DD; Thu, 16 Jul 2015 18:36:19 +0000 (UTC) Date: Thu, 16 Jul 2015 18:36:18 +0000 To: freebsd-virtualization@freebsd.org From: "robak (Bartek Rutkowski)" Reply-to: D1309+333+706359225b357843@FreeBSD.org Subject: [Differential] [Commented On] D1309: VIMAGE PF fixes #1 Message-ID: <3a8f5ec4bc8b7650da09ee797d8b4b03@localhost.localdomain> X-Priority: 3 Thread-Topic: D1309: VIMAGE PF fixes #1 X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NzA2ZjJlODRkOGZmNmYwM2M1MmQ1N2YzYTJkIFWn+aI= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Jul 2015 18:36:19 -0000 robak added a subscriber: robak. robak added a comment. Is there update to these fixes? REVISION DETAIL https://reviews.freebsd.org/D1309 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: rodrigc, glebius, trociny, zec, network, gnn, bz Cc: robak, emaste, freebsd-virtualization-list, freebsd-pf-list, freebsd-net-list