From owner-freebsd-virtualization@freebsd.org Sun Feb 25 13:14:05 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EB8C8F2E803 for ; Sun, 25 Feb 2018 13:14:04 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9D56E7CE16 for ; Sun, 25 Feb 2018 13:14:04 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id C468920988 for ; Sun, 25 Feb 2018 08:14:03 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Sun, 25 Feb 2018 08:14:03 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= content-type:date:from:message-id:mime-version:subject:to :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=ZYB51LpWX/zvUlQR9 OQyaD4ij/H0VtzfSlPFqqAJckQ=; b=EJViRH0i2wSYQyijMrbICum5dqZ8bd19m KlvYh7IE2k2m31Tqs9ReYzZoEYi41IRhrGZhU+unOhGfFWpEla8JLt4HjEV7j/dA bOFGm4FEQOTlJVcbJhj9ywuU+gJqFuS4RIXgf+fwOL8tHaOsn4JurKKIZhSs2Bcx sv2FtuzoRsQSF1USIEnkg12vGwqSOHXuXkn+iwLIaK4wzWpIlyF8z0WEOOxODQaY JS/2qCxI2am6rHrtrJdlMf+qc9oXvjnnoJm4rIUzxuG0HqxTt3wKOosQc0axBGx1 hhbrT/fEDHe7qvmxLic+6gr55mvOuBYs2p5rm3KsbMjvp0bVocmhg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s= fm2; bh=ZYB51LpWX/zvUlQR9OQyaD4ij/H0VtzfSlPFqqAJckQ=; b=L13+a9rV 9bzDJwx7aYYdtgOzkPmR8nfFds9hoWYnUaoj00olIDPA+H0L9D7RYh66FAKsRtIL asevbwafxoOKK9Nl1vr5uaV5ALHUvKUtGab0NJFzdvsCWBdPiBsGOMtpvFRlCxRE EVYDXvM0vUa5gH+HG2h/wd0j1lSxrI21G5A3on1s80KKK4G5+5JkMLBZLMa+DP5F A5NzhAPYKr4ETwaigOeVG01iKexeDo70bTQFN5yEiF9qOeQFQnwJfcX7NtKPunKZ CrtuOqLPeLhKRtxEFVB4Ye36d+W4yGrBwoLp6u2jt56LDsoZ2rgopqHL9UIyWHDz czX/aavSFxyfZg== X-ME-Sender: Received: from v007.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA id 4A179246A3 for ; Sun, 25 Feb 2018 08:14:03 -0500 (EST) Date: Sun, 25 Feb 2018 13:14:01 +0000 From: tech-lists To: freebsd-virtualization@freebsd.org Subject: bhyve manager Message-ID: <20180225131401.GA3138@v007.zyxst.net> Mail-Followup-To: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline User-Agent: Mutt/1.9.3 (2018-01-21) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 13:14:05 -0000 Hi, What do folks use for their bhyve guest management? I have always spun bhyve guests up by hand but now I'm considering streamlining the process. What do you use? thanks, -- J. From owner-freebsd-virtualization@freebsd.org Sun Feb 25 16:09:20 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 50B26F375DB for ; Sun, 25 Feb 2018 16:09:20 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:bb:dcff:fe50:d900]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "lerctr.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DF2708428E for ; Sun, 25 Feb 2018 16:09:19 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Content-transfer-encoding:Content-type:Mime-version:In-Reply-To: References:Message-ID:To:From:Subject:Date:Sender:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=D2AEY+dGVJF6bzpiI4dvOm1AQ1rJ1aBJdjXaC9nsFOs=; b=l8XSM8JsVxnu48LQGYKuwnJVeV 5YucC2owYYShJSy/aleOCqvNWM3z6IVZoOVKU9PC8UI0Eq2u4PuCkRWV080o9L93rqxH5zgiHUsph f3vHyajACZqI2nHeWFL9umrUfCYle6ugpMv2ozU4kIl1iLeVvN1nFBGDK4Ig//STtRpw=; Received: from [2600:1700:210:b18f:8015:ebb:1103:3269] (port=57251 helo=[192.168.200.244]) by thebighonker.lerctr.org with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.90_1 (FreeBSD)) (envelope-from ) id 1epyrW-000P4C-D8; Sun, 25 Feb 2018 10:09:18 -0600 User-Agent: Microsoft-MacOutlook/10.b.0.180223 Date: Sun, 25 Feb 2018 10:09:16 -0600 Subject: Re: bhyve manager From: Larry Rosenman To: tech-lists , Message-ID: <820B83AB-B2DB-4D5A-9455-BA478A4164A7@lerctr.org> Thread-Topic: bhyve manager References: <20180225131401.GA3138@v007.zyxst.net> In-Reply-To: <20180225131401.GA3138@v007.zyxst.net> Mime-version: 1.0 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: quoted-printable X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 16:09:20 -0000 I'm using sysutils/vm-bhyve=20 Very simple and works. --=20 Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 =EF=BB=BFOn 2/25/18, 9:34 AM, "tech-lists" wrote: Hi, =20 What do folks use for their bhyve guest management? =20 I have always spun bhyve guests up by hand but now I'm considering streamlining the process. What do you use? =20 thanks, --=20 J. _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" =20 From owner-freebsd-virtualization@freebsd.org Sun Feb 25 16:56:20 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA960F3A38E for ; Sun, 25 Feb 2018 16:56:20 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 33B4186B17 for ; Sun, 25 Feb 2018 16:56:19 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1PGuALC006098; Sun, 25 Feb 2018 08:56:10 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1PGu9gN006097; Sun, 25 Feb 2018 08:56:09 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802251656.w1PGu9gN006097@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve manager In-Reply-To: <20180225131401.GA3138@v007.zyxst.net> To: tech-lists Date: Sun, 25 Feb 2018 08:56:09 -0800 (PST) CC: freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 16:56:20 -0000 > Hi, > > What do folks use for their bhyve guest management? > > I have always spun bhyve guests up by hand but now I'm considering > streamlining the process. What do you use? Personally I use vm-byve with some local hacking on it to remove things like 16 character VM names and to allow me to set wired memory from the config file. Oh, and the CPU output column needs some hackery after my cpu topology changes as that field can become very wide. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Sun Feb 25 17:31:26 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B9715F02CD0 for ; Sun, 25 Feb 2018 17:31:26 +0000 (UTC) (envelope-from tommi.pernila@gmail.com) Received: from mail-qk0-f178.google.com (mail-qk0-f178.google.com [209.85.220.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 607F56842C for ; Sun, 25 Feb 2018 17:31:26 +0000 (UTC) (envelope-from tommi.pernila@gmail.com) Received: by mail-qk0-f178.google.com with SMTP id s198so16489188qke.5 for ; Sun, 25 Feb 2018 09:31:26 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=qTTZt0iwW5Rjwu2brXor+NNAaEmrFhkmB3MeHgJaxP0=; b=Pi09Rt6U5n4ADCSs7EHymvQjZ/pCPeADbgTKrwM4QZm6lMhVd50cfQEoKR7d3w1OAR cw2PPWDhpD2zHR50rlNImSK74AyCCZq5g3nVC44nfCdujyutDTIeoM2iA/6qn34obrDR lVX4AkaPK+bD457A1cpr37DoyzGDb9lhH2+9ubEe5iLJBs1nqiH3rRkFEXdI8mJ/2Y8P QwFhcynZf3HPIi5dNlyWC9TPtMxwQYYbheg/sHreHQSMp+dK/o3ya0Nqr9rNCQjn/NO2 KiI+6jo5s5y+96HB7WEI+BUBTUjMM/TwiUBRa1Pa3Hm5pO5SS5XDIa4RQAI2Rq5y2Kis lMrg== X-Gm-Message-State: APf1xPBcVJczzGIOPhSWcL73nBQgs7ney360KRRclrFGMZ4MLTcGhjA3 P0q0dxhIAaOwssSIaFVaMKt99MUEWiOvg9XX5jc= X-Google-Smtp-Source: AG47ELsd8/1+St8YL+RvdnJAULAadSHuEx/VB55K74HmBY6ZRn/2zaftrtFAb+H0pqg9JHqGRIu69xC2ODh88iuWMaA= X-Received: by 10.55.190.65 with SMTP id o62mr12661349qkf.349.1519579499730; Sun, 25 Feb 2018 09:24:59 -0800 (PST) MIME-Version: 1.0 References: <20180225131401.GA3138@v007.zyxst.net> <201802251656.w1PGu9gN006097@pdx.rh.CN85.dnsmgr.net> In-Reply-To: <201802251656.w1PGu9gN006097@pdx.rh.CN85.dnsmgr.net> From: Tommi Pernila Date: Sun, 25 Feb 2018 17:24:49 +0000 Message-ID: Subject: Re: bhyve manager To: "Rodney W. Grimes" Cc: freebsd-virtualization@freebsd.org, tech-lists Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 17:31:27 -0000 Hi, been happy with sysutils/iohyve https://github.com/pr1ntf/iohyve/blob/master/README.md -T On Sun, 25 Feb 2018 at 19.18, Rodney W. Grimes < freebsd-rwg@pdx.rh.cn85.dnsmgr.net> wrote: > > Hi, > > > > What do folks use for their bhyve guest management? > > > > I have always spun bhyve guests up by hand but now I'm considering > > streamlining the process. What do you use? > > Personally I use vm-byve with some local hacking on it to remove things > like 16 character VM names and to allow me to set wired memory from > the config file. Oh, and the CPU output column needs some hackery > after my cpu topology changes as that field can become very wide. > > -- > Rod Grimes > rgrimes@freebsd.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Sun Feb 25 17:51:45 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2D41EF0617A for ; Sun, 25 Feb 2018 17:51:45 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 95B4D6940B for ; Sun, 25 Feb 2018 17:51:44 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 2210E20B57B3 for ; Mon, 26 Feb 2018 03:51:42 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 132C82820A6 for ; Mon, 26 Feb 2018 03:51:42 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id fxxDD7r34RPz for ; Mon, 26 Feb 2018 03:51:41 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 8FB05280502; Mon, 26 Feb 2018 03:51:39 +1000 (AEST) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) To: Mike Tancsa Cc: Nimrod Levy , "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> From: Peter Grehan Message-ID: <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> Date: Sun, 25 Feb 2018 09:51:37 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=Op4juWPpsa0A:10 a=tJ_7W1keeuu5JoBnH9wA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 17:51:45 -0000 Hi Mike, (moving this to -virtualization) > Actually I can confirm the same sort of hard lockup happens on my Epyc > board with RELENG11. It also happens in current. I will file a PR and > post on freebsd-current in case someone has any suggestions on how to > try and figure out whats going on. I could reproduce this on a Ryzen 1700 with HT enabled - it took ~700 seconds, and the entire machine locked up. An interesting point is a single VM was able to run to completion. I'll keep testing with various combinations of numbers of VMs, different vCPUs per VM, and pinning guest vCPUs. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Feb 25 20:38:30 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B30D6F26F6C for ; Sun, 25 Feb 2018 20:38:30 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4439C6F824 for ; Sun, 25 Feb 2018 20:38:30 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from [IPv6:2001:559:8000:c9:8cdd:d289:bd04:a689] (unknown [IPv6:2001:559:8000:c9:8cdd:d289:bd04:a689]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id A30067594B; Sun, 25 Feb 2018 20:38:21 +0000 (UTC) Message-ID: <5A931EBC.60205@redbarn.org> Date: Sun, 25 Feb 2018 12:38:20 -0800 From: Paul Vixie User-Agent: Postbox 5.0.22 (Windows/20171208) MIME-Version: 1.0 To: Tommi Pernila CC: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org Subject: Re: bhyve manager References: <20180225131401.GA3138@v007.zyxst.net> <201802251656.w1PGu9gN006097@pdx.rh.CN85.dnsmgr.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 20:38:30 -0000 Tommi Pernila wrote: > Hi, > > been happy with sysutils/iohyve > https://github.com/pr1ntf/iohyve/blob/master/README.md is there a way to integrate it with sysutils/rtty, so that there is a console log, and so multiple people can attach to the same console? right now i do my bhyving with a small collection of shell scripts. but i would switch to iohyve if possible. (i just can't use "libvirt".) -- P Vixie From owner-freebsd-virtualization@freebsd.org Sun Feb 25 21:01:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 24E9BF2874B for ; Sun, 25 Feb 2018 21:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C1E170704 for ; Sun, 25 Feb 2018 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9D15623453 for ; Sun, 25 Feb 2018 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1PL0wVG001114 for ; Sun, 25 Feb 2018 21:00:58 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1PL0wob001102 for freebsd-virtualization@FreeBSD.org; Sun, 25 Feb 2018 21:00:58 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201802252100.w1PL0wob001102@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-virtualization@FreeBSD.org Subject: Problem reports for freebsd-virtualization@FreeBSD.org that need special attention Date: Sun, 25 Feb 2018 21:00:58 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 21:01:00 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 212820 | FreeBSD 10-STABLE from latest HEAD and 11-RELEASE 1 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Sun Feb 25 21:04:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A72ACF29014 for ; Sun, 25 Feb 2018 21:04:18 +0000 (UTC) (envelope-from lcraft@gmail.com) Received: from mail-io0-x231.google.com (mail-io0-x231.google.com [IPv6:2607:f8b0:4001:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4364970DC9 for ; Sun, 25 Feb 2018 21:04:18 +0000 (UTC) (envelope-from lcraft@gmail.com) Received: by mail-io0-x231.google.com with SMTP id e30so4581425ioc.3 for ; Sun, 25 Feb 2018 13:04:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=yh8ZQZBUVBN+GJR3XmP/19Vbnen2yOAi+lQvO8f+ggM=; b=l8Snh9z5il8oelmlAr3bPDaHvvEC+QYDygJftNMnBMQGCPiie/cz6wTidL7FhkbrsF ctB1ds5kTsp9OIgUn6u0Erm4L4XWX6EJCrgMXHThyZTHqZrJ60lEriAhVFULnOTEn0tR UbXV2wzTOvHg9qV/OJLsBbtMk2mJ7gAAvFLpCEtRhFC6yz8oNGnKtOTl2/gOv33yGUl3 WSyAZIqQU662H6v2WoKAIH7mZzGCK+NNmIwb93K7gSUu4YIweXmopNd6tJhR0ZBTNMLa dz0za9y1vx8UYx3RDnavFwEGDENvKQ/JEgnniyHeGwkcCGOEdc5vN7j5ge4RGP+vdcxO hbQA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=yh8ZQZBUVBN+GJR3XmP/19Vbnen2yOAi+lQvO8f+ggM=; b=f01XUFVybuhAUcCuFs9Ib7Cm343yqr+VndSmFw+Zkn7SM+z8WB5ntbcWj7ig8ZW2jW IT+UdUdjqMmr+j/DmvhDhdOYYMU1DElQ2k0zL3QgMFXWIboAZb1iYHpJqupbMRujeEaN 4R6cZoOlt794KHCRYBJrtT9OQ/liaHWGO348cwYB7dwnLqWOUvocaMqVnX25jKuhP2Kl p9iIB+lTLvLU/w0NNqBThzsMoDmpwLiiJ3JXmu2ClY1Kdcu+xRFxQlqJgmwh5w7E6FpG 4XjLEXEpJLOLsO9Z/w4BB4GMx3G+e/niP2dvfMv2Lo2qRWeqhCnHyPbFcCEeo5t20lWs hV2g== X-Gm-Message-State: APf1xPBzoKepKrEtHJ/eAAWcWOPm5bfOiPqMWH4CdqpzBZ1TvPzDwD+z XSmyVcU/VQoBEF4HLkr02V38mlWM X-Google-Smtp-Source: AG47ELutmEfb+1E9tPr9wXcxgoy2Zssi2XXRZUeSzJP+dRY5dQoEiaWYE8/CJCdFiPRPMy+RRKY9WA== X-Received: by 10.107.141.194 with SMTP id p185mr9518166iod.204.1519592657617; Sun, 25 Feb 2018 13:04:17 -0800 (PST) Received: from [192.168.1.137] ([63.150.218.60]) by smtp.gmail.com with ESMTPSA id k73sm3428579ioi.83.2018.02.25.13.04.16 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 25 Feb 2018 13:04:16 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: bhyve manager From: Loyd Craft In-Reply-To: <820B83AB-B2DB-4D5A-9455-BA478A4164A7@lerctr.org> Date: Sun, 25 Feb 2018 16:04:15 -0500 Cc: tech-lists , freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <915489B0-56C4-4EA9-8BE7-7428F5493FC4@gmail.com> References: <20180225131401.GA3138@v007.zyxst.net> <820B83AB-B2DB-4D5A-9455-BA478A4164A7@lerctr.org> To: Larry Rosenman X-Mailer: Apple Mail (2.3445.5.20) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 21:04:18 -0000 I=E2=80=99m a big fan of chyves.. > On Feb 25, 2018, at 11:09 AM, Larry Rosenman wrote: >=20 > I'm using sysutils/vm-bhyve=20 >=20 > Very simple and works. >=20 >=20 > --=20 > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 E-Mail: ler@lerctr.org > US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 >=20 > =EF=BB=BFOn 2/25/18, 9:34 AM, "tech-lists" = wrote: >=20 > Hi, >=20 > What do folks use for their bhyve guest management? >=20 > I have always spun bhyve guests up by hand but now I'm considering > streamlining the process. What do you use? >=20 > thanks, > --=20 > J. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" >=20 >=20 >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Sun Feb 25 23:10:02 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1962CF314C2 for ; Sun, 25 Feb 2018 23:10:02 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 909FA759F7 for ; Sun, 25 Feb 2018 23:10:01 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1PN9v2S007395; Sun, 25 Feb 2018 15:09:57 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1PN9txx007394; Sun, 25 Feb 2018 15:09:55 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802252309.w1PN9txx007394@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve manager In-Reply-To: <5A931EBC.60205@redbarn.org> To: Paul Vixie Date: Sun, 25 Feb 2018 15:09:55 -0800 (PST) CC: Tommi Pernila , freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Feb 2018 23:10:02 -0000 > > > Tommi Pernila wrote: > > Hi, > > > > been happy with sysutils/iohyve > > https://github.com/pr1ntf/iohyve/blob/master/README.md > > is there a way to integrate it with sysutils/rtty, so that there is a > console log, and so multiple people can attach to the same console? > > right now i do my bhyving with a small collection of shell scripts. but > i would switch to iohyve if possible. (i just can't use "libvirt".) I believe that sysutils/vm-bhyve supports tmux as a console option, that might get you close to what you want. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Mon Feb 26 00:06:52 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38FCBF34F02 for ; Mon, 26 Feb 2018 00:06:52 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CA38278285 for ; Mon, 26 Feb 2018 00:06:51 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from [IPv6:2001:559:8000:c9:dc3:59e3:1fa5:69dc] (unknown [IPv6:2001:559:8000:c9:dc3:59e3:1fa5:69dc]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id C65947594B; Mon, 26 Feb 2018 00:06:50 +0000 (UTC) Message-ID: <5A934F9A.7020302@redbarn.org> Date: Sun, 25 Feb 2018 16:06:50 -0800 From: Paul Vixie User-Agent: Postbox 5.0.22 (Windows/20171208) MIME-Version: 1.0 To: "Rodney W. Grimes" CC: Tommi Pernila , freebsd-virtualization@freebsd.org Subject: Re: bhyve manager References: <201802252309.w1PN9txx007394@pdx.rh.CN85.dnsmgr.net> In-Reply-To: <201802252309.w1PN9txx007394@pdx.rh.CN85.dnsmgr.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 00:06:52 -0000 Rodney W. Grimes wrote: > I believe that sysutils/vm-bhyve supports tmux as a console option, > that might get you close to what you want. i'll check it out. i should have popularized rtty more than i have. i don't believe that tmux has logging. -- P Vixie From owner-freebsd-virtualization@freebsd.org Mon Feb 26 00:13:53 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA4DCF3576A for ; Mon, 26 Feb 2018 00:13:53 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-wm0-x22f.google.com (mail-wm0-x22f.google.com [IPv6:2a00:1450:400c:c09::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 28D3078732 for ; Mon, 26 Feb 2018 00:13:52 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-wm0-x22f.google.com with SMTP id t6so5677521wmt.5 for ; Sun, 25 Feb 2018 16:13:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=tcCTebkLndtzzsxzzSrAuMpP2MsoOGJHLSfDIoiLK6I=; b=IO3QknOWycxcN5kR7D1BWvgWF1uAa9ranNlitKLEov0qvQbWaLFQ2Q8mMcOdYZ/v/L IqfWw6yNbp75gkYX5l6OUxg38QqX6bCfO/AqaEkrV0mYAB/EjTA0Tk7kIEM8ZB+Yr1go o0Ecor2mmNiMq0iPmqGcLTz80aFiDEOScGqUOtwcyTP9j4x2IKmQYpZfpYGWpRPHAuwU q6YYNe0lMuf63IdeHHTe2zhb94ERtbJfWSdS2BTQdcfPm8nnmP8alCvJ8GgwB6lE4YKf ZGVIHtVsz/i3bxFK6P8/pJAX4NSz8LlKw8gaV9h1meySi56xH0qzKHyptwVLEKep81Ae oOrQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=tcCTebkLndtzzsxzzSrAuMpP2MsoOGJHLSfDIoiLK6I=; b=hCilnZg957lxc64I3do3SZ7aRcE5AVV7M4quoBQiW6T4PBAfkATWFUC2IHYInpEGrf Zoh7WkXmLe0sNYT9Ee4o2EMYOY5OkRy3RBEBWCSCApDD0tGVKL2NdtVjhSIOhgI0fiK7 5YzPqIL2ebjF7rd+/waaOk577pRRFw5P9zi+Sx4VYGbK/2fwPPKb1UN857M/tY/hrae4 NBz0ySLk222SN1LMx9nfqhf2PZ9XoTdTPQP+nTtregXzw8h/SIMS1oMpGvYNNOCySyBd R5gJ5LpV6IK5MY3X19OjSo1ylm9n+mvA+bZFvfp0xO9U+ZPyEMLR0skKIfql6mHRIEsE aSbQ== X-Gm-Message-State: APf1xPAvOWRTq5ys2/wUnOFk8cpGcopqr5JPL91GfuDC20/4aZwSB21J fbVNxQUhUC1jxgsAeRalSnOUJZI/VVk= X-Google-Smtp-Source: AH8x225O65uIJLjBEzXe6sYxhN2DKxeWRY8ivzlpSIl3PkKvM1DO7HD3yeUlFdIi4QzFLqQPgQpCvw== X-Received: by 10.80.173.10 with SMTP id y10mr11972520edc.247.1519604030758; Sun, 25 Feb 2018 16:13:50 -0800 (PST) Received: from mutt-hbsd ([93.174.93.71]) by smtp.gmail.com with ESMTPSA id l60sm6228169edl.56.2018.02.25.16.13.47 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 25 Feb 2018 16:13:49 -0800 (PST) Date: Sun, 25 Feb 2018 19:13:27 -0500 From: Shawn Webb To: Paul Vixie Cc: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org Subject: Re: bhyve manager Message-ID: <20180226001327.6u2z6oasohgy6vkq@mutt-hbsd> References: <201802252309.w1PN9txx007394@pdx.rh.CN85.dnsmgr.net> <5A934F9A.7020302@redbarn.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="723qnemt3pba35he" Content-Disposition: inline In-Reply-To: <5A934F9A.7020302@redbarn.org> X-Operating-System: FreeBSD mutt-hbsd 12.0-CURRENT FreeBSD 12.0-CURRENT X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: NeoMutt/20171215 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 00:13:54 -0000 --723qnemt3pba35he Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Feb 25, 2018 at 04:06:50PM -0800, Paul Vixie wrote: >=20 >=20 > Rodney W. Grimes wrote: > > I believe that sysutils/vm-bhyve supports tmux as a console option, > > that might get you close to what you want. >=20 > i'll check it out. i should have popularized rtty more than i have. i don= 't > believe that tmux has logging. tmux supports logging. I've used it before to help document some setups I've done for clients. Take a look at my .tmux.conf[1] to find out how to do it: [1]: https://github.com/lattera/dotfiles/blob/master/.tmux.conf Thanks, --=20 Shawn Webb Cofounder and Security Engineer HardenedBSD Tor-ified Signal: +1 443-546-8752 GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --723qnemt3pba35he Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEKrq2ve9q9Ia+iT2eaoRlj1JFbu4FAlqTUSQACgkQaoRlj1JF bu52fg//cuDQauKsReBzXqTy8tzUkk80eeenOLcX454CctdKrPJUex2FmlORSMUf p2QTFna3dGzTS8U13uVs1lCRUZN3SMmIP2BQuYu3OtSVYI/2a65R4SuAbUtalZmn j5KfYhNJk6MuqQX63Nu/79eow4kw3L5Gwo+QRN6HuVQEVlYGXGndnrvZNK3h5k0C P+ry0OXFsiG9OYfL4jB1oiW4wcDfiGXdRXErN+kC9d59waA+IjOxPly2ME1z70cW shdohIKk8iLmyPdMnQBbowJFIL/qISUwhlfpECPsV6eMqOyAjFbARsqFWCM+xbhd Bu83coONX1kRUYz9ztWrXS0l/TCPiWVqHVlghAOTyVm9rEWBw/vLuh2jjaCC/04d uAdfIHAlV5L9sEMrMakanUVm4336wCrM+EE+LQ1edpfoGBz3ny1jsWeIulwYu/tg 1Mv7qbsMHwsPZzi7FUVTB7enQnsEXrf4ZwwA49R/dONt74lQIcpty4ZSOFE9q3jq 669tPJhv1ZK2ZxiQVDxXNo7h49jH65pQYGh+FPO6tSejqvsOOOrn6uStXeYzMzZm qrfFicmkMCMgivdEgIbjd1Eck9X6NQNd2iA6IlFlzKFO3jJG544qj2f9FLsplSXW PzlnoOLFqnFUf3JtJBTuFLSXV2kk8EPcIu5PljFsofxTgn8QNYY= =IyF5 -----END PGP SIGNATURE----- --723qnemt3pba35he-- From owner-freebsd-virtualization@freebsd.org Mon Feb 26 00:50:08 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 501DDF377F5 for ; Mon, 26 Feb 2018 00:50:08 +0000 (UTC) (envelope-from kiri@kx.openedu.org) Received: from kx.openedu.org (flets-sg1027.kamome.or.jp [202.216.24.27]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 970D679880 for ; Mon, 26 Feb 2018 00:50:06 +0000 (UTC) (envelope-from kiri@kx.openedu.org) Received: from kx.openedu.org (kx.openedu.org [202.216.24.27]) by kx.openedu.org (8.14.5/8.14.5) with ESMTP id w1Q0o1QE093429; Mon, 26 Feb 2018 09:50:02 +0900 (JST) (envelope-from kiri@kx.openedu.org) Message-Id: <201802260050.w1Q0o1QE093429@kx.openedu.org> Date: Mon, 26 Feb 2018 09:50:01 +0900 From: KIRIYAMA Kazuhiko To: "Rodney W. Grimes" Cc: tech-lists , freebsd-virtualization@freebsd.org Subject: Re: bhyve manager In-Reply-To: <201802251656.w1PGu9gN006097@pdx.rh.CN85.dnsmgr.net> References: <20180225131401.GA3138@v007.zyxst.net> <201802251656.w1PGu9gN006097@pdx.rh.CN85.dnsmgr.net> User-Agent: Wanderlust/2.14.0 (Africa) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.6 MULE XEmacs/21.4 (patch 22) (Instant Classic) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 00:50:08 -0000 At Sun, 25 Feb 2018 08:56:09 -0800 (PST), Rodney W. Grimes wrote: > > > Hi, > > > > What do folks use for their bhyve guest management? > > > > I have always spun bhyve guests up by hand but now I'm considering > > streamlining the process. What do you use? > > Personally I use vm-byve with some local hacking on it to remove things MeToo :) vm-bhyve is very simple and intuitive and also easy to modify. I've modified sevral parts as follows: (1) vm image name could be included blanks (2) can be treat with *.img images (3) add force options for destroy or rename I've created vm-bhyve-devel port including above diffs and it's tarball and package were up at [1] and [2]. [1] http://ds.truefc.org/~kiri/freebsd/ports/vm-bhyve-1.2b.tar.gz[ [2] http://ds.truefc.org/~kiri/freebsd/packages/vm-bhyve-devel-1.2b.txz > like 16 character VM names and to allow me to set wired memory from > the config file. Oh, and the CPU output column needs some hackery > after my cpu topology changes as that field can become very wide. > > -- > Rod Grimes rgrimes@freebsd.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > --- KIRIYAMA Kazuhiko From owner-freebsd-virtualization@freebsd.org Mon Feb 26 01:38:23 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B986CF3A45D for ; Mon, 26 Feb 2018 01:38:23 +0000 (UTC) (envelope-from fabian.freyer@physik.tu-berlin.de) Received: from mail.physik.tu-berlin.de (mail.physik-pool.tu-berlin.de [130.149.50.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 582137AED6 for ; Mon, 26 Feb 2018 01:38:22 +0000 (UTC) (envelope-from fabian.freyer@physik.tu-berlin.de) Received: from [192.168.119.1] (ip5f5bd553.dynamic.kabel-deutschland.de [95.91.213.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.physik.tu-berlin.de (Postfix) with ESMTPSA id 06EF561F9B for ; Mon, 26 Feb 2018 01:38:14 +0000 (UTC) From: "Fabian Freyer" To: freebsd-virtualization@freebsd.org Subject: bhyve and mmap(2) Date: Mon, 26 Feb 2018 02:38:13 +0100 X-Mailer: MailMate (1.10r5443) Message-ID: <0001CF7F-66BC-451E-9C86-03C50471F23D@physik.tu-berlin.de> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=_MailMate_67B14867-574A-4859-BB7B-D040D915B850_="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 01:38:23 -0000 This is an OpenPGP/MIME signed message (RFC 3156 and 4880). --=_MailMate_67B14867-574A-4859-BB7B-D040D915B850_= Content-Type: text/plain; markup=markdown Content-Transfer-Encoding: quoted-printable Hi! Would be possible to use mmap(2) around libvmmapi to map a file (MAP_PRIV= ATE) and or shared memory segments (MAP_SHARED) into guest physical addre= ss space? Fabian --=_MailMate_67B14867-574A-4859-BB7B-D040D915B850_= Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iQJWBAEBCgBAFiEEX6JoxdmEemcFacQZmealkcs85+YFAlqTZQUiHGZhYmlhbi5m cmV5ZXJAcGh5c2lrLnR1LWJlcmxpbi5kZQAKCRCZ5qWRyzzn5s03EACYhnfJyXBC 7jieEPReEdX4UGcYPFnseTgAnqo/XCq1Ikg5itABoD3cG0mCnTBfvJK3bA+Y7nhL fz4JV5JRrDszFOukRZpdukvRkIJ6BT+mhaKExn4dqZ4bInfvEedJ5ejP1YWXCBT7 mxmjAQoCduIfT/tibW2WdpXWRKKRyMcBO2XSUAjarXvUqLUCDkF4rSynIVkdWqRz x4LpVR3h9HS21NUy9Bp7n/q71j1C5EI/SsXqGoZ0e/myIJlx5mXZSJpFeK3n8qEi 5rBTxkBhbIjFOVU7qdqP0S6J90WCs/PGERTl4fzxyCPKDwaVbIjVCa00/Rfo/Gc9 Zll/oXhsJJdHQoLJLuXrL9UyYTAR3nMAS/WL6/4mRfF8kuFOWFqw1s5/shYKQurE 7rzh/hpPUq4FcrZoSVUKH4OoYUQuL2mT+FGAIVQq/y33pvR8dZc6lfzTz7a7tIEI REj18zMSAD9flDo14Ois7VQmwUGEvOqMwRDnFeEsNRS1+bdVHV0moTya8fmwnlDd nS1fp3CyIouA09kf1ywLUKmpP0KlFDOLnen4JeAynBRp8x0UILTB0QysAzr9Ew7F rI9uIG8f5GiIqjl/cEp3lgFlNYHjb493CnquueKChL+7ZI2hgUGL/1CrPiMMx0Gz fODqrocs+PipX5gxA2YUTHTkbiALHNaVqw== =w0LL -----END PGP SIGNATURE----- --=_MailMate_67B14867-574A-4859-BB7B-D040D915B850_=-- From owner-freebsd-virtualization@freebsd.org Mon Feb 26 01:50:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4D7B9F03148 for ; Mon, 26 Feb 2018 01:50:31 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-it0-x230.google.com (mail-it0-x230.google.com [IPv6:2607:f8b0:4001:c0b::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C60987B59C for ; Mon, 26 Feb 2018 01:50:30 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-it0-x230.google.com with SMTP id v186so9167695itc.5 for ; Sun, 25 Feb 2018 17:50:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to; bh=DipmDMatvmQ7SvJzSRa+gHr5uDBqVhqjOqapzif6OdM=; b=DVlBkADr3intSzSweDsGA0zqhw15EwDU1E+qNWDTmCFZRmcKBnlMAE5O0PJCIw/FyS pE8CUhwETnyylhkJ0tvuhBvDoiKo76yjfbFEzwa97keuNXyxsY45G2S2mOUmDqmALAYk sD5D2KTgDzh2XPo9RLv36nRwNo8D7F0mO06yWQgU4iJvd6izIlAZGxeJ0QBq7sTWA17L vHnEAeQCp/VIGfghfLF4+PWvucEe5WN75r2GnxT0efYx4Q2bPQgjsW19vQqu4SEPrhEP 9I6178gRhQyOp4tpTxEQlKen99NRDET8uqA1enQoRxqK9zjNK5Cfu/VdPoMt4k2ERTjH B88Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to; bh=DipmDMatvmQ7SvJzSRa+gHr5uDBqVhqjOqapzif6OdM=; b=oB0P2LqIiQOjWxzUO/9soIEkoWahEpytqiDhYy70XvfX2cncYJtS7NUJCrYVH+BCFo VT+2NHZWS3Q9dag8oyF8OkUfmZ2h0gjzkIOkbSkZD67oNBEbDCcUI2pwCDQZ0cMwlsux 4BavUiDcb0oiHt8AJ2xr2VFRnAtvxPDPnkjVrV+POIrIj/rqNIwv91i//0/NhGQBCAU4 AorOFbKLUgFYG68C1GZVnxvmxN06QHj6LLnvxwRd1q7uo4C1a5r5VyTpaebU6LtLqjhQ tUGxdFV51cZj/8pDVF309skW9iei+kFl9JzbXWyFVwnW9E82OR/WRtkRkvQTsA7qGHPg OYVA== X-Gm-Message-State: APf1xPD6H6CsSLJ6KVyI5sHoY/XCEnYYnPr826R79I6ZTsfOvPhFo4/A S4q/5USdlUUXGEPKDQup6w9CSqbClQzt/u22aSVquQ== X-Google-Smtp-Source: AH8x227bFhjjsdgUkUrsfh3ctbGaefFQ2Fl9Un/rj/Kjx2b9k2qbpkJrSkQSUwxxjVozYN8sO7/n4D7At+/fnz5QxHY= X-Received: by 10.36.112.196 with SMTP id f187mr10481624itc.122.1519609830169; Sun, 25 Feb 2018 17:50:30 -0800 (PST) MIME-Version: 1.0 Sender: jtubnor@gmail.com Received: by 10.2.177.28 with HTTP; Sun, 25 Feb 2018 17:50:09 -0800 (PST) In-Reply-To: <20180225131401.GA3138@v007.zyxst.net> References: <20180225131401.GA3138@v007.zyxst.net> From: Jason Tubnor Date: Mon, 26 Feb 2018 12:50:09 +1100 X-Google-Sender-Auth: nrgkpVx_IP6_Co_FwHAQgiQaJP4 Message-ID: Subject: Re: bhyve manager To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 01:50:31 -0000 On 26 February 2018 at 00:14, tech-lists wrote: > Hi, > > What do folks use for their bhyve guest management? > > I have always spun bhyve guests up by hand but now I'm considering > streamlining the process. What do you use? > > We were using chyves with ugly hacks to play nice with supported versions of OpenBSD but based on this, it was only a temporary measure to get kit out into the field. We are now using vm-bhyve with full UEFI guests including OpenBSD/UEFI and Windows Server 2016 as no ugly hacks are required for whatever version of OpenBSD you need to use. vm-bhyve is more light weight and doesn't create endless mount points like iohyve and chyves does. Jason. From owner-freebsd-virtualization@freebsd.org Mon Feb 26 06:32:05 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 18CFAF2EACB for ; Mon, 26 Feb 2018 06:32:05 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv189.fwdcdn.com (frv189.fwdcdn.com [212.42.77.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AA7AB85A01 for ; Mon, 26 Feb 2018 06:32:04 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv197.fwdcdn.com ([212.42.77.197]) by frv189.fwdcdn.com with esmtp ID 1eqC1h-0007m8-2s for freebsd-virtualization@freebsd.org; Mon, 26 Feb 2018 08:12:41 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Type:MIME-Version:Message-Id:To:Subject:From:Date:Sender: Reply-To:Cc:Content-Transfer-Encoding:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=XJi3/nSqnPLiPErM1Wa/JZAr2C1CDtQhE8MtzbiZXw8=; b=TnT/2xXvKRYMY9+lDEcUkLmRxs iw1ZDDARkdRhMrrivYmm+ic59ZpZ06tm9AWsm4mLsKRjUcTG/K/tp9xz0fg0RPZPQsE9L8MAvQ7t3 DRAeSv1OTCqghP9QM1QXmkIlFVlHGJWVW74WABYxuINwU+1DbNYRXCCzNGHSSEGv5dTM=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1eqC1Z-0007h1-Bs for freebsd-virtualization@freebsd.org; Mon, 26 Feb 2018 08:12:33 +0200 Date: Mon, 26 Feb 2018 08:12:33 +0200 From: wishmaster Subject: Migrate from real server to virtual To: "freebsd-virtualization@freebsd.org" X-Mailer: mail.ukr.net 5.0 Message-Id: <1519624732.983711988.ao3r3oq0@frv52.fwdcdn.com> Received: from artemrts@ukr.net by frv52.fwdcdn.com; Mon, 26 Feb 2018 08:12:33 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 06:32:05 -0000 Hi, colleagues. There is a server running with Windows Server 2008 R2 and I am attempting launch this server in virtual environment as a back up. But there is one big problem - I can not shutdown this server. My first step was creating a VHD image with help of Disk2vhd. Then a converted this image from VHD to raw image with qemu. I don't know boot setting of BIOS. With this command I am unable to start the server. bhyve -c 2 -s 0,hostbridge -s 3,ahci-hd,/vm/img/disk1.raw -s 4,ahci-cd,/VM/distro/null.iso -s 10,virtio-net,tap1 -s 20,fbuf,tcp=192.168.0.254:5900,w=800,h=600,wait -s 21,lpc -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 6G -H -w windows2 Boot Filed. UEFI Hard Drive Any ideas? -- Vitaly From owner-freebsd-virtualization@freebsd.org Mon Feb 26 09:09:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E8D6DF369B8 for ; Mon, 26 Feb 2018 09:09:13 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6C4E26B377 for ; Mon, 26 Feb 2018 09:09:13 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w1Q99BhO088865 for ; Mon, 26 Feb 2018 10:09:11 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 0AAFDB55; Mon, 26 Feb 2018 10:09:10 +0100 (CET) Message-ID: <5A93CEB6.1080406@omnilan.de> Date: Mon, 26 Feb 2018 10:09:10 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve manager References: <20180225131401.GA3138@v007.zyxst.net> In-Reply-To: <20180225131401.GA3138@v007.zyxst.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Mon, 26 Feb 2018 10:09:11 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 09:09:14 -0000 Bezüglich tech-lists's Nachricht vom 25.02.2018 14:14 (localtime): > Hi, > > What do folks use for their bhyve guest management? > > I have always spun bhyve guests up by hand but now I'm considering > streamlining the process. What do you use? Just to feed the poll: Copy'n'pasting relevant lines from 'cat ~/vm-launches.txt' Reason: I very much dislike utilizing if_bridge(4), instead would prefere vale(4), but that's reproducibly locking up in real world setups. So my choice is ng_bridge(4), which isn't covered by any byhve(4) helper project afaik. 2nd reason: People are working on native config file support. There's https://reviews.freebsd.org/D2448 and https://reviews.freebsd.org/D2505 e.g., which seems desireable to me and I liked it very much at the time of evaluating. Unfortunately, neither time nor skills allow me to seriously contribute. But that's the way to go imho, so I dropped hacking vm-bhyve/chyves in favour of coming up with small, _bhyve.conf compatible_ shell parser. Unfortunately, even for that, I couldn't find any time. So still 'cat ~/vm-launches.txt', where my MAC database resides ;-) -harry From owner-freebsd-virtualization@freebsd.org Mon Feb 26 09:22:29 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A3FBCF378E1 for ; Mon, 26 Feb 2018 09:22:29 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (vm1982.vellance.net [79.99.187.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 37ABB6BDBD for ; Mon, 26 Feb 2018 09:22:28 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 4514520126; Mon, 26 Feb 2018 10:16:15 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519636576; bh=k7N/w6eNYeQVSAhv9t6gvZ578q1Eo5Cbnig8zOhGeCA=; h=Subject:To:References:From:Date:In-Reply-To; b=QxgYG8N0D8DTkQ7kxhnCJx3CAwsAdmm1G1ogQK9Xja6W5bGMSF87ubK9Hxr9Knm/A q4+h6WPqPIoFKig/VYD6X2fnmHKdoHBqtYOPRJdu26DAg+aVovB1plSRJcnkl4X9CD yHsCArI6VVhd3YVqqfpFekfoX7X7FsyVVP9d5w5wgtXKhTVSP3b6RjDt4tXeGtfIWW w65R4TvMZJ+v05aF/i6nu5lUlfOYqpT/9osUCXhp3lHiUTBnjSlPZJ3cLUSouTM8QD Jh9hPEJr81ddmRGin6EowQMLb0VnfXSKy9CRObSmUjOHFfEx3NtDbEZlU0Vl5630JL lLa3dBRo//DIP0mjIjzBfra11PANsU/4360Q3cie7LOMJK24wUXpjdZD17yNVhKIAW NslveBiiH+PtrBN8wEAFLf0mdl+X4GbcYJhCPMeeSqo6J1D6o/02qiq6HZbn0NRHkn eFldyAF9NExcsQYOcbmbvFmp/yqIasmeNV95bwn1LI36mnk45/uUwIzgS86SO0ApHB I0j7NrGK+S9ZDqdS9wsJi0gwKqONCvwh6gYb4dt4ePAVYQh+82SuZEsGYST8Ulf34y D84nVVNx+e9QRg/tB8meBpQ97MvOxE0ojuRy9Gh516Oz/OSHcwzWOWg21sqrFY3KiI LqO88hl3cSCnGWsv+7VkOIZM= Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 1208220150; Mon, 26 Feb 2018 10:16:02 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519636574; bh=k7N/w6eNYeQVSAhv9t6gvZ578q1Eo5Cbnig8zOhGeCA=; h=Subject:To:References:From:Date:In-Reply-To; b=OCMeLoha7ehnfcXw11FfBF9L624XGF2w+xaKpxar6I6cZblgIZuaG2X0UEgdJd/aU l0SrDOLsPfCjfD9DzSBt315JzcZjVB9UqhTAiBTVA5J1GROklQ+mM9GANopQQ40JpN dkyyd12YqbqCVt2fMSAKHyoU2OpSIoNQk3Ozj5HWQgggvpoOKoqSco5llbSF7B32i7 Wab9vbGTM1Ip8CNEtaKKfSreIaGrZw9+29F7qEvNWK+vSTLC1YLJXs/Ha9d0QtHWXT yl4/wB3k4hoh/RCU7LEneBntW98Vq6O71wbtiZBbULUEjG2bn7jWjH44KixKYr32Ld GF6CLf3Tm2fKg44yXAoPYSFtxt92SctzgwKxQqPCukhxg7Tz89qwTP5cK+o7tC9lka Oe1Q29m6+LEdu7sChWmZTKm75Ce+Yae4to9VbaQ0G1gtGBXnjebhZ1cGz7NvS3Y5bx U9KuSnMuC9ISS+dePmax0DzF+q1qWE8LrFwJW+Atciv2S5UzLi+/BU4iM6aQScl7eT Z69VVALG1Kv4I9IEdbeyLdfCHQFbchxGixQvEbSq0jzJOfRou8ibyMLwjYPdvZVJLp h3MFNPMLBx0OumbuInNohQFJ7I5pnJ6TizUg0UF2NIroVAtXv/aL3IHdILaKiHGkou Nd6hCj6tUVMB+nUW61hJrlPI= X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on vm1982.vellance.net X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=ham autolearn_force=no version=3.4.1 Received: from quanza-qhq-dhcp161.q (engineering.quanza.net [91.208.87.11]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by vm1982.vellance.net (Postfix) with ESMTPSA; Mon, 26 Feb 2018 10:15:58 +0100 (CET) Subject: Re: bhyve manager To: Harry Schmalzbauer , freebsd-virtualization@freebsd.org References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> From: Ruben Message-ID: Date: Mon, 26 Feb 2018 10:15:56 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <5A93CEB6.1080406@omnilan.de> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 09:22:30 -0000 Hi Harry, What are your reasons for preferring ng_bridge over the "normal" bridge? Kind regards, Ruben On 26/02/2018 10:09, Harry Schmalzbauer wrote: > BezĂĽglich tech-lists's Nachricht vom 25.02.2018 14:14 (localtime): >> Hi, >> >> What do folks use for their bhyve guest management? >> >> I have always spun bhyve guests up by hand but now I'm considering >> streamlining the process. What do you use? > Just to feed the poll: > Copy'n'pasting relevant lines from 'cat ~/vm-launches.txt' > > Reason: > I very much dislike utilizing if_bridge(4), instead would prefere > vale(4), but that's reproducibly locking up in real world setups. > So my choice is ng_bridge(4), which isn't covered by any byhve(4) helper > project afaik. > 2nd reason: > People are working on native config file support. There's > https://reviews.freebsd.org/D2448 and https://reviews.freebsd.org/D2505 > e.g., which seems desireable to me and I liked it very much at the time > of evaluating. > Unfortunately, neither time nor skills allow me to seriously > contribute. But that's the way to go imho, so I dropped hacking > vm-bhyve/chyves in favour of coming up with small, _bhyve.conf > compatible_ shell parser. Unfortunately, even for that, I couldn't find > any time. > > So still 'cat ~/vm-launches.txt', where my MAC database resides ;-) > > -harry > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Mon Feb 26 09:56:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D61F0F39BF0 for ; Mon, 26 Feb 2018 09:56:34 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3B6B16D1E5 for ; Mon, 26 Feb 2018 09:56:34 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w1Q9uXD0089737; Mon, 26 Feb 2018 10:56:33 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id CC03DB68; Mon, 26 Feb 2018 10:56:32 +0100 (CET) Message-ID: <5A93D9D0.4090804@omnilan.de> Date: Mon, 26 Feb 2018 10:56:32 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Ruben CC: freebsd-virtualization@freebsd.org Subject: Re: bhyve manager References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: ACL 130 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Mon, 26 Feb 2018 10:56:33 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 09:56:35 -0000 BezĂĽglich Ruben's Nachricht vom 26.02.2018 10:15 (localtime): … > On 26/02/2018 10:09, Harry Schmalzbauer wrote: >> BezĂĽglich tech-lists's Nachricht vom 25.02.2018 14:14 (localtime): >>> Hi, >>> >>> What do folks use for their bhyve guest management? >>> … >> Copy'n'pasting relevant lines from 'cat ~/vm-launches.txt' >> >> Reason: >> I very much dislike utilizing if_bridge(4), instead would prefere >> vale(4), but that's reproducibly locking up in real world setups. >> So my choice is ng_bridge(4), which isn't covered by any byhve(4) helper > Hi Harry, > > > What are your reasons for preferring ng_bridge over the "normal" bridge? Two very different main reasons: if_bridge(4) is very standards compliant (e.g. that different reserved MAC addresses won't get forwarded – don't know any explicit examples out of mind), which was problematic for some SDN setups (software defined networking, in means of sharing a PHY for multiple VMs and simultaniously interconnect VMs to VMs) Another, personally very significant, reason is that you'll get a superfluous host interface for each if_bridge(4), which makes the output of plain ifconfig(8) kind of unreadable. For VM SDN, I don't need/want those host interfaces, despite they don't do any harm. vale(4) was extremely convinient. Simply create a switch, then each VM attaches on the fly :-) Unfortunately, I'm unable to debug the lockups and my setups was kind of hacky, since I haven't used NIC's native netmap(4) support, but used emulated netmap(4) for if_vlan(4). This leads to loss of almost all performance advantages, but left convinience advantages. Unfortunately, emulated netmap(4) is supposed to have some unresolved problems on FreeBSD and upstream hackers consider my hacky setup as wrong by nature – which it is technically speaking. For real-world usagen, one would need to code a VLAN filter between bhyve(4) and vale(4). Skillwise, I'm not the one :-( -harry From owner-freebsd-virtualization@freebsd.org Mon Feb 26 10:35:01 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1BD99F3C0AB for ; Mon, 26 Feb 2018 10:35:01 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (vm1982.vellance.net [79.99.187.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A2CC76EC54 for ; Mon, 26 Feb 2018 10:35:00 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id B335620157; Mon, 26 Feb 2018 11:34:58 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519641299; bh=wnK+iXFSpr2oof5ke1eBp4C3AgrQsnLaOzLHmSKqS50=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=ZIhaIodkOxZCZiU/pMGEQfNgui10XkZXxiWa7ODzMw1jgMx0L5EWvYtPZr+Shxp0v kggno243K/O3SlLMehLXJ9B8utP4pIkSssaoJwx6c73R9FEIfxpj4J6JbKnCrIvHi9 QIQ7TyJ/F9lUZwkXess2ZIYlyW09Kts1+9tD+ihHyh30G1BisrbOTa9fk5giuTQWr3 F7ugnwCN8nEZ51oDovV05i+h3ZX2cXN6nt9QCsuw77uiUwuho/qyI7KNXXm7OfgEXN LCTD3OfA0cRUgQGzNqFFHIWGqsqQ3zp41vTnF7i1o4kT2ioNhYXXN1nREgEq0B3FBe +OsSFwsBSsqfiR6Xm3hdz8AfF6iR6IP84Pi2VKTn+iu/PEFG555KijhfGbL25QvTkr zu8TYmniDQigUJOOjKI6WzZ2WkH8RPsT5v9Dsq0NtQf60nQ869W/21q6XLsHNwKceD beKYWMIC7NC8iE+Hm68fhnWF3vPcOszzUJo5w9QZs891J9aa+RM7FVsTUh9JJHTJuP yPO2yBk4YsruUafcbyen+JXmEeCL2vMxN9k8pktAy1VV9/0j7K+2pz7pHcTrExQNCR 6VcC1JhKJ+d+EhUGZ/kO74MUMtNiMwxoS/meygLqRKEwjDOk9s+b/X6X9M5yO/7+TW e5Js3Z484Px27hZB5MlkGnxo= Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 31CA120126; Mon, 26 Feb 2018 11:34:56 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519641298; bh=wnK+iXFSpr2oof5ke1eBp4C3AgrQsnLaOzLHmSKqS50=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=ensHloqyRZysamJ3VXGoaY8mSd9H+8m0oWYNZrJtt3iERzTJNm7Drnm2rJ42xmhpU QmwKE/4/4HrJ/vaYV41+db7JRSKR/O6x0IkNCtsvX1rCvzGjH9GyFJYx0/z2IwVPsw RP3uKmT8OJOV2gYmJKs3RwmXc1FMVJR3kuFfyKTeBryae5Gm3TpXoOlxLbyw9phdhv uoyXEO7ZFNRXKzZZNJOcZhl9anLZeepuyR6O3uxFwozhfaeciqjQ/tEXuO8DrejaIr 5gDwYZFWcu2/o4IS+P2bcyAudamskBfuWqjX3OheH7NOKqihVop9ItwYTIrZX5HhJe iYSHOY8/7zADI64N/IbsloUCv3VkgoO4lWNEUuG+o8EHvE6Gix0SDL09Sfbxeshoa0 nQ0JF7IROCh2ZqaPYGzoLVXudP/O0BycIgvBpibbGdzdlFF+9QIx3hLanrG+rcOVda oUzQQdLdf9sidXwDFldjZcV7UZfXlPTX1Z730Or+TuRG1J3N3VhyEQx18kSaQlDAba JOur5Zsuw9LNdJR/snucB1VCXFS+9FdmlwDbkpeMJMkQtTgxsXIhqVSnkAadjf/fvk Gzn0wZN/eNpOkkdz5UslfeNampJvRvlEprKE8kaMSRHLfatHeWhvDKwIqlX6PRSpbl Gj0JFzIfa+iV0d/7+xpueSJc= X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on vm1982.vellance.net X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=ham autolearn_force=no version=3.4.1 Received: from quanza-qhq-dhcp161.q (engineering.quanza.net [91.208.87.11]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by vm1982.vellance.net (Postfix) with ESMTPSA; Mon, 26 Feb 2018 11:34:56 +0100 (CET) Subject: superfluous host interfaces To: Harry Schmalzbauer Cc: freebsd-virtualization@freebsd.org References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> From: Ruben Message-ID: <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> Date: Mon, 26 Feb 2018 11:34:52 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <5A93D9D0.4090804@omnilan.de> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 10:35:01 -0000 On 26/02/2018 10:56, Harry Schmalzbauer wrote: >> Hi Harry, >> >> >> What are your reasons for preferring ng_bridge over the "normal" bridge? > Two very different main reasons: > if_bridge(4) is very standards compliant (e.g. that different reserved > MAC addresses won't get forwarded – don't know any explicit examples out > of mind), which was problematic for some SDN setups (software defined > networking, in means of sharing a PHY for multiple VMs and > simultaniously interconnect VMs to VMs) > > Another, personally very significant, reason is that you'll get a > superfluous host interface for each if_bridge(4), which makes the output > of plain ifconfig(8) kind of unreadable. > For VM SDN, I don't need/want those host interfaces, despite they don't > do any harm. > > vale(4) was extremely convinient. Simply create a switch, then each VM > attaches on the fly :-) > Unfortunately, I'm unable to debug the lockups and my setups was kind of > hacky, since I haven't used NIC's native netmap(4) support, but used > emulated netmap(4) for if_vlan(4). This leads to loss of almost all > performance advantages, but left convinience advantages. Unfortunately, > emulated netmap(4) is supposed to have some unresolved problems on > FreeBSD and upstream hackers consider my hacky setup as wrong by nature > – which it is technically speaking. For real-world usagen, one would > need to code a VLAN filter between bhyve(4) and vale(4). Skillwise, I'm > not the one :-( > > -harry Hi Harry, Thank you for elaborating on that. I took the liberty of creating a new mailthread as my questions are kind of off-topic to the original thread. By superflous host interfaces, do you mean the tap interfaces configured for each vm together with the bridge interfaces they are "bundled" in? Overall I'm very happy with my bhyve setups atm. If there are any speed-/administrative-advantages that come with bridge_ng however, I'm very interested in switching to such a setup (or at least play with it). I'm running my vm's without any helper project so I'm flexible enough to do some fiddling :P Do you know of any documentation on using bridge_ng together with bhyve? My search-engines don't turn up much Im affraid and I haven't stumbled on it before. Kind regards, Ruben From owner-freebsd-virtualization@freebsd.org Mon Feb 26 12:13:20 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6A64DF1145D for ; Mon, 26 Feb 2018 12:13:20 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EDD3D7222D for ; Mon, 26 Feb 2018 12:13:19 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w1QCDIjf092102; Mon, 26 Feb 2018 13:13:18 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 8887BB92; Mon, 26 Feb 2018 13:13:18 +0100 (CET) Message-ID: <5A93F9DE.9090908@omnilan.de> Date: Mon, 26 Feb 2018 13:13:18 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Ruben CC: FreeBSD virtualization Subject: Re: superfluous host interfaces References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> In-Reply-To: <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Mon, 26 Feb 2018 13:13:18 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 12:13:20 -0000 BezĂĽglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): > On 26/02/2018 10:56, Harry Schmalzbauer wrote: … >> Another, personally very significant, reason is that you'll get a >> superfluous host interface for each if_bridge(4), which makes the output >> of plain ifconfig(8) kind of unreadable. … > > By superflous host interfaces, do you mean the tap interfaces configured > for each vm together with the bridge interfaces they are "bundled" in? Additionally to the if_tap(4) ethernet host interfaces, you also get if_bridge(4) ethernet interfaces, named bridgeX if I remember correctly. The if_bridge(4) host interface is for control purposes only on a VM-SDN host – at least with my setups. I never needed to make use of IP numbered bridges. And I don't need to utilize any if_bridge(4) features like STP, so I consider the bridgeX host interfaces as superfluous in the VM-SDN use case. I'd call the if_tap(4) host interfaces likewise superfluous – you would only need the corresponding character devices – but that's been implemented long before the need for SDN setups, so it is like it is. And using ng_bridge(4) instead of if_bridge(4) doesn't change the need for if_tap(4). Only with vale(4) switches, bhyve(8) was able to provide virtio-net connection wihtout "spamming" the host's ethernet interface list (no tapX, no bridgeX). > Overall I'm very happy with my bhyve setups atm. If there are any > speed-/administrative-advantages that come with bridge_ng however, I'm > very interested in switching to such a setup (or at least play with it). > I'm running my vm's without any helper project so I'm flexible enough to > do some fiddling :P > > Do you know of any documentation on using bridge_ng together with bhyve? > My search-engines don't turn up much Im affraid and I haven't stumbled > on it before. Unfortunately it's not too easy to get started with netgraph. Besides numerous man pages for the different nodes (ng_bridge(4) e.g.), I only know the following source for a good overview: http://www.netbsd.org/gallery/presentations/ast/2012_AsiaBSDCon/Tutorial_NETGRAPH.pdf One convenience disadvantage with ng_bridge(4) is that you have to assign MACs manually, while if_bridge(4) does that itself (adjustable by sysctl net.link.bridge.inherit_mac). And you need to script all setups yourself. Almost all of my setups seem to be awkward enough that I always had to do some local scripting, so that wasn't really a disadvantage for me. If you're happy with your setup, I don't think you gain anything from switching to ng_bridge(4), besides learning to control netgraph(4) (which is very desirable imho). I haven't had time left to do useful benchmarking regarding ng_bridge(4) vs. if_bridge(4). I even don't know if netgraph nodes are still limited to single threads. But rough load comparings on a IvyBride machine showed similar resource usage for both bridges, both easy capable of 1GbE saturation with small frames (while I remember one run with ng_bridge(4) and if_vmnet(4), which couldn't deliver 1GbE speed, and I wanted to falsify for vmnet/tap difference... just ran out of time :-( ). -harry From owner-freebsd-virtualization@freebsd.org Mon Feb 26 12:28:41 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9526F1C8A4 for ; Mon, 26 Feb 2018 12:28:40 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (vm1982.vellance.net [79.99.187.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6940072B0A for ; Mon, 26 Feb 2018 12:28:40 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id B227620157; Mon, 26 Feb 2018 13:28:37 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519648118; bh=JPUCXZ46vQOBkJ4lJxrI+ObT6qXMTKLW7NY+32iTPvM=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=ORM0Xu7k6W5Oz/MAve1Vd0SvjFDyUlXg55ENBVFV4ugqX8INhoorfxkymP68tGPgh +kzgbUoYvEN3caWZDGMbEvtyq/EZExtofpksyEVbzz0kEdH8x24GCVyGYkMrF57EKt b2XnJB9DoBvpqWtpj0/3fORYkeWHoVbHQFANfZ923GrbWRvr0Qy830WXUEHlmAIemk 93zTzmYOt2yBz+fy1Ry5qJW0ernXBmukRHA27XMUx/Ef0HjOrtSZy+f2LOn6XV6csP Z0LFAPoQOtEUiHScJZsXqZEXbB364D++PL274IJl7BY7uncVokH3b+/3V/xlyOi49L CiKcoCtDOOzVozCoNmRnTmdnbPdmcZPP6eoD8JZhUgOX3/wg4eucr1fcbdeqgGHPeU tJLXnOyP8nVU7Pp1PIpVIcReW8LsVbYKc3gTUHQ4+Do8j5rL/7YOEG7ZJc039oN4oX ie9WJGrILcIOMJcMYiH0G+b9qwBF1NUWEDxCSpXwEIWbiEbiR8Y95Lq5WqBI7zqNJR T7X5AfjW0NsiWFpM4ykILdEJZ5ReATbFb8iF6P3l1xa1Hznhm3mEVG95PTzQqIQTxX 1fKeriszAOhTbmRnf6EhxcpDQZQKDrvqxCtYkh0hY6TCw0P2Fiq+Zj6X6UIUqOprvb dp1jCP7FS9V4LUUPjVnf1ca4= Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 8D2DA20126; Mon, 26 Feb 2018 13:28:25 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519648117; bh=JPUCXZ46vQOBkJ4lJxrI+ObT6qXMTKLW7NY+32iTPvM=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=jAR2J+8ZcAeD2Dc90vbDPkU0X6LTJmX3nI2LBvS9o5U8B+MZhRc7OLCBS5KieZgnp jA36MKyMgRIfGxnimaPw420kI4QGRLLOd0Mac3dZTpP+iYwwTMe3v7iF7hASMLPntN NgNPOkBj/Z+ZpbU9Xi+8+FoxTezexBUuh26n6nOaUwSrLj7QiXJsQvRg2ODMcwTCWx 8GlsjfH41Jb7eZRF+OnZM16TNhEPaNMz394akeVLeRmV/D6IAAVg5uPPPdGJUJSewc r9yhPKlDSYz94tJs/de/Wm4aY8+6LZcWZqzbMmCQ6BOvO7pVAMk2Pa444mSIlr9Ncj tOPcgd4Tt2VzDQP8HxqBKR68t+K2H/9Vl7ummE4GUc8apw6ctlKX3ZpxUOS2n1kGWf UFLAtUqnv54QItojRKn+l6orhJ8Gm1yH+VWvKJy19d2owhBFwjYETj0pQSInm8CGXi zlNW+a9NNMboBxSQo4yZYYlClpV5rEh1No+vUxv0aC9EXcu1I4KHnFnt/N9nFz+jaw hb4HCRKpHnAAcz31s8+RhDYSKXw5Jn2Rbb1P2OV00mqzuM7yVozvTWRIxXpFjs9+i9 889pqdiD4p7dLNd7RYR80xMRGmHpi2Kwpupz522dtMjGPM1zcP/KhLVQVdR7SYOBL6 pf+uypgyz3Y1boO3EnwSljPs= X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on vm1982.vellance.net X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=ham autolearn_force=no version=3.4.1 Received: from quanza-qhq-dhcp161.q (engineering.quanza.net [91.208.87.11]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by vm1982.vellance.net (Postfix) with ESMTPSA; Mon, 26 Feb 2018 13:28:25 +0100 (CET) Subject: Re: superfluous host interfaces To: Harry Schmalzbauer Cc: FreeBSD virtualization References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> From: Ruben Message-ID: <745701ca-4351-ae19-2688-ee458e85efa6@osfux.nl> Date: Mon, 26 Feb 2018 13:28:23 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <5A93F9DE.9090908@omnilan.de> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 12:28:41 -0000 Hi Harry, Following some examples in the presentation you linked, Im rather suprised that i'm apparently already utilizing the ng subsystem on some of my machines (ngctl list lists entries and a couple of hooks as well). Ill put a rig together for some playing around with the netgraph subsystem, very interesting! Thank you (again) for your elaboration :) Kind regards, Ruben On 26/02/2018 13:13, Harry Schmalzbauer wrote: > BezĂĽglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): >> On 26/02/2018 10:56, Harry Schmalzbauer wrote: > … >>> Another, personally very significant, reason is that you'll get a >>> superfluous host interface for each if_bridge(4), which makes the output >>> of plain ifconfig(8) kind of unreadable. > … >> By superflous host interfaces, do you mean the tap interfaces configured >> for each vm together with the bridge interfaces they are "bundled" in? > Additionally to the if_tap(4) ethernet host interfaces, you also get > if_bridge(4) ethernet interfaces, named bridgeX if I remember correctly. > The if_bridge(4) host interface is for control purposes only on a VM-SDN > host – at least with my setups. I never needed to make use of IP > numbered bridges. And I don't need to utilize any if_bridge(4) features > like STP, so I consider the bridgeX host interfaces as superfluous in > the VM-SDN use case. > > I'd call the if_tap(4) host interfaces likewise superfluous – you would > only need the corresponding character devices – but that's been > implemented long before the need for SDN setups, so it is like it is. > And using ng_bridge(4) instead of if_bridge(4) doesn't change the need > for if_tap(4). Only with vale(4) switches, bhyve(8) was able to provide > virtio-net connection wihtout "spamming" the host's ethernet interface > list (no tapX, no bridgeX). > > >> Overall I'm very happy with my bhyve setups atm. If there are any >> speed-/administrative-advantages that come with bridge_ng however, I'm >> very interested in switching to such a setup (or at least play with it). >> I'm running my vm's without any helper project so I'm flexible enough to >> do some fiddling :P >> >> Do you know of any documentation on using bridge_ng together with bhyve? >> My search-engines don't turn up much Im affraid and I haven't stumbled >> on it before. > Unfortunately it's not too easy to get started with netgraph. > Besides numerous man pages for the different nodes (ng_bridge(4) e.g.), > I only know the following source for a good overview: > http://www.netbsd.org/gallery/presentations/ast/2012_AsiaBSDCon/Tutorial_NETGRAPH.pdf > > One convenience disadvantage with ng_bridge(4) is that you have to > assign MACs manually, while if_bridge(4) does that itself (adjustable by > sysctl net.link.bridge.inherit_mac). > And you need to script all setups yourself. Almost all of my setups > seem to be awkward enough that I always had to do some local scripting, > so that wasn't really a disadvantage for me. > > If you're happy with your setup, I don't think you gain anything from > switching to ng_bridge(4), besides learning to control netgraph(4) > (which is very desirable imho). > I haven't had time left to do useful benchmarking regarding ng_bridge(4) > vs. if_bridge(4). I even don't know if netgraph nodes are still limited > to single threads. But rough load comparings on a IvyBride machine > showed similar resource usage for both bridges, both easy capable of > 1GbE saturation with small frames (while I remember one run with > ng_bridge(4) and if_vmnet(4), which couldn't deliver 1GbE speed, and I > wanted to falsify for vmnet/tap difference... just ran out of time :-( ). > > -harry From owner-freebsd-virtualization@freebsd.org Mon Feb 26 14:17:39 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8BD9AF27E67 for ; Mon, 26 Feb 2018 14:17:39 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DAB1677050 for ; Mon, 26 Feb 2018 14:17:38 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1QEHYaY010436; Mon, 26 Feb 2018 06:17:34 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1QEHXlQ010435; Mon, 26 Feb 2018 06:17:33 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802261417.w1QEHXlQ010435@pdx.rh.CN85.dnsmgr.net> Subject: Re: Migrate from real server to virtual In-Reply-To: <1519624732.983711988.ao3r3oq0@frv52.fwdcdn.com> To: wishmaster Date: Mon, 26 Feb 2018 06:17:33 -0800 (PST) CC: "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 14:17:39 -0000 > Hi, colleagues. > > There is a server running with Windows Server 2008 R2 and I am attempting launch this server in virtual environment as a back up. But there is one big problem - I can not shutdown this server. > My first step was creating a VHD image with help of Disk2vhd. Then a converted this image from VHD to raw image with qemu. > I don't know boot setting of BIOS. > > With this command I am unable to start the server. > > bhyve -c 2 -s 0,hostbridge -s 3,ahci-hd,/vm/img/disk1.raw -s 4,ahci-cd,/VM/distro/null.iso -s 10,virtio-net,tap1 -s 20,fbuf,tcp=192.168.0.254:5900,w=800,h=600,wait -s 21,lpc -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 6G -H -w windows2 > > Boot Filed. UEFI Hard Drive > > Any ideas? You mention how you start it, what are you using to try and stop it? Also what version of FreeBSD are you running as a host? Are you saying you can not connect to the vnc on 192.168.0.254:5900 and tell windows to shutdown? Or are you saying you connect to that vnc and even though you told windows to shutdown it fails to do so? Sorry for all the questions, and no answer, but it is not clear exactly what your problem is. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Mon Feb 26 14:39:23 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7853EF29738 for ; Mon, 26 Feb 2018 14:39:23 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv197.fwdcdn.com (frv197.fwdcdn.com [212.42.77.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1538D77E46 for ; Mon, 26 Feb 2018 14:39:22 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=iGCormRRNCFxP/+Rr6plNt7/9JIQHyboCe8K89aQN0s=; b=D6FoFm30wpNzbrBbCNO8Hz+Nco /OMndpN8YRzQlNO1ReJbzPG7oYHfroMNvjyqOOpT38cksnkZZaTXIc9Z/aXqPDM6QtliaDCcFhCqi GPW7rs8Yqgo3KOW09DTEfrS5Zx6gHPHm40lR1K//zSeQTIzXNr17fXeI5jfUDKoEkalg=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1eqJvz-0005hQ-Vh for freebsd-virtualization@freebsd.org; Mon, 26 Feb 2018 16:39:19 +0200 Date: Mon, 26 Feb 2018 16:39:19 +0200 From: wishmaster Subject: Re[2]: Migrate from real server to virtual To: "Rodney W. Grimes" Cc: "freebsd-virtualization@freebsd.org" X-Mailer: mail.ukr.net 5.0 Message-Id: <1519655843.315990939.0ghqn7l2@frv52.fwdcdn.com> In-Reply-To: <201802261417.w1QEHXlQ010435@pdx.rh.CN85.dnsmgr.net> References: <1519624732.983711988.ao3r3oq0@frv52.fwdcdn.com> <201802261417.w1QEHXlQ010435@pdx.rh.CN85.dnsmgr.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Mon, 26 Feb 2018 16:39:19 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 14:39:23 -0000   --- Original message --- From: "Rodney W. Grimes" Date: 26 February 2018, 16:17:44 > > Hi, colleagues. > > > > There is a server running with Windows Server 2008 R2 and I am attempting launch this server in virtual environment as a back up. But there is one big problem - I can not shutdown this server. > > My first step was creating a VHD image with help of Disk2vhd. Then a converted this image from VHD to raw image with qemu. > > I don't know boot setting of BIOS. > > > > With this command I am unable to start the server. > > > > bhyve -c 2 -s 0,hostbridge -s 3,ahci-hd,/vm/img/disk1.raw -s 4,ahci-cd,/VM/distro/null.iso -s 10,virtio-net,tap1 -s 20,fbuf,tcp=192.168.0.254:5900,w=800,h=600,wait -s 21,lpc -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 6G -H -w windows2 > > > > Boot Filed. UEFI Hard Drive > > > > Any ideas? > > You mention how you start it, what are you using to try and stop it? Ctrl+C then bhyvectl --vm windows2 --destroy > Also what version of FreeBSD are you running as a host? FreeBSD 11.1-STABLE r329364 > Are you saying you can not connect to the vnc on 192.168.0.254:5900 > and tell windows to shutdown? I can connect to the 192.168.0.254:5900, but error is displayed: Boot Filed. UEFI Hard Drive > Or are you saying you connect to that vnc and even though you told > windows to shutdown it fails to do so? > > Sorry for all the questions, and no answer, > but it is not clear exactly what your problem is. > > -- > Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Mon Feb 26 15:08:02 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6105EF2B995 for ; Mon, 26 Feb 2018 15:08:02 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B4BCB795D1 for ; Mon, 26 Feb 2018 15:08:01 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1QF7wPB010683; Mon, 26 Feb 2018 07:07:58 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1QF7w0g010682; Mon, 26 Feb 2018 07:07:58 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802261507.w1QF7w0g010682@pdx.rh.CN85.dnsmgr.net> Subject: Re: Re[2]: Migrate from real server to virtual In-Reply-To: <1519655843.315990939.0ghqn7l2@frv52.fwdcdn.com> To: wishmaster Date: Mon, 26 Feb 2018 07:07:58 -0800 (PST) CC: "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 15:08:02 -0000 > > ? > > --- Original message --- > From: "Rodney W. Grimes" > Date: 26 February 2018, 16:17:44 > > > > > Hi, colleagues. > > > > > > There is a server running with Windows Server 2008 R2 and I am attempting launch this server in virtual environment as a back up. But there is one big problem - I can not shutdown this server. > > > My first step was creating a VHD image with help of Disk2vhd. Then a converted this image from VHD to raw image with qemu. > > > I don't know boot setting of BIOS. > > > > > > With this command I am unable to start the server. > > > > > > bhyve -c 2 -s 0,hostbridge -s 3,ahci-hd,/vm/img/disk1.raw -s 4,ahci-cd,/VM/distro/null.iso -s 10,virtio-net,tap1 -s 20,fbuf,tcp=192.168.0.254:5900,w=800,h=600,wait -s 21,lpc -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 6G -H -w windows2 > > > > > > Boot Filed. UEFI Hard Drive > > > > > > Any ideas? > > > > You mention how you start it, what are you using to try and stop it? > > Ctrl+C then bhyvectl --vm windows2 --destroy Ok, thats to clean up after a crashed VM, not the way to shutdown a running system. > > Also what version of FreeBSD are you running as a host? > > FreeBSD 11.1-STABLE r329364 Thanks, wanted to make sure this was a 10.x system. > > Are you saying you can not connect to the vnc on 192.168.0.254:5900 > > and tell windows to shutdown? > > I can connect to the 192.168.0.254:5900, but error is displayed: Boot Filed. UEFI Hard Drive Boot Failed? So windows never started. Your not having a shutdown problem your having a start up failure. What is the output of: file /vm/img/disk1.raw file /VM/distro/null.iso And do you really have /vm and /VM? Or is that a typo? -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Tue Feb 27 06:14:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3CC6CF283B7 for ; Tue, 27 Feb 2018 06:14:14 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D7FCE84513 for ; Tue, 27 Feb 2018 06:14:13 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from [IPv6:2001:559:8000:c9:c479:6a5b:b7d2:c3d5] (unknown [IPv6:2001:559:8000:c9:c479:6a5b:b7d2:c3d5]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id 4531E7594B; Tue, 27 Feb 2018 06:14:11 +0000 (UTC) Message-ID: <5A94F730.7040009@redbarn.org> Date: Mon, 26 Feb 2018 22:14:08 -0800 From: Paul Vixie User-Agent: Postbox 5.0.22 (Windows/20171208) MIME-Version: 1.0 To: Harry Schmalzbauer CC: Ruben , FreeBSD virtualization Subject: Re: superfluous host interfaces References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> In-Reply-To: <5A93F9DE.9090908@omnilan.de> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 06:14:14 -0000 Harry Schmalzbauer wrote: > Bezüglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): >> On 26/02/2018 10:56, Harry Schmalzbauer wrote: > … >>> Another, personally very significant, reason is that you'll get a >>> superfluous host interface for each if_bridge(4), which makes the output >>> of plain ifconfig(8) kind of unreadable. > … >> By superflous host interfaces, do you mean the tap interfaces configured >> for each vm together with the bridge interfaces they are "bundled" in? > > Additionally to the if_tap(4) ethernet host interfaces, you also get > if_bridge(4) ethernet interfaces, named bridgeX if I remember correctly. you do not remember correctly. > [mm1.redbarn:amd64] egrep 'bridge|tap' /etc/rc.conf > autobridge_interfaces="bridge0" > autobridge_bridge0="tap* igb1" > cloned_interfaces="bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 tap7" > ifconfig_bridge0="inet 24.104.150.210/27" > ifconfig_bridge0_ipv6="inet6 2001:559:8000:cd::2/64 auto_linklocal up" > ifconfig_tap0="up" > ifconfig_tap1="up" > ifconfig_tap2="up" > ifconfig_tap3="up" > ifconfig_tap4="up" > ifconfig_tap5="up" > ifconfig_tap6="up" > ifconfig_tap7="up" > [mm1.redbarn:amd64] ifconfig | egrep '^(bridge|tap)' > bridge0: flags=8843 metric 0 mtu 1500 > tap0: flags=8943 metric 0 mtu 1500 > tap1: flags=8943 metric 0 mtu 1500 > tap2: flags=8943 metric 0 mtu 1500 > tap3: flags=8943 metric 0 mtu 1500 > tap4: flags=8943 metric 0 mtu 1500 > tap5: flags=8943 metric 0 mtu 1500 > tap6: flags=8903 metric 0 mtu 1500 > tap7: flags=8903 metric 0 mtu 1500 the only bridge i see is the one i statically defined. > And using ng_bridge(4) instead of if_bridge(4) doesn't change the need > for if_tap(4). Only with vale(4) switches, bhyve(8) was able to provide > virtio-net connection wihtout "spamming" the host's ethernet interface > list (no tapX, no bridgeX). how did you get bhyve to use the netmap API rather than the tap character special device? -- P Vixie From owner-freebsd-virtualization@freebsd.org Tue Feb 27 06:26:07 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CCB04F28A9E for ; Tue, 27 Feb 2018 06:26:07 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv190.fwdcdn.com (frv190.fwdcdn.com [212.42.77.190]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5C294849F2 for ; Tue, 27 Feb 2018 06:26:07 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv199.fwdcdn.com ([212.42.77.199]) by frv190.fwdcdn.com with esmtp ID 1eqYQe-0008ov-13 for freebsd-virtualization@freebsd.org; Tue, 27 Feb 2018 08:07:56 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=IBwWJX+aDaiT6aADZXIuBxHLt9rJog5BuEfnAcBmXnI=; b=FEbzakamz4uK1jDPfPzLg9YZ0Y TQnFABQB6/jgjRNAdQwxGNXOwN0xx6WEVtflL+uUx8yIUF+bXGNjiHuF1r5D16shXsa7c23+pbLhM 6q8X/ngXhhQNWjqvSDBYtUxvn3zemqilU84Ts8FaPENZdQ853bO1IE+wT8ugbRcuMkhk=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv199.fwdcdn.com with smtp ID 1eqYQV-0008iW-Qb for freebsd-virtualization@freebsd.org; Tue, 27 Feb 2018 08:07:47 +0200 Date: Tue, 27 Feb 2018 08:07:47 +0200 From: wishmaster Subject: Re[2]: Re[2]: Migrate from real server to virtual To: "Rodney W. Grimes" Cc: "freebsd-virtualization@freebsd.org" X-Mailer: mail.ukr.net 5.0 Message-Id: <1519711012.787233844.2n5j39fz@frv52.fwdcdn.com> In-Reply-To: <201802261507.w1QF7w0g010682@pdx.rh.CN85.dnsmgr.net> References: <1519655843.315990939.0ghqn7l2@frv52.fwdcdn.com> <201802261507.w1QF7w0g010682@pdx.rh.CN85.dnsmgr.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 27 Feb 2018 08:07:47 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 06:26:08 -0000 --- Original message --- From: "Rodney W. Grimes" Date: 26 February 2018, 17:08:06 > > > > ? > > > > --- Original message --- > > From: "Rodney W. Grimes" > > Date: 26 February 2018, 16:17:44 > > > > > > > > Hi, colleagues. > > > > > > > > There is a server running with Windows Server 2008 R2 and I am attempting launch this server in virtual environment as a back up. But there is one big problem - I can not shutdown this server. > > > > My first step was creating a VHD image with help of Disk2vhd. Then a converted this image from VHD to raw image with qemu. > > > > I don't know boot setting of BIOS. > > > > > > > > With this command I am unable to start the server. > > > > > > > > bhyve -c 2 -s 0,hostbridge -s 3,ahci-hd,/vm/img/disk1.raw -s 4,ahci-cd,/VM/distro/null.iso -s 10,virtio-net,tap1 -s 20,fbuf,tcp=192.168.0.254:5900,w=800,h=600,wait -s 21,lpc -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 6G -H -w windows2 > > > > > > > > Boot Filed. UEFI Hard Drive > > > > > > > > Any ideas? > > > > > > You mention how you start it, what are you using to try and stop it? > > > > Ctrl+C then bhyvectl --vm windows2 --destroy > > Ok, thats to clean up after a crashed VM, not the way to shutdown > a running system. > > > > Also what version of FreeBSD are you running as a host? > > > > FreeBSD 11.1-STABLE r329364 > > Thanks, wanted to make sure this was a 10.x system. > > > > Are you saying you can not connect to the vnc on 192.168.0.254:5900 > > > and tell windows to shutdown? > > > > I can connect to the 192.168.0.254:5900, but error is displayed: Boot Filed. UEFI Hard Drive > > Boot Failed? So windows never started. > Your not having a shutdown problem your having a start up failure. > > What is the output of: > file /vm/img/disk1.raw > file /VM/distro/null.iso > > And do you really have /vm and /VM? Or is that a typo? > > > -- > Rod Grimes rgrimes@freebsd.org I said not clear. I can not reboot hardware server for some reason and therefore do not know boot settings: or this is UEFI boot or Legacy. But problem is in inability to boot the virtual server. After I connect via VNC I see this error: Boot Filed. UEFI Hard Drive Without parameter "-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd" bhyve does not start at all with error virtual machine cannot be booted. -- Vitaly From owner-freebsd-virtualization@freebsd.org Tue Feb 27 06:57:17 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD6A9F29DC1 for ; Tue, 27 Feb 2018 06:57:17 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 1FC8585993 for ; Tue, 27 Feb 2018 06:57:16 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id B2676209C006 for ; Tue, 27 Feb 2018 16:57:08 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id AC01A280903 for ; Tue, 27 Feb 2018 16:57:08 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id TZqGzNcf2kQz for ; Tue, 27 Feb 2018 16:57:08 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id D4E1D2820A7; Tue, 27 Feb 2018 16:57:06 +1000 (AEST) Subject: Re: bhyve and mmap(2) To: Fabian Freyer References: <0001CF7F-66BC-451E-9C86-03C50471F23D@physik.tu-berlin.de> Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: Date: Mon, 26 Feb 2018 22:57:03 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <0001CF7F-66BC-451E-9C86-03C50471F23D@physik.tu-berlin.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=Op4juWPpsa0A:10 a=07d9gI8wAAAA:8 a=XV5vBF53AnnAyZL96wAA:9 a=6srBFSeoIlzI1HAV:21 a=6-a_Z7xu-HBWCG-z:21 a=QEXdDO2ut3YA:10 a=H71i6ErUBJYA:10 a=e2CUPOnPG4QKp8I52DXD:22 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 06:57:17 -0000 Hi Fabian, > Would be possible to use mmap(2) around libvmmapi to map a file > (MAP_PRIVATE) and or shared memory segments (MAP_SHARED) into guest > physical address space? It currently isn't - doing that will just insert the mappings into the user process's view, and not into guest address space. Bhyve currently uses a separate vmspace for guest address space. While this simplifies the EPT code internally, it also prevents direct manipulation of the address space using standard system calls. A possible solution to this would be to have the ability to apply address-space manipulation calls to an arbitrary address space - this was brought up in Linux a long while back: https://lwn.net/Articles/19047/ later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 07:04:56 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 60526F2A2C7 for ; Tue, 27 Feb 2018 07:04:56 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-it0-x22e.google.com (mail-it0-x22e.google.com [IPv6:2607:f8b0:4001:c0b::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DEEEF85E2D for ; Tue, 27 Feb 2018 07:04:55 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-it0-x22e.google.com with SMTP id l187so14091265ith.4 for ; Mon, 26 Feb 2018 23:04:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=7iEcr3jk/dbFCRI06/GUvgjOXJiawLfVX5CenCO+yEI=; b=XiBrOhXIVOBYNI6HcbPBOYXg75MmAKAyIaWs18EN7pQFB2vQi/laaoJkNuztx+cC7C i0MmV4NK1nMUm7MIJkxM7ixUUF9y2TeJEOLB8o0hEqxy+ksKJ4Qzxkq2w9kHcd7tw07/ x6oM58S1VUtKIMZMCQq3A2teRcfZ/ljD5601LWa+ZeTT/S9gc2c5+ucAhkJgKFJsBdea 0DQjDMJedqht1SonJkrKi+dGKvDO64IRyKfo8tvfj0TxNDp/CqN0J3JTVriHffJcfzoi 7NRy1sXcUdeVpnwsIRRSapdn5DXIBqPYZITxrajKvvZ1ZsM3UtAGZmorpz8ngs/M6/Q8 6neg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=7iEcr3jk/dbFCRI06/GUvgjOXJiawLfVX5CenCO+yEI=; b=K1cAYkUhJJ1vdohDXkeHYDkFrcgpQAZ1spHzUNRH1IKkmn6hKXeojaYvL4QdMkNHqm OCcm4gQgsDfDK4jS51lP9ouQeZ1OL1x4W/Vyfzo1ZOElqkXajgzCbq+2bh4elys9ziaD yaNmsszr4h90gUXOhtKKp3MJjoNAqKpqMOUB08pv2JueZTuJxcnSOBcUnvOl6M7YnXps ygL/QQX2QmggopyfHO9Mhc0Nkv4Fc04cC5mGVrtJ/O0UCZZSSSAB/z6ATtNqA3WDoPWb MnWOPztkgVutujkEQGqoL39S8mJLSLEuBn3sjhKaCsb+ubIEMUNsYIj1w0jhc1g32Z+j 9NqQ== X-Gm-Message-State: APf1xPDWOVr5H2Jb4N6jgzxca7GqS3omiyN+vgsspCAYxvoSbUYjQa9g XsLyoMzpRY/3/ovivRCt1NS0TpewgXPX7+uh9/4= X-Google-Smtp-Source: AH8x227f0uQABOyHcUuMTklkUfxFz4ztHfmK3iUn+8IW4s2+4+priVjLd7iDqzxK6PKxIrOCFObIyGHryEZnRWBrfNQ= X-Received: by 10.36.112.196 with SMTP id f187mr15138022itc.122.1519715095300; Mon, 26 Feb 2018 23:04:55 -0800 (PST) MIME-Version: 1.0 Received: by 10.2.177.28 with HTTP; Mon, 26 Feb 2018 23:04:54 -0800 (PST) Received: by 10.2.177.28 with HTTP; Mon, 26 Feb 2018 23:04:54 -0800 (PST) In-Reply-To: <1519711012.787233844.2n5j39fz@frv52.fwdcdn.com> References: <1519655843.315990939.0ghqn7l2@frv52.fwdcdn.com> <201802261507.w1QF7w0g010682@pdx.rh.CN85.dnsmgr.net> <1519711012.787233844.2n5j39fz@frv52.fwdcdn.com> From: Jason Tubnor Date: Tue, 27 Feb 2018 18:04:54 +1100 Message-ID: Subject: Re: Re[2]: Re[2]: Migrate from real server to virtual To: wishmaster Cc: freebsd-rwg@pdx.rh.cn85.dnsmgr.net, freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 07:04:56 -0000 On 27 Feb. 2018 5:07 pm, "wishmaster" wrote: Boot Filed. UEFI Hard Drive Without parameter "-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd" bhyve does not start at all with error virtual machine cannot be booted. Have you tried using the CSM UEFI firmware that came in same bundle as the one above? It's worth a try. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 07:10:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21BC2F2A67F for ; Tue, 27 Feb 2018 07:10:22 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8F74785FA7 for ; Tue, 27 Feb 2018 07:10:21 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1R7AIpZ013837; Mon, 26 Feb 2018 23:10:18 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1R7AHhp013836; Mon, 26 Feb 2018 23:10:17 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802270710.w1R7AHhp013836@pdx.rh.CN85.dnsmgr.net> Subject: Re: Re[2]: Re[2]: Migrate from real server to virtual In-Reply-To: To: Jason Tubnor Date: Mon, 26 Feb 2018 23:10:17 -0800 (PST) CC: wishmaster , freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 07:10:22 -0000 > On 27 Feb. 2018 5:07 pm, "wishmaster" wrote: > > > Boot Filed. UEFI Hard Drive > > Without parameter "-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd" > bhyve does not start at all with error > > virtual machine cannot be booted. > > > Have you tried using the CSM UEFI firmware that came in same bundle as the > one above? It's worth a try. That was going to be my next suggestion as well. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Tue Feb 27 07:12:05 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C2C5EF2A933 for ; Tue, 27 Feb 2018 07:12:05 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 349F886290 for ; Tue, 27 Feb 2018 07:12:05 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id DB6C820ADBF0 for ; Tue, 27 Feb 2018 17:12:02 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id D455A280903 for ; Tue, 27 Feb 2018 17:12:02 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id pb8g0tcVbEAa for ; Tue, 27 Feb 2018 17:12:02 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id DC38B2808FA; Tue, 27 Feb 2018 17:12:00 +1000 (AEST) Subject: Re: Migrate from real server to virtual To: Jason Tubnor , wishmaster Cc: freebsd-rwg@pdx.rh.cn85.dnsmgr.net, freebsd-virtualization@freebsd.org References: <1519655843.315990939.0ghqn7l2@frv52.fwdcdn.com> <201802261507.w1QF7w0g010682@pdx.rh.CN85.dnsmgr.net> <1519711012.787233844.2n5j39fz@frv52.fwdcdn.com> From: Peter Grehan Message-ID: <5afabe23-f3ab-3b63-e51f-013ff77c1f88@freebsd.org> Date: Mon, 26 Feb 2018 23:11:58 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=Op4juWPpsa0A:10 a=5MdHBi09tl80OceswdAA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 07:12:05 -0000 > Have you tried using the CSM UEFI firmware that came in same bundle as the > one above? It's worth a try. Unfortunately that is known not to work with Windows :( later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 07:13:53 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43DF2F2AA9A for ; Tue, 27 Feb 2018 07:13:53 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 937F386397 for ; Tue, 27 Feb 2018 07:13:52 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1R7Do3v013869; Mon, 26 Feb 2018 23:13:50 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1R7DoUL013868; Mon, 26 Feb 2018 23:13:50 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802270713.w1R7DoUL013868@pdx.rh.CN85.dnsmgr.net> Subject: Re: Re[2]: Re[2]: Migrate from real server to virtual In-Reply-To: <1519711012.787233844.2n5j39fz@frv52.fwdcdn.com> To: wishmaster Date: Mon, 26 Feb 2018 23:13:50 -0800 (PST) CC: "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 07:13:53 -0000 ... > > Boot Failed? So windows never started. > > Your not having a shutdown problem your having a start up failure. > > > > What is the output of: > > file /vm/img/disk1.raw > > file /VM/distro/null.iso > > > > And do you really have /vm and /VM? Or is that a typo? You have not answered these 3 questions.... what is output of "file /vm/img/disk1.raw" what is output of "file /VM/distro/null.iso" Is there a possible typo here in your command line??? vm vs VM? > > I said not clear. I can not reboot hardware server for some reason and therefore do not know boot settings: or this is UEFI boot or Legacy. > But problem is in inability to boot the virtual server. After I connect via VNC I see this error: > > Boot Filed. UEFI Hard Drive > > Without parameter "-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd" bhyve does not start at all with error Without a BIOS you must use bhyveload to get a kernel loaded, and thats not going to work for your Windows img. > virtual machine cannot be booted. > > -- > Vitaly -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Tue Feb 27 08:00:06 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CE4AEF2D628 for ; Tue, 27 Feb 2018 08:00:06 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv199.fwdcdn.com (frv199.fwdcdn.com [212.42.77.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8B60F87BB8 for ; Tue, 27 Feb 2018 08:00:06 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=OmfqSE8t0JC+XvED66JVWJ1/CX35c8TLENh1L/mLC3k=; b=s8t/+aS+YZ6hycBzCsCe3BxL9g gBQdnA3erbvdmZq9/MiTzuLUl08QBqJbiv3WlGBJ7OwXKfRSSMRg7Bs5Vg9geu720Ti97Ntb2cBk4 DAOP1zJROYKM27O97+dgPvVN0plHg+5jqFYfjN1kxs+G9gtkHfQ+ZkTZWmNHFNvmGneA=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv199.fwdcdn.com with smtp ID 1eqaB8-000NY6-BW for freebsd-virtualization@freebsd.org; Tue, 27 Feb 2018 10:00:02 +0200 Date: Tue, 27 Feb 2018 10:00:02 +0200 From: wishmaster Subject: Re[2]: Re[2]: Re[2]: Migrate from real server to virtual To: "Rodney W. Grimes" Cc: "freebsd-virtualization@freebsd.org" X-Mailer: mail.ukr.net 5.0 Message-Id: <1519718030.395694294.bemhjglf@frv52.fwdcdn.com> In-Reply-To: <201802270713.w1R7DoUL013868@pdx.rh.CN85.dnsmgr.net> References: <1519711012.787233844.2n5j39fz@frv52.fwdcdn.com> <201802270713.w1R7DoUL013868@pdx.rh.CN85.dnsmgr.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 27 Feb 2018 10:00:02 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 08:00:07 -0000 --- Original message --- From: "Rodney W. Grimes" Date: 27 February 2018, 09:13:56 > ... > > > > Boot Failed? So windows never started. > > > Your not having a shutdown problem your having a start up failure. > > > > > > What is the output of: > > > file /vm/img/disk1.raw > > > file /VM/distro/null.iso > > > > > > And do you really have /vm and /VM? Or is that a typo? > > > You have not answered these 3 questions.... > what is output of "file /vm/img/disk1.raw" > what is output of "file /VM/distro/null.iso" > > Is there a possible typo here in your command line??? vm vs VM? This files are present and without typo as I have copied path and filenames via clipboard. Next I will try with sysutils/uefi-edk2-bhyve-csm. -- Vitaly From owner-freebsd-virtualization@freebsd.org Tue Feb 27 08:17:24 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53B82F2EB0A for ; Tue, 27 Feb 2018 08:17:24 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A2DFE686C9 for ; Tue, 27 Feb 2018 08:17:23 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w1R8HJUH004416; Tue, 27 Feb 2018 09:17:19 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 55E61D44; Tue, 27 Feb 2018 09:17:19 +0100 (CET) Message-ID: <5A95140E.8030909@omnilan.de> Date: Tue, 27 Feb 2018 09:17:18 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Paul Vixie CC: Ruben , FreeBSD virtualization Subject: Re: superfluous host interfaces References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> <5A94F730.7040009@redbarn.org> In-Reply-To: <5A94F730.7040009@redbarn.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Tue, 27 Feb 2018 09:17:20 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 08:17:24 -0000 Bezüglich Paul Vixie's Nachricht vom 27.02.2018 07:14 (localtime): > > > Harry Schmalzbauer wrote: >> Bezüglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): >>> On 26/02/2018 10:56, Harry Schmalzbauer wrote: >> … >>>> Another, personally very significant, reason is that you'll get a >>>> superfluous host interface for each if_bridge(4), which makes the >>>> output >>>> of plain ifconfig(8) kind of unreadable. >> … >>> By superflous host interfaces, do you mean the tap interfaces configured >>> for each vm together with the bridge interfaces they are "bundled" in? >> >> Additionally to the if_tap(4) ethernet host interfaces, you also get >> if_bridge(4) ethernet interfaces, named bridgeX if I remember correctly. > > you do not remember correctly. Please see next para. >> [mm1.redbarn:amd64] egrep 'bridge|tap' /etc/rc.conf >> autobridge_interfaces="bridge0" >> autobridge_bridge0="tap* igb1" >> cloned_interfaces="bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 tap7" >> ifconfig_bridge0="inet 24.104.150.210/27" >> ifconfig_bridge0_ipv6="inet6 2001:559:8000:cd::2/64 auto_linklocal up" >> ifconfig_tap0="up" >> ifconfig_tap1="up" >> ifconfig_tap2="up" >> ifconfig_tap3="up" >> ifconfig_tap4="up" >> ifconfig_tap5="up" >> ifconfig_tap6="up" >> ifconfig_tap7="up" >> [mm1.redbarn:amd64] ifconfig | egrep '^(bridge|tap)' >> bridge0: flags=8843 metric 0 >> mtu 1500 That's what I mean; and it's named bridgeX, so memeory works in that case ;-) If you have only one "LAN" sharing all VMs, the one additional interface is neglectable. But my setups are different. I have almost as many different 802.11q separated ethernet collsion domains (VLANs) as VMs. That's what ESXi's portgroup is used for. I need a separate switch for each VLAN (guests mustn't be able to sniff traffic etc.). … >> And using ng_bridge(4) instead of if_bridge(4) doesn't change the need >> for if_tap(4). Only with vale(4) switches, bhyve(8) was able to provide >> virtio-net connection wihtout "spamming" the host's ethernet interface >> list (no tapX, no bridgeX). > > how did you get bhyve to use the netmap API rather than the tap > character special device? Not me, peter commited the following: https://svnweb.freebsd.org/base/head/usr.sbin/bhyve/pci_virtio_net.c?r1=288470&r2=293459 >From that an, you don't need to add any host ethernet devices/interfaces, simply start your VM with e.g. "-s 1:0,virtio-net,vale0:1,mac=02:03:04:05:06:07". As long as you created vale0, port [:]1 will be created dynamically and also destroyed after shutdown. Again, to mimic ESXi's portgroups, you need one vale(4) switch for each VLAN. And to uplink, you need to utilize if_valn(4), which forces netmap emulated mode. If you don't have/need VLANs, you can uplink a supported NIC via native netmap support, and additionally gain significatn efficiency improvements. Unfortunately, at least if_vlan(4) uplinks, don't work reliably. After some short time, the complete network netmap(4) subsystem locks up. I talked with Vincenco Maffione (a member of Liugi Rizzo's netmap(4) team of University of Pisa) and fixing emulated netpmap mode on FreeBSD doesn't have really high priority there, since such a setup is considered as weak design. For sure, it's a hack/workarround, but we don't have VLAN/portgroup support in vale(4) nor in byhve(8), and writing my own userland filter is beyond my scope. -harry From owner-freebsd-virtualization@freebsd.org Tue Feb 27 08:28:33 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DC02FF2F949 for ; Tue, 27 Feb 2018 08:28:33 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F33D68EDA for ; Tue, 27 Feb 2018 08:28:32 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1R8STrs014219; Tue, 27 Feb 2018 00:28:29 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1R8STFo014218; Tue, 27 Feb 2018 00:28:29 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802270828.w1R8STFo014218@pdx.rh.CN85.dnsmgr.net> Subject: Re: Re[2]: Re[2]: Re[2]: Migrate from real server to virtual In-Reply-To: <1519718030.395694294.bemhjglf@frv52.fwdcdn.com> To: wishmaster Date: Tue, 27 Feb 2018 00:28:29 -0800 (PST) CC: "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 08:28:34 -0000 [ Charset UTF-8 unsupported, converting... ] > > > > --- Original message --- > From: "Rodney W. Grimes" > Date: 27 February 2018, 09:13:56 > > > > > ... > > > > > > Boot Failed? So windows never started. > > > > Your not having a shutdown problem your having a start up failure. > > > > > > > > What is the output of: > > > > file /vm/img/disk1.raw > > > > file /VM/distro/null.iso > > > > > > > > And do you really have /vm and /VM? Or is that a typo? > > > > > > You have not answered these 3 questions.... > > what is output of "file /vm/img/disk1.raw" > > what is output of "file /VM/distro/null.iso" > > > > Is there a possible typo here in your command line??? vm vs VM? > > This files are present and without typo as I have copied path and filenames via clipboard. > Next I will try with sysutils/uefi-edk2-bhyve-csm. It would still be helpful to know what the host system thinks of these files, please output of: file /vm/img/disk1.raw file /VM/distory/null.iso -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Tue Feb 27 08:44:41 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0EE42F30D23 for ; Tue, 27 Feb 2018 08:44:41 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv197.fwdcdn.com (frv197.fwdcdn.com [212.42.77.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9C50769B8E for ; Tue, 27 Feb 2018 08:44:40 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=5SatRPv+ci9tq2ISCE3L9YClwGj9EiLfouP/ryMhEuY=; b=IhLBSooUqwdaCDSTXL6DP1KJ8g oNPbVDc29vj85uYddjo/+Qk76VsGsqYzWGYlwXYvFAbl3cqejE0s/yXs57KdBNCWR8220mjCB/8l4 aiNwAKF6IbZuW1+Y3eVTnkr4HrvkyVI8MedHOYSyc+qENcfn0xFarVdwsLwMzP2eP/fk=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1eqasC-000Jyg-Ia for freebsd-virtualization@freebsd.org; Tue, 27 Feb 2018 10:44:32 +0200 Date: Tue, 27 Feb 2018 10:44:32 +0200 From: wishmaster Subject: Re[2]: Re[2]: Re[2]: Re[2]: Migrate from real server to virtual To: "Rodney W. Grimes" Cc: "freebsd-virtualization@freebsd.org" X-Mailer: mail.ukr.net 5.0 Message-Id: <1519720616.366400937.tlfp1iws@frv52.fwdcdn.com> In-Reply-To: <201802270828.w1R8STFo014218@pdx.rh.CN85.dnsmgr.net> References: <1519718030.395694294.bemhjglf@frv52.fwdcdn.com> <201802270828.w1R8STFo014218@pdx.rh.CN85.dnsmgr.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 27 Feb 2018 10:44:32 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 08:44:41 -0000 --- Original message --- From: "Rodney W. Grimes" Date: 27 February 2018, 10:28:37 > [ Charset UTF-8 unsupported, converting... ] > > > > > > > > --- Original message --- > > From: "Rodney W. Grimes" > > Date: 27 February 2018, 09:13:56 > > > > > > > > > ... > > > > > > > > Boot Failed? So windows never started. > > > > > Your not having a shutdown problem your having a start up failure. > > > > > > > > > > What is the output of: > > > > > file /vm/img/disk1.raw > > > > > file /VM/distro/null.iso > > > > > > > > > > And do you really have /vm and /VM? Or is that a typo? > > > > > > > > > You have not answered these 3 questions.... > > > what is output of "file /vm/img/disk1.raw" > > > what is output of "file /VM/distro/null.iso" > > > > > > Is there a possible typo here in your command line??? vm vs VM? > > > > This files are present and without typo as I have copied path and filenames via clipboard. > > Next I will try with sysutils/uefi-edk2-bhyve-csm. > > It would still be helpful to know what the host system thinks of > these files, please output of: > file /vm/img/disk1.raw > file /VM/distory/null.iso Ok, # file ./null.iso ./null.iso: empty # file ./disk1.raw ./disk1.raw: DOS/MBR boot sector MS-MBR Windows 7 english at offset 0x163 "Invalid partition table" at offset 0x17b "Error loading operating system" at offset 0x19a "Missing operating system", disk signature 0xbaf010d7; partition 1 : ID=0x7, active, start-CHS (0x0,32,33), end-CHS (0xc,223,19), startsector 2048, 204800 sectors; partition 2 : ID=0x7, start-CHS (0xc,223,20), end-CHS (0x3ff,254,63), startsector 206848, 253745152 sectors; partition 3 : ID=0x7, start-CHS (0x3ff,254,63), end-CHS (0x3ff,254,63), startsector 253953468, 722810844 sectors May be I incorrect have converted this image?... I have just tested with UEFI_CSM. I am able manage BHYVE UEFI via F2 key pressing and there are Legacy CD-ROM and Legacy Hard Drive options. If choosing HDD and continue to booting just black screen... From owner-freebsd-virtualization@freebsd.org Tue Feb 27 15:22:45 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0C0DDF2EC2D for ; Tue, 27 Feb 2018 15:22:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 995117D380 for ; Tue, 27 Feb 2018 15:22:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DBF8011D63 for ; Tue, 27 Feb 2018 15:22:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1RFMhPO077266 for ; Tue, 27 Feb 2018 15:22:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1RFMhEc077265 for freebsd-virtualization@FreeBSD.org; Tue, 27 Feb 2018 15:22:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 226142] [bhyve] [panic] mtx_lock_spin: recursed on non-recursive mutex vcpu lock @ /usr/src/sys/amd64/vmm/vmm.c:2246 Date: Tue, 27 Feb 2018 15:22:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 15:22:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226142 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-virtualization@Free | |BSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 27 15:25:20 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E129EF2F018 for ; Tue, 27 Feb 2018 15:25:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E80D7D70E for ; Tue, 27 Feb 2018 15:25:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CA44011D7B for ; Tue, 27 Feb 2018 15:25:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1RFPJZH080903 for ; Tue, 27 Feb 2018 15:25:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1RFPJmY080902 for freebsd-virtualization@FreeBSD.org; Tue, 27 Feb 2018 15:25:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 226142] [bhyve] [panic] mtx_lock_spin: recursed on non-recursive mutex vcpu lock @ /usr/src/sys/amd64/vmm/vmm.c:2246 Date: Tue, 27 Feb 2018 15:25:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 15:25:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226142 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grehan@FreeBSD.org --- Comment #1 from Peter Grehan --- The issue (and a proposed fix) is discussed here https://reviews.freebsd.org/D14382 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 27 15:40:24 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3FFFF30A07 for ; Tue, 27 Feb 2018 15:40:24 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 604E87ECE9 for ; Tue, 27 Feb 2018 15:40:24 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id C8ECC21758 for ; Tue, 27 Feb 2018 10:40:23 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Tue, 27 Feb 2018 10:40:23 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; bh=QbxFb4a3xIIzWLnrVMl6WpEHQ7XvM4W/NGVGvY+7zVw=; b=ihqMbMlh clX0cpVvDsAUlONdcagC//yCNX/rz/jrXPMBdPpJ5Vp3aZ1zj2I1RBXuYjbK7f+C EYpNcNng4ALvRyibqHt+g2BngfjCNwES8ymO4tVSVy8cCYloAxMavjB63asU13w3 7m1ZJMq0OeuI0GTnvQyH34FlUv0uq/+u0n7xGfxjjqrkFLYPXgNwjKK2GND0GClU Vp1/SUQ97MZ2Kvet0a48Gn4+kg2Ib0G8oPIkCpEiI8XHRmibjc2x5lZOhqSDoB7I Rq2iBEqzd/vi50LglGqIyPpxglxDBsjDREdBJ2wndEyLHcRmXgxptpp47oHn7XnQ XeTEgdxoeqGyXg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; bh=QbxFb4a3xIIzWLnrVMl6WpEHQ7XvM 4W/NGVGvY+7zVw=; b=HvH554KozywLChawdR+t4ciLSgs4ODDJM6uUQfzLHEHqF JN6Pa4JV8YpzCAsEA4JbrOEaruCvLv/fY1ufIVMpLghkTZdqCm05AZ+k6CvV3E4V TMo2QiaAvKdS7JN2XGVa0yaVB6J/4I0b8uW4dnk6/7o7y/cgnfsbsPvrdY9wWiN0 JYl0W8/M7ht2OPq1Iz47i07K0ywsVcq7lHSFDJxolUUSzIcJ3aSijbjZVbeuKiWA wVC9UVrssbxXYyleBcr7ALF6Ri2QW3f5ybq+LvmaIDkI4GzMi8nZxVxeDlTMmUwZ 68R8+uEMWm++6uixqBNGwGL3kWQf/fKXb30KSdOLw== X-ME-Sender: Received: from v007.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA id 5764D24608 for ; Tue, 27 Feb 2018 10:40:23 -0500 (EST) Date: Tue, 27 Feb 2018 15:40:21 +0000 From: tech-lists To: freebsd-virtualization@freebsd.org Subject: Re: bhyve manager Message-ID: <20180227154021.GA46543@v007.zyxst.net> Mail-Followup-To: freebsd-virtualization@freebsd.org References: <20180225131401.GA3138@v007.zyxst.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <20180225131401.GA3138@v007.zyxst.net> User-Agent: Mutt/1.9.3 (2018-01-21) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 15:40:24 -0000 On Sun, Feb 25, 2018 at 01:14:01PM +0000, tech-lists wrote: >Hi, > >What do folks use for their bhyve guest management? > >I have always spun bhyve guests up by hand but now I'm considering >streamlining the process. What do you use? thanks for all the suggestions. I wasn't sure where to start before. Now I know. -- J. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 15:49:15 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF4EBF3178E for ; Tue, 27 Feb 2018 15:49:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E10B7F5B3 for ; Tue, 27 Feb 2018 15:49:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9356E12082 for ; Tue, 27 Feb 2018 15:49:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1RFnETU033341 for ; Tue, 27 Feb 2018 15:49:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1RFnEvc033340 for freebsd-virtualization@FreeBSD.org; Tue, 27 Feb 2018 15:49:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225588] VirtualBox 5.2.6 guests freeze after a while, sometimes with I/O errors Date: Tue, 27 Feb 2018 15:49:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 15:49:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225588 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-ports-bugs@FreeBSD. |freebsd-virtualization@Free |org |BSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 27 16:42:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21D04F35C27 for ; Tue, 27 Feb 2018 16:42:00 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8A4C1821A3 for ; Tue, 27 Feb 2018 16:41:58 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1RGfsaf016072; Tue, 27 Feb 2018 08:41:54 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1RGfs1g016071; Tue, 27 Feb 2018 08:41:54 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802271641.w1RGfs1g016071@pdx.rh.CN85.dnsmgr.net> Subject: Re: Re[2]: Re[2]: Re[2]: Re[2]: Migrate from real server to virtual In-Reply-To: <1519720616.366400937.tlfp1iws@frv52.fwdcdn.com> To: wishmaster Date: Tue, 27 Feb 2018 08:41:54 -0800 (PST) CC: "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 16:42:00 -0000 > --- Original message --- > From: "Rodney W. Grimes" > Date: 27 February 2018, 10:28:37 > > > --- Original message --- > > > From: "Rodney W. Grimes" > > > Date: 27 February 2018, 09:13:56 > > > > ... > > > > > > > > > > Boot Failed? So windows never started. > > > > > > Your not having a shutdown problem your having a start up failure. > > > > > > > > > > > > What is the output of: > > > > > > file /vm/img/disk1.raw ^^^^ > > > > > > file /VM/distro/null.iso ^^^^ Your command in the original email had these 2 strings, please correct that error in your command. VM != vm in unix world. > > > > > > And do you really have /vm and /VM? Or is that a typo? > > > > > > > > > > > > You have not answered these 3 questions.... > > > > what is output of "file /vm/img/disk1.raw" > > > > what is output of "file /VM/distro/null.iso" > > > > > > > > Is there a possible typo here in your command line??? vm vs VM? > > > > > > This files are present and without typo as I have copied path and filenames via clipboard. > > > Next I will try with sysutils/uefi-edk2-bhyve-csm. > > > > It would still be helpful to know what the host system thinks of > > these files, please output of: > > file /vm/img/disk1.raw > > file /VM/distory/null.iso > > Ok, > > # file ./null.iso > ./null.iso: empty > > # file ./disk1.raw > ./disk1.raw: DOS/MBR boot sector MS-MBR Windows 7 english at offset 0x163 "Invalid partition table" at offset 0x17b "Error loading operating system" at offset 0x19a "Missing operating system", disk signature 0xbaf010d7; partition 1 : ID=0x7, active, start-CHS (0x0,32,33), end-CHS (0xc,223,19), startsector 2048, 204800 sectors; partition 2 : ID=0x7, start-CHS (0xc,223,20), end-CHS (0x3ff,254,63), startsector 206848, 253745152 sectors; partition 3 : ID=0x7, start-CHS (0x3ff,254,63), end-CHS (0x3ff,254,63), startsector 253953468, 722810844 sectors Ok so infact these 2 files are in the same directory, that needs to be spelled exactly the same on the command line of bhyyve. But I think the bigger problem is that this is an MBR disk with Windows 7 in it, I do not believe that bhyve can run Windows 7 at this time. > May be I incorrect have converted this image?... The results above look ok, though the alignment is a bit odd. You man want to play with mdconfig and fusefs to see if you can read the converted image: pkg install fusefs-ntfs mdconfig -f disk1.raw ntfs-3g /dev/md0s1 /mnt find /mnt That should atleast validate the file system a little. > I have just tested with UEFI_CSM. > I am able manage BHYVE UEFI via F2 key pressing and there are Legacy CD-ROM and Legacy Hard Drive options. If choosing HDD and continue to booting just black screen... Peter pointed out to us that UEFI_CSM does not work with windows. I think the bigger problem here is this appears to be a windows 7 image? -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Tue Feb 27 17:55:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 067C6F3B137 for ; Tue, 27 Feb 2018 17:55:22 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A7BE486042; Tue, 27 Feb 2018 17:55:21 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w1RHtKcH071210 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Tue, 27 Feb 2018 12:55:21 -0500 (EST) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w1RHtJCH040626; Tue, 27 Feb 2018 12:55:19 -0500 (EST) (envelope-from mike@sentex.net) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) To: Peter Grehan Cc: "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> From: Mike Tancsa Organization: Sentex Communications Message-ID: <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> Date: Tue, 27 Feb 2018 12:55:20 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 17:55:22 -0000 On 2/25/2018 12:51 PM, Peter Grehan wrote: > Hi Mike, > >  (moving this to -virtualization) > >> Actually I can confirm the same sort of hard lockup happens on my Epyc >> board with RELENG11.  It also happens in current. I will file a PR and >> post on freebsd-current in case someone has any suggestions on how to >> try and figure out whats going on. > >  I could reproduce this on a Ryzen 1700 with HT enabled - it took ~700 > seconds, and the entire machine locked up. > >  An interesting point is a single VM was able to run to completion. > >  I'll keep testing with various combinations of numbers of VMs, > different vCPUs per VM, and pinning guest vCPUs. Hi Peter, I upgraded both boxes (Ryzen and Epyc) to HEAD. For the record, the Epyc CPU is CPU1 Information AMD EPYC 7281 16-Core Family: 17h Model: 00h-0Fh Microcode Patch Level: 8001207 Bios Release Date: 01/08/2018 SuperMicro: H11SSL-i Not sure if its related to core count or not, but it takes several instances on the Epyc to lock up and takes a lot longer. I enabled IOMMU on it as well, and it's dmesg shows below. But the lockups are still there with or without it enabled. ivhd0: on acpi0 ivhd0: Flag:b0 ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd0: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd0: Extended features[62:32]:f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd0: supported paging level:7, will use only: 4 ivhd0: device range: 0x0 - 0xffff ivhd0: PCI cap 0x190b640f@0x40 feature:19 ivhd1: on acpi0 ivhd1: Flag:b0 ivhd1: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd1: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd1: Extended features[62:32]:f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd1: supported paging level:7, will use only: 4 ivhd1: device range: 0x0 - 0xffff ivhd1: PCI cap 0x190b640f@0x40 feature:19 ivhd2: on acpi0 ivhd2: Flag:b0 ivhd2: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd2: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd2: Extended features[62:32]:f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd2: supported paging level:7, will use only: 4 ivhd2: device range: 0x0 - 0x3ffe ivhd2: PCI cap 0x190b640f@0x40 feature:19 ivhd3: on acpi0 ivhd3: Flag:b0 ivhd3: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd3: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd3: Extended features[62:32]:f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd3: supported paging level:7, will use only: 4 ivhd3: device range: 0x0 - 0x3ffe ivhd3: PCI cap 0x190b640f@0x40 feature:19 ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-virtualization@freebsd.org Tue Feb 27 18:40:50 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0DBFF3E82E for ; Tue, 27 Feb 2018 18:40:50 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 28F93681EA for ; Tue, 27 Feb 2018 18:40:49 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 832A720B4B94 for ; Wed, 28 Feb 2018 04:40:47 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 718122820AA for ; Wed, 28 Feb 2018 04:40:47 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id jaDl1EGfdLSF for ; Wed, 28 Feb 2018 04:40:47 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 3C49D2808FA; Wed, 28 Feb 2018 04:40:44 +1000 (AEST) Subject: Re: Migrate from real server to virtual To: "Rodney W. Grimes" , wishmaster Cc: "freebsd-virtualization@freebsd.org" References: <201802271641.w1RGfs1g016071@pdx.rh.CN85.dnsmgr.net> From: Peter Grehan Message-ID: <038eaa86-9a8c-8385-a61b-115c6dfb1ded@freebsd.org> Date: Tue, 27 Feb 2018 10:40:41 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <201802271641.w1RGfs1g016071@pdx.rh.CN85.dnsmgr.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=Op4juWPpsa0A:10 a=ZiVqx6C8AIpdG7eco4cA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 18:40:50 -0000 > But I think the bigger problem is that this is an MBR disk with Windows 7 in it, I > do not believe that bhyve can run Windows 7 at this time. Bhyve has been able to run Win7 since 2015, though x64 only and in UEFI mode. later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 18:52:32 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D1B2FF3F68D for ; Tue, 27 Feb 2018 18:52:32 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5E62468EAF; Tue, 27 Feb 2018 18:52:28 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (203-59-173-201.dyn.iinet.net.au [203.59.173.201]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id w1RIqFu1074762 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Tue, 27 Feb 2018 10:52:19 -0800 (PST) (envelope-from julian@freebsd.org) To: FreeBSD virtualization mailing list , Peter Grehan From: Julian Elischer Subject: bhyve bombed out.. Message-ID: <052690c9-1a8c-241e-d09c-f6feefd58638@freebsd.org> Date: Wed, 28 Feb 2018 02:52:09 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 18:52:33 -0000 environment: HOST: freebsd 12 (a couple of weeks ago) on ESX 6.0.0 yes..  nested Virtualisation Client: slightly modified freebsd current (from the 20th) Bhyve dies afer a while with: vm exit[0]     reason        VMX     rip        0x00000008003e4b03     inst_length    0     status        0     exit_reason    48     qualification    0x0000000000000001     inst_type        0     inst_error        0 Abort trap *** Error code 99 Any suggestions? I'm working towards having a hardware host. This doesn't work at all on esx 5.1.1 so I'm actually amazed it runs for as long as it does on 6.0.0... (days if not doing much). From owner-freebsd-virtualization@freebsd.org Tue Feb 27 18:53:41 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CD621F3F84B for ; Tue, 27 Feb 2018 18:53:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 67E1F691E7 for ; Tue, 27 Feb 2018 18:53:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 82F1713B17 for ; Tue, 27 Feb 2018 18:53:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1RIreb5081467 for ; Tue, 27 Feb 2018 18:53:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1RIreDD081466 for freebsd-virtualization@FreeBSD.org; Tue, 27 Feb 2018 18:53:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 226142] [bhyve] [panic] mtx_lock_spin: recursed on non-recursive mutex vcpu lock @ /usr/src/sys/amd64/vmm/vmm.c:2246 Date: Tue, 27 Feb 2018 18:53:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dch@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 18:53:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226142 --- Comment #2 from Dave Cottlehuber --- Thanks Peter! giving it a whirl now; https://github.com/skunkwerks/freebsd/commit/e1f1fbb91c80d7f60801e2487c3e87= 61d61f7864 for a git-friendly branch. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 27 19:04:32 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7614CF40639 for ; Tue, 27 Feb 2018 19:04:32 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1256E69BA8 for ; Tue, 27 Feb 2018 19:04:32 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 0BC0D6BB7 for ; Tue, 27 Feb 2018 19:04:32 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 0B6B61286A9; Tue, 27 Feb 2018 19:04:32 +0000 (UTC) Date: Tue, 27 Feb 2018 19:04:32 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67>, none X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqVq8A= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) reviewer(@rgrimes) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 19:04:32 -0000 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIGFkZGVkIGEgY29tbWVudC4KCgogIHBp bmc/CiAgCiAgV291bGQgdGhlc2UgY2hhbmdlcyBiZSB3ZWxjb21lIGluIGJhc2U/IElmIHllcywg d2hhdCB3b3VsZCBzdGlsbCBuZWVkIHRvIGJlIGRvbmUgdG8gdGhpcyByZXZpZXcgaW4gb3JkZXIg dG8gZ2V0IGl0IGludG8gYSBjb21taXR0YWJsZSBzdGF0ZT8KClJFVklTSU9OIERFVEFJTAogIGh0 dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzMKCkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0 cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL3NldHRpbmdzL3BhbmVsL2VtYWlscHJlZmVyZW5jZXMv CgpUbzogZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlLCBpbXAsIHJncmltZXMsICNi aHl2ZSwgZ3JlaGFuCkNjOiBncmVoYW4sIGltcCwgZnJlZWJzZC12aXJ0dWFsaXphdGlvbi1saXN0 LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Tue Feb 27 19:41:52 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DCD4AF21A5B for ; Tue, 27 Feb 2018 19:41:52 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D32E6BD26 for ; Tue, 27 Feb 2018 19:41:52 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 746F3725A for ; Tue, 27 Feb 2018 19:41:52 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 742C01339E3; Tue, 27 Feb 2018 19:41:52 +0000 (UTC) Date: Tue, 27 Feb 2018 19:41:52 +0000 To: freebsd-virtualization@freebsd.org From: rgrimes Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <6a98dbfee5e21ae882f9da4e7cdd33bf@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67>, none X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqVtIA= X-Phabricator-Stamps: actor(@rgrimes) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) reviewer(@rgrimes) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 19:41:53 -0000 cmdyaW1lcyBhZGRlZCBhIGNvbW1lbnQuCgoKICBJZiBQZXRlciBhY2NlcHRzIHRoaXMgYW5kIHNh eXMgSSBjYW4gZ28gYWhlYWQgd2l0aCBhIGNvbW1pdCBJIHdvdWxkIGRvIHRoYXQsIGJ1dCBJIG5l ZWQgaGlzIGFwcHJvdmFsIHRvIGNvbW1pdCBpdC4KClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8v cmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzMKCkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6Ly9y ZXZpZXdzLmZyZWVic2Qub3JnL3NldHRpbmdzL3BhbmVsL2VtYWlscHJlZmVyZW5jZXMvCgpUbzog ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlLCBpbXAsIHJncmltZXMsICNiaHl2ZSwg Z3JlaGFuCkNjOiBncmVoYW4sIGltcCwgZnJlZWJzZC12aXJ0dWFsaXphdGlvbi1saXN0LCAjY29u dHJpYnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Tue Feb 27 20:09:59 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 459EEF24078 for ; Tue, 27 Feb 2018 20:09:59 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id BCFA06D1A4 for ; Tue, 27 Feb 2018 20:09:58 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from Vincents-MacBook-Pro-2.local (vhoffman.plus.com [81.174.148.213]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by unsane.co.uk (Postfix) with ESMTPSA id 917C53018D for ; Tue, 27 Feb 2018 20:09:52 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=unsane.co.uk; s=251017; t=1519762192; bh=Lq+JclnLv81fKeDcxSjQe5D/SHy5oK77OhxigB2BbKQ=; h=Subject:To:References:From:Date:In-Reply-To; b=ZsoSzzdXbyrKIElHcdpRZtZcpu+VULfH6RNghwrycGEOYOvflaJ7lWOJi0+qWXGyR 9USiKNoUYxERLtzV62J6E12W5UkxW9rxiUz2DEQepDVljyK5J+9WSyHwsqIGRdXXtb 0W5n6om/JnqxiFuoTbAymfP8keY0gf5s5aox7Le0= Subject: Re: superfluous host interfaces To: freebsd-virtualization@freebsd.org References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> <5A94F730.7040009@redbarn.org> <5A95140E.8030909@omnilan.de> From: Vincent Hoffman-Kazlauskas Message-ID: Date: Tue, 27 Feb 2018 20:09:52 +0000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <5A95140E.8030909@omnilan.de> Content-Type: text/plain; charset=windows-1252 Content-Language: en-GB Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 20:09:59 -0000 On 27/02/2018 08:17, Harry Schmalzbauer wrote: > Bezüglich Paul Vixie's Nachricht vom 27.02.2018 07:14 (localtime): >> >> >> Harry Schmalzbauer wrote: >>> Bezüglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): >>>> On 26/02/2018 10:56, Harry Schmalzbauer wrote: >>> … >>>>> Another, personally very significant, reason is that you'll get a >>>>> superfluous host interface for each if_bridge(4), which makes the >>>>> output >>>>> of plain ifconfig(8) kind of unreadable. >>> … >>>> By superflous host interfaces, do you mean the tap interfaces configured >>>> for each vm together with the bridge interfaces they are "bundled" in? >>> >>> Additionally to the if_tap(4) ethernet host interfaces, you also get >>> if_bridge(4) ethernet interfaces, named bridgeX if I remember correctly. >> >> you do not remember correctly. > > Please see next para. > > >>> [mm1.redbarn:amd64] egrep 'bridge|tap' /etc/rc.conf >>> autobridge_interfaces="bridge0" >>> autobridge_bridge0="tap* igb1" >>> cloned_interfaces="bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 tap7" >>> ifconfig_bridge0="inet 24.104.150.210/27" >>> ifconfig_bridge0_ipv6="inet6 2001:559:8000:cd::2/64 auto_linklocal up" >>> ifconfig_tap0="up" >>> ifconfig_tap1="up" >>> ifconfig_tap2="up" >>> ifconfig_tap3="up" >>> ifconfig_tap4="up" >>> ifconfig_tap5="up" >>> ifconfig_tap6="up" >>> ifconfig_tap7="up" >>> [mm1.redbarn:amd64] ifconfig | egrep '^(bridge|tap)' >>> bridge0: flags=8843 metric 0 >>> mtu 1500 > > That's what I mean; and it's named bridgeX, so memeory works in that > case ;-) > If you have only one "LAN" sharing all VMs, the one additional interface > is neglectable. > But my setups are different. > I have almost as many different 802.11q separated ethernet collsion > domains (VLANs) as VMs. > That's what ESXi's portgroup is used for. I need a separate switch for > each VLAN (guests mustn't be able to sniff traffic etc.). > Untested by me with bhyve but it looks like net/openvswitch (http://www.openvswitch.org/) could be useful to you. As I say though untested by me so cant speak for performance etc. Vince > > … > >>> And using ng_bridge(4) instead of if_bridge(4) doesn't change the need >>> for if_tap(4). Only with vale(4) switches, bhyve(8) was able to provide >>> virtio-net connection wihtout "spamming" the host's ethernet interface >>> list (no tapX, no bridgeX). >> >> how did you get bhyve to use the netmap API rather than the tap >> character special device? > > Not me, peter commited the following: > https://svnweb.freebsd.org/base/head/usr.sbin/bhyve/pci_virtio_net.c?r1=288470&r2=293459 > > From that an, you don't need to add any host ethernet > devices/interfaces, simply start your VM with e.g. "-s > 1:0,virtio-net,vale0:1,mac=02:03:04:05:06:07". > > As long as you created vale0, port [:]1 will be created dynamically and > also destroyed after shutdown. > > Again, to mimic ESXi's portgroups, you need one vale(4) switch for each > VLAN. And to uplink, you need to utilize if_valn(4), which forces > netmap emulated mode. > If you don't have/need VLANs, you can uplink a supported NIC via native > netmap support, and additionally gain significatn efficiency improvements. > Unfortunately, at least if_vlan(4) uplinks, don't work reliably. After > some short time, the complete network netmap(4) subsystem locks up. > I talked with Vincenco Maffione (a member of Liugi Rizzo's netmap(4) > team of University of Pisa) and fixing emulated netpmap mode on FreeBSD > doesn't have really high priority there, since such a setup is > considered as weak design. For sure, it's a hack/workarround, but we > don't have VLAN/portgroup support in vale(4) nor in byhve(8), and > writing my own userland filter is beyond my scope. > > -harry > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Tue Feb 27 21:11:51 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 819E2F29735 for ; Tue, 27 Feb 2018 21:11:51 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 272D97042A for ; Tue, 27 Feb 2018 21:11:51 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (203-59-173-201.dyn.iinet.net.au [203.59.173.201]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id w1RLBiPo075434 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Tue, 27 Feb 2018 13:11:47 -0800 (PST) (envelope-from julian@freebsd.org) Subject: Re: superfluous host interfaces To: Ruben , Harry Schmalzbauer Cc: freebsd-virtualization@freebsd.org References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> From: Julian Elischer Message-ID: <24dc03e2-e28b-0670-4b8f-21e7677ce415@freebsd.org> Date: Wed, 28 Feb 2018 05:11:38 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 21:11:51 -0000 On 26/2/18 6:34 pm, Ruben wrote: > On 26/02/2018 10:56, Harry Schmalzbauer wrote: > >>> Hi Harry, >>> >>> >>> What are your reasons for preferring ng_bridge over the "normal" bridge? >> Two very different main reasons: >> if_bridge(4) is very standards compliant (e.g. that different reserved >> MAC addresses won't get forwarded – don't know any explicit examples out >> of mind), which was problematic for some SDN setups (software defined >> networking, in means of sharing a PHY for multiple VMs and >> simultaniously interconnect VMs to VMs) >> >> Another, personally very significant, reason is that you'll get a >> superfluous host interface for each if_bridge(4), which makes the output >> of plain ifconfig(8) kind of unreadable. >> For VM SDN, I don't need/want those host interfaces, despite they don't >> do any harm. >> >> vale(4) was extremely convinient. Simply create a switch, then each VM >> attaches on the fly :-) >> Unfortunately, I'm unable to debug the lockups and my setups was kind of >> hacky, since I haven't used NIC's native netmap(4) support, but used >> emulated netmap(4) for if_vlan(4). This leads to loss of almost all >> performance advantages, but left convinience advantages. Unfortunately, >> emulated netmap(4) is supposed to have some unresolved problems on >> FreeBSD and upstream hackers consider my hacky setup as wrong by nature >> – which it is technically speaking. For real-world usagen, one would >> need to code a VLAN filter between bhyve(4) and vale(4). Skillwise, I'm >> not the one :-( >> >> -harry > Hi Harry, > > Thank you for elaborating on that. I took the liberty of creating a new > mailthread as my questions are kind of off-topic to the original thread. > > By superflous host interfaces, do you mean the tap interfaces configured > for each vm together with the bridge interfaces they are "bundled" in? > > Overall I'm very happy with my bhyve setups atm. If there are any > speed-/administrative-advantages that come with bridge_ng however, I'm > very interested in switching to such a setup (or at least play with it). > I'm running my vm's without any helper project so I'm flexible enough to > do some fiddling :P > > Do you know of any documentation on using bridge_ng together with bhyve? > My search-engines don't turn up much Im affraid and I haven't stumbled > on it before. I will add another postive to ng_bridge and a negative.. using ng_bridge makes it easier to do funk things with your network if you want to but it requires you to do your own scripting. see the jail examples in /usr/share/examples and replace the jail with bhyve. > > Kind regards, > > Ruben > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > > From owner-freebsd-virtualization@freebsd.org Tue Feb 27 21:14:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2DB30F29B1B for ; Tue, 27 Feb 2018 21:14:14 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CF7F870745 for ; Tue, 27 Feb 2018 21:14:13 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (203-59-173-201.dyn.iinet.net.au [203.59.173.201]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id w1RLE82L075447 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Tue, 27 Feb 2018 13:14:11 -0800 (PST) (envelope-from julian@freebsd.org) Subject: Re: superfluous host interfaces To: Harry Schmalzbauer , Ruben Cc: FreeBSD virtualization References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> From: Julian Elischer Message-ID: Date: Wed, 28 Feb 2018 05:14:02 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <5A93F9DE.9090908@omnilan.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 21:14:14 -0000 On 26/2/18 8:13 pm, Harry Schmalzbauer wrote: > BezĂĽglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): >> On 26/02/2018 10:56, Harry Schmalzbauer wrote: > … >>> Another, personally very significant, reason is that you'll get a >>> superfluous host interface for each if_bridge(4), which makes the output >>> of plain ifconfig(8) kind of unreadable. > … >> By superflous host interfaces, do you mean the tap interfaces configured >> for each vm together with the bridge interfaces they are "bundled" in? > Additionally to the if_tap(4) ethernet host interfaces, you also get > if_bridge(4) ethernet interfaces, named bridgeX if I remember correctly. > The if_bridge(4) host interface is for control purposes only on a VM-SDN > host – at least with my setups. I never needed to make use of IP > numbered bridges. And I don't need to utilize any if_bridge(4) features > like STP, so I consider the bridgeX host interfaces as superfluous in > the VM-SDN use case. > > I'd call the if_tap(4) host interfaces likewise superfluous – you would > only need the corresponding character devices – but that's been > implemented long before the need for SDN setups, so it is like it is. > And using ng_bridge(4) instead of if_bridge(4) doesn't change the need > for if_tap(4). Only with vale(4) switches, bhyve(8) was able to provide > virtio-net connection wihtout "spamming" the host's ethernet interface > list (no tapX, no bridgeX). > > >> Overall I'm very happy with my bhyve setups atm. If there are any >> speed-/administrative-advantages that come with bridge_ng however, I'm >> very interested in switching to such a setup (or at least play with it). >> I'm running my vm's without any helper project so I'm flexible enough to >> do some fiddling :P >> >> Do you know of any documentation on using bridge_ng together with bhyve? >> My search-engines don't turn up much Im affraid and I haven't stumbled >> on it before. > Unfortunately it's not too easy to get started with netgraph. > Besides numerous man pages for the different nodes (ng_bridge(4) e.g.), > I only know the following source for a good overview: > http://www.netbsd.org/gallery/presentations/ast/2012_AsiaBSDCon/Tutorial_NETGRAPH.pdf https://people.freebsd.org/~julian/netgraph.html dated but not too much > > One convenience disadvantage with ng_bridge(4) is that you have to > assign MACs manually, while if_bridge(4) does that itself (adjustable by > sysctl net.link.bridge.inherit_mac). > And you need to script all setups yourself. Almost all of my setups > seem to be awkward enough that I always had to do some local scripting, > so that wasn't really a disadvantage for me. > > If you're happy with your setup, I don't think you gain anything from > switching to ng_bridge(4), besides learning to control netgraph(4) > (which is very desirable imho). > I haven't had time left to do useful benchmarking regarding ng_bridge(4) > vs. if_bridge(4). I even don't know if netgraph nodes are still limited > to single threads. But rough load comparings on a IvyBride machine > showed similar resource usage for both bridges, both easy capable of > 1GbE saturation with small frames (while I remember one run with > ng_bridge(4) and if_vmnet(4), which couldn't deliver 1GbE speed, and I > wanted to falsify for vmnet/tap difference... just ran out of time :-( ). > > -harry > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > > From owner-freebsd-virtualization@freebsd.org Tue Feb 27 21:16:58 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3805F29DC3 for ; Tue, 27 Feb 2018 21:16:58 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5763D70879 for ; Tue, 27 Feb 2018 21:16:58 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (203-59-173-201.dyn.iinet.net.au [203.59.173.201]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id w1RLGqAF075463 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Tue, 27 Feb 2018 13:16:55 -0800 (PST) (envelope-from julian@freebsd.org) Subject: Re: superfluous host interfaces To: Harry Schmalzbauer , Ruben Cc: FreeBSD virtualization References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> From: Julian Elischer Message-ID: <6185840a-3517-bfd6-3715-80bf8f092f66@freebsd.org> Date: Wed, 28 Feb 2018 05:16:46 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <5A93F9DE.9090908@omnilan.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 21:16:58 -0000 On 26/2/18 8:13 pm, Harry Schmalzbauer wrote: > > > If you're happy with your setup, I don't think you gain anything from > switching to ng_bridge(4), besides learning to control netgraph(4) > (which is very desirable imho). > I haven't had time left to do useful benchmarking regarding ng_bridge(4) > vs. if_bridge(4). I even don't know if netgraph nodes are still limited > to single threads. depends on the node.. teh framework allows many threads to traverse it at a time but some nodes have resources that need guarding. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 21:54:53 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 199DAF2CCD8 for ; Tue, 27 Feb 2018 21:54:53 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (vm1982.vellance.net [79.99.187.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A1057726F5; Tue, 27 Feb 2018 21:54:52 +0000 (UTC) (envelope-from mail@osfux.nl) Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id 401C2201BF; Tue, 27 Feb 2018 22:54:50 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519768490; bh=3siq/+C5Ro7FL8hfHtkcqL+9GnUyirhMqCgc9IESSJw=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=MRf1JAKXixFpJLr7tSe4e/oz7Gfqc3O+ryCt0Zoq/KKi1YsWFzfoHtBgMwcNsv63J H1ZiY5W6no3B/N73IKAP7cK1BiNNnPFkoWArgUxKX4A01sanuCxn5dDCOlfhyUJ+p8 RaHVzqkyK5J3fmlKSK6Ijpz+14DHigSGKE7M3olp96zp37+FIZqgLSV1aDqpLhZfu2 FMldkI4D91ipKXXPoNoFS0vHhz7qvRL15gNOEZTqjtufrFSfww4RoBrMWr+b64G03K iLMpBF7x8kzFfAkUwne6x6ytyyeciNzsoxYZikdQZo/XKbMsidvDoFXUpQcYhmj6cj DVGqKRQwo65RYwvySGpGacWUxdQYzSUp3SpspAcmpbJJlFIRPcI8+wWfBRCexOJ9sp yxbrDp9PIPOYZWKyzt3Bcz86eXUVfP2noFS0YgXa7YeSoCTFpOi53pSKCVFT/SsbVL D8nrYJ99t5fuDUlr96TD1y3agZ73bHw/D5CcBTAWdVFqr8XkyOoTrYNk2eP9hQGm4q NdMv9b67TBLJNCGR52dJo1GNnWk231n55c74fZPLOVUCLT5+1obr+Bw5e3g9txEKwA M8uKOlosA8li6DHSpRpuLHhD9F6dQ1Mr1Rb7CeS9/RjKbnJRPy2R4fzcOVPPGc2amn FZOImC5t7IaDAbwHwtWRwA+8= Received: from vm1982.vellance.net (localhost [127.0.0.1]) by vm1982.vellance.net (Postfix) with ESMTP id F1BEF20126; Tue, 27 Feb 2018 22:54:47 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=osfux.nl; s=default; t=1519768489; bh=3siq/+C5Ro7FL8hfHtkcqL+9GnUyirhMqCgc9IESSJw=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=EmT1RjAms2jWpCqZFdZq4hGf0ifRHiK1eFkVceYmsMZfDtyH7tX4a13kjGgFoWVfk Qzr/E97COPysPLPjSIgnDytD0OG5V26ZOs6JKa6D+I+JYSJDI0K4jSYFltBVBJkxKj B9sj5lgkl2Z813yJ9/m/Zjkd7oGiQPIhGn88MdM5bItV6HYXEQmMvTyXY1B4ngei2+ pSHIPiCFP9AS1cdS0AElLHXAvftBPqAHOVN8IYI7CNc5dqm5GBvfEFGs/3n0PLIx1M d6jFFVv0n6gfrQsJaooFjBpXE5IymE6BDtgd0NGmix5LdoBnGg/SS6bFeDR1l0PRlY yHrF6nsvdL4PfWuCUrQFLLc+V6fJe1BIOjkwjfz6sM5NVJ1wVOUVwtIxMhNBlrBKJF TpIURFtTzs3PGKuNGYvcq3P4gcGrk6neD3dOXXZcm4E8d2AO0sfCjSkyeePcrxR3US 3kZcs2h3FnzmGNkkf5Zpgu2ljgpqPn42y/Q/2ih5Fd+T+v2fSSCO0J+Jkqg68Vlfin vcJx0qOApqZE7lN6lSk3uKWKSGhzlNeMwa8hvoY2/Pzz6D0vz2YNajl3EAGg6kZeh7 t+ppWRiR+jnFAZmr3w1REyJoDMUOYrr4fcZhbwHSgnYNfc5vWNX9y4if2czoucQIcC afA97BIxKLnQSHY2ZP2Sjre4= X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on vm1982.vellance.net X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=ham autolearn_force=no version=3.4.1 Received: from rubens-MacBook-Air.local (ip51ccb320.speed.planet.nl [81.204.179.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by vm1982.vellance.net (Postfix) with ESMTPSA; Tue, 27 Feb 2018 22:54:47 +0100 (CET) Subject: Re: superfluous host interfaces To: Julian Elischer , Harry Schmalzbauer Cc: FreeBSD virtualization References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> <6185840a-3517-bfd6-3715-80bf8f092f66@freebsd.org> From: Ruben Message-ID: <3e2d7c27-1afb-75d9-f282-c1dd3c740595@osfux.nl> Date: Tue, 27 Feb 2018 22:54:46 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <6185840a-3517-bfd6-3715-80bf8f092f66@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Content-Language: en-US X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 21:54:53 -0000 Hi Julian, Thank you for your feedback. I'm not affraid of some scripting, ill try to make some time and dig into the ng stuff :) Regards, Ruben On 27/02/2018 22:16, Julian Elischer wrote: > On 26/2/18 8:13 pm, Harry Schmalzbauer wrote: >> >> >> If you're happy with your setup, I don't think you gain anything from >> switching to ng_bridge(4), besides learning to control netgraph(4) >> (which is very desirable imho). >> I haven't had time left to do useful benchmarking regarding ng_bridge(4) >> vs. if_bridge(4). I even don't know if netgraph nodes are still limited >> to single threads. > > depends on the node.. teh framework allows many threads to traverse it > at a time > but some nodes have resources that need guarding. From owner-freebsd-virtualization@freebsd.org Tue Feb 27 23:31:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91D49F33EA8 for ; Tue, 27 Feb 2018 23:31:00 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 0B2EA76F0D for ; Tue, 27 Feb 2018 23:30:59 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 9C09320768C0 for ; Wed, 28 Feb 2018 09:30:57 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 96B832820A8 for ; Wed, 28 Feb 2018 09:30:57 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id iCsWwKg3tWIu for ; Wed, 28 Feb 2018 09:30:57 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id E660D2809BD; Wed, 28 Feb 2018 09:30:55 +1000 (AEST) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) To: Mike Tancsa Cc: "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> From: Peter Grehan Message-ID: Date: Tue, 27 Feb 2018 15:30:53 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=Op4juWPpsa0A:10 a=pwdUeM8-EA_1Fz4opM4A:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Feb 2018 23:31:00 -0000 Hi Mike, >> =C2=A0I could reproduce this on a Ryzen 1700 with HT enabled - it too= k ~700 >> seconds, and the entire machine locked up. >> >> =C2=A0An interesting point is a single VM was able to run to completi= on. >> >> =C2=A0I'll keep testing with various combinations of numbers of VMs, >> different vCPUs per VM, and pinning guest vCPUs. 3 4*vCPU guests locked the machine up in ~170 secs, 4 guests ran to=20 completion :( > Not sure if its related to core count or not, but it takes several > instances on the Epyc to lock up and takes a lot longer. I enabled IOMM= U > on it as well, and it's dmesg shows below. But the lockups are still > there with or without it enabled. Would you be able to try on the Epyc with vCPUs pinned, and all guest=20 vCPUs on different physical CPUs ? i.e. for a configuration that will lock up, run the same configuration=20 but with vCPUs pinned. For example, a 4 vCPU guest that will have vCPUs=20 0-3 pinned to host physical CPUs 7-10 would look like: -c 4 -p 0:7 -p 1:8 -p 2:9 -p 3:10 later, Peter. From owner-freebsd-virtualization@freebsd.org Wed Feb 28 06:01:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC76AF2C479 for ; Wed, 28 Feb 2018 06:01:22 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv199.fwdcdn.com (frv199.fwdcdn.com [212.42.77.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 56CEE866EE for ; Wed, 28 Feb 2018 06:01:22 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=ZaVDnZZVHn38ej6VDfUx20HclaFi27geAPmNPjQVhWc=; b=dMRvhqpHEpBppp24DmkLNiOWY0 hY/6BSjljOFAmjkFqxPvSWQ4PAc+RKWXek0rZuISdVrJ/WGdTd4KCJYudlEJTFBHWjjfYGXgfXKiP LBmIeQQgCZF4t/CWtJ+WV+8Ucw1Xs4fWCDZUXc3h2d8pNgdko9midudsa2KmS4tQwGcw=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv199.fwdcdn.com with smtp ID 1equnn-000JrX-LG for freebsd-virtualization@freebsd.org; Wed, 28 Feb 2018 08:01:19 +0200 Date: Wed, 28 Feb 2018 08:01:19 +0200 From: wishmaster Subject: Re[2]: Migrate from real server to virtual To: Peter Grehan Cc: "Rodney W. Grimes" , "freebsd-virtualization@freebsd.org" X-Mailer: mail.ukr.net 5.0 Message-Id: <1519797493.7978147.fd786v89@frv52.fwdcdn.com> In-Reply-To: <038eaa86-9a8c-8385-a61b-115c6dfb1ded@freebsd.org> References: <201802271641.w1RGfs1g016071@pdx.rh.CN85.dnsmgr.net> <038eaa86-9a8c-8385-a61b-115c6dfb1ded@freebsd.org> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Wed, 28 Feb 2018 08:01:19 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Feb 2018 06:01:22 -0000 --- Original message --- From: "Peter Grehan" Date: 27 February 2018, 20:40:52 > > But I think the bigger problem is that this is an MBR disk with Windows 7 in it, I > > do not believe that bhyve can run Windows 7 at this time. > > Bhyve has been able to run Win7 since 2015, though x64 only and in > UEFI mode. > Yes, Windows 7 is from the same "brunch" as Windows 2008. And I think my problem is that hardware server has been installed without UEFI, just in Legacy mode. So, in this situation it is unable run this server in Bihyve with UEFI. Am I right? -- Vitaly From owner-freebsd-virtualization@freebsd.org Wed Feb 28 11:51:19 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1D6DCF41120 for ; Wed, 28 Feb 2018 11:51:19 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9363873321 for ; Wed, 28 Feb 2018 11:51:18 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w1SBpGgx019653; Wed, 28 Feb 2018 12:51:16 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 3D455F87; Wed, 28 Feb 2018 12:51:16 +0100 (CET) Message-ID: <5A9697B3.5050200@omnilan.de> Date: Wed, 28 Feb 2018 12:51:15 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Vincent Hoffman-Kazlauskas CC: freebsd-virtualization@freebsd.org Subject: Re: superfluous host interfaces References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> <5A93D9D0.4090804@omnilan.de> <54f9019e-6e86-8e10-32d7-9f14d159bb0a@osfux.nl> <5A93F9DE.9090908@omnilan.de> <5A94F730.7040009@redbarn.org> <5A95140E.8030909@omnilan.de> In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Wed, 28 Feb 2018 12:51:16 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Feb 2018 11:51:19 -0000 Bezüglich Vincent Hoffman-Kazlauskas's Nachricht vom 27.02.2018 21:09 (localtime): > > On 27/02/2018 08:17, Harry Schmalzbauer wrote: >> Bezüglich Paul Vixie's Nachricht vom 27.02.2018 07:14 (localtime): >>> >>> Harry Schmalzbauer wrote: >>>> Bezüglich Ruben's Nachricht vom 26.02.2018 11:34 (localtime): … >> If you have only one "LAN" sharing all VMs, the one additional interface >> is neglectable. >> But my setups are different. >> I have almost as many different 802.11q separated ethernet collsion >> domains (VLANs) as VMs. >> That's what ESXi's portgroup is used for. I need a separate switch for >> each VLAN (guests mustn't be able to sniff traffic etc.). >> > Untested by me with bhyve but it looks like net/openvswitch > (http://www.openvswitch.org/) could be useful to you. As I say though > untested by me so cant speak for performance etc. I made a local OVS port which incorporated netmap support, but I was told that OVS lost attraction for the netmap team, when I tried to solve some problems, since netmap patches from upstream were highly linux specific and considered obsolete. Intel contributed some DPDK resources, which look interesting (and seem to perform great on linux). But OVS itself would need more resources to get better support on FreeBSD and additionally a huge ammount of resources to get DPDK|netmap enabled. In 10GE days, OVS without netmap|DPDK doesn't make much sense imho. We have netmap/vale(4), which could be extenden to cover a small subset of OVS feature, with porbably moderate ammount of resources. So in my opinion, for those using bhyve(4) as slim hypervisor, the not very slim OVS doesn't fit well overall, especially due to perfomance constraints. A portgroup/vlan filter+manager on top of vale(4) was a much better companion for bhyve(4). I'll start immediately when retireing (learing to use whatever debugger will be arround then...) ;-) -harry From owner-freebsd-virtualization@freebsd.org Wed Feb 28 14:31:05 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A3429F2A656 for ; Wed, 28 Feb 2018 14:31:05 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 27CB27994F; Wed, 28 Feb 2018 14:31:04 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w1SEV1bq020478; Wed, 28 Feb 2018 06:31:01 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w1SEV1JC020477; Wed, 28 Feb 2018 06:31:01 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201802281431.w1SEV1JC020477@pdx.rh.CN85.dnsmgr.net> Subject: Re: Re[2]: Migrate from real server to virtual In-Reply-To: <1519797493.7978147.fd786v89@frv52.fwdcdn.com> To: wishmaster Date: Wed, 28 Feb 2018 06:31:01 -0800 (PST) CC: Peter Grehan , "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Feb 2018 14:31:05 -0000 > --- Original message --- > From: "Peter Grehan" > Date: 27 February 2018, 20:40:52 > > > > > > But I think the bigger problem is that this is an MBR disk > > > with Windows 7 in it, I > > > do not believe that bhyve can run Windows 7 at this time. So let me correct that statement with the new information. I do not believe that bhyve can run an MBR Windows 7 install at this time, as that would indicated the install is not UEFI bootable, and we can only boot Windows 7 64 bit in EFI mode. > > > > Bhyve has been able to run Win7 since 2015, though x64 only and in > > UEFI mode. > > > > Yes, Windows 7 is from the same "brunch" as Windows 2008. And I > think my problem is that hardware server has been installed > without UEFI, just in Legacy mode. > So, in this situation it is unable run this server in Bihyve with UEFI. > > Am I right? Yes, I do believe that is the correct conclusion to your current situation. The other part that could be at issue here is if this is a 32bit or 64bit version of windows. As Peter stated only 64 bit windows in UEFI mode. It might be possible to create a shim drive that has the Windows UEFI boot code on it, and set that shim drive up to load the copy of windows from your image file. This would be a experiment that might lead to a booting VM. It may also be possible to remove the legacy bootmgr files from the disk0.img and add the needed uefi files, I gave some commands in a prior email that would allow you to mount this disk on the FreeBSD system to facilitate this type of work. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Wed Feb 28 14:50:24 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 60D10F2B94C for ; Wed, 28 Feb 2018 14:50:24 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D37C57A469 for ; Wed, 28 Feb 2018 14:50:23 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id w1SEafx2013959; Wed, 28 Feb 2018 15:36:41 +0100 (CET) Received: from [217.29.44.49] ([217.29.44.49]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id w1SEaf5w070321; Wed, 28 Feb 2018 15:36:41 +0100 (CET) (envelope-from hausen@punkt.de) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Migrate from real server to virtual From: "Patrick M. Hausen" In-Reply-To: <201802281431.w1SEV1JC020477@pdx.rh.CN85.dnsmgr.net> Date: Wed, 28 Feb 2018 15:36:40 +0100 Cc: wishmaster , "freebsd-virtualization@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <05127CBE-F8D2-4BF3-BDA1-AD5E1E2B1BE5@punkt.de> References: <201802281431.w1SEV1JC020477@pdx.rh.CN85.dnsmgr.net> To: "Rodney W. Grimes" X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Feb 2018 14:50:24 -0000 Hi all, > Am 28.02.2018 um 15:31 schrieb Rodney W. Grimes = : > Yes, I do believe that is the correct conclusion to your current = situation. > The other part that could be at issue here is if this is a 32bit or = 64bit > version of windows. As Peter stated only 64 bit windows in UEFI mode. >=20 > It might be possible to create a shim drive that has the Windows UEFI = boot > code on it, and set that shim drive up to load the copy of windows = from > your image file. rEFInd might be worth a try: http://www.rodsbooks.com/refind/features.html Patrick --=20 punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling From owner-freebsd-virtualization@freebsd.org Thu Mar 1 07:22:45 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43D1AF3308D for ; Thu, 1 Mar 2018 07:22:45 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: from mail-wr0-x22d.google.com (mail-wr0-x22d.google.com [IPv6:2a00:1450:400c:c0c::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3DE6B714B1 for ; Thu, 1 Mar 2018 07:22:44 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: by mail-wr0-x22d.google.com with SMTP id z12so4962911wrg.4 for ; Wed, 28 Feb 2018 23:22:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:user-mail-address:date:message-id:user-agent :mime-version; bh=tJR6LEUhAL673S1W9JrU73oery2nbBVNkbbQepHu7LA=; b=LDQvHBN9mCe+bly+FchlKSAZSjskvS3iU05ZY6kDpk6GHsLIEcNV0+ECd/NfaW18wY GKnoRgMD386cvxxL3vZljKwd3KDQsbgX/XMl89P2eAmurWGA8SIrPjMiwE6o+KiHVUl0 0dfbmctjYifEQIOgNEnqhaLJNHaNFeawAOtvFvIISJ6G8Z9cncRvn+ycGZvCN6fuLzR0 aiTr8iC9//PR5YMLt5FRa30sg8luEMDmCDpi0N18fKbXlHga5r29pMhOqZZID1NVgCOd YDZVa9tNXdsiLXt9zFKHx4FNkSLx91LPQw+LJYKF4OOlSP3pPD1fSzjD8LA8yNEUlVvB rYpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:user-mail-address:date :message-id:user-agent:mime-version; bh=tJR6LEUhAL673S1W9JrU73oery2nbBVNkbbQepHu7LA=; b=R7xNyJP0ZlnoL5FQNc7UhzEPZp+BIOgzjAydRyzf+LMpFK5gIiOHGe5ETRknlU8J9A udsdLDRUX6BDh8TQfbUB7TOLOm/1F6vFp0z9R3+ppQ1L8UYaWS4ohvJ3Ydzc9ZQjLbRR a5n637k8Y/TSrW1luw+FS63UHQ8Q6foKkBSFfs42TKc6J85UsmZFl/UYG1GXvYB/jDW9 DizT1AVeBUBbyQotrLbmixs5A079sahbxBtzM4oZhjue9gXLOYQAxUkm9W6NgCvv/Lga I6v96J8J4Zvi1WwNp+H5uN9R/HGhNBkHcUziU8hiW9Eju0k2VEmCq1rMpVBvuSfVshTY w9FQ== X-Gm-Message-State: APf1xPAdEAHlmC7yqC9UwKBT1q91iJtC9UskJXpy7h9RqpMsw0d/7or0 2SqwXSIYnF2piuyIdnG2dbetxA== X-Google-Smtp-Source: AG47ELsQNNAtuGtdKOjA/h1KKJlea0cukreXDSpUarNNPgbUDQ5oQWhP1mYeaBPrV+5xb+EuUuNk4g== X-Received: by 10.223.133.140 with SMTP id 12mr684393wrt.192.1519888962975; Wed, 28 Feb 2018 23:22:42 -0800 (PST) Received: from jedi.localdomain (178-143-48-243.dynamic.orange.sk. [178.143.48.243]) by smtp.gmail.com with ESMTPSA id e67sm12078877wmf.7.2018.02.28.23.22.42 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 28 Feb 2018 23:22:42 -0800 (PST) Received: by jedi.localdomain (Postfix, from userid 1001) id AFC8DA05; Thu, 1 Mar 2018 08:22:41 +0100 (CET) From: Ludovit Koren To: freebsd-virtualization@freebsd.org Subject: bhyve - windows7 installation User-Mail-Address: ludovit.koren@gmail.com Date: Thu, 01 Mar 2018 08:22:41 +0100 Message-ID: <86inagi7jy.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 07:22:45 -0000 Hi, on FreeBSD 11.1-STABLE #0 r329013, I was trying to install windows7 using bhyve. I run the following commands: mkdir -p iso-remaster/virtio /usr/local/bin/7z x en_windows_7_professional_with_sp1_vl_build_x64_dvd_u_677791.iso -oiso-remaster tar xf virtio-win-0.1.141.iso -C iso-remaster/virtio/ mkisofs -b boot/etfsboot.com -no-emul-boot -c BOOT.CAT -iso-level 4 -J -l -D -N -joliet-long -relaxed-filenames -v -V "Custom" -udf -boot-info-table -eltorito-alt-boot -eltorito-platform 0xEF -eltorito-boot efi/microsoft/boot/efisys_noprompt.bin -no-emul-boot -o install_windows_w7_professional_x64.iso iso-remaster ifconfig bridge0 create ifconfig bridge0 up ifconfig tap1 create ifconfig bridge0 addm em0 addm tap1 and I was able to install windows successfully: bhyve -S -c 1 -s 0,hostbridge -s 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512 -s 4,ahci-cd,install_windows_w7_professional_x64.iso -s 2:0,virtio-net,tap1 -s 31,lpc -s 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w windows7 The windows seems to be working fine. The problem is, I have no working network interface, nor can I install one. I do not know, what I am doing wrong. Any help appreciated. Regards, lk From owner-freebsd-virtualization@freebsd.org Thu Mar 1 09:51:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 74F79F2F210 for ; Thu, 1 Mar 2018 09:51:22 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv197.fwdcdn.com (frv197.fwdcdn.com [212.42.77.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 10AC378C1F for ; Thu, 1 Mar 2018 09:51:21 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=+tsJhIpFIqGv/LtIbditN6M7CV9tDebdIBAkfxzygM8=; b=wlI61bViT6dib1S+3GMYCrw/Fc hd4IfAD1klIHxHA+nbeISFaY3lu/bvNh8UdVAyIRf1Mj9z/gF4gZNjWF4yxDxHZwo6afxPtSAudn6 iUx0GYsD92LnytUA/wX6XVxcmC+F6IYvP+Z1hz+ELgLUVLoVNVePePTwpeAx82RdzeBw=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1erKrp-000A5t-14 for freebsd-virtualization@freebsd.org; Thu, 01 Mar 2018 11:51:13 +0200 Date: Thu, 01 Mar 2018 11:51:12 +0200 From: wishmaster Subject: Re: bhyve - windows7 installation To: Ludovit Koren Cc: freebsd-virtualization@freebsd.org X-Mailer: mail.ukr.net 5.0 Message-Id: <1519897621.423119418.rh2w2yz2@frv52.fwdcdn.com> In-Reply-To: <86inagi7jy.fsf@gmail.com> References: <86inagi7jy.fsf@gmail.com> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Thu, 01 Mar 2018 11:51:12 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 09:51:22 -0000 --- Original message --- From: "Ludovit Koren" Date: 1 March 2018, 11:40:05 > > > Hi, > > on FreeBSD 11.1-STABLE #0 r329013, I was trying to install windows7 > using bhyve. I run the following commands: > > mkdir -p iso-remaster/virtio > /usr/local/bin/7z x en_windows_7_professional_with_sp1_vl_build_x64_dvd_u_677791.iso > -oiso-remaster > tar xf virtio-win-0.1.141.iso -C iso-remaster/virtio/ > mkisofs -b boot/etfsboot.com -no-emul-boot -c BOOT.CAT -iso-level 4 -J -l -D -N -joliet-long -relaxed-filenames -v -V "Custom" -udf -boot-info-table -eltorito-alt-boot -eltorito-platform 0xEF -eltorito-boot efi/microsoft/boot/efisys_noprompt.bin -no-emul-boot -o install_windows_w7_professional_x64.iso iso-remaster > > ifconfig bridge0 create > ifconfig bridge0 up > ifconfig tap1 create > ifconfig bridge0 addm em0 addm tap1 > > and I was able to install windows successfully: > > bhyve -S -c 1 -s 0,hostbridge -s 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512 -s 4,ahci-cd,install_windows_w7_professional_x64.iso -s 2:0,virtio-net,tap1 -s 31,lpc -s 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w windows7 > > > The windows seems to be working fine. The problem is, I have no working > network interface, nor can I install one. > > I do not know, what I am doing wrong. Any help appreciated. Just download virtio driver from here https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.141-1/ Then add this ISO as ahci-cd to your virtual machine, next from Windows go to the Hardware Manager and update virtio driver for Network Card. -- Vitaly From owner-freebsd-virtualization@freebsd.org Thu Mar 1 11:14:07 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AFAA0F3A532 for ; Thu, 1 Mar 2018 11:14:07 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 219437CCCF for ; Thu, 1 Mar 2018 11:14:06 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w21BE4P8033714; Thu, 1 Mar 2018 12:14:04 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 45ABD2B7; Thu, 1 Mar 2018 12:14:04 +0100 (CET) Message-ID: <5A97E07B.7060000@omnilan.de> Date: Thu, 01 Mar 2018 12:14:03 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Ludovit Koren CC: freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <86inagi7jy.fsf@gmail.com> In-Reply-To: <86inagi7jy.fsf@gmail.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Thu, 01 Mar 2018 12:14:04 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 11:14:08 -0000 Bezüglich Ludovit Koren's Nachricht vom 01.03.2018 08:22 (localtime): > > Hi, > > on FreeBSD 11.1-STABLE #0 r329013, I was trying to install windows7 > using bhyve. I run the following commands: > > mkdir -p iso-remaster/virtio > /usr/local/bin/7z x en_windows_7_professional_with_sp1_vl_build_x64_dvd_u_677791.iso > -oiso-remaster > tar xf virtio-win-0.1.141.iso -C iso-remaster/virtio/ > mkisofs -b boot/etfsboot.com -no-emul-boot -c BOOT.CAT -iso-level 4 -J -l -D -N -joliet-long -relaxed-filenames -v -V "Custom" -udf -boot-info-table -eltorito-alt-boot -eltorito-platform 0xEF -eltorito-boot efi/microsoft/boot/efisys_noprompt.bin -no-emul-boot -o install_windows_w7_professional_x64.iso iso-remaster > > ifconfig bridge0 create > ifconfig bridge0 up > ifconfig tap1 create > ifconfig bridge0 addm em0 addm tap1 > > and I was able to install windows successfully: > > bhyve -S -c 1 -s 0,hostbridge -s 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512 -s 4,ahci-cd,install_windows_w7_professional_x64.iso -s 2:0,virtio-net,tap1 -s 31,lpc -s 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w windows7 > > > The windows seems to be working fine. The problem is, I have no working > network interface, nor can I install one. > > I do not know, what I am doing wrong. Any help appreciated. If you want to make windows Setup aware of 3rd-party drivers, you need to do that with some unattended answer file. Simply adding driver files to the same setup source won't work (while there is/was a standard path for such things – $$\$OEM$ or the like – but I don't remember out of mind and I'm even unsure if this was NT only...) I'm either attaching a second ODD or another HDD, wich provides driver files on FAT32 – until I find some time to improve C skills and write floppy support for bhyve(8) ;-) (which would be a very good practicing project imho). I'd suggest the following mass storage config (adding a second ODD with the virtio-141 drivers): -s 3,ahci,hd:/dev/zvol/zroot/msw7,sectorsize=512/8192,cd:./en_windows_7_professional_with_sp1_vl_build_x64_dvd_u_677791.iso,cd:./virtio-win-0.1.141.iso After connecting via VNC the vm boots from DVD and you see the setup program. You won't have mouse support, but keyboard's been working, right? So you have been able to finsih setup and login via VNC, still no mouse. Use your existing setup or do a new one to make the last assumptions true. If you booted with the two ISO images, use the keyboard to start "control panel/Device Manager", where you should find the unattached virtio NIC. Installt/Update the driver from there, you can tell the assistant to use e:\ as source (your 2nd. ODD). Hth, -harry From owner-freebsd-virtualization@freebsd.org Thu Mar 1 13:00:24 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F1727F27766 for ; Thu, 1 Mar 2018 13:00:23 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9841183352; Thu, 1 Mar 2018 13:00:23 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w21D0MoO080100 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 1 Mar 2018 08:00:22 -0500 (EST) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w21D0K8s053861; Thu, 1 Mar 2018 08:00:21 -0500 (EST) (envelope-from mike@sentex.net) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) To: Peter Grehan Cc: "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> From: Mike Tancsa Organization: Sentex Communications Message-ID: <36c062e4-352b-eebe-5f08-1af250d98eee@sentex.net> Date: Thu, 1 Mar 2018 08:00:19 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 13:00:24 -0000 On 2/27/2018 6:30 PM, Peter Grehan wrote: >  i.e. for a configuration that will lock up, run the same configuration > but with vCPUs pinned. For example, a 4 vCPU guest that will have vCPUs > 0-3 pinned to host physical CPUs 7-10 would look like: > >  -c 4 -p 0:7 -p 1:8 -p 2:9 -p 3:10 Hi Peter, On the Epyc it seemed to take a longer, but eventually the box locked up and the watchdog ended up rebooting the server. I started 3, vCPU guests all with separate CPU's pinned. It lasted 9hrs. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-virtualization@freebsd.org Thu Mar 1 13:33:42 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7A3DDF2A6D7 for ; Thu, 1 Mar 2018 13:33:42 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: from mail-wr0-x236.google.com (mail-wr0-x236.google.com [IPv6:2a00:1450:400c:c0c::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ED80184FFE for ; Thu, 1 Mar 2018 13:33:41 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: by mail-wr0-x236.google.com with SMTP id v65so6114595wrc.11 for ; Thu, 01 Mar 2018 05:33:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:user-mail-address:date:in-reply-to :message-id:user-agent:mime-version:content-transfer-encoding; bh=tmkvI/I97WiYYU3X2yZU0rV/LwrFRl0jzwVPfZNmmb8=; b=RFa9vhmtCqO0SqDgeT/rlYtrlpuTrs3j6RDfVxulnIU/7J5iQ60TxT6JJGBVwVr1PR 3kZYi6PPHewNn/VQwSwp3byajZs5q1Vk+9Ufpey4iayOO03tqzNUspM5Lkg0TwWyedN4 1m81aPI96FtxYrOwXdkFjdsltYj4aLhMizct/tf5qv6eIt/ebVLthwrawosdvNsbFKam U1wlacKNCEEcERbmpgsLs1WoaLjgq8cGHXHcyAyKv7NSMS4DoOIBxkszGlgojac7y6L6 DH0PThLctOE5JYkExfMuflCOoC7h2vcvzV/JfZnDMY4tBltl1J63mXFe7iW307bTpIU9 E77w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:user-mail-address :date:in-reply-to:message-id:user-agent:mime-version :content-transfer-encoding; bh=tmkvI/I97WiYYU3X2yZU0rV/LwrFRl0jzwVPfZNmmb8=; b=tyQ3osCn3dmGcyRUcboJCwLiP3fNRS90VEAEQjt5/U3oL3bHwI7+cHVfM6Mq7G47io maXFrzsgmmTgS7zYmHXT8yZ3q/wCru+x1A/m6/Nm/Jc6HyuWAklrLuujgR2jjZhYao+q mZthwNxXWVxsONYB27rGCJf/ZTva7AT5XD09ZecLAiEuxeWr/qnW+WsX3lHS5L3tt//x cOCZBnybxNYmjD+9nNI4IkTJ6LfW+oBD0cpwLUZxiWdhVAI67b3q1WZHkBf/mYv8zGy4 gsgOQq1jkCaaYgeK3sia6KdWLB2RaXedrwS0MnVNqBj+KW8wt0a46Ux+nSBOWifrJPWS HRuw== X-Gm-Message-State: APf1xPDBikNyml1OdalNggI2C1iAEBri3Eg9SEJAlZAcNBJXhGobWmlO KqsyC/UckeANHLemjoyyPWxDeA== X-Google-Smtp-Source: AG47ELv7ztnSHNazAD/ymgPi1lfSXmwE5J27WrzYb7qoEp7C8UF6tO966suwmQTSiPOZp4m0qBysLA== X-Received: by 10.223.200.2 with SMTP id d2mr1753438wrh.81.1519911219908; Thu, 01 Mar 2018 05:33:39 -0800 (PST) Received: from jedi.localdomain (178-143-48-243.dynamic.orange.sk. [178.143.48.243]) by smtp.gmail.com with ESMTPSA id w29sm3918252wra.84.2018.03.01.05.33.39 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 01 Mar 2018 05:33:39 -0800 (PST) Received: by jedi.localdomain (Postfix, from userid 1001) id 4AE47AA0; Thu, 1 Mar 2018 14:33:38 +0100 (CET) From: Ludovit Koren To: Harry Schmalzbauer Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <86inagi7jy.fsf@gmail.com> <5A97E07B.7060000@omnilan.de> User-Mail-Address: ludovit.koren@gmail.com Date: Thu, 01 Mar 2018 14:33:38 +0100 In-Reply-To: <5A97E07B.7060000@omnilan.de> (Harry Schmalzbauer's message of "Thu, 01 Mar 2018 12:14:03 +0100") Message-ID: <86efl3j4y5.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 13:33:42 -0000 >>>>> Harry Schmalzbauer writes: > Bez=C3=BCglich Ludovit Koren's Nachricht vom 01.03.2018 08:22 (local= time): >>=20 >> Hi, >>=20 >> on FreeBSD 11.1-STABLE #0 r329013, I was trying to install windows7 >> using bhyve. I run the following commands: >>=20 >> mkdir -p iso-remaster/virtio >> /usr/local/bin/7z x en_windows_7_professional_with_sp1_vl_build_x64_= dvd_u_677791.iso >> -oiso-remaster >> tar xf virtio-win-0.1.141.iso -C iso-remaster/virtio/ >> mkisofs -b boot/etfsboot.com -no-emul-boot -c BOOT.CAT -iso-level 4 >> -J -l -D -N -joliet-long -relaxed-filenames -v -V "Custom" -udf >> -boot-info-table -eltorito-alt-boot -eltorito-platform 0xEF >> -eltorito-boot efi/microsoft/boot/efisys_noprompt.bin -no-emul-boot >> -o install_windows_w7_professional_x64.iso iso-remaster >>=20 >> ifconfig bridge0 create >> ifconfig bridge0 up >> ifconfig tap1 create >> ifconfig bridge0 addm em0 addm tap1 >>=20 >> and I was able to install windows successfully: >>=20 >> bhyve -S -c 1 -s 0,hostbridge -s >> 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=3D512 -s >> 4,ahci-cd,install_windows_w7_professional_x64.iso -s >> 2:0,virtio-net,tap1 -s 31,lpc -s >> 29,fbuf,tcp=3D0.0.0.0:5900,w=3D1366,h=3D768,wait -l com1,/dev/nmdm0A= -l >> com2,/dev/nmdm1A -l >> bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w >> windows7 >>=20 >>=20 >> The windows seems to be working fine. The problem is, I have no work= ing >> network interface, nor can I install one. >>=20 >> I do not know, what I am doing wrong. Any help appreciated. > If you want to make windows Setup aware of 3rd-party drivers, you need > to do that with some unattended answer file. > Simply adding driver files to the same setup source won't work (while > there is/was a standard path for such things =E2=80=93 $$\$OEM$ or th= e like =E2=80=93 > but I don't remember out of mind and I'm even unsure if this was NT o= nly...) > I'm either attaching a second ODD or another HDD, wich provides driver > files on FAT32 =E2=80=93 until I find some time to improve C skills a= nd write > floppy support for bhyve(8) ;-) (which would be a very good practicing > project imho). > I'd suggest the following mass storage config (adding a second ODD wi= th > the virtio-141 drivers): > -s > 3,ahci,hd:/dev/zvol/zroot/msw7,sectorsize=3D512/8192,cd:./en_windows_= 7_professional_with_sp1_vl_build_x64_dvd_u_677791.iso,cd:./virtio-win-0.1.1= 41.iso > After connecting via VNC the vm boots from DVD and you see the setup > program. You won't have mouse support, but keyboard's been working, r= ight? > So you have been able to finsih setup and login via VNC, still no mou= se. > Use your existing setup or do a new one to make the last assumptions = true. > If you booted with the two ISO images, use the keyboard to start > "control panel/Device Manager", where you should find the unattached > virtio NIC. Installt/Update the driver from there, you can tell the > assistant to use e:\ as source (your 2nd. ODD). Thank you very much. It is up and running. I have an additional question. When I try to run: bhyve -c 1 -s 0,hostbridge -s 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=3D5= 12/8192 -s 10,virtio-net,tap1 -s 31,lpc -s 29,fbuf,tcp=3D0.0.0.0:5900,w=3D1= 366,h=3D768,wait -s 26,passthru,0/26/0 -S -l com1,/dev/nmdm0A -l com2,/dev/= nmdm1A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w = windows7 bhyve: passthru device 0/26/0 BAR 0: base 0xd4739000 or size 0x400 not page= aligned bhyve: failed to initialize BARs for PCI 0/26/0 pciconf -vlb ppt0@pci0:0:26:0 ppt0@pci0:0:26:0: class=3D0x0c0320 card=3D0x17df103c chip=3D0x1e2d808= 6 rev=3D0x04 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D '7 Series/C216 Chipset Family USB Enhanced Host Controll= er' class =3D serial bus subclass =3D USB bar [10] =3D type Memory, range 32, base 0xd4739000, size 1024, enabl= ed The intention is to have usb device in the windows. Any suggestions? Thank you very much. Regards, lk From owner-freebsd-virtualization@freebsd.org Thu Mar 1 14:06:08 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C455EF2D738 for ; Thu, 1 Mar 2018 14:06:07 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1AFEF87677 for ; Thu, 1 Mar 2018 14:06:06 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w21E625X025816; Thu, 1 Mar 2018 06:06:02 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w21E62La025815; Thu, 1 Mar 2018 06:06:02 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve - windows7 installation In-Reply-To: <86efl3j4y5.fsf@gmail.com> To: Ludovit Koren Date: Thu, 1 Mar 2018 06:06:02 -0800 (PST) CC: Harry Schmalzbauer , freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 14:06:08 -0000 > >>>>> Harry Schmalzbauer writes: > > > Bez?glich Ludovit Koren's Nachricht vom 01.03.2018 08:22 (localtime): > >> > >> Hi, ... > > After connecting via VNC the vm boots from DVD and you see the setup > > program. You won't have mouse support, but keyboard's been working, right? > > So you have been able to finsih setup and login via VNC, still no mouse. > > Use your existing setup or do a new one to make the last assumptions true. > > If you booted with the two ISO images, use the keyboard to start > > "control panel/Device Manager", where you should find the unattached > > virtio NIC. Installt/Update the driver from there, you can tell the > > assistant to use e:\ as source (your 2nd. ODD). > > Thank you very much. It is up and running. > > I have an additional question. When I try to run: > > bhyve -c 1 -s 0,hostbridge -s 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512/8192 -s 10,virtio-net,tap1 -s 31,lpc -s 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -s 26,passthru,0/26/0 -S -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w windows7 > bhyve: passthru device 0/26/0 BAR 0: base 0xd4739000 or size 0x400 not page aligned ^^^^^ > > bhyve: failed to initialize BARs for PCI 0/26/0 > > > > pciconf -vlb ppt0@pci0:0:26:0 > ppt0@pci0:0:26:0: class=0x0c0320 card=0x17df103c chip=0x1e2d8086 rev=0x04 hdr=0x00 > vendor = 'Intel Corporation' > device = '7 Series/C216 Chipset Family USB Enhanced Host Controller' > class = serial bus > subclass = USB > bar [10] = type Memory, range 32, base 0xd4739000, size 1024, enabled ^^^^^^^^^^ Due to the design of the IOMMU you can only manage IO space in page (4096 on x86) granually sizes. The device your trying to pass in has a 1024 byte memory region that is part of a 4096 byte page that may have other things in it. At this time bhyve does not have any way to deal with this, though some other hypervisors have techniques that make this work. I do not have or know of any list of USB controller cards that have 4k aligned and 4k sized BAR's. > The intention is to have usb device in the windows. A discussion recently in the developers conference call touched on this very subject. The basic design would be rather than pass in a whole controller would be to add the ability to pass in individual devices. > Any suggestions? Are you trying to pass in a motherboard resource? You might find an add on USB card that has proper BAR size and alignment, though I have no tips for which ones do or dont. It may also be possible to hack the code to ignore the error IF SECRUITY IS OF NO CONCERN, as this hack would allow the VM guest to access devices outside of its domain. I am uncertain if this might have other side effects as to loss of access to devices in the same page from the host perspective. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Thu Mar 1 14:28:25 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8E324F2F71E for ; Thu, 1 Mar 2018 14:28:25 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 21E5468933 for ; Thu, 1 Mar 2018 14:28:25 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w21ESOvV035448; Thu, 1 Mar 2018 15:28:24 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id C3410312; Thu, 1 Mar 2018 15:28:23 +0100 (CET) Message-ID: <5A980E07.3020901@omnilan.de> Date: Thu, 01 Mar 2018 15:28:23 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Ludovit Koren CC: freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <86inagi7jy.fsf@gmail.com> <5A97E07B.7060000@omnilan.de> <86efl3j4y5.fsf@gmail.com> In-Reply-To: <86efl3j4y5.fsf@gmail.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: ACL 130 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Thu, 01 Mar 2018 15:28:24 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 14:28:25 -0000 BezĂĽglich Ludovit Koren's Nachricht vom 01.03.2018 14:33 (localtime): >>>>>> Harry Schmalzbauer writes: … > > I'd suggest the following mass storage config (adding a second ODD with > > the virtio-141 drivers): > > -s > > 3,ahci,hd:/dev/zvol/zroot/msw7,sectorsize=512/8192,cd:./en_windows_7_professional_with_sp1_vl_build_x64_dvd_u_677791.iso,cd:./virtio-win-0.1.141.iso > > > After connecting via VNC the vm boots from DVD and you see the setup > > program. You won't have mouse support, but keyboard's been working, right? > > So you have been able to finsih setup and login via VNC, still no mouse. > > Use your existing setup or do a new one to make the last assumptions true. > > If you booted with the two ISO images, use the keyboard to start > > "control panel/Device Manager", where you should find the unattached > > virtio NIC. Installt/Update the driver from there, you can tell the > > assistant to use e:\ as source (your 2nd. ODD). > > Thank you very much. It is up and running. > > I have an additional question. When I try to run: > > bhyve -c 1 -s 0,hostbridge -s 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512/8192 -s 10,virtio-net,tap1 -s 31,lpc -s 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -s 26,passthru,0/26/0 -S -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w windows7 > bhyve: passthru device 0/26/0 BAR 0: base 0xd4739000 or size 0x400 not page aligned > > bhyve: failed to initialize BARs for PCI 0/26/0 > > > > pciconf -vlb ppt0@pci0:0:26:0 > ppt0@pci0:0:26:0: class=0x0c0320 card=0x17df103c chip=0x1e2d8086 rev=0x04 hdr=0x00 > vendor = 'Intel Corporation' > device = '7 Series/C216 Chipset Family USB Enhanced Host Controller' > class = serial bus > subclass = USB > bar [10] = type Memory, range 32, base 0xd4739000, size 1024, enabled > > > The intention is to have usb device in the windows. > > Any suggestions? Unfortunately I can only tell that this is a known limitation/bug. For some background, you can see https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-December/004000.html and https://lists.freebsd.org/pipermail/freebsd-virtualization/2016-December/005012.html and a quote from mav@: BezĂĽglich Alexander Motin's Nachricht vom 29.12.2016 11:32 (localtime): >> ppt0@pci0:6:0:0: class=0x010601 card=0x10601b21 chip=0x06121b21 >> > rev=0x01 hdr=0x00 >> > bar [10] = type I/O Port, range 32, base 0x5050, size 8, enabled >> > bar [14] = type I/O Port, range 32, base 0x5040, size 4, enabled >> > bar [18] = type I/O Port, range 32, base 0x5030, size 8, enabled >> > bar [1c] = type I/O Port, range 32, base 0x5020, size 4, enabled >> > bar [20] = type I/O Port, range 32, base 0x5000, size 32, enabled >> > bar [24] = type Memory, range 32, base 0xc3e10000, size 512, enabled > I believe it is bhyve bug, since these values are just what hardware > reports. BAR size of 512 bytes indeed does not align to 4K, but this > not our problem. :) As long as your controller supports MSI (message signaling interrupts), you correctly assigned ppt(4) and there's nothing non-hackers can do. To play the same old song: I'm short in skills resp. time to investigate further. Mabye you want to search/file a PR at https://bugs.freebsd.org/bugzilla/ -harry From owner-freebsd-virtualization@freebsd.org Thu Mar 1 16:54:12 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8D3C2F3B8D9 for ; Thu, 1 Mar 2018 16:54:12 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 37C1E70136; Thu, 1 Mar 2018 16:54:12 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w21GsB5o021488 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 1 Mar 2018 11:54:11 -0500 (EST) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w21Gs9wO054338; Thu, 1 Mar 2018 11:54:09 -0500 (EST) (envelope-from mike@sentex.net) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) From: Mike Tancsa To: Peter Grehan Cc: "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> <36c062e4-352b-eebe-5f08-1af250d98eee@sentex.net> Organization: Sentex Communications Message-ID: <7fa0b7a0-492e-6ded-3b5c-1edeff54d746@sentex.net> Date: Thu, 1 Mar 2018 11:54:11 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <36c062e4-352b-eebe-5f08-1af250d98eee@sentex.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 16:54:12 -0000 On 3/1/2018 8:00 AM, Mike Tancsa wrote: > On 2/27/2018 6:30 PM, Peter Grehan wrote: >>  i.e. for a configuration that will lock up, run the same configuration >> but with vCPUs pinned. For example, a 4 vCPU guest that will have vCPUs >> 0-3 pinned to host physical CPUs 7-10 would look like: >> >>  -c 4 -p 0:7 -p 1:8 -p 2:9 -p 3:10 > Hi Peter, > On the Epyc it seemed to take a longer, but eventually the box locked > up and the watchdog ended up rebooting the server. I started 3, vCPU > guests all with separate CPU's pinned. It lasted 9hrs. The Ryzen board also locked up with just 2 VMs running, and all vCPUs pinned to separate cores. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-virtualization@freebsd.org Thu Mar 1 17:02:10 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA3C1F3C241 for ; Thu, 1 Mar 2018 17:02:09 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 5F8CD7079D for ; Thu, 1 Mar 2018 17:02:09 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id C4101211B71A for ; Fri, 2 Mar 2018 03:02:05 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id BE8252808C8 for ; Fri, 2 Mar 2018 03:02:05 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 2h_2hFRLm-B7 for ; Fri, 2 Mar 2018 03:02:05 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 08DA9280504; Fri, 2 Mar 2018 03:02:04 +1000 (AEST) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) To: Mike Tancsa Cc: "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> <36c062e4-352b-eebe-5f08-1af250d98eee@sentex.net> <7fa0b7a0-492e-6ded-3b5c-1edeff54d746@sentex.net> From: Peter Grehan Message-ID: Date: Thu, 1 Mar 2018 09:02:02 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <7fa0b7a0-492e-6ded-3b5c-1edeff54d746@sentex.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=v2DPQv5-lfwA:10 a=EmWB8mlrOu5xcvncD0EA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 17:02:10 -0000 >> On the Epyc it seemed to take a longer, but eventually the box locked >> up and the watchdog ended up rebooting the server. I started 3, vCPU >> guests all with separate CPU's pinned. It lasted 9hrs. > > The Ryzen board also locked up with just 2 VMs running, and all vCPUs > pinned to separate cores. Thanks for that Mike - it rules out any issues related to vCPUs moving around on physical cores. I'd like to now see if there's a way to get this to happen quicker - perhaps running the test with increasing numbers of guest vCPUs ? From what I've seen, the network test only really uses 2 vCPUs so it's probably ok to even go to oversubscribing. I'll get this going on my Ryzen. later, Peter. From owner-freebsd-virtualization@freebsd.org Thu Mar 1 18:25:19 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1912AF4173E for ; Thu, 1 Mar 2018 18:25:18 +0000 (UTC) (envelope-from dreamashish21@gmail.com) Received: from mail-io0-x232.google.com (mail-io0-x232.google.com [IPv6:2607:f8b0:4001:c06::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9343C739F9 for ; Thu, 1 Mar 2018 18:25:17 +0000 (UTC) (envelope-from dreamashish21@gmail.com) Received: by mail-io0-x232.google.com with SMTP id g21so8099439ioj.5 for ; Thu, 01 Mar 2018 10:25:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=L/BvA/v5Hv1UTHrQ+Xr3rVr5M762WcMpHrSYs+Y9odo=; b=R3G5FXREq9c3avLbbqAIgxml0btBlxifxSuD+61p/HqgDFx07NDVKu1OL4ryLNWp4J oL+o53YQt2SrewVrRmyBrFjCM0ZPS7M31zX6w9sRa/Ko+MOJ8ikpPOG9c5vKvzbBzeW8 DXfIppNjadaZSeXjxpwibKRlyEDII9L+cXaU8kIFxJUjRXmo7bnT92bFbgikDD8X5Pr8 wCOs37HSnm5CVwfMZnYtQA+eDJTvV5cnq2MI7CNVG36NFyqf0r6yefdBe3Ssgj1A2fat CV2Sf6KDkpZoYNVvCTwuASxbL9KJV05J1KYNg12ijIfMVWyJxT7TFiRzDISZ7FvKVnfc imMw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=L/BvA/v5Hv1UTHrQ+Xr3rVr5M762WcMpHrSYs+Y9odo=; b=X76GCtXoS31BnRyy8Y6VwTmKNDKObKLKoTILId9zkLk244flZcOaQxNGVXVL43TQpI YboHef3yTvbI0mamJOULxGT9iuHsQ/drZqgTK7yHo7yFUTWr8N9ucdTCRCYfiSxNmfP8 rbjvOf/hNM3oXZyoR86WzUtrQZLWuixX0QffLVdxSyvGwduXCCGmOSBoZ8SYt1ycjfhi A/WpWVL5fUVppc7KR4FZcC4yeVFOHQJ2X3AfC9RmrWR79kbMydazNBoj7CfNXJjT+3O5 0vH78gy9/WyGYvzbHm360L3yxXk4ZWTxa5sDBVrdipcosliwR1DO+EPDCkjanTYjjzc2 +ufw== X-Gm-Message-State: APf1xPB1gL/0uNnQWA2SZvXVVJYE9slYR3JVwt8G/HOYug9aVwQKZ7ns tQSaeCG65CZJ7Xt9sW05cEQqBd37OT3XGuAsKMs= X-Google-Smtp-Source: AG47ELvteMbyBY+OEABzvRRu4Pf6s9IPAs3IxalHOez3kQsv6erT1WfSE0VHcZtql/9E5bMFpBCSoSazzo++X7NguPk= X-Received: by 10.107.176.77 with SMTP id z74mr2955608ioe.8.1519928716679; Thu, 01 Mar 2018 10:25:16 -0800 (PST) MIME-Version: 1.0 Received: by 10.107.85.5 with HTTP; Thu, 1 Mar 2018 10:24:36 -0800 (PST) From: Ashish Gahlot Date: Thu, 1 Mar 2018 23:54:36 +0530 Message-ID: Subject: GSOC 2018 To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 18:25:19 -0000 Hello all, My name is Ashish Kumar Gahlot and I am a final year undergraduate student of Engineering College Ajmer(Rajasthan, India) majoring in Computer Science. I am interested in working on project *Verification of bhyve's instruction emulation *for GSOC 2018. I am having experience with writing large programs in c and assembly and have written X86 bare-bones kernel. I have attached my CV below. Looking forward to your response to get started :) Thanks & Regards, Ashish Kumar Gahlot -- Ashish Kumar Gahlot IV year, UG Govt. Engg. College, Ajmer, India From owner-freebsd-virtualization@freebsd.org Thu Mar 1 18:29:10 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4BF94F41B0C for ; Thu, 1 Mar 2018 18:29:10 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A255573BDE for ; Thu, 1 Mar 2018 18:29:09 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: by mail-wm0-x232.google.com with SMTP id 188so13968055wme.1 for ; Thu, 01 Mar 2018 10:29:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:user-mail-address:date:in-reply-to :message-id:user-agent:mime-version; bh=vbu1YQ9jjnIz12vziN1kXD91ZBBjYIV/3j9kip+7mQg=; b=pPwDGlrz1S+bmzKF1SmFDMxd8V37AF5QJ4kK58BFriW69QA6cMI+s7u1V7PScAopv8 9gJ63wFrDslbnZBLTNimfuljl8gG/yBGcZ6VlVJDOXqxbc/72ieqe0Jg49peLkllr0gE gYE+qRjpqiE4am8rR2A7Xxh4nzwD5AwGNYChjkPO6FV3clS7tlQFegpt7FgR0yMU1mjQ h8w+rTGT8fQXHKIS/dzJYzh/+8i9BW6CPK7UH0XBphMjTeQ3gleQmiKSCI5cp+nuQ0Dm 26/+pvpNkk7/qH83k9FEdJ2L7zgNGj+d/1xoC/r2QDXCzJAmAqEyXrOnblk3lAgNaNhO Hzxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:user-mail-address :date:in-reply-to:message-id:user-agent:mime-version; bh=vbu1YQ9jjnIz12vziN1kXD91ZBBjYIV/3j9kip+7mQg=; b=sEStRwWevaJt6CnohShIEcGwVETgvkLqZsmKuMCDCzG7MThZdSQN7PJRgLe4S/LH1P /Cf956+jxXprDUM0zzZIk5UThaCzamaJaOp/YgYUxB+m21rlf9d7W9LWwvY3+u2gyHMq CzvR/iaqvMa6xCiUbqkGNd9c8ZgQRAQmJ6E//QS2ZGHptvhidVVJZv5jVPxkiZccyLOr 5vEpXVNoKokfaGmxcVwt8ddwwVroFouK80BmrSoz0OapWOkFwCQBPNEpdZTasrlDRNoT CGhP7XLv031c67QXx+pjJR03pOrr84Bb+vSxKHShPVegfp1yPNFqM/qx0Xxgh1b+5eez KpqQ== X-Gm-Message-State: AElRT7G5Iqbn5wA4F8vZ+fhNC8bE6OS4rzHaA58tZs+E1BarE7AeKEuH QIOo+6QfUemozr2D1bGwUytQLw== X-Google-Smtp-Source: AG47ELslq71M5Uhxnuje1g3Hva7yfQev3Ru1yYEwfSAPbhKh5GYcgmBOUr6+BaX6taRQ9NINqr1UcQ== X-Received: by 10.28.3.4 with SMTP id 4mr2738990wmd.60.1519928947978; Thu, 01 Mar 2018 10:29:07 -0800 (PST) Received: from jedi.localdomain (adsl-dyn-247.95-102-174.t-com.sk. [95.102.174.247]) by smtp.gmail.com with ESMTPSA id 186sm2504735wmm.32.2018.03.01.10.29.06 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 01 Mar 2018 10:29:07 -0800 (PST) Received: by jedi.localdomain (Postfix, from userid 1001) id E9116B29; Thu, 1 Mar 2018 19:29:05 +0100 (CET) From: Ludovit Koren To: "Rodney W. Grimes" Cc: Harry Schmalzbauer , freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> User-Mail-Address: ludovit.koren@gmail.com Date: Thu, 01 Mar 2018 19:29:05 +0100 In-Reply-To: <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> (Rodney W. Grimes's message of "Thu, 1 Mar 2018 06:06:02 -0800 (PST)") Message-ID: <86606fir9q.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 18:29:10 -0000 >>>>> Rodney W Grimes writes: >> >>>>> Harry Schmalzbauer writes: >> >> > Bez?glich Ludovit Koren's Nachricht vom 01.03.2018 08:22 (localtime): >> >> >> >> Hi, > ... >> > After connecting via VNC the vm boots from DVD and you see the setup >> > program. You won't have mouse support, but keyboard's been working, right? >> > So you have been able to finsih setup and login via VNC, still no mouse. >> > Use your existing setup or do a new one to make the last assumptions true. >> > If you booted with the two ISO images, use the keyboard to start >> > "control panel/Device Manager", where you should find the unattached >> > virtio NIC. Installt/Update the driver from there, you can tell the >> > assistant to use e:\ as source (your 2nd. ODD). >> >> Thank you very much. It is up and running. >> >> I have an additional question. When I try to run: >> >> bhyve -c 1 -s 0,hostbridge -s >> 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512/8192 -s >> 10,virtio-net,tap1 -s 31,lpc -s >> 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -s 26,passthru,0/26/0 -S >> -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l >> bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w >> windows7 >> bhyve: passthru device 0/26/0 BAR 0: base 0xd4739000 or size 0x400 not page aligned > ^^^^^ >> >> bhyve: failed to initialize BARs for PCI 0/26/0 >> >> >> >> pciconf -vlb ppt0@pci0:0:26:0 >> ppt0@pci0:0:26:0: class=0x0c0320 card=0x17df103c chip=0x1e2d8086 rev=0x04 hdr=0x00 >> vendor = 'Intel Corporation' >> device = '7 Series/C216 Chipset Family USB Enhanced Host Controller' >> class = serial bus >> subclass = USB >> bar [10] = type Memory, range 32, base 0xd4739000, size 1024, enabled > ^^^^^^^^^^ > Due to the design of the IOMMU you can only manage IO space in page > (4096 on x86) granually sizes. The device your trying to pass in > has a 1024 byte memory region that is part of a 4096 byte page that > may have other things in it. > At this time bhyve does not have any way to deal with this, though some > other hypervisors have techniques that make this work. I used VirtualBox. I gave a try to bhyve. I am using FreeBSD for all work I need. I need windows for some tasks: some VPN (I am not able to connect with vpnc, openconnect, racoon, strongswan), Iphone backup, etc. I am not able to use a single hypervisor for all of that. Could you recommend one? thanks. regards, lk > I do not have or know of any list of USB controller cards that > have 4k aligned and 4k sized BAR's. >> The intention is to have usb device in the windows. > A discussion recently in the developers conference call > touched on this very subject. The basic design would be > rather than pass in a whole controller would be to add > the ability to pass in individual devices. >> Any suggestions? > Are you trying to pass in a motherboard resource? > You might find an add on USB card that has proper BAR > size and alignment, though I have no tips for which > ones do or dont. > It may also be possible to hack the code to ignore the > error IF SECRUITY IS OF NO CONCERN, as this hack would > allow the VM guest to access devices outside of its > domain. I am uncertain if this might have other side > effects as to loss of access to devices in the same > page from the host perspective. > -- > Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Thu Mar 1 18:44:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 48DFBF42B8D for ; Thu, 1 Mar 2018 18:44:00 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CC470745C6 for ; Thu, 1 Mar 2018 18:43:59 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w21Ihv7v026768; Thu, 1 Mar 2018 10:43:57 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w21Ihvkr026767; Thu, 1 Mar 2018 10:43:57 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201803011843.w21Ihvkr026767@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve - windows7 installation In-Reply-To: <86606fir9q.fsf@gmail.com> To: Ludovit Koren Date: Thu, 1 Mar 2018 10:43:57 -0800 (PST) CC: Harry Schmalzbauer , freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 18:44:00 -0000 > >>>>> Rodney W Grimes writes: > > >> >>>>> Harry Schmalzbauer writes: > >> > >> > Bez?glich Ludovit Koren's Nachricht vom 01.03.2018 08:22 (localtime): > >> >> > >> >> Hi, > > ... > >> > After connecting via VNC the vm boots from DVD and you see the setup > >> > program. You won't have mouse support, but keyboard's been working, right? > >> > So you have been able to finsih setup and login via VNC, still no mouse. > >> > Use your existing setup or do a new one to make the last assumptions true. > >> > If you booted with the two ISO images, use the keyboard to start > >> > "control panel/Device Manager", where you should find the unattached > >> > virtio NIC. Installt/Update the driver from there, you can tell the > >> > assistant to use e:\ as source (your 2nd. ODD). > >> > >> Thank you very much. It is up and running. > >> > >> I have an additional question. When I try to run: > >> > >> bhyve -c 1 -s 0,hostbridge -s > >> 3,ahci-hd,/dev/zvol/zroot/msw7,sectorsize=512/8192 -s > >> 10,virtio-net,tap1 -s 31,lpc -s > >> 29,fbuf,tcp=0.0.0.0:5900,w=1366,h=768,wait -s 26,passthru,0/26/0 -S > >> -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l > >> bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -m 4G -H -w > >> windows7 > >> bhyve: passthru device 0/26/0 BAR 0: base 0xd4739000 or size 0x400 not page aligned > > ^^^^^ > >> > >> bhyve: failed to initialize BARs for PCI 0/26/0 > >> > >> > >> > >> pciconf -vlb ppt0@pci0:0:26:0 > >> ppt0@pci0:0:26:0: class=0x0c0320 card=0x17df103c chip=0x1e2d8086 rev=0x04 hdr=0x00 > >> vendor = 'Intel Corporation' > >> device = '7 Series/C216 Chipset Family USB Enhanced Host Controller' > >> class = serial bus > >> subclass = USB > >> bar [10] = type Memory, range 32, base 0xd4739000, size 1024, enabled > > ^^^^^^^^^^ > > > Due to the design of the IOMMU you can only manage IO space in page > > (4096 on x86) granually sizes. The device your trying to pass in > > has a 1024 byte memory region that is part of a 4096 byte page that > > may have other things in it. > > > At this time bhyve does not have any way to deal with this, though some > > other hypervisors have techniques that make this work. > > I used VirtualBox. I gave a try to bhyve. I am using FreeBSD for all work > I need. I need windows for some tasks: some VPN (I am not able to > connect with vpnc, openconnect, racoon, strongswan), Iphone backup, > etc. I am not able to use a single hypervisor for all of that. Could you > recommend one? Unfortanetly I can not make one as I am not familiar with all of your listed needs and what they specifically require. I do not know which, if any, can deal with passing in your non-page sized USB device either. > thanks. > regards, > lk > > > I do not have or know of any list of USB controller cards that > > have 4k aligned and 4k sized BAR's. > > >> The intention is to have usb device in the windows. > > > A discussion recently in the developers conference call > > touched on this very subject. The basic design would be > > rather than pass in a whole controller would be to add > > the ability to pass in individual devices. > > >> Any suggestions? > > > Are you trying to pass in a motherboard resource? > > You might find an add on USB card that has proper BAR > > size and alignment, though I have no tips for which > > ones do or dont. > > > It may also be possible to hack the code to ignore the > > error IF SECRUITY IS OF NO CONCERN, as this hack would > > allow the VM guest to access devices outside of its > > domain. I am uncertain if this might have other side > > effects as to loss of access to devices in the same > > page from the host perspective. > > > -- > > Rod Grimes rgrimes@freebsd.org > > > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Thu Mar 1 22:24:42 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA5EAF2F985 for ; Thu, 1 Mar 2018 22:24:41 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf0-f51.google.com (mail-lf0-f51.google.com [209.85.215.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 530647D7E5 for ; Thu, 1 Mar 2018 22:24:41 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf0-f51.google.com with SMTP id t204so10611239lff.9 for ; Thu, 01 Mar 2018 14:24:41 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=dZNaO8uJuWkOTFrjMHgY+oHkR835DL00GQ9z4jXEulU=; b=KoNKQB3NUvcrZ/nLG8kKu3SZVVwtBtmv3rLfusRjbzSaiqeiiEr6uHYN+kpVnNtnmv cSneCUd0E9wE82OjPpgS7BkqyAJjYX8ndaRrf/5usGuI+fAipCd/wIKdL/3ydzLIb3le ULh0fRTrr7oIDxIHi4G5dw6yyuYRNf9UgA6fADpRksx7uZU9FCUUsNkS+J2+ko1xQHpL JmvKJyez+VZe55ywSupzoFcSO3Rj5OSf8PZlf189Xhi2L/ZdFHxrIYSPEzSI1u+gCb8g 3zCJzQeXxO/0WPc+qj1S3G0zWq6VXXx+eP3l8C8ZLXAcpO18NRZrerR3WGjq0HdL9yf5 Bl2w== X-Gm-Message-State: AElRT7FUZ7rCtTSKzUVw9BmAoWbd/gajrnsjQkniL6Gmygxf3V1QqVsn cqKYcpgiovcUeuGaK9qypmeY98YN X-Google-Smtp-Source: AG47ELvg/FZ0NRBWnxQRyeWnXh+zC/0qpBvdhKZ0GpbnlDN48rlJ3uorx5u6uiy0dBdRbI0hSPesrA== X-Received: by 10.46.84.86 with SMTP id y22mr2388185ljd.36.1519942743828; Thu, 01 Mar 2018 14:19:03 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id v83sm1035862lje.53.2018.03.01.14.19.02 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 01 Mar 2018 14:19:03 -0800 (PST) Subject: Re: bhyve - windows7 installation To: "Rodney W. Grimes" , Ludovit Koren Cc: freebsd-virtualization@freebsd.org References: <86efl3j4y5.fsf@gmail.com> <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> From: Andriy Gapon Message-ID: <3ab0c15f-afb5-c880-91d1-ba09a5c8bbc9@FreeBSD.org> Date: Fri, 2 Mar 2018 00:19:01 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 22:24:42 -0000 On 01/03/2018 16:06, Rodney W. Grimes wrote: > Due to the design of the IOMMU you can only manage IO space in page > (4096 on x86) granually sizes. The device your trying to pass in > has a 1024 byte memory region that is part of a 4096 byte page that > may have other things in it. > > At this time bhyve does not have any way to deal with this, though some > other hypervisors have techniques that make this work. > > I do not have or know of any list of USB controller cards that > have 4k aligned and 4k sized BAR's. I have this local hack for that problem. It comes without any warranty and its use is completely at your own risk. commit 74e0a8d1ae01c7aaabd7d965958b735c7cf18871 Author: Andriy Gapon Date: Fri Nov 17 20:17:57 2017 +0200 bhyve: allow BAR sizes that are not page aligned by rounding them up This is based on the assumption that drivers won't access the added space. diff --git a/usr.sbin/bhyve/pci_passthru.c b/usr.sbin/bhyve/pci_passthru.c index f314679d912b0..14c1384c6c8f8 100644 --- a/usr.sbin/bhyve/pci_passthru.c +++ b/usr.sbin/bhyve/pci_passthru.c @@ -563,13 +563,20 @@ cfginitbar(struct vmctx *ctx, struct passthru_softc *sc) size = bar.pbi_length; if (bartype != PCIBAR_IO) { - if (((base | size) & PAGE_MASK) != 0) { + if ((base & PAGE_MASK) != 0) { warnx("passthru device %d/%d/%d BAR %d: " - "base %#lx or size %#lx not page aligned\n", + "base %#lx not page aligned\n", sc->psc_sel.pc_bus, sc->psc_sel.pc_dev, - sc->psc_sel.pc_func, i, base, size); + sc->psc_sel.pc_func, i, base); return (-1); } + if ((size & PAGE_MASK) != 0) { + warnx("passthru device %d/%d/%d BAR %d: " + "size %#lx not page aligned\n", + sc->psc_sel.pc_bus, sc->psc_sel.pc_dev, + sc->psc_sel.pc_func, i, size); + size = round_page(size); + } } /* Cache information about the "real" BAR */ -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Fri Mar 2 02:45:28 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2DB06F4074D for ; Fri, 2 Mar 2018 02:45:28 +0000 (UTC) (envelope-from dreamashish21@gmail.com) Received: from mail-it0-x244.google.com (mail-it0-x244.google.com [IPv6:2607:f8b0:4001:c0b::244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C2F7A86DE1 for ; Fri, 2 Mar 2018 02:45:27 +0000 (UTC) (envelope-from dreamashish21@gmail.com) Received: by mail-it0-x244.google.com with SMTP id k79so437217ita.2 for ; Thu, 01 Mar 2018 18:45:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=/JwWQ5ItBcAjYI+KrrCAvUVe+uo19UEoQ1Sn4aPlbYk=; b=AeZyN5CIGSyozg3cOK/tvM86uGFe19Q8v/hTvp/MsPBsWwg3TTEPVLydoeJphunNl5 Zh6Qboyma0/dZjFKf+fQXqWaiTWmbJykc1C3KNhUHKxh+tmbagZE/9H64P97A5ivbTok saK0wiWZzougjPMfkNWBhK6QPb8e721/LtrnK8buPG3XyiqAmS2d2PiTVoS9gQMkLr7B /nZkxOIWOket0j+Jh4/tQXq06Rl8W9kuXRb+4rLphEPFhJtd+MqRyc9gPlebey6y3u2Z TdiccfjXeMQI1KPhb9WETbYqi/bFpGaZgq5zJZ/MCu/rNJG2XlA8nTd3/Vu2GbiIzLo4 vXqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=/JwWQ5ItBcAjYI+KrrCAvUVe+uo19UEoQ1Sn4aPlbYk=; b=uIQJ1AWXSI1+xy4lxVtkbSFfuiExz61sW9sB5DmiaZGhSxhJtTKuzwroheT/+03W9j 1NqIGaEqMZSPFt6faysdG5y+6ZpslFIc4Dm/XM5TQmvMfq7F6uZXWMZ3Y5SBWcZVjIs1 VNcg6+kOGC1djoWS6VySxtFkeG3Cbz92R0ekuPQTSE4PS3so47Pn3mijS9X39WgcOuHF BTTq+GPWJSMnBcXP7eYi4q2YPsd1HvmRc/Md1vgEpSICuxNanM6YPLDJr50+TSX1TBGu 3Eqo6anwx1y/DF04Wi5KkclO4V53QuKmNDqCOcuge6lJj4zkmKT90FCSoj2KluCQPd50 ZvmA== X-Gm-Message-State: AElRT7GCH0tefFT9hQYmelAEUOglXdr8qWU95cYMUzq8QAR883Hb5CQc D0Id2JpBzVFHXn/L5J8Q1QZI556q/EvSfAkfQsI= X-Google-Smtp-Source: AG47ELty10QxL9Sf+5lNvm/ebPKQtPjeR4uPcYgxPZrGCmWpFq9I7fE64pkp0k64EdqaRBxZrEmFf8vfqfsvUluAmnk= X-Received: by 10.36.39.7 with SMTP id g7mr495736ita.55.1519958726641; Thu, 01 Mar 2018 18:45:26 -0800 (PST) MIME-Version: 1.0 Received: by 10.107.85.5 with HTTP; Thu, 1 Mar 2018 18:44:46 -0800 (PST) In-Reply-To: References: From: Ashish Gahlot Date: Fri, 2 Mar 2018 08:14:46 +0530 Message-ID: Subject: Re: GSOC 2018 To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Mar 2018 02:45:28 -0000 Hello all, Please have a look at my CV which was not displayed in my previous message. https://github.com/Agahlot/CV/blob/master/cv.pdf Thanks & Regards, Ashish Kumar Gahlot On Fri, Mar 2, 2018 at 12:28 AM, Tommi Pernila wrote= : > Hi Ashish, > > this mailing list doesn=E2=80=99t allow attachements. > If you want people to read your CV please reply to your original email > with a link to the CV. > > Br, > > Tommi > > On Thu, 1 Mar 2018 at 20.27, Ashish Gahlot > wrote: > >> Hello all, >> >> My name is Ashish Kumar Gahlot and I am a final year undergraduate stude= nt >> of Engineering College Ajmer(Rajasthan, India) majoring in >> Computer Science. >> >> I am interested in working on project *Verification of bhyve's instructi= on >> emulation *for GSOC 2018. I am having experience with writing large >> programs in c and assembly and have written X86 bare-bones kernel. >> >> I have attached my CV below. Looking forward to your response to get >> started :) >> >> Thanks & Regards, >> Ashish Kumar Gahlot >> >> >> -- >> Ashish Kumar Gahlot >> IV year, UG >> Govt. Engg. College, Ajmer, India >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to "freebsd-virtualization- >> unsubscribe@freebsd.org" >> > --=20 Ashish Kumar Gahlot IV year, UG Govt. Engg. College, Ajmer, India From owner-freebsd-virtualization@freebsd.org Fri Mar 2 07:18:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE6D5F2A6CC for ; Fri, 2 Mar 2018 07:17:59 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: from mail-wm0-x22d.google.com (mail-wm0-x22d.google.com [IPv6:2a00:1450:400c:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 674A6713D6; Fri, 2 Mar 2018 07:17:59 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: by mail-wm0-x22d.google.com with SMTP id t74so1245705wme.3; Thu, 01 Mar 2018 23:17:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:user-mail-address:date:in-reply-to :message-id:user-agent:mime-version; bh=VpUGv7GjajGLzxcid8HlO8roi4DeEkAFJF2NYpNPoss=; b=EM7gwwp0qmh3LZLX0JVT+KkaC9iLR6IFzOfY9X0WN3iGZ4rW79gGIS8xBUSZBUoijf djN3QNaAr+jnpy0EYY16zXoPlMUznuXBV4BVKbixopdpQPpIeuNSSyLWrP+wHMUqqq1I sLzgJ1m8pCBBAadwHXbXG94PchqS28SkG+wV5e84shYXmPiCmgh231vmaoH7rtRlSGzv VXxwAZaB5SEm49Tpg+ZCulNQGOgZkcBNoJxLsKtFIhUS/ywsafhmnLhwgTh7L87sXAHd m8+hK1xcyBEJ67OX7P7UohNjUUBgakjvfiLORkluz4Ai5NOtr8GxEf2zKyib65SL2lku 2nkw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:user-mail-address :date:in-reply-to:message-id:user-agent:mime-version; bh=VpUGv7GjajGLzxcid8HlO8roi4DeEkAFJF2NYpNPoss=; b=bi0MVCk/1ouhIkE3p2ajHL+2qen87ewtT4p+0k3EQQuiC41ZsnAh+yoJh+38b2OgVi lCKGpL9ZiuJsfzy82kUMwcv0Vg4zVyFQgzzgHFtmI7RB2RRWZrAerSTKKApUnX5zXaZx Pd3w0sqGe8fL0bdJaakO9Yjjv22AzfykuKxPgVbeeURYf8BRQ61hu76j1+MzfCp+PGe8 89Vdcu/NpAEo5BfUXK59Bw+HDVzJ7WbwZ+p+7RvNTFuEjUqbNGZ2UdvOPbKnhnL+MY3k 9UYcbFBV4c38AiDRPv6bXScEew/pGd+VNyszoHbWXSGNzfmIrthqdDhS3A6MAkJ6hs3i JGuA== X-Gm-Message-State: AElRT7EVeIsk0ttDsP+oS6dKq+zn0597gqOreS/BTaVneDzD6W58VJLl qNGgz0BPjouPtJRAFWBa91nhqA== X-Google-Smtp-Source: AG47ELuvd83yWKVtdLw6pxwa3xO1jk0mtvAyb3qe9ZfdmGPpGbw0OMSMlGp0syuZAgTIyyV9ldYmjA== X-Received: by 10.28.216.82 with SMTP id p79mr713318wmg.8.1519975078165; Thu, 01 Mar 2018 23:17:58 -0800 (PST) Received: from jedi.localdomain (178-143-48-243.dynamic.orange.sk. [178.143.48.243]) by smtp.gmail.com with ESMTPSA id b136sm640397wme.34.2018.03.01.23.17.57 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 01 Mar 2018 23:17:57 -0800 (PST) Received: by jedi.localdomain (Postfix, from userid 1001) id A2FE6104C; Fri, 2 Mar 2018 08:17:56 +0100 (CET) From: Ludovit Koren To: Andriy Gapon Cc: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <86efl3j4y5.fsf@gmail.com> <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> <3ab0c15f-afb5-c880-91d1-ba09a5c8bbc9@FreeBSD.org> User-Mail-Address: ludovit.koren@gmail.com Date: Fri, 02 Mar 2018 08:17:56 +0100 In-Reply-To: <3ab0c15f-afb5-c880-91d1-ba09a5c8bbc9@FreeBSD.org> (Andriy Gapon's message of "Fri, 2 Mar 2018 00:19:01 +0200") Message-ID: <86woyvgd3v.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Mar 2018 07:18:00 -0000 >>>>> Andriy Gapon writes: > On 01/03/2018 16:06, Rodney W. Grimes wrote: >> Due to the design of the IOMMU you can only manage IO space in page >> (4096 on x86) granually sizes. The device your trying to pass in >> has a 1024 byte memory region that is part of a 4096 byte page that >> may have other things in it. >> >> At this time bhyve does not have any way to deal with this, though some >> other hypervisors have techniques that make this work. >> >> I do not have or know of any list of USB controller cards that >> have 4k aligned and 4k sized BAR's. > I have this local hack for that problem. > It comes without any warranty and its use is completely at your own risk. Thank you. I will try it. lk > commit 74e0a8d1ae01c7aaabd7d965958b735c7cf18871 > Author: Andriy Gapon > Date: Fri Nov 17 20:17:57 2017 +0200 > bhyve: allow BAR sizes that are not page aligned by rounding them up > This is based on the assumption that drivers won't access the added space. > diff --git a/usr.sbin/bhyve/pci_passthru.c b/usr.sbin/bhyve/pci_passthru.c > index f314679d912b0..14c1384c6c8f8 100644 > --- a/usr.sbin/bhyve/pci_passthru.c > +++ b/usr.sbin/bhyve/pci_passthru.c > @@ -563,13 +563,20 @@ cfginitbar(struct vmctx *ctx, struct passthru_softc *sc) > size = bar.pbi_length; > if (bartype != PCIBAR_IO) { > - if (((base | size) & PAGE_MASK) != 0) { > + if ((base & PAGE_MASK) != 0) { > warnx("passthru device %d/%d/%d BAR %d: " > - "base %#lx or size %#lx not page aligned\n", > + "base %#lx not page aligned\n", sc-> psc_sel.pc_bus, sc->psc_sel.pc_dev, > - sc->psc_sel.pc_func, i, base, size); > + sc->psc_sel.pc_func, i, base); > return (-1); > } > + if ((size & PAGE_MASK) != 0) { > + warnx("passthru device %d/%d/%d BAR %d: " > + "size %#lx not page aligned\n", > + sc->psc_sel.pc_bus, sc->psc_sel.pc_dev, > + sc->psc_sel.pc_func, i, size); > + size = round_page(size); > + } > } > /* Cache information about the "real" BAR */ > -- > Andriy Gapon -- A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing on usenet and in e-mail? From owner-freebsd-virtualization@freebsd.org Fri Mar 2 09:43:33 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1A835F34C5F for ; Fri, 2 Mar 2018 09:43:33 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 849C677BB2 for ; Fri, 2 Mar 2018 09:43:32 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w229hTeC048201; Fri, 2 Mar 2018 10:43:29 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 23069571; Fri, 2 Mar 2018 10:43:29 +0100 (CET) Message-ID: <5A991CC0.4050101@omnilan.de> Date: Fri, 02 Mar 2018 10:43:28 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Ludovit Koren CC: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> <86606fir9q.fsf@gmail.com> In-Reply-To: <86606fir9q.fsf@gmail.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Fri, 02 Mar 2018 10:43:29 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Mar 2018 09:43:33 -0000 BezĂĽglich Ludovit Koren's Nachricht vom 01.03.2018 19:29 (localtime): >>>>>> Rodney W Grimes writes: > > >> >>>>> Harry Schmalzbauer writes: … > >> bhyve: passthru device 0/26/0 BAR 0: base 0xd4739000 or size 0x400 not page aligned > > ^^^^^ > >> > >> bhyve: failed to initialize BARs for PCI 0/26/0 > >> > >> > >> > >> pciconf -vlb ppt0@pci0:0:26:0 > >> ppt0@pci0:0:26:0: class=0x0c0320 card=0x17df103c chip=0x1e2d8086 rev=0x04 hdr=0x00 > >> vendor = 'Intel Corporation' > >> device = '7 Series/C216 Chipset Family USB Enhanced Host Controller' > >> class = serial bus > >> subclass = USB > >> bar [10] = type Memory, range 32, base 0xd4739000, size 1024, enabled > > ^^^^^^^^^^ > > > Due to the design of the IOMMU you can only manage IO space in page > > (4096 on x86) granually sizes. The device your trying to pass in > > has a 1024 byte memory region that is part of a 4096 byte page that > > may have other things in it. > > > At this time bhyve does not have any way to deal with this, though some > > other hypervisors have techniques that make this work. > > I used VirtualBox. I gave a try to bhyve. I am using FreeBSD for all work > I need. I need windows for some tasks: some VPN (I am not able to > connect with vpnc, openconnect, racoon, strongswan), Iphone backup, > etc. I am not able to use a single hypervisor for all of that. Could you > recommend one? I know your situation – I tried virtualbox-ose-3.2.8 (~8 yeras ago) and it's still running on my ancient workstation. Simply works for the one XP I need to have arround for some of the named reasons. Regarding USB-related requirements, I always found a device which made trouble – even with ESXi's generally very well working USB passthrough. So I use a USB-Device-IP-bridge. The one I import from USA to Europe, because of it's yet problemfree design/hardware/(Win-)software, can be found for ~US$55.- if you search for ID-DS0611-S1 – might be out of budget for private use though... I'm very curious about the workaround avg@ posted. For all server virtualization tasks I switched to bhyve(8) half a year ago for my local office. It simply works (for FreeBSD + Win2012R2 guests) and I'm happily finding workarounds for current limitations in favour of having a bare metal ZFS storage subsystem in parallel to the hypervisor :-) Thanks to all coders for this nice OS extention! -harry From owner-freebsd-virtualization@freebsd.org Fri Mar 2 15:11:33 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 505CCF2B7EC for ; Fri, 2 Mar 2018 15:11:33 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9E424856C9; Fri, 2 Mar 2018 15:11:32 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w22FBRs1030532; Fri, 2 Mar 2018 07:11:27 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w22FBQbf030531; Fri, 2 Mar 2018 07:11:26 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201803021511.w22FBQbf030531@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve - windows7 installation In-Reply-To: <86woyvgd3v.fsf@gmail.com> To: Ludovit Koren Date: Fri, 2 Mar 2018 07:11:26 -0800 (PST) CC: Andriy Gapon , freebsd-virtualization@FreeBSD.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Mar 2018 15:11:33 -0000 > >>>>> Andriy Gapon writes: > > > On 01/03/2018 16:06, Rodney W. Grimes wrote: > >> Due to the design of the IOMMU you can only manage IO space in page > >> (4096 on x86) granually sizes. The device your trying to pass in > >> has a 1024 byte memory region that is part of a 4096 byte page that > >> may have other things in it. > >> > >> At this time bhyve does not have any way to deal with this, though some > >> other hypervisors have techniques that make this work. > >> > >> I do not have or know of any list of USB controller cards that > >> have 4k aligned and 4k sized BAR's. > > > I have this local hack for that problem. > > It comes without any warranty and its use is completely at your own risk. > > Thank you. I will try it. Andriy, Thanks for providing this patch, I tried to find the repository it is in with google and did not, is this a private repository? Either way would it be ok with you if I published, with attribution of cource, your patch first from my people.freebsd.org/~rgrimes#bhyve page, and possibly later from a wiki page? I'll properly dress it in "this has security implications" and enumerate what those are. Thanks, > lk > > > commit 74e0a8d1ae01c7aaabd7d965958b735c7cf18871 > > Author: Andriy Gapon > > Date: Fri Nov 17 20:17:57 2017 +0200 > > > bhyve: allow BAR sizes that are not page aligned by rounding them up > > > This is based on the assumption that drivers won't access the added space. > > > diff --git a/usr.sbin/bhyve/pci_passthru.c b/usr.sbin/bhyve/pci_passthru.c > > index f314679d912b0..14c1384c6c8f8 100644 > > --- a/usr.sbin/bhyve/pci_passthru.c > > +++ b/usr.sbin/bhyve/pci_passthru.c > > @@ -563,13 +563,20 @@ cfginitbar(struct vmctx *ctx, struct passthru_softc *sc) > > size = bar.pbi_length; > > > if (bartype != PCIBAR_IO) { > > - if (((base | size) & PAGE_MASK) != 0) { > > + if ((base & PAGE_MASK) != 0) { > > warnx("passthru device %d/%d/%d BAR %d: " > > - "base %#lx or size %#lx not page aligned\n", > > + "base %#lx not page aligned\n", > sc-> psc_sel.pc_bus, sc->psc_sel.pc_dev, > > - sc->psc_sel.pc_func, i, base, size); > > + sc->psc_sel.pc_func, i, base); > > return (-1); > > } > > + if ((size & PAGE_MASK) != 0) { > > + warnx("passthru device %d/%d/%d BAR %d: " > > + "size %#lx not page aligned\n", > > + sc->psc_sel.pc_bus, sc->psc_sel.pc_dev, > > + sc->psc_sel.pc_func, i, size); > > + size = round_page(size); > > + } > > } > > > /* Cache information about the "real" BAR */ > > > > -- > > Andriy Gapon > > > -- > A: Because it fouls the order in which people normally read text. > Q: Why is top-posting such a bad thing? Sorry for the middle posting :-) > A: Top-posting. > Q: What is the most annoying thing on usenet and in e-mail? -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Fri Mar 2 15:37:35 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E3358F2D83B for ; Fri, 2 Mar 2018 15:37:34 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf0-f46.google.com (mail-lf0-f46.google.com [209.85.215.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4D6DE86FBE for ; Fri, 2 Mar 2018 15:37:34 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf0-f46.google.com with SMTP id y19so13921012lfd.4 for ; Fri, 02 Mar 2018 07:37:34 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=6+J3U+EEoCGKYzQDbAcBvTiTraJ6KtZfVISSv0wPm/E=; b=aSpxRZwkh9mplx+H4ozrvy/lS0g1t+lOqgGCWm7YAzrub7vLlroszl75WcKKCSTboX xfFFcqn8VMy8oh5K0uYJlg3bWkaYEeEvnkmTQ3g+tD8Qz/KXkcuJvof8//5NEWx3eurn b0nK9VimIirQGL9RkeaY/fU/OztJTWck6YKL6QcKe969M7B+ePkMxktJXUyvDJO7FuKL 03cLCnC5ks9RoTPfBiLirDoYn+sgp96mtN7t0gzLt4HyKumhpOKtmow60G7wT9Xdy0BD ci03o3NGACYvE5YiB6UuDVOfmcEJHShfGnkugxJ6BAFizi08zfkavBM75YjttQoU6VbD Y1bw== X-Gm-Message-State: AElRT7FKMl2pLRTmEZ1Hi+FeHU41su1xUSLp0WV1f0KPnApzlXgtYdmv TBPznykPsMOldx+Vk7SuWjv14WRU X-Google-Smtp-Source: AG47ELu0obtWmwZSaV00N+8GSHh7T9FjIukPvVJHtzm4ozRs9eXjxcvQebP90bDpCtyawkR2C5X1Jg== X-Received: by 10.25.157.80 with SMTP id g77mr4117043lfe.142.1520005046845; Fri, 02 Mar 2018 07:37:26 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id d14sm1376576ljd.31.2018.03.02.07.37.25 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 02 Mar 2018 07:37:25 -0800 (PST) Subject: Re: bhyve - windows7 installation To: "Rodney W. Grimes" , Ludovit Koren Cc: freebsd-virtualization@FreeBSD.org References: <201803021511.w22FBQbf030531@pdx.rh.CN85.dnsmgr.net> From: Andriy Gapon Message-ID: <75274ee8-4375-671d-8dd8-72a6d31c52da@FreeBSD.org> Date: Fri, 2 Mar 2018 17:37:24 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <201803021511.w22FBQbf030531@pdx.rh.CN85.dnsmgr.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Mar 2018 15:37:35 -0000 On 02/03/2018 17:11, Rodney W. Grimes wrote: > Andriy, > Thanks for providing this patch, I tried to find the repository > it is in with google and did not, is this a private repository? Yes, a repo for my private development. > Either way would it be ok with you if I published, with attribution > of cource, your patch first from my people.freebsd.org/~rgrimes#bhyve > page, and possibly later from a wiki page? I'll properly dress it > in "this has security implications" and enumerate what those are. Yes, I am completely okay with it. -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Fri Mar 2 19:01:59 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 73209F3DCBB for ; Fri, 2 Mar 2018 19:01:59 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: from mail-wm0-x233.google.com (mail-wm0-x233.google.com [IPv6:2a00:1450:400c:c09::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0044272F7C; Fri, 2 Mar 2018 19:01:58 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: by mail-wm0-x233.google.com with SMTP id z9so4850711wmb.3; Fri, 02 Mar 2018 11:01:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:user-mail-address:date:in-reply-to :message-id:user-agent:mime-version; bh=ccCyWZSyOl/b9PuIxozrpksgYzvBU0ppQPnpbqGHa+0=; b=iYIk/QfotQrf0Alz/O28qTQw8Hz3TGiWBNcrPAZCAuWP3nWdEvbbks5BaNED/K4x5r d16QYMGzyBL2KxTw/46caS30Cm/mLhQ0UU2/YvWn8Lo2FR3BsITTgVKdYU57JhQ//EY3 0Trq0jFZTkXRg22bgPgglROH/G3PRpmFDmRZzvVetignUDvSNQcspy6a8BZg6kxBYoc7 l640mmOByb8xJma7NxxOSddrdYqsnRaIyDnKBuh69PfW6G21m3SZCEG2SbnHLuj+UlkL 6ZxMN/fCNBQnQlbNyJ3TxszRAJfTPIdXIvImRAfnghdRS0zRzWvL96k4elhFyUpHrsjq A70g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:user-mail-address :date:in-reply-to:message-id:user-agent:mime-version; bh=ccCyWZSyOl/b9PuIxozrpksgYzvBU0ppQPnpbqGHa+0=; b=nJ+AJXgb3PeoKElBe+q3ZCQt31/V4CbktvZl3mWi4p1O+0IrlMOlVhmCRBkWaazzDo eiEh+xPVdDNmCoMrqZ/B9aqYG/p/hxboJNLfceQ++2MufEcEqeyRRONEPx82P14cBMQZ YVB7P5ju5f9oAUcPJFCteM1PtH/1dUtiJLUFMeF0k28qObPMv3a4Sq5nuR7LmEmQcw1T 3towkUhpghZ1EhPvPUbMYDvdy4AjgAds5YXe9lmSLtvVApC8VUdzKcfnnRlNolH0WQSk rzjksmgKk0A1KEgYNFIsSl386jgBuln4iGynR8qpKLuWwdAM/BqFyjjfryRAsIjXz+28 K9xg== X-Gm-Message-State: AElRT7G2mCBQhJNtR/iyiEwD+N59eTyxUNVYmR/KA2tT/MsvoTWYwT4A 4EFma6kheJNiJd2+HEJSe9sRuQ== X-Google-Smtp-Source: AG47ELtkQu1SDItbWhRpBskNoxHUncsDLuLz2n+KsXH02isrWsK4SQ3fqXny6I1SPIuGPIgr18qJ9g== X-Received: by 10.28.84.26 with SMTP id i26mr2310587wmb.129.1520017317588; Fri, 02 Mar 2018 11:01:57 -0800 (PST) Received: from jedi.localdomain (adsl-dyn-247.95-102-174.t-com.sk. [95.102.174.247]) by smtp.gmail.com with ESMTPSA id c47sm1315524wrg.22.2018.03.02.11.01.56 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 02 Mar 2018 11:01:56 -0800 (PST) Received: by jedi.localdomain (Postfix, from userid 1001) id B3E6911DA; Fri, 2 Mar 2018 20:01:55 +0100 (CET) From: Ludovit Koren To: Andriy Gapon Cc: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org Subject: Re: bhyve - windows7 installation References: <86efl3j4y5.fsf@gmail.com> <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> <3ab0c15f-afb5-c880-91d1-ba09a5c8bbc9@FreeBSD.org> User-Mail-Address: ludovit.koren@gmail.com Date: Fri, 02 Mar 2018 20:01:55 +0100 In-Reply-To: <3ab0c15f-afb5-c880-91d1-ba09a5c8bbc9@FreeBSD.org> (Andriy Gapon's message of "Fri, 2 Mar 2018 00:19:01 +0200") Message-ID: <86h8py1eu4.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Mar 2018 19:01:59 -0000 >>>>> Andriy Gapon writes: > On 01/03/2018 16:06, Rodney W. Grimes wrote: >> Due to the design of the IOMMU you can only manage IO space in page >> (4096 on x86) granually sizes. The device your trying to pass in >> has a 1024 byte memory region that is part of a 4096 byte page that >> may have other things in it. >> >> At this time bhyve does not have any way to deal with this, though some >> other hypervisors have techniques that make this work. >> >> I do not have or know of any list of USB controller cards that >> have 4k aligned and 4k sized BAR's. > I have this local hack for that problem. > It comes without any warranty and its use is completely at your own risk. > commit 74e0a8d1ae01c7aaabd7d965958b735c7cf18871 > Author: Andriy Gapon > Date: Fri Nov 17 20:17:57 2017 +0200 > bhyve: allow BAR sizes that are not page aligned by rounding them up > This is based on the assumption that drivers won't access the added space. > diff --git a/usr.sbin/bhyve/pci_passthru.c b/usr.sbin/bhyve/pci_passthru.c > index f314679d912b0..14c1384c6c8f8 100644 > --- a/usr.sbin/bhyve/pci_passthru.c > +++ b/usr.sbin/bhyve/pci_passthru.c > @@ -563,13 +563,20 @@ cfginitbar(struct vmctx *ctx, struct passthru_softc *sc) > size = bar.pbi_length; > if (bartype != PCIBAR_IO) { > - if (((base | size) & PAGE_MASK) != 0) { > + if ((base & PAGE_MASK) != 0) { > warnx("passthru device %d/%d/%d BAR %d: " > - "base %#lx or size %#lx not page aligned\n", > + "base %#lx not page aligned\n", sc-> psc_sel.pc_bus, sc->psc_sel.pc_dev, > - sc->psc_sel.pc_func, i, base, size); > + sc->psc_sel.pc_func, i, base); > return (-1); > } > + if ((size & PAGE_MASK) != 0) { > + warnx("passthru device %d/%d/%d BAR %d: " > + "size %#lx not page aligned\n", > + sc->psc_sel.pc_bus, sc->psc_sel.pc_dev, > + sc->psc_sel.pc_func, i, size); > + size = round_page(size); > + } > } > /* Cache information about the "real" BAR */ Hi, I applied the patch and I got the following error for usb in windows: This device cannot find enough free resources that it can use. (Code 12) If you want to use this device, you will need to disable one of the other devices on this system. I don't know how to proceed.... thanks regards, lk From owner-freebsd-virtualization@freebsd.org Sat Mar 3 20:31:58 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 053BAF393B4 for ; Sat, 3 Mar 2018 20:31:58 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf0-f42.google.com (mail-lf0-f42.google.com [209.85.215.42]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6E8F574B6D for ; Sat, 3 Mar 2018 20:31:57 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf0-f42.google.com with SMTP id v9so17867070lfa.11 for ; Sat, 03 Mar 2018 12:31:57 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=vQTXzcdIaZIsC2ChifCcf+DGMtOghEUOPfeJg5TxDXA=; b=roDQBlfLtZUuVaWHZZyzopw+gGVMju3LnsEWmvWb3ZgjZWGdiny1wgS41rQDy1zeb3 VEreSG2IL6onvwPC/KRxITJjM0Lqiy3uzwJoKRAj+XQ932LwpHkO0OcWYB8yAcsNx5yv LKlItPJrpXUBF0i1L/6JQq30o9YPP+lIAUwq37Dw2aDuzgu14Yy6kx5pxhjvNm+a/5VJ TOtheyEOfX1RvLWfNgg69G0aSA+J7YpF1WyPAvXDOHjcM5C3z0lj0178ZNHEhZIwWuAM jva7ceYrO2SLT467urJEPGKZ0E+05BUXu2c7Wc5fVOYUg3ddtS2WN1o6PXOUiNoqjuOK YdsQ== X-Gm-Message-State: AElRT7E2NRdg/Rud87u2NFExCdh99IAfAlmFcxNFIPO06iKHY2HPWOXW FPtEAF87j1kua/cJ/bj+bpV6X0rq X-Google-Smtp-Source: AG47ELvP1XuKhZ+ZAdTCGRxdmkFa7FkxM65UfnbRl+cwLeup5tFwNoCAK4JyVSYiBFgbZU5XUAt1zg== X-Received: by 10.46.68.78 with SMTP id r75mr6561445lja.13.1520109109554; Sat, 03 Mar 2018 12:31:49 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id 7sm1953900ljx.39.2018.03.03.12.31.47 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 03 Mar 2018 12:31:48 -0800 (PST) Subject: Re: bhyve - windows7 installation To: Ludovit Koren Cc: "Rodney W. Grimes" , freebsd-virtualization@FreeBSD.org References: <86efl3j4y5.fsf@gmail.com> <201803011406.w21E62La025815@pdx.rh.CN85.dnsmgr.net> <3ab0c15f-afb5-c880-91d1-ba09a5c8bbc9@FreeBSD.org> <86h8py1eu4.fsf@gmail.com> From: Andriy Gapon Message-ID: <5891ac2b-6e98-e19e-05a7-4107fcd97a87@FreeBSD.org> Date: Sat, 3 Mar 2018 22:31:46 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <86h8py1eu4.fsf@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Mar 2018 20:31:58 -0000 On 02/03/2018 21:01, Ludovit Koren wrote: > I applied the patch and I got the following error for usb in windows: > > This device cannot find enough free resources that it can use. (Code 12) > > If you want to use this device, you will need to disable one of the other devices on this system. > > > I don't know how to proceed.... The hack that I shared is just a hack around some reasonable restrictions in bhyve. I don't know anything about Windows internals, so can't help further. -- Andriy Gapon