From owner-freebsd-virtualization@freebsd.org Sun Aug 5 07:10:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0CF4C106C848 for ; Sun, 5 Aug 2018 07:10:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9D59E82F4A for ; Sun, 5 Aug 2018 07:10:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 629D3106C843; Sun, 5 Aug 2018 07:10:21 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 517BE106C842 for ; Sun, 5 Aug 2018 07:10:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E79D982F42 for ; Sun, 5 Aug 2018 07:10:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 287EE23036 for ; Sun, 5 Aug 2018 07:10:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w757AKgU056746 for ; Sun, 5 Aug 2018 07:10:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w757AKSF056745 for virtualization@FreeBSD.org; Sun, 5 Aug 2018 07:10:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 184046] bhyve(4) manpage references non-existant manpages bhyvectl(8), vmm(4) Date: Sun, 05 Aug 2018 07:10:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Manual Pages X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc component see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Aug 2018 07:10:22 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D184046 Oleksandr Tymoshenko changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |doc@FreeBSD.org Component|Documentation |Manual Pages Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D1= 089 | |80 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sun Aug 5 21:21:08 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B01FF105EEB1 for ; Sun, 5 Aug 2018 21:21:08 +0000 (UTC) (envelope-from freebsd@twc.com) Received: from dnvrco-cmomta01.email.rr.com (dnvrco-outbound-snat.email.rr.com [107.14.73.227]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5012178EFD for ; Sun, 5 Aug 2018 21:21:07 +0000 (UTC) (envelope-from freebsd@twc.com) Received: from [IPv6:::ffff:192.168.1.13] ([74.132.25.214]) by cmsmtp with ESMTPA id mQKHfvVsB5AwUmQKJfi8IJ; Sun, 05 Aug 2018 21:12:36 +0000 MIME-Version: 1.0 To: FreeBSD virtualization From: Steven Friedrich Subject: Seeking advice on virtualization Date: Sun, 5 Aug 2018 17:12:34 -0400 Importance: normal X-Priority: 3 X-CMAE-Envelope: MS4wfLXq+mS2IQ5WiExOAX0laux3qsdFxLD8OBSN6gh2nfhcYeQTVQ4MwBm1idHSlHueEGrXRzd3fnDM688NWaLZhe/ghOYOlL6g2KIaOJD1HqNie6+SZa9S YaeG/L1YItrXN/sUbeZURikU0HqpCHEt4uwfZZuTtl14ygeZns2ViQZoN99gvLTNwvKQtnLnJUuHGHw7kfQBz3amYZrkiYGdskY= Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Aug 2018 21:21:08 -0000 I am looking for advice on which virtualization to experiment with first. = What are the pros and cons of bhyve vs xen? I want to use FreeBSD as a host and have maximum flexibility with guests (m= ostly Linux distros). Sent from Mail for Windows 10 From owner-freebsd-virtualization@freebsd.org Sun Aug 5 22:42:21 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 162A51060EFC for ; Sun, 5 Aug 2018 22:42:21 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from mailout4.ceti.pl (mailout4.ceti.pl [62.121.128.44]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A71AC7BAE1 for ; Sun, 5 Aug 2018 22:42:20 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from localhost (localhost [127.0.0.1]) by mailout4.ceti.pl (Postfix) with ESMTP id D7938C0552F0A for ; Mon, 6 Aug 2018 00:42:10 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mailout1.ceti.pl Received: from mailout4.ceti.pl ([62.121.128.44]) by localhost (mailout1.ceti.pl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YGbVpzZ2gxeL for ; Mon, 6 Aug 2018 00:42:05 +0200 (CEST) Received: from tau1.ceti.pl (tau.ceti.pl [62.121.128.11]) by mailout4.ceti.pl (Postfix) with ESMTP id 89C1CC0552F07 for ; Mon, 6 Aug 2018 00:42:05 +0200 (CEST) Received: by tau1.ceti.pl (Postfix, from userid 3727) id 6DD99960E1E; Mon, 6 Aug 2018 00:42:05 +0200 (CEST) Date: Mon, 6 Aug 2018 00:42:05 +0200 From: Tomasz Rola To: FreeBSD virtualization Subject: Re: Seeking advice on virtualization Message-ID: <20180805224205.GB17784@tau1.ceti.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Aug 2018 22:42:21 -0000 On Sun, Aug 05, 2018 at 05:12:34PM -0400, Steven Friedrich wrote: > I am looking for advice on which virtualization to experiment with > first. What are the pros and cons of bhyve vs xen? I want to use > FreeBSD as a host and have maximum flexibility with guests (mostly > Linux distros). Right now I cannot give you pros and cons about specific solutions (I am sure someone else will), but I would advice that you keep using raw hard drive format. I.e. one where the layout of virtual drive is like what you would get by doing "cat someemulateddrive". This makes it easier when you decide to try another virtualisation / hypervisor. Or maybe even switch between back and forth (but, of course, not run two different hypervisors at the same time, on same machine - last time I checked such a stunt was not possible). -- Regards, Tomasz Rola -- ** A C programmer asked whether computer had Buddha's nature. ** ** As the answer, master did "rm -rif" on the programmer's home ** ** directory. And then the C programmer became enlightened... ** ** ** ** Tomasz Rola mailto:tomasz_rola@bigfoot.com ** From owner-freebsd-virtualization@freebsd.org Sun Aug 5 23:07:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B642D10617DB for ; Sun, 5 Aug 2018 23:07:14 +0000 (UTC) (envelope-from paul.g.webster@googlemail.com) Received: from mail-ua0-x22a.google.com (mail-ua0-x22a.google.com [IPv6:2607:f8b0:400c:c08::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 59AC77C45C for ; Sun, 5 Aug 2018 23:07:14 +0000 (UTC) (envelope-from paul.g.webster@googlemail.com) Received: by mail-ua0-x22a.google.com with SMTP id h1-v6so10135579uao.8 for ; Sun, 05 Aug 2018 16:07:14 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=N0BoYTlxRbnf0c8KOJF49OdxsNOeazdHSt+ho/Nzqzw=; b=RPhKojgjuKV/wSWkYDmcKYYjPh9FXIbP+QIJ/ext8MS+zxWATLKaoJZ5EZsOmgukBG cP25/f6lePLPq9pbXpHKRtAOqnQltfTvIwL1GKN58Y5DUjsDt15vvD1CHdF1m/PrzM+7 9XUS802IsrTIg/D7AQoFtJ5cyI9cPCxhOKEtiElTt+vF2AED5r+BnZIBAHsZ9uMzMgPl W/TuRuTkeXMg/mv2JNf5XmBaO79Mim8g++ctM84cdTBp3g3lvIqMl8wDzlE5Y7u66n1J Dq6WMKCt+6AFbjLidh85Mp8bLnMbyNEqHGdoJ9bo9Yz1tnOdY45p+mrNDSRw6hzBPBuS C98A== X-Gm-Message-State: AOUpUlHSUhrO2cvFiZEcBIOaPWcF6VwyMY7uJr+XNeREAAWdXlwlIIlO 8e3zS0trCfl0Kf9eJPaiz3vAdjMKaaDghWH2jYGtE2xi X-Google-Smtp-Source: AAOMgpf/T7ykSpWTWp4L7gjwaO4LllSpffAfjl8Tk7hE6Rd4GtF1Udd+ZhcYSY+lz+5ABd2M1swnGUM/qQwxXbVZDrk= X-Received: by 2002:a1f:1584:: with SMTP id 126-v6mr8357314vkv.146.1533510433582; Sun, 05 Aug 2018 16:07:13 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab0:21ca:0:0:0:0:0 with HTTP; Sun, 5 Aug 2018 16:07:13 -0700 (PDT) In-Reply-To: <20180805224205.GB17784@tau1.ceti.pl> References: <20180805224205.GB17784@tau1.ceti.pl> From: Paul Webster Date: Mon, 6 Aug 2018 00:07:13 +0100 Message-ID: Subject: Re: Seeking advice on virtualization To: Tomasz Rola Cc: FreeBSD virtualization Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Aug 2018 23:07:14 -0000 In theory as ZFS works on both linux and BSD you could simply use vdevs and snapshots for easy transport On 5 August 2018 at 23:42, Tomasz Rola wrote: > On Sun, Aug 05, 2018 at 05:12:34PM -0400, Steven Friedrich wrote: > > I am looking for advice on which virtualization to experiment with > > first. What are the pros and cons of bhyve vs xen? I want to use > > FreeBSD as a host and have maximum flexibility with guests (mostly > > Linux distros). > > Right now I cannot give you pros and cons about specific solutions (I > am sure someone else will), but I would advice that you keep using raw > hard drive format. > > I.e. one where the layout of virtual drive is like what you would get > by doing "cat someemulateddrive". This makes it easier > when you decide to try another virtualisation / hypervisor. Or maybe > even switch between back and forth (but, of course, not run two > different hypervisors at the same time, on same machine - last time I > checked such a stunt was not possible). > > -- > Regards, > Tomasz Rola > > -- > ** A C programmer asked whether computer had Buddha's nature. ** > ** As the answer, master did "rm -rif" on the programmer's home ** > ** directory. And then the C programmer became enlightened... ** > ** ** > ** Tomasz Rola mailto:tomasz_rola@bigfoot.com ** > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Sun Aug 5 23:39:20 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3169B1061FBB for ; Sun, 5 Aug 2018 23:39:20 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-oi0-f48.google.com (mail-oi0-f48.google.com [209.85.218.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B0C5B7D36C for ; Sun, 5 Aug 2018 23:39:19 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-oi0-f48.google.com with SMTP id s198-v6so19028508oih.11 for ; Sun, 05 Aug 2018 16:39:19 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=BkFFUIeyyicxkrkZ53aMqVxgl7A+mrSoPX6rvpu88/g=; b=Irn4tjM5667ORDHgITdxgKfehE0mzwUQ1ohVMehPuVgns3sr0AjigTAYWwytkoag64 U15qIN2c8P2D1/g67xoxk6HR2VoLYMehvvHcqJmCmvgU5V285YGvvriWvsKJkElfODnw dojzAtVKD6avAnSRZvAgPs8Fg3ySH4maNDbz8q7X/fymEOYiv4KG0l+PgYmHKsX52jMG uWl0T6O+iGJQ4bxqbHWVPrpE1/ZNT2RWbnFSFDs7YjH28fFk4GThkmwWbkMoEDwJwCaO OQ+lzA0+acPH8+hPcxRthjPnusvcl3mcUgQqVPxoQBfL/p38kcS2ffPLOlH2kaZIrxwF qb3Q== X-Gm-Message-State: AOUpUlHtMq2IcVdqRrvvchlO6s9lurNzsyRZMPJG6MxozFs6n42MbTfG kBlXdJ5GReFsA0YswvnuxTCGGUtgHWqww+g2h+c= X-Google-Smtp-Source: AAOMgpciXOOg+egvigrv+eMqwTMkY6Xln5gJquv0mmIGG1rdp4vantrdnZUJByDCju6Vlw1fQK7btgOWWbJAr3RxzHI= X-Received: by 2002:aca:e8c9:: with SMTP id f192-v6mr12557311oih.87.1533512352917; Sun, 05 Aug 2018 16:39:12 -0700 (PDT) MIME-Version: 1.0 References: <5b676c39.1c69fb81.db51a.843aMFETCHER_ADDED@google.com> In-Reply-To: <5b676c39.1c69fb81.db51a.843aMFETCHER_ADDED@google.com> From: Jason Tubnor Date: Mon, 6 Aug 2018 09:39:01 +1000 Message-ID: Subject: Re: Seeking advice on virtualization To: FreeBSD@twc.com Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Aug 2018 23:39:20 -0000 On Mon, 6 Aug 2018 at 07:12, Steven Friedrich wrote: > I am looking for advice on which virtualization to experiment with first. > What are the pros and cons of bhyve vs xen? > I want to use FreeBSD as a host and have maximum flexibility with guests > (mostly Linux distros). > > I'd look at your requirements first. While we use bhyve extensively here, the current provisioning tools might not be up to your requirements. Bhyve and ZFS zvols work great for us, simplistic and easy to investigate is something goes wrong (though nothing has gone wrong). Using Xen may fit better into an existing Xen environment. Cheers, Jason. From owner-freebsd-virtualization@freebsd.org Tue Aug 7 17:07:05 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CC79A1064B86 for ; Tue, 7 Aug 2018 17:07:05 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from mailout4.ceti.pl (mailout4.ceti.pl [62.121.128.44]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6A9B877E0C for ; Tue, 7 Aug 2018 17:07:05 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from localhost (localhost [127.0.0.1]) by mailout4.ceti.pl (Postfix) with ESMTP id 64C8FC0552F15; Tue, 7 Aug 2018 19:06:57 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mailout1.ceti.pl Received: from mailout4.ceti.pl ([62.121.128.44]) by localhost (mailout1.ceti.pl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eDGTm34IKo12; Tue, 7 Aug 2018 19:06:48 +0200 (CEST) Received: from tau1.ceti.pl (tau.ceti.pl [62.121.128.11]) by mailout4.ceti.pl (Postfix) with ESMTP id A26DAC0552E29; Tue, 7 Aug 2018 19:06:48 +0200 (CEST) Received: by tau1.ceti.pl (Postfix, from userid 3727) id 6E0B2960E07; Tue, 7 Aug 2018 19:06:48 +0200 (CEST) Date: Tue, 7 Aug 2018 19:06:48 +0200 From: Tomasz Rola To: Paul Webster Cc: FreeBSD virtualization , Tomasz Rola Subject: Re: Seeking advice on virtualization Message-ID: <20180807170648.GA1599@tau1.ceti.pl> References: <20180805224205.GB17784@tau1.ceti.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Aug 2018 17:07:06 -0000 On Mon, Aug 06, 2018 at 12:07:13AM +0100, Paul Webster wrote: > In theory as ZFS works on both linux and BSD you could simply use vdevs and > snapshots for easy transport Um-hm. I was writing about "hard disk file" format, in which a hypervisor (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated machine. Wikipedia calls it "img format": https://en.wikipedia.org/wiki/IMG_(file_format) Advantage from using this format (as opposed to something like qcow or vmhd) is that, in theory (and even in practice) one can boot such machine (I mean, virtual machine defined with such "raw" hard drives) using any hypervisor. Or to put it differently, it is not proprietary and is the easiest one to implement, so it is what most probably will keep being used years or decades from now (in whatever hypervisor / PC emulator of the future day is fashionable). I believe in the past I have installed an OS (say, FreeDOS) using virtualbox and after deciding I would not use virtualbox in a future, I started to boot said machine using kvm. Likewise, I believe some OSes rejected being installed under certain hypervisor, so one had to install them using this other hypervisor and then could happily continue to run it under his preferred hypervisor. All of this made possible thanks to avoiding file formats supported by one or only few hypervisors. Of course there are many hd-file formats and some are supported by more than one hypervisor, but the easiest one is raw and in case of emergency it can be also mounted as any other block device (always, I guess, but I would pay attention to block size mismatch). -- Regards, Tomasz Rola -- ** A C programmer asked whether computer had Buddha's nature. ** ** As the answer, master did "rm -rif" on the programmer's home ** ** directory. And then the C programmer became enlightened... ** ** ** ** Tomasz Rola mailto:tomasz_rola@bigfoot.com ** From owner-freebsd-virtualization@freebsd.org Tue Aug 7 18:57:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 32AA41067D04 for ; Tue, 7 Aug 2018 18:57:22 +0000 (UTC) (envelope-from hicks@cgi.cz) Received: from hel.cgi.cz (hel.cgi.cz [178.238.36.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9B0997C662 for ; Tue, 7 Aug 2018 18:57:21 +0000 (UTC) (envelope-from hicks@cgi.cz) Received: from hel.cgi.cz (localhost [127.0.0.1]) by hel.cgi.cz (Postfix) with ESMTP id B371B130E9B for ; Tue, 7 Aug 2018 20:57:12 +0200 (CEST) X-Virus-Scanned: amavisd-new at cgi.cz Received: from hel.cgi.cz ([127.0.0.1]) by hel.cgi.cz (hel.cgi.cz [127.0.0.1]) (amavisd-new, port 10024) with LMTP id j8DsJed0vTpt for ; Tue, 7 Aug 2018 20:57:10 +0200 (CEST) Received: from mail2.cgi.cz (hermes [172.17.174.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by hel.cgi.cz (Postfix) with ESMTPS id 1DF33130E7D for ; Tue, 7 Aug 2018 20:57:10 +0200 (CEST) Received: from [192.168.8.106] (unknown [82.100.31.11]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail2.cgi.cz (Postfix) with ESMTPSA id EF6465B4BE for ; Tue, 7 Aug 2018 20:57:09 +0200 (CEST) Subject: Re: Seeking advice on virtualization To: freebsd-virtualization@freebsd.org References: <20180805224205.GB17784@tau1.ceti.pl> <20180807170648.GA1599@tau1.ceti.pl> From: Jakub Chromy Message-ID: Date: Tue, 7 Aug 2018 20:57:10 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: <20180807170648.GA1599@tau1.ceti.pl> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Aug 2018 18:57:22 -0000 > I was writing about "hard disk file" format, in which a hypervisor > (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated > machine. Wikipedia calls it "img format": > > https://en.wikipedia.org/wiki/IMG_(file_format) > > Advantage from using this format (as opposed to something like qcow or > vmhd) is that, in theory (and even in practice) one can boot such > machine (I mean, virtual machine defined with such "raw" hard drives) > using any hypervisor. ZFS ZVOL is a true "raw device" as well... (or at least it did behave like that for me):   dd if=/dev/zvol/pool/mypornhubpremiumarchive0 of=/var/vm/mypornhubpremiumarchive0.raw but you get snapshots, zfs send | zfs recv and stuff. -- regards / s pozdravem Jakub Chromy CGI Systems div. ---------------- CGI CZ s.r.o. sales@cgi.cz 775 144 257 234 697 102 www.cgi.cz On 7.8.2018 19:06, Tomasz Rola wrote: > On Mon, Aug 06, 2018 at 12:07:13AM +0100, Paul Webster wrote: >> In theory as ZFS works on both linux and BSD you could simply use vdevs and >> snapshots for easy transport > Um-hm. > > I was writing about "hard disk file" format, in which a hypervisor > (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated > machine. Wikipedia calls it "img format": > > https://en.wikipedia.org/wiki/IMG_(file_format) > > Advantage from using this format (as opposed to something like qcow or > vmhd) is that, in theory (and even in practice) one can boot such > machine (I mean, virtual machine defined with such "raw" hard drives) > using any hypervisor. Or to put it differently, it is not proprietary > and is the easiest one to implement, so it is what most probably will > keep being used years or decades from now (in whatever hypervisor / PC > emulator of the future day is fashionable). > > I believe in the past I have installed an OS (say, FreeDOS) using > virtualbox and after deciding I would not use virtualbox in a future, > I started to boot said machine using kvm. Likewise, I believe some > OSes rejected being installed under certain hypervisor, so one had to > install them using this other hypervisor and then could happily > continue to run it under his preferred hypervisor. > > All of this made possible thanks to avoiding file formats supported by > one or only few hypervisors. > > Of course there are many hd-file formats and some are supported by > more than one hypervisor, but the easiest one is raw and in case of > emergency it can be also mounted as any other block device (always, I > guess, but I would pay attention to block size mismatch). > From owner-freebsd-virtualization@freebsd.org Tue Aug 7 19:21:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3230F10685C1 for ; Tue, 7 Aug 2018 19:21:00 +0000 (UTC) (envelope-from paul.g.webster@googlemail.com) Received: from mail-ua0-x22b.google.com (mail-ua0-x22b.google.com [IPv6:2607:f8b0:400c:c08::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C3E3A7D3C9 for ; Tue, 7 Aug 2018 19:20:59 +0000 (UTC) (envelope-from paul.g.webster@googlemail.com) Received: by mail-ua0-x22b.google.com with SMTP id i4-v6so17406623uak.0 for ; Tue, 07 Aug 2018 12:20:59 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=S+3oHnxQu3x1ad/RjAdMl1jQYGrpdv+taGWztocZq1o=; b=AxcJrSO2LaVJwJ5gAk3o5zezsH0i4AUqSzX9LuPF6IvnqlWBCIfnreIb/ugWFpCjl+ fwxKz0pcIayydqH4MgH+icz/TOPprl5wHJOlWGegBk7D8fwy3I1Ewgq+0do/0C3s0/Nz jyZjKLXY5y3+Ci+AeqtDZ0Lh8W5zHAjb7n2/bQJ4pKC4yVbK6cBLcM/QjW8i+7FbtYPG 5Lkzd5iPfLLSk/W1YyML25H0LN7IhSv6T7D6RvHTp4JywfCjAj4dIRCPcj27OM1W+saG X2dSXutsxP0RhOdEknZPSSP+g5sI4x4UcyLBaXWddYrWJsXXWHb4o9guFHKzvlIvU8l5 TSXQ== X-Gm-Message-State: AOUpUlHBSaPnMjfb4JFOWjf73e2hg08/um/BKHpec2rGO9qZR5g8HO0F NnUduApWoikdBQONkiNYb15ircL1jOeFe5fwPZibKDSp X-Google-Smtp-Source: AAOMgpcNkQT1MxgvJxUO0863Kw9S/qEiI2KmJ2FBpVpHtEyFrTZ6dRP3wIUtUFSMEE8IMk3qgaeBRfRDK8GrM6/lEfM= X-Received: by 2002:a9f:2266:: with SMTP id 93-v6mr14143484uad.40.1533669658836; Tue, 07 Aug 2018 12:20:58 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab0:21ca:0:0:0:0:0 with HTTP; Tue, 7 Aug 2018 12:20:58 -0700 (PDT) In-Reply-To: References: <20180805224205.GB17784@tau1.ceti.pl> <20180807170648.GA1599@tau1.ceti.pl> From: Paul Webster Date: Tue, 7 Aug 2018 20:20:58 +0100 Message-ID: Subject: Re: Seeking advice on virtualization To: Jakub Chromy Cc: "freebsd-virtua." Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Aug 2018 19:21:00 -0000 even cooler you get 'clones' so you can say make a raw/zvol of debian or whatever you like then if you make a snapshot of it and clone it to something else 'debian2' it uses no space until you write/delete/edit something, basically the clone only has diffs. And yes zvols are literally like raw devices, dd style you can infact take a raw image and dd it to a zvol On 7 August 2018 at 19:57, Jakub Chromy wrote: > I was writing about "hard disk file" format, in which a hypervisor >> (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated >> machine. Wikipedia calls it "img format": >> >> https://en.wikipedia.org/wiki/IMG_(file_format) >> >> Advantage from using this format (as opposed to something like qcow or >> vmhd) is that, in theory (and even in practice) one can boot such >> machine (I mean, virtual machine defined with such "raw" hard drives) >> using any hypervisor. >> > > ZFS ZVOL is a true "raw device" as well... (or at least it did behave like > that for me): > > dd if=/dev/zvol/pool/mypornhubpremiumarchive0 > of=/var/vm/mypornhubpremiumarchive0.raw > > but you get snapshots, zfs send | zfs recv and stuff. > > -- > > > regards / s pozdravem > > > Jakub Chromy > > > CGI Systems div. > ---------------- > CGI CZ s.r.o. > sales@cgi.cz > 775 144 257 > 234 697 102 > www.cgi.cz > > > On 7.8.2018 19:06, Tomasz Rola wrote: > >> On Mon, Aug 06, 2018 at 12:07:13AM +0100, Paul Webster wrote: >> >>> In theory as ZFS works on both linux and BSD you could simply use vdevs >>> and >>> snapshots for easy transport >>> >> Um-hm. >> >> I was writing about "hard disk file" format, in which a hypervisor >> (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated >> machine. Wikipedia calls it "img format": >> >> https://en.wikipedia.org/wiki/IMG_(file_format) >> >> Advantage from using this format (as opposed to something like qcow or >> vmhd) is that, in theory (and even in practice) one can boot such >> machine (I mean, virtual machine defined with such "raw" hard drives) >> using any hypervisor. Or to put it differently, it is not proprietary >> and is the easiest one to implement, so it is what most probably will >> keep being used years or decades from now (in whatever hypervisor / PC >> emulator of the future day is fashionable). >> >> I believe in the past I have installed an OS (say, FreeDOS) using >> virtualbox and after deciding I would not use virtualbox in a future, >> I started to boot said machine using kvm. Likewise, I believe some >> OSes rejected being installed under certain hypervisor, so one had to >> install them using this other hypervisor and then could happily >> continue to run it under his preferred hypervisor. >> >> All of this made possible thanks to avoiding file formats supported by >> one or only few hypervisors. >> >> Of course there are many hd-file formats and some are supported by >> more than one hypervisor, but the easiest one is raw and in case of >> emergency it can be also mounted as any other block device (always, I >> guess, but I would pay attention to block size mismatch). >> >> > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubs > cribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Tue Aug 7 19:38:47 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5D671068F8D for ; Tue, 7 Aug 2018 19:38:47 +0000 (UTC) (envelope-from hicks@cgi.cz) Received: from hel.cgi.cz (hel.cgi.cz [178.238.36.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3FD3C7DD1C for ; Tue, 7 Aug 2018 19:38:47 +0000 (UTC) (envelope-from hicks@cgi.cz) Received: from hel.cgi.cz (localhost [127.0.0.1]) by hel.cgi.cz (Postfix) with ESMTP id D64BA12F21A for ; Tue, 7 Aug 2018 21:38:44 +0200 (CEST) X-Virus-Scanned: amavisd-new at cgi.cz Received: from hel.cgi.cz ([127.0.0.1]) by hel.cgi.cz (hel.cgi.cz [127.0.0.1]) (amavisd-new, port 10024) with LMTP id ZIZBXRCHM76I for ; Tue, 7 Aug 2018 21:38:42 +0200 (CEST) Received: from mail2.cgi.cz (hermes [172.17.174.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by hel.cgi.cz (Postfix) with ESMTPS id 03F0D12F1DC for ; Tue, 7 Aug 2018 21:38:42 +0200 (CEST) Received: from [192.168.8.106] (unknown [82.100.31.11]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail2.cgi.cz (Postfix) with ESMTPSA id CB7565B59F for ; Tue, 7 Aug 2018 21:38:41 +0200 (CEST) Subject: Re: Seeking advice on virtualization To: "freebsd-virtua." References: <20180805224205.GB17784@tau1.ceti.pl> <20180807170648.GA1599@tau1.ceti.pl> From: Jakub Chromy Message-ID: <91bddabb-5fba-ad01-fb6f-063e673a0ba1@cgi.cz> Date: Tue, 7 Aug 2018 21:38:42 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-GB Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Aug 2018 19:38:47 -0000 > even cooler you get 'clones' so you can say make a raw/zvol of debian > or whatever you like then if you make a snapshot of it and clone it to > something else 'debian2' it uses no space until you write/delete/edit > something, basically the clone only has diffs. yep... but it has some downsides too.. try to delete the original (source) ZVOL. Impossible until you remove the daughter clones first. > And yes zvols are literally like raw devices, dd style you can infact > take a raw image and dd it to a zvol yes... and you can even create sparse volumes (-s flag).. supercool :) > > On 7 August 2018 at 19:57, Jakub Chromy > wrote: > > I was writing about "hard disk file" format, in which a hypervisor > (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated > machine. Wikipedia calls it "img format": > > https://en.wikipedia.org/wiki/IMG_(file_format) > > > Advantage from using this format (as opposed to something like > qcow or > vmhd) is that, in theory (and even in practice) one can boot such > machine (I mean, virtual machine defined with such "raw" hard > drives) > using any hypervisor. > > > ZFS ZVOL is a true "raw device" as well... (or at least it did > behave like that for me): > >   dd if=/dev/zvol/pool/mypornhubpremiumarchive0 > of=/var/vm/mypornhubpremiumarchive0.raw > > but you get snapshots, zfs send | zfs recv and stuff. > > -- > > >    regards / s pozdravem > > > Jakub Chromy > > > CGI Systems div. > ---------------- > CGI CZ s.r.o. > sales@cgi.cz > 775 144 257 > 234 697 102 > www.cgi.cz > > > On 7.8.2018 19:06, Tomasz Rola wrote: > > On Mon, Aug 06, 2018 at 12:07:13AM +0100, Paul Webster wrote: > > In theory as ZFS works on both linux and BSD you could > simply use vdevs and > snapshots for easy transport > > Um-hm. > > I was writing about "hard disk file" format, in which a hypervisor > (i.e. bhyve, kvm, virtualbox) is keeping a disk for emulated > machine. Wikipedia calls it "img format": > > https://en.wikipedia.org/wiki/IMG_(file_format) > > > Advantage from using this format (as opposed to something like > qcow or > vmhd) is that, in theory (and even in practice) one can boot such > machine (I mean, virtual machine defined with such "raw" hard > drives) > using any hypervisor. Or to put it differently, it is not > proprietary > and is the easiest one to implement, so it is what most > probably will > keep being used years or decades from now (in whatever > hypervisor / PC > emulator of the future day is fashionable). > > I believe in the past I have installed an OS (say, FreeDOS) using > virtualbox and after deciding I would not use virtualbox in a > future, > I started to boot said machine using kvm. Likewise, I believe some > OSes rejected being installed under certain hypervisor, so one > had to > install them using this other hypervisor and then could happily > continue to run it under his preferred hypervisor. > > All of this made possible thanks to avoiding file formats > supported by > one or only few hypervisors. > > Of course there are many hd-file formats and some are supported by > more than one hypervisor, but the easiest one is raw and in > case of > emergency it can be also mounted as any other block device > (always, I > guess, but I would pay attention to block size mismatch). > > > _______________________________________________ > freebsd-virtualization@freebsd.org > mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org > " > > From owner-freebsd-virtualization@freebsd.org Wed Aug 8 18:02:11 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3EA3106563B for ; Wed, 8 Aug 2018 18:02:11 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8C3EB8AD51 for ; Wed, 8 Aug 2018 18:02:11 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from John-Baldwins-MacBook-Pro-2.local (ralph.baldwin.cx [66.234.199.215]) by mail.baldwin.cx (Postfix) with ESMTPSA id CE53A10B429; Wed, 8 Aug 2018 14:02:09 -0400 (EDT) Subject: Re: Passthrough not working with OpenBSD nor NetBSD To: Farid Joubbi , freebsd-virtualization@freebsd.org References: From: John Baldwin Message-ID: Date: Wed, 8 Aug 2018 11:02:08 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Wed, 08 Aug 2018 14:02:10 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2018 18:02:12 -0000 On 7/6/18 8:07 AM, Farid Joubbi wrote: > Hello, > > I have configured passthrough of two different PCI Express network > interface cards. I can't get neither OpenBSD nor NetBSD to work with these > NICs. > > I get this in dmesg when booting the NetBSD install: > > wm0 at pci0 dev 5 function 0: 82576 quad-1000BaseT Ethernet (rev. 0x01) > pci_intr_map: no mapping for pin B (line=ff) > wm0: unable to map interrupt > bge0 at pci0 dev 6 function 0: Broadcom BCM5720 Gigabit Ethernet > pci_intr_map: no mapping for pin B (line=ff) > bge0: couldn't map interrupt > > With OpenBSD it's the same error. > > I have no problems running FreeBSD or CentOS with the exact same setup. > > This is how vm is configured for the NetBSD install: > loader="grub" > cpu=1 > memory=4G > passthru0="12/0/1" > passthru1="3/0/1" > disk0_type="virtio-blk" > disk0_name="disk0.img" > uuid="1c9596b9-80a0-11e8-960c-5cb9013bbb64" > grub_install0="knetbsd -h -r cd0a /netbsd" > grub_run0="knetbsd -h -r ld0a /netbsd" > > > I started out with OpenBSD and a Intel NIC. Then I added the Broadcom NIC > since I figured that maybe it's a driver issue. > I'm running bhyve on 11.1-RELEASE-p11. > > Any ideas? You have to use MSI interrupts for pass-through devices for bhyve. Those errors look as if the guests are trying to use legacy INTx interrupts. -- John Baldwin From owner-freebsd-virtualization@freebsd.org Wed Aug 8 18:08:35 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C40151065C2A for ; Wed, 8 Aug 2018 18:08:35 +0000 (UTC) (envelope-from djfarid@gmail.com) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 400148B49E; Wed, 8 Aug 2018 18:08:35 +0000 (UTC) (envelope-from djfarid@gmail.com) Received: by mail-ed1-x535.google.com with SMTP id o8-v6so1662684edt.13; Wed, 08 Aug 2018 11:08:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=nHGKP1UD0ZmGwx83poj2lpG2/e99OqoTG28HMZjuvAU=; b=W6JxGQmwHf7L6+KnGwHBvFdqTwebaZOaKON4g+Jlc7uqtUD2bc5dilPnNYczcjOc+z ylqZIVyav2Qwf83Mbem7FUodL9vSfpELUToRcPePIw8acnTrsN/6Mo1Rye7TvY6ROixu YMNBYstxQ9CxkjmUMHkzv9+N5b4XaNb/25e/vt4RofsaRYxSyJAfE0AVXlCtYAXiYEes YKgUFktgl87WqW9GppsMhD3pgDuVg6vfsj6ROsGpzBWzLCLJIpNTqllaCTmuU0ZblCyk 7mFF8sbhqdU9P0qbjD5YMcWmbhhGd1orUv78INRhDGib5TpzQZ2yDFukOjWVpyQJtPeJ KZ4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=nHGKP1UD0ZmGwx83poj2lpG2/e99OqoTG28HMZjuvAU=; b=Zs9geS1YK5Bcy5ZGPLEImUidrZ1MfJwYl0+TvnDOxSM0eg2CIvBuyYTpn2dlJ4gJQU F2gJT+IQmZ8vD1IZr7QYJbtfwlrUOc1gJHgMJKyQvYXteFBO7gS/aeE9YpR340qOEWxg MBq9c39iOi5XmFTEfrzqCq0/B4gnFy6Py6Kzhasuwfcw+A69UXrUPU9t1+OPLFWwnWFj 27Dpfx+YfkUKY2rpGrdzfylfhADf08sXh+WaZNCVV64lauD5Js/F6aBBDZT3GRYcTfx1 LW04cKFAw5mTM6F/xu1HHdlJ+gtSm9ou/1iGFvSTeJqntHGWeVOxKW6b7ZuI5lfo3yKA wUOQ== X-Gm-Message-State: AOUpUlGBP4KW/oF4U2f68+FhG1YZW8Tvzm3DDwdk7b6ctfcDE1+BRYSp Va0fqWYZxeEmiLP/NUb/fO9OgCt5m1pp+8nnLLJ5DQ== X-Google-Smtp-Source: AA+uWPxSVmogpx2WyQV/Iu843uT5KV2+8lGWU2ufQ1wqsInSInUIkLUuvVyIw+CHSh0hNDa1nzhkvmiiWle/eqOLsjs= X-Received: by 2002:aa7:c68b:: with SMTP id n11-v6mr4617729edq.122.1533751714089; Wed, 08 Aug 2018 11:08:34 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Farid Joubbi Date: Wed, 8 Aug 2018 20:08:22 +0200 Message-ID: Subject: Re: Passthrough not working with OpenBSD nor NetBSD To: John Baldwin Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2018 18:08:36 -0000 That's what I also thought, but it's not anything I can force it to do, is it? Isn't it supposed to detect the MSI interrupt compatibility automatically? On Wed, Aug 8, 2018, 20:02 John Baldwin wrote: > On 7/6/18 8:07 AM, Farid Joubbi wrote: > > Hello, > > > > I have configured passthrough of two different PCI Express network > > interface cards. I can't get neither OpenBSD nor NetBSD to work with > these > > NICs. > > > > I get this in dmesg when booting the NetBSD install: > > > > wm0 at pci0 dev 5 function 0: 82576 quad-1000BaseT Ethernet (rev. 0x01) > > pci_intr_map: no mapping for pin B (line=ff) > > wm0: unable to map interrupt > > bge0 at pci0 dev 6 function 0: Broadcom BCM5720 Gigabit Ethernet > > pci_intr_map: no mapping for pin B (line=ff) > > bge0: couldn't map interrupt > > > > With OpenBSD it's the same error. > > > > I have no problems running FreeBSD or CentOS with the exact same setup. > > > > This is how vm is configured for the NetBSD install: > > loader="grub" > > cpu=1 > > memory=4G > > passthru0="12/0/1" > > passthru1="3/0/1" > > disk0_type="virtio-blk" > > disk0_name="disk0.img" > > uuid="1c9596b9-80a0-11e8-960c-5cb9013bbb64" > > grub_install0="knetbsd -h -r cd0a /netbsd" > > grub_run0="knetbsd -h -r ld0a /netbsd" > > > > > > I started out with OpenBSD and a Intel NIC. Then I added the Broadcom NIC > > since I figured that maybe it's a driver issue. > > I'm running bhyve on 11.1-RELEASE-p11. > > > > Any ideas? > > You have to use MSI interrupts for pass-through devices for bhyve. Those > errors look as if the guests are trying to use legacy INTx interrupts. > > -- > John Baldwin > From owner-freebsd-virtualization@freebsd.org Wed Aug 8 18:10:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7BF231065D43 for ; Wed, 8 Aug 2018 18:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 19E028B587 for ; Wed, 8 Aug 2018 18:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id D1D061065D41; Wed, 8 Aug 2018 18:10:33 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C074A1065D40 for ; Wed, 8 Aug 2018 18:10:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 625BA8B584 for ; Wed, 8 Aug 2018 18:10:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A968EEC2C for ; Wed, 8 Aug 2018 18:10:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w78IAWlN030471 for ; Wed, 8 Aug 2018 18:10:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w78IAWAI030461 for virtualization@FreeBSD.org; Wed, 8 Aug 2018 18:10:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 229824] Fatal trap 1 when resuming from S3 with a VirtualBox VM running Date: Wed, 08 Aug 2018 18:10:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2018 18:10:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229824 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jhb@FreeBSD.org --- Comment #1 from John Baldwin --- FreeBSD doesn't have a way to let external hypervisors like vbox work across suspend and resume. I did add a hook for bhyve in https://svnweb.freebsd.org/base?view=3Drevision&revision=3D259782. We woul= d need something similar. The same issue matters for permitting multiple hypervis= ors being active at the same time (e.g. you can't run both bhyve and vbox at the same time currently). I had been thinking of adding a kind of hypervisor framework to let hypervisors allocate the VMX region and then permit associating it with a given process so that you could do the right vmxon/vm= xoff during context switch. Having that would also allow us to more cleanly han= dle suspend/resume for arbitrary hypervisors. One thing you might be able to do for now is change the vbox driver to set = the same vmm_resume_p pointer that bhyve's vmm.ko sets during MOD_LOAD to a function that reinvokes vmxon with the right address on each CPU during res= ume. Probably both bhyve and vbox should also fail to load in MOD_LOAD if that pointer is already non-NULL which would enforce only one could be used at a time. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Aug 9 06:33:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0353D1056EA6 for ; Thu, 9 Aug 2018 06:33:18 +0000 (UTC) (envelope-from zeon@zeon.kiev.ua) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7CCAB829FE for ; Thu, 9 Aug 2018 06:33:17 +0000 (UTC) (envelope-from zeon@zeon.kiev.ua) Received: by mailman.ysv.freebsd.org (Postfix) id 419FD1056EA5; Thu, 9 Aug 2018 06:33:17 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1F82E1056EA4 for ; Thu, 9 Aug 2018 06:33:17 +0000 (UTC) (envelope-from zeon@zeon.kiev.ua) Received: from mail-it0-x236.google.com (mail-it0-x236.google.com [IPv6:2607:f8b0:4001:c0b::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A1B76829FC for ; Thu, 9 Aug 2018 06:33:16 +0000 (UTC) (envelope-from zeon@zeon.kiev.ua) Received: by mail-it0-x236.google.com with SMTP id v71-v6so1176031itb.3 for ; Wed, 08 Aug 2018 23:33:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zeon-kiev-ua.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=+XGD5n2pihQhUkNsufMkIudliuOyclOtqzKvbz8lvXo=; b=yNom6iIY4nC/ea0txD+HfONZl2FBdkXocQszwxWNHm+Hei4aN59Mafmyv9G2hpgXwJ pjwPpRaa9Ntng99+uulEB7SakXr7YxL4Tr2izl/6z3dfl5iXkQ/inw+Rlg6nSgcVXEe+ 4+p3JUhmVT487ILBIiqXn1dkfGtZ+D41eInq5jG0LMW/xyOqjvegavju9nrKTbb/oJED qwAS/Uxj1mm5vtJf8+8zvixF2j48JU2usdsGdxxbkfyNKwb3hs8F3VYU92JUm9ldaIYr tOtRYUQOYKXkiMazf6tTNWFzn1FUzcitgbsUJFXP2EBFYZjEt5WZb8Oa2r/6aDby8+Qp 9FOA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=+XGD5n2pihQhUkNsufMkIudliuOyclOtqzKvbz8lvXo=; b=NGpcFGKSkKMqsYM4xgLUTzunZg4nQRUYzgn/xpCkhpiwnBeEjz3RBhV6V8C/0crAEL aIsD5/WaG1oQXtj7J1TxvGzXvTGQtfkP7i8O/v8OuPTWhdZsTAkm1PES9znDfwn5vGT8 b7AoZbV/yRRnV6bgGPTMTIAImzzErWLGKGxYsEg/1VOWlt1tEkXzr40HhSjQD6dXIwgU cHcjRPIffC1fsnbQ85+DdQY3vMCmovRdGC4gWfddKutD0m+6CnngxGj2Rx0Su6TFUWKw wa4F3CyBqeSq/WNv7hYt5qW3Jilv9rQL2P34HC3PtQL5gFaAL5krCWDdIKv4m+9aiQz8 35Ng== X-Gm-Message-State: AOUpUlGNNnh9JD6Cd5dgN4O8IEOhUVWT+6koDx5+D5dAosPMAylIG/C2 FuQbA/FD2zz6h9Wj0Hf4muoqBKPRQ/z1+/AIT5eZX6gXkH4K+g== X-Google-Smtp-Source: AA+uWPx6GYrbt5wyVr4WOLjZt1rD25uq9CxJGtyY+EsBf6aGxMJr9bt7uBlizIej+ntVyVDEzB6dHg15MmPtbvhdbFg= X-Received: by 2002:a24:b101:: with SMTP id o1-v6mr821339itf.121.1533796395630; Wed, 08 Aug 2018 23:33:15 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a6b:f810:0:0:0:0:0 with HTTP; Wed, 8 Aug 2018 23:33:15 -0700 (PDT) In-Reply-To: References: From: Nikita Olenets Date: Thu, 9 Aug 2018 09:33:15 +0300 Message-ID: Subject: Re: [Bug 230082] bhyve doesn't set process title To: bugzilla-noreply@freebsd.org Cc: virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 06:33:18 -0000 Hello, Looks like the issue is exist still. 09:27:34)27[root@host ~]# ps wwwwwwax | grep Test01 3148 0 Is+ 0:00,04 /bin/sh /usr/local/sbin/vm -tf _run Test01 5531 0 SC+ 1:43,20 bhyve -c 1 -m 2G -AHP -U 7f86c10b-d8c9-11e7-ae5d-f04da2090b7b -u -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/usr/local/VM/ Test01 /disk0.img -s 5:0,virtio-net,tap1102,mac=58:9c:fc:07:1a:8b -l com1,stdio Test01 (09:27:40)27[root@host ~]# uname -a FreeBSD host.local.org 11.2-STABLE FreeBSD 11.2-STABLE #18 r337452: Wed Aug 8 15:06:59 EEST 2018 root@host.local.org:/usr/obj/usr/src/sys/CUSTOM amd64 ===== Comparing to the older system ( r335977 ) (09:31:30)4[root@bohus docs]# ps wwwwwwax | grep Ubuntu 5053 1 IC+ 115:04,09 bhyve: Ubuntu (bhyve) (09:31:37)4[root@bohus docs]# uname -a FreeBSD bohus 11.2-STABLE FreeBSD 11.2-STABLE #7 r335977: Fri Jul 6 06:58:35 EEST 2018 root@bohus:/usr/obj/usr/src/sys/CUSTOM amd64 On Fri, Aug 3, 2018 at 8:25 AM, wrote: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230082 > > Yuichiro NAITO changed: > > What |Removed |Added > ------------------------------------------------------------ > ---------------- > Status|In Progress |Closed > Resolution|--- |FIXED > > --- Comment #9 from Yuichiro NAITO --- > (In reply to Mariusz Zaborski from comment #7) > > The setproctitle(3) looks fine with me - I will commit it. > > Thanks for the commit. > > > With the ps_string the problem is a little more complicated. > > In my opinion the title is a part of a global namespace so we should not > be ab\ > le to change it but I would like to discussed this. > > I misunderstood sysctl behavior. > > I saw that original (before r335939) setproctitle(3) calls sysctl like > this. > > ``` > sysctl([CTL_KERN, KERN_PROC, KEN_PROC_ARGS, getpid()], ...) > ``` > > This code works in capability mode all the time (independent of r335939). > I thought calling sysctl("kern.ps_strings") was also safe in capability > mode. > But, the sysctl is allowed to write only... > > > In this bug report can we only focus on the bhyve title issue? > > Yes, I don't see any other problems for now. > I will close this PR. > > Thank you! > > -- > You are receiving this mail because: > You are the assignee for the bug. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" > -- Nikita Olenets From owner-freebsd-virtualization@freebsd.org Thu Aug 9 07:13:03 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0FE3310591DA for ; Thu, 9 Aug 2018 07:13:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8AF4E83F6B for ; Thu, 9 Aug 2018 07:13:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 503F510591D7; Thu, 9 Aug 2018 07:13:02 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EFB610591D6 for ; Thu, 9 Aug 2018 07:13:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D40B283F66 for ; Thu, 9 Aug 2018 07:13:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 3F43415BD7 for ; Thu, 9 Aug 2018 07:13:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w797D1W2018878 for ; Thu, 9 Aug 2018 07:13:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w797D1fU018877 for virtualization@FreeBSD.org; Thu, 9 Aug 2018 07:13:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230082] bhyve doesn't set process title Date: Thu, 09 Aug 2018 07:13:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zeon@zeon.kiev.ua X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 07:13:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230082 Nikita Olenets changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |zeon@zeon.kiev.ua --- Comment #10 from Nikita Olenets --- (In reply to Yuichiro NAITO from comment #9) Hello,=20 Looks like the issue is exist still. 09:27:34)27[root@host ~]# ps wwwwwwax | grep Test01 3148 0 Is+ 0:00,04 /bin/sh /usr/local/sbin/vm -tf _run Test01 5531 0 SC+ 1:43,20 bhyve -c 1 -m 2G -AHP -U 7f86c10b-d8c9-11e7-ae5d-f04da2090b7b -u -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/usr/local/VM/ Test01 /disk0.img -s 5:0,virtio-net,tap1102,mac=3D58:9c:fc:07:1a:8b -l com1,stdio Test01 (09:27:40)27[root@host ~]# uname -a FreeBSD host.local.org 11.2-STABLE FreeBSD 11.2-STABLE #18 r337452: Wed Aug= 8 15:06:59 EEST 2018 root@host.local.org:/usr/obj/usr/src/sys/CUSTOM amd= 64 =3D=3D=3D=3D=3D OLDER BEHAVIOR =3D=3D=3D=3D=3D=20 Comparing to the older system ( r335977 ) (09:31:30)4[root@bohus docs]# ps wwwwwwax | grep Ubuntu 5053 1 IC+ 115:04,09 bhyve: Ubuntu (bhyve) (09:31:37)4[root@bohus docs]# uname -a FreeBSD bohus 11.2-STABLE FreeBSD 11.2-STABLE #7 r335977: Fri Jul 6 06:58:= 35 EEST 2018 root@bohus:/usr/obj/usr/src/sys/CUSTOM amd64 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Aug 9 08:28:08 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA2BA105BFC3 for ; Thu, 9 Aug 2018 08:28:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 574A386CB9 for ; Thu, 9 Aug 2018 08:28:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 1CAE4105BFB7; Thu, 9 Aug 2018 08:28:08 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B74E105BFB6 for ; Thu, 9 Aug 2018 08:28:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A106886CB1 for ; Thu, 9 Aug 2018 08:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id EFCE016585 for ; Thu, 9 Aug 2018 08:28:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w798S6Xc016667 for ; Thu, 9 Aug 2018 08:28:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w798S6oR016666 for virtualization@FreeBSD.org; Thu, 9 Aug 2018 08:28:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230082] bhyve doesn't set process title Date: Thu, 09 Aug 2018 08:28:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: oshogbo@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 08:28:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230082 --- Comment #11 from Mariusz Zaborski --- This wasn't integrated yet to the 11. I will do this today. Thanks. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Aug 9 11:09:09 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5ABD010612A2 for ; Thu, 9 Aug 2018 11:09:09 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D99EB8CE8B for ; Thu, 9 Aug 2018 11:09:08 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate1.intern.punkt.de with ESMTP id w79B91de011950 for ; Thu, 9 Aug 2018 13:09:01 +0200 (CEST) Received: from [217.29.44.49] ([217.29.44.49]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id w79B90XJ021500 for ; Thu, 9 Aug 2018 13:09:00 +0200 (CEST) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Why can't I dtrace processes running in a jail from the host? Message-Id: Date: Thu, 9 Aug 2018 13:09:00 +0200 To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 11:09:09 -0000 Hi all, I'm wondering why on a busy hosting server with hundreds of PHP-FPM workers running in jails "dtrace -l" on the host does not show any PHP specific probes. PHP *is* compiled with dtrace support for all the jails. Enabling /dev/dtrace/* via devfs.rules for a specific jail and then repeating the process *inside* the jail works as expected. Shouldn't jailed processes be transparently visible from the host system but not vice versa? Thanks, Patrick -- punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling From owner-freebsd-virtualization@freebsd.org Thu Aug 9 14:53:06 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 949D31069703 for ; Thu, 9 Aug 2018 14:53:06 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-pf1-x444.google.com (mail-pf1-x444.google.com [IPv6:2607:f8b0:4864:20::444]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 16E2779135 for ; Thu, 9 Aug 2018 14:53:06 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-pf1-x444.google.com with SMTP id p12-v6so2976417pfh.2 for ; Thu, 09 Aug 2018 07:53:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=RRW92JbHaDNaIHOAoA0Py1tCsG7s36XtkjF4f/wFfIg=; b=XzovleSNT4cLRwNK8KLwemcrZOBYjwGCqxBW8JDCuLMXs4PGKHZ7IJKplLLsDDIT45 l2YbEVpwK+rBIuul/8IrP4p0XsHTGBUV0flxjpJfQHtLxsQwAARoDy2ImGEEIO94KkiO 5BR6osEEWG8bkdJzue3onC1xYX+CJXwwjb6WdLkMOz2VKXC7ACrJnqhXMk/e3goqJBv1 p6n6sXKnOP6e6ejOtWFdD2L8MmMlsl1AblV5Elf1KGhyxyY4Eub2WmKkeBA+C2FsF0xv 89MoKg5cGhmHkV6PTQwnyXMgAEMQLi+YSpP1P6oXV8GlUrwax5MnwEGbwTPsZSoU/Rqv Nygg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=RRW92JbHaDNaIHOAoA0Py1tCsG7s36XtkjF4f/wFfIg=; b=fSzFdi+IR0CFziJreYSH28/Ym8rCY4kfszpeIWRpzGNmJHkHUtzKvUVapI6cxgHBex y7XRQ9mQM60vlMnYZ6IGdsfpJYFuJL49W9s6TSIXBFoRpwjEweeAG44iO8orQMNm8EFO twPuOTRFMOieTopjgTLp4zYnSUYhlwliSzvir1HWdQAt9LtQ6kbj4tBOSIP1Pczn77zd 4i/qdlSpT6Un6jDCp2sbymxg3L/maENAfh8uibmWoR9+IYYPE7DmU9TfbFUMvxo2XKXR /kp2A/h73lW046i1eViog4PF6Ia0GRUCZWvpEacC6OqOKl5j7ZTR+8Y8Y79Nj4L9TuLQ eV4w== X-Gm-Message-State: AOUpUlHix6FS+DcZxFiYKb3gm3cEi4ylssfi0+Z7S7WMnBrlPtmL+C5c v+6Uk5v/WUzRNdRaW67ja7XlqOMa X-Google-Smtp-Source: AA+uWPxgli/nT4mX06QOh9FhKJhi+1bFsEkOQvcMh21Pk3sz78b0pjmwiZi7mE3oOusCHAqYXq/ksQ== X-Received: by 2002:a63:fd06:: with SMTP id d6-v6mr2537606pgh.348.1533826385083; Thu, 09 Aug 2018 07:53:05 -0700 (PDT) Received: from raichu (toroon0560w-lp130-09-70-52-224-239.dsl.bell.ca. [70.52.224.239]) by smtp.gmail.com with ESMTPSA id u42-v6sm9854961pgn.1.2018.08.09.07.53.03 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Aug 2018 07:53:04 -0700 (PDT) Sender: Mark Johnston Date: Thu, 9 Aug 2018 10:52:59 -0400 From: Mark Johnston To: "Patrick M. Hausen" Cc: freebsd-virtualization@freebsd.org Subject: Re: Why can't I dtrace processes running in a jail from the host? Message-ID: <20180809145258.GA68459@raichu> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 14:53:06 -0000 On Thu, Aug 09, 2018 at 01:09:00PM +0200, Patrick M. Hausen wrote: > Hi all, > > I'm wondering why on a busy hosting server with hundreds of PHP-FPM > workers running in jails "dtrace -l" on the host does not show any > PHP specific probes. PHP *is* compiled with dtrace support for all the > jails. > > Enabling /dev/dtrace/* via devfs.rules for a specific jail and then repeating > the process *inside* the jail works as expected. > > Shouldn't jailed processes be transparently visible from the host system > but not vice versa? For userland static probes to be globally visible, the process needs to register them with the kernel when it starts. This is done automatically using a constructor which issues ioctls to /dev/dtrace/helper, hence the requirement for /dev/dtrace/* in the jail. In general it is still possible to use unregistered userland probes in this scenario: dtrace(1) can discover them when it attaches to a specified process. I'm not sure how well this will work if the process is jailed and dtrace(1) is invoked on the host, but it's worth trying. I would be rather wary of enabling access to /dev/dtrace/* in a jail. The kernel code which parses probe metadata has a large attack surface and has had security holes in the past. From owner-freebsd-virtualization@freebsd.org Thu Aug 9 16:24:12 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2766F106BD46 for ; Thu, 9 Aug 2018 16:24:12 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D30507C658 for ; Thu, 9 Aug 2018 16:24:11 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from John-Baldwins-MacBook-Pro-2.local (ralph.baldwin.cx [66.234.199.215]) by mail.baldwin.cx (Postfix) with ESMTPSA id 18D6310B429; Thu, 9 Aug 2018 12:24:11 -0400 (EDT) Subject: Re: Passthrough not working with OpenBSD nor NetBSD To: Farid Joubbi References: Cc: freebsd-virtualization@freebsd.org From: John Baldwin Message-ID: Date: Thu, 9 Aug 2018 09:24:10 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Thu, 09 Aug 2018 12:24:11 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 16:24:12 -0000 On 8/8/18 11:08 AM, Farid Joubbi wrote: > That's what I also thought, but it's not anything I can force it to do, is it? Isn't it supposed to detect the MSI interrupt compatibility automatically? Apparently Open/Net always try to setup INTx before trying MSI even if they won't use INTx per the commit log in revision 280725. We could perhaps try to provide a "fake" INTx interrupt that doesn't work, but I'll have to think about how to implement that. -- John Baldwin From owner-freebsd-virtualization@freebsd.org Thu Aug 9 17:07:30 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D0C0C106D207 for ; Thu, 9 Aug 2018 17:07:30 +0000 (UTC) (envelope-from djfarid@gmail.com) Received: from mail-ed1-x543.google.com (mail-ed1-x543.google.com [IPv6:2a00:1450:4864:20::543]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3286A7E55E; Thu, 9 Aug 2018 17:07:30 +0000 (UTC) (envelope-from djfarid@gmail.com) Received: by mail-ed1-x543.google.com with SMTP id r4-v6so3190180edp.9; Thu, 09 Aug 2018 10:07:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=5SU52EM4XmPlPYrkZXIfXxA01I6fNmQoJ+SXhxxfaEs=; b=hcYw9MD1M/vY9XfLs70PhqUcmu3yHyhBjuKXaJXjJdF1R1oolRTwN0yDDKR7qEWjFj vk6NYJcXNB/Vd4RcNYMs+RNGQKbYWfaygyVMJWWPQyM7K1ocpbeqKgSdi7S/xVT6UqCj onUSPxDRMn4AhTuOZCFh5f1QGevz5WpTbuQxhNZEbxOuQx2YqmEXmat0BY145WQzb/Jp 4uQyHZPpGbT7plRcREPHL+u0AuXFyFX80mFi4pRvR9B7va8zNl5azUVpifOlQZB4a1w2 dsZdUnXF6bsGHHRrdz2qxdUCN5YffanDU2MjwRW2Pq6tVWkPD+rzoJ25n0RQuOVJdW3B H2ww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=5SU52EM4XmPlPYrkZXIfXxA01I6fNmQoJ+SXhxxfaEs=; b=l9HAkMAZLB+ulRaZYWvhpvW/4lfJmMySenQJhSWPRvuW0swl7dTLZ59CuS1xBWOqLv HkccTvypOxm7i+Uq8ANFoV5CGyMOQX2xRzl4GK089KWIv8tmdqRHm37wfUXVUe7ITZsu Drils0TucjQpQIeTWaB4f3Fq7+99jPICYlGeoxa+MajpoLvqAtVT62uo4oR7obgR0n3/ TjjVLt5m/BVtMcZtf1nZpD8N82ulQCzFlQBqthowjFQtkZdYJ92JDXqyhSUSR5DbcBKL rcwhQx1ITgyUw2wmpk32XVuhJVzPND4NBuSrg/MdFcXaS8qZDPRZefzVEEEgWxewS1Jr ZBbQ== X-Gm-Message-State: AOUpUlFwLx6kwytl4vfBJqOsf+qEkwMjv3itwP9D5Gmpxz2laGryqvvW 9ZJVL4J+2e9GXW0quSynMLX0taHsYpBGukDnOfC+UQ== X-Google-Smtp-Source: AA+uWPzfGmhldchpN4qCoJOqobc1w1zX3P7SBPjdauN6CBKlSHhgBST1AipKvMUHeSb+pSpNOXrAQBveCVhB9+UzL50= X-Received: by 2002:aa7:c68b:: with SMTP id n11-v6mr4391528edq.122.1533834449038; Thu, 09 Aug 2018 10:07:29 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Farid Joubbi Date: Thu, 9 Aug 2018 19:07:17 +0200 Message-ID: Subject: Re: Passthrough not working with OpenBSD nor NetBSD To: John Baldwin Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 17:07:31 -0000 How does KVM and VMware solve that? I haven't tried PCI passthrough with them, but I assume that it works..? On Thu, Aug 9, 2018, 18:24 John Baldwin wrote: > On 8/8/18 11:08 AM, Farid Joubbi wrote: > > That's what I also thought, but it's not anything I can force it to do, > is it? Isn't it supposed to detect the MSI interrupt compatibility > automatically? > > Apparently Open/Net always try to setup INTx before trying MSI even if they > won't use INTx per the commit log in revision 280725. We could perhaps try > to provide a "fake" INTx interrupt that doesn't work, but I'll have to > think > about how to implement that. > > -- > John Baldwin > From owner-freebsd-virtualization@freebsd.org Thu Aug 9 17:30:08 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 775D5106DAE7 for ; Thu, 9 Aug 2018 17:30:08 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 225457F807 for ; Thu, 9 Aug 2018 17:30:08 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from John-Baldwins-MacBook-Pro-2.local (ralph.baldwin.cx [66.234.199.215]) by mail.baldwin.cx (Postfix) with ESMTPSA id BF06F10B707; Thu, 9 Aug 2018 13:30:06 -0400 (EDT) Subject: Re: Passthrough not working with OpenBSD nor NetBSD To: Farid Joubbi References: Cc: freebsd-virtualization@freebsd.org From: John Baldwin Message-ID: Date: Thu, 9 Aug 2018 10:30:05 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Thu, 09 Aug 2018 13:30:07 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 17:30:08 -0000 They may implement INTx interrupts for pass-through perhaps. INTx are a lot bigger pain to emulate since there isn't a standard way in PCI to determine if an interrupt is pending (and you need that to simulate a level-triggered interrupt like INTx). I think very recent revisions of PCI did add a new bit to test that in the PCI status register, but it is in a new enough version of PCI that any compliant devices would also support MSI anyway. On 8/9/18 10:07 AM, Farid Joubbi wrote: > How does KVM and VMware solve that? > I haven't tried PCI passthrough with them, but I assume that it works..? > > On Thu, Aug 9, 2018, 18:24 John Baldwin > wrote: > > On 8/8/18 11:08 AM, Farid Joubbi wrote: > > That's what I also thought, but it's not anything I can force it to do, is it? Isn't it supposed to detect the MSI interrupt compatibility automatically? > > Apparently Open/Net always try to setup INTx before trying MSI even if they > won't use INTx per the commit log in revision 280725.  We could perhaps try > to provide a "fake" INTx interrupt that doesn't work, but I'll have to think > about how to implement that. > > -- > John Baldwin > -- John Baldwin From owner-freebsd-virtualization@freebsd.org Fri Aug 10 01:24:27 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A080E1054374 for ; Fri, 10 Aug 2018 01:24:27 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id F249C713FA for ; Fri, 10 Aug 2018 01:24:26 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40074269 for freebsd-virtualization@freebsd.org; Fri, 10 Aug 2018 08:24:23 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7A1ONpj031022 for ; Fri, 10 Aug 2018 08:24:23 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7A1OJUU031021 for freebsd-virtualization@freebsd.org; Fri, 10 Aug 2018 08:24:19 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Fri, 10 Aug 2018 08:24:19 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: Outdated grub2-bhyve and booting Centos7 Message-ID: <20180810012419.GA30888@admin.sibptus.transneft.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 01:24:27 -0000 Dear Colleagues, Can I draw your attention to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 please? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Fri Aug 10 07:15:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D2714105F613; Fri, 10 Aug 2018 07:15:22 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 587B27CB9B; Fri, 10 Aug 2018 07:15:22 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate1.intern.punkt.de with ESMTP id w7A7FKpR027926; Fri, 10 Aug 2018 09:15:20 +0200 (CEST) Received: from [217.29.44.49] ([217.29.44.49]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id w7A7FJbF064903; Fri, 10 Aug 2018 09:15:20 +0200 (CEST) (envelope-from hausen@punkt.de) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Why can't I dtrace processes running in a jail from the host? From: "Patrick M. Hausen" In-Reply-To: <20180809145258.GA68459@raichu> Date: Fri, 10 Aug 2018 09:15:22 +0200 Cc: freebsd-virtualization@freebsd.org, freebsd-dtrace@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <8B1BDE9F-BDAD-4CEB-B7A2-8052497F50EA@punkt.de> References: <20180809145258.GA68459@raichu> To: Mark Johnston X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 07:15:23 -0000 Hi! > Am 09.08.2018 um 16:52 schrieb Mark Johnston : > For userland static probes to be globally visible, the process needs to > register them with the kernel when it starts. This is done > automatically using a constructor which issues ioctls to > /dev/dtrace/helper, hence the requirement for /dev/dtrace/* in the jail. I figured as much. Enabling /dev/dtrace/* in the jail and restarting the jail made the probes visible in the host system I'm still somewhat stuck. What I'm trying to do is track down some performance problems in a large complex PHP web application. I have done this in the past on "regular" setups without jails and with PHP 5.6 compiled with dtrace support using /usr/local/share/dtrace-toolkit/Php/* ... This setup is jailed with PHP 7.2, dtrace support seems to be the default for the port. I'm specifically after php-fpm dtrace_execute_ex function-entry php-fpm dtrace_execute_ex function-return of course, to see where the application spends it's CPU cycles. But regardless if I'm doing this on the host or in the jail, I only get these results: dtrace -m php\* ZEND_CATCH_SPEC_CONST_CV_HANDLER:exception-caught php_request_shutdown:request-shutdown php_request_startup:request-startup zend_error:error zend_throw_exception_internal:exception-thrown Nothing else. Still `dtrace -m php\* -l` does show all the probes. Any ideas? Thanks Patrick -- punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling From owner-freebsd-virtualization@freebsd.org Fri Aug 10 09:42:11 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 73FE21064645 for ; Fri, 10 Aug 2018 09:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 10BB082545 for ; Fri, 10 Aug 2018 09:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C9CF01064642; Fri, 10 Aug 2018 09:42:10 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B877E1064640 for ; Fri, 10 Aug 2018 09:42:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5A5A38253C for ; Fri, 10 Aug 2018 09:42:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A218623929 for ; Fri, 10 Aug 2018 09:42:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7A9g99i039522 for ; Fri, 10 Aug 2018 09:42:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7A9g9JG039521 for virtualization@FreeBSD.org; Fri, 10 Aug 2018 09:42:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230082] bhyve doesn't set process title Date: Fri, 10 Aug 2018 09:42:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zeon@zeon.kiev.ua X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 09:42:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230082 --- Comment #12 from Nikita Olenets --- Hi Mariusz, Was this patch added to the 11? Thank you. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Aug 10 10:30:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD2E01065E14 for ; Fri, 10 Aug 2018 10:30:33 +0000 (UTC) (envelope-from dnpowers@me.com) Received: from mr21p32im-asmtp003.me.com (mr21p32im-asmtp003.me.com [17.111.214.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 809BA842B2 for ; Fri, 10 Aug 2018 10:30:33 +0000 (UTC) (envelope-from dnpowers@me.com) Received: from process-dkim-sign-daemon.mr21p32im-asmtp003.me.com by mr21p32im-asmtp003.me.com (Oracle Communications Messaging Server 8.0.2.2.20180531 64bit (built May 31 2018)) id <0PD800E00NK3SA00@mr21p32im-asmtp003.me.com> for freebsd-virtualization@freebsd.org; Fri, 10 Aug 2018 09:30:17 +0000 (GMT) Received: from icloud.com ([127.0.0.1]) by mr21p32im-asmtp003.me.com (Oracle Communications Messaging Server 8.0.2.2.20180531 64bit (built May 31 2018)) with ESMTPSA id <0PD800GO1NQF2D10@mr21p32im-asmtp003.me.com> for freebsd-virtualization@freebsd.org; Fri, 10 Aug 2018 09:30:17 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-08-10_06:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 clxscore=1011 suspectscore=4 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1808100104 From: David Powers MIME-version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Bhyve Guest Network Troubles Message-id: Date: Fri, 10 Aug 2018 04:29:16 -0500 To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3445.9.1) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 10:30:34 -0000 Good morning, I am sure this is a common issue, but I was unable to find a way to = search the list archives in an attempt to find a potential answer. I have a test vm running in Bhyve that is able to reach all interfaces = on its host via icmp. However, the guest is unable to reach the default route of the host, and = thus no Internet. I was hoping that someone might be able to help take a look at my config = and spot the potential issue(s), but not sure what information would be = most helpful. When I run a tcpdump I can see the traffic on the tap and bridge that = the guest is attached to. However, I never observe the traffic on any of the physical interfaces. Blessings, David Powers Ephesians 2 14-16 For he himself is our peace, who has made the two groups one and has = destroyed the barrier, the dividing wall of hostility, by setting aside = in his flesh the law with its commands and regulations. His purpose was = to create in himself one new humanity out of the two, thus making peace, = and in one body to reconcile both of them to God through the cross, by = which he put to death their hostility. From owner-freebsd-virtualization@freebsd.org Fri Aug 10 10:43:17 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C752B10663FA for ; Fri, 10 Aug 2018 10:43:17 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B64C84BEB for ; Fri, 10 Aug 2018 10:43:17 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate1.intern.punkt.de with ESMTP id w7AAhFXH032661; Fri, 10 Aug 2018 12:43:15 +0200 (CEST) Received: from [217.29.44.49] ([217.29.44.49]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id w7AAhFwb076546; Fri, 10 Aug 2018 12:43:15 +0200 (CEST) (envelope-from hausen@punkt.de) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Bhyve Guest Network Troubles From: "Patrick M. Hausen" In-Reply-To: Date: Fri, 10 Aug 2018 12:43:15 +0200 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1F38BF1A-AF14-49D6-95C9-F475F661959C@punkt.de> References: To: David Powers X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 10:43:18 -0000 Hi, > Am 10.08.2018 um 11:29 schrieb David Powers via freebsd-virtualization = : > I have a test vm running in Bhyve that is able to reach all interfaces = on its host via icmp. > However, the guest is unable to reach the default route of the host, = and thus no Internet. > I was hoping that someone might be able to help take a look at my = config and spot the potential issue(s), but not sure what information = would be most helpful. What OS is the guest running? Please provide ifconfig -a netstat -rn of both host and guest. Kind regards, Patrick --=20 punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling From owner-freebsd-virtualization@freebsd.org Fri Aug 10 11:58:11 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 926DC1068076 for ; Fri, 10 Aug 2018 11:58:11 +0000 (UTC) (envelope-from djfarid@gmail.com) Received: from mail-ed1-x52c.google.com (mail-ed1-x52c.google.com [IPv6:2a00:1450:4864:20::52c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0272D86DC8 for ; Fri, 10 Aug 2018 11:58:11 +0000 (UTC) (envelope-from djfarid@gmail.com) Received: by mail-ed1-x52c.google.com with SMTP id s16-v6so4617903edq.12 for ; Fri, 10 Aug 2018 04:58:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=BLLXNXJEpWKl37axEZJOZkbku+zuwBK3jaY2TmzbXQw=; b=NcPJr4KJRm3BJr6wgvwnFePCkwt4LDpx9QPox3yB4iDPGGOSSVewHRbsmQhpchBglp CO8BS168JSJwskFEOBQ7B2h5szCoEmlA1fGUo8foBd5BD+a3V35I8yYQWDskmemOZSwl aC+LunxO9Gwk7xm6LOox+7Df15mG9S7aXambrXMRz9sh0ElBGIJIitHG5g+8cgEbsmUo 5ktJzmRLzHimRE/7czTkg/QV0TbtGFsIbuTeVb0vp3MPXxSzYfUfW0q+YjiXZocvtI5L 4pcPmktWTr8S7AuQCP3XEA9sdQO836OV3YTRaqVv6Yo0XdCZynClucQ0NOGyBzyGoj29 tIpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=BLLXNXJEpWKl37axEZJOZkbku+zuwBK3jaY2TmzbXQw=; b=K6Wut/DcA0uWRU92URBrFqyWJW8T0utr/w7t6IKjFLdBbewub/NMsl0zDgjoCF7SZl 3LuvKw/Yf0A+T8+Mxyy21Jatu8it/Ss4h6pZr/AljCMoh3DDtXzyXaEwC1w557M6zosh RCB9+QSHyKy2Y9iR2+Xvz4+wOyvxQVPPw3qf0jxOn3y778RWPVchXcTCXdrq0yM3PjLL DWCzk7wLFOfu70qlp/7HjYlisVTc0yAMSFl6FFL5HTCgfzUW+l1pbbHujQjTZWbB3Jyr 1r0mXXrkuN/Q8UcqfEm64eeASZot0nkwiSUrTAUUB5Oa0o6WkhAgedhgz4V1nD601fMz W6Ng== X-Gm-Message-State: AOUpUlHKo98kwiT9F8sJdOzacX8bMRLtNOow6FU4DJvBtinwGHt9aVbl K/5nbjAMpryh+AIY8+Uvfe132pW3PCpLN5iRLy0= X-Google-Smtp-Source: AA+uWPxpG6PBkK/uLr5nOrJoGjqmLz0IKP1VY0WkceX86lRrpzDu8UV8MhnTWD8jn9FMeoUNI1oPho+Cwt3eWsst960= X-Received: by 2002:a50:a4f1:: with SMTP id x46-v6mr7965877edb.247.1533902289191; Fri, 10 Aug 2018 04:58:09 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Farid Joubbi Date: Fri, 10 Aug 2018 13:57:57 +0200 Message-ID: Subject: Re: Bhyve Guest Network Troubles To: David Powers Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 11:58:11 -0000 I had a similar problem. I had to turn off TCP offloading and other hardware offloading features on the NIC for it to work. On Fri, Aug 10, 2018, 12:31 David Powers via freebsd-virtualization < freebsd-virtualization@freebsd.org> wrote: > Good morning, > > I am sure this is a common issue, but I was unable to find a way to search > the list archives in an attempt to find a potential answer. > > I have a test vm running in Bhyve that is able to reach all interfaces on > its host via icmp. > However, the guest is unable to reach the default route of the host, and > thus no Internet. > I was hoping that someone might be able to help take a look at my config > and spot the potential issue(s), but not sure what information would be > most helpful. > When I run a tcpdump I can see the traffic on the tap and bridge that the > guest is attached to. > However, I never observe the traffic on any of the physical interfaces. > > Blessings, > > David Powers > > > Ephesians 2 14-16 > > For he himself is our peace, who has made the two groups one and has > destroyed the barrier, the dividing wall of hostility, by setting aside in > his flesh the law with its commands and regulations. His purpose was to > create in himself one new humanity out of the two, thus making peace, and > in one body to reconcile both of them to God through the cross, by which he > put to death their hostility. > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Fri Aug 10 12:24:06 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 20D7F10697F3 for ; Fri, 10 Aug 2018 12:24:06 +0000 (UTC) (envelope-from hicks@cgi.cz) Received: from hel.cgi.cz (hel.cgi.cz [178.238.36.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A7DDF889C4 for ; Fri, 10 Aug 2018 12:24:05 +0000 (UTC) (envelope-from hicks@cgi.cz) Received: from hel.cgi.cz (localhost [127.0.0.1]) by hel.cgi.cz (Postfix) with ESMTP id 3B78A131164 for ; Fri, 10 Aug 2018 14:23:57 +0200 (CEST) X-Virus-Scanned: amavisd-new at cgi.cz Received: from hel.cgi.cz ([127.0.0.1]) by hel.cgi.cz (hel.cgi.cz [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 694otnGOKgxE for ; Fri, 10 Aug 2018 14:23:55 +0200 (CEST) Received: from mail2.cgi.cz (hermes [172.17.174.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by hel.cgi.cz (Postfix) with ESMTPS id D61F3131156 for ; Fri, 10 Aug 2018 14:23:54 +0200 (CEST) Received: from [192.168.8.106] (unknown [82.100.31.11]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail2.cgi.cz (Postfix) with ESMTPSA id 8ACE15D1B4 for ; Fri, 10 Aug 2018 14:23:54 +0200 (CEST) Subject: Re: Bhyve Guest Network Troubles To: freebsd-virtualization@freebsd.org References: From: Jakub Chromy Message-ID: <7d3e5367-199b-dcb0-da66-d3a1e88279e4@cgi.cz> Date: Fri, 10 Aug 2018 14:23:55 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 12:24:06 -0000 ... does your WAN (eg. internet) interface have any IP assigned...? I mean your bhyve hypervisor... -- regards / s pozdravem Jakub Chromy CGI Systems div. ---------------- CGI CZ s.r.o. sales@cgi.cz 775 144 257 234 697 102 www.cgi.cz On 10.8.2018 11:29, David Powers via freebsd-virtualization wrote: > Good morning, > > I am sure this is a common issue, but I was unable to find a way to search the list archives in an attempt to find a potential answer. > > I have a test vm running in Bhyve that is able to reach all interfaces on its host via icmp. > However, the guest is unable to reach the default route of the host, and thus no Internet. > I was hoping that someone might be able to help take a look at my config and spot the potential issue(s), but not sure what information would be most helpful. > When I run a tcpdump I can see the traffic on the tap and bridge that the guest is attached to. > However, I never observe the traffic on any of the physical interfaces. > > Blessings, > > David Powers > > > Ephesians 2 14-16 > > For he himself is our peace, who has made the two groups one and has destroyed the barrier, the dividing wall of hostility, by setting aside in his flesh the law with its commands and regulations. His purpose was to create in himself one new humanity out of the two, thus making peace, and in one body to reconcile both of them to God through the cross, by which he put to death their hostility. > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Fri Aug 10 14:47:45 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 72728106CE74 for ; Fri, 10 Aug 2018 14:47:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 0DFEE8DD04 for ; Fri, 10 Aug 2018 14:47:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C744E106CE73; Fri, 10 Aug 2018 14:47:44 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5E51106CE71 for ; Fri, 10 Aug 2018 14:47:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 57A898DD01 for ; Fri, 10 Aug 2018 14:47:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9FAA326355 for ; Fri, 10 Aug 2018 14:47:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7AElhNQ057558 for ; Fri, 10 Aug 2018 14:47:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7AElh4R057557 for virtualization@FreeBSD.org; Fri, 10 Aug 2018 14:47:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230082] bhyve doesn't set process title Date: Fri, 10 Aug 2018 14:47:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 14:47:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230082 --- Comment #13 from commit-hook@freebsd.org --- A commit references this bug: Author: oshogbo Date: Fri Aug 10 14:47:17 UTC 2018 New revision: 337575 URL: https://svnweb.freebsd.org/changeset/base/337575 Log: MFC r337189: bhyve: set title before entering capability mode PR: 230082 Submitted by: Yuichiro NAITO Changes: _U stable/11/ stable/11/usr.sbin/bhyve/bhyverun.c --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Aug 10 14:52:37 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D8D40106D1B8 for ; Fri, 10 Aug 2018 14:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 73B3F8E2AB for ; Fri, 10 Aug 2018 14:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 369E4106D1B7; Fri, 10 Aug 2018 14:52:37 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23964106D1B6 for ; Fri, 10 Aug 2018 14:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B3ED58E2A8 for ; Fri, 10 Aug 2018 14:52:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B97E9264B2 for ; Fri, 10 Aug 2018 14:52:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7AEqZbR072779 for ; Fri, 10 Aug 2018 14:52:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7AEqZ2k072778 for virtualization@FreeBSD.org; Fri, 10 Aug 2018 14:52:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230082] bhyve doesn't set process title Date: Fri, 10 Aug 2018 14:52:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: oshogbo@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 14:52:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230082 --- Comment #14 from Mariusz Zaborski --- Yes :) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Aug 10 17:04:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 144EC10704FA for ; Fri, 10 Aug 2018 17:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A49C673238 for ; Fri, 10 Aug 2018 17:04:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 65E3C10704F9; Fri, 10 Aug 2018 17:04:13 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5456810704F8 for ; Fri, 10 Aug 2018 17:04:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E859273232 for ; Fri, 10 Aug 2018 17:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 4AB3E276C0 for ; Fri, 10 Aug 2018 17:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7AH4Csf048694 for ; Fri, 10 Aug 2018 17:04:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7AH4C8S048693 for virtualization@FreeBSD.org; Fri, 10 Aug 2018 17:04:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230082] bhyve doesn't set process title Date: Fri, 10 Aug 2018 17:04:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zeon@zeon.kiev.ua X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 17:04:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230082 --- Comment #15 from Nikita Olenets --- I'm confirming that it is working now. Thank you, Mariusz! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Aug 10 18:34:27 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7E0511071B0F; Fri, 10 Aug 2018 18:34:27 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-pg1-x541.google.com (mail-pg1-x541.google.com [IPv6:2607:f8b0:4864:20::541]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F12D2757E4; Fri, 10 Aug 2018 18:34:26 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-pg1-x541.google.com with SMTP id y4-v6so4777372pgp.9; Fri, 10 Aug 2018 11:34:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=0RUxShoM3hxcoMLqb+5lX6nklcLFUux1MTjzSYdpkU0=; b=QpKznk/Wa6IcIh+ysJY26Wcpz0a8hShgCFSAQ/ODpQk3aZF7pJP3jvUUNBMYGowSf3 RMlxGJoAJgBu4k7DI2C61rrxrvyJhC9Is2u9BpjYjt02xhvcGh+aIP+6inWjfyP+3zWV pSgfxTWbWotPWIGfMQ3ziRoXgvIpll84yjs1hHzneWMqkGGx9U0dP4um+Zt0Xs4FbH2g txXQwN6kPczbMhp0+C85krIRXuyS0Uf0biAlb9KUP1xO9v6sKc8YmPFqBMN5FSERcmNj Jy5Nl3A0BbQBlv7rxQMmczk2LmqS4uQID9Kwd+YyImHvKbt4X+g/6gOiG7fbQf3+Xnt9 c+7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=0RUxShoM3hxcoMLqb+5lX6nklcLFUux1MTjzSYdpkU0=; b=SWohSPUhyxsCHTIgUStpsoaEjGEF48rIQ5Q4TFume6faaUkUsvwnbLS0qTSKPwaZi4 tqSYMC/s8ueSHdfpE0+ERFEdBORAmasUnILqIXfkWpvAaqUXPiwlmWDkIT/xLAftUA2z NOm9wDBsZC6D3bK3BERPdGFaGFDP3SXPSyxdmrTWoGv8tLGBEaPd7Kph6JiLCuTN4D4P 8joQp58oz6fiDuYfKn0YeFBNImJJqhC8Hxiley4TyQF/wCe8FvchcwBon2cZTmXpKYbc NwOT8aMR2DvWAqAd5Jeo+g4sgn/hsaLD8e2cGYLQmv4Hon0Gy+pKIvsvL8l8cVlNvjtU BcZg== X-Gm-Message-State: AOUpUlF/UCS/jqGEaNC5ZwPLP2MdAIM6J89fNXYe2ZqAhVZPyceSYE3S TIhwywJc3e8/uicyrl2lki8/6Le5 X-Google-Smtp-Source: AA+uWPwOjP2xZo2kneakP4hcXzedPf/SjpeBXgacySlys/yvoKLpIgoxMnDiw/Zpe108aLppgQSm6w== X-Received: by 2002:a63:6b03:: with SMTP id g3-v6mr7548584pgc.57.1533926065845; Fri, 10 Aug 2018 11:34:25 -0700 (PDT) Received: from raichu (toroon0560w-lp130-09-70-52-224-239.dsl.bell.ca. [70.52.224.239]) by smtp.gmail.com with ESMTPSA id v23-v6sm12373331pfm.80.2018.08.10.11.34.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 10 Aug 2018 11:34:24 -0700 (PDT) Sender: Mark Johnston Date: Fri, 10 Aug 2018 14:34:19 -0400 From: Mark Johnston To: "Patrick M. Hausen" Cc: freebsd-virtualization@freebsd.org, freebsd-dtrace@freebsd.org Subject: Re: Why can't I dtrace processes running in a jail from the host? Message-ID: <20180810183419.GA52302@raichu> References: <20180809145258.GA68459@raichu> <8B1BDE9F-BDAD-4CEB-B7A2-8052497F50EA@punkt.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8B1BDE9F-BDAD-4CEB-B7A2-8052497F50EA@punkt.de> User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 18:34:27 -0000 On Fri, Aug 10, 2018 at 09:15:22AM +0200, Patrick M. Hausen wrote: > Hi! > > > Am 09.08.2018 um 16:52 schrieb Mark Johnston : > > For userland static probes to be globally visible, the process needs to > > register them with the kernel when it starts. This is done > > automatically using a constructor which issues ioctls to > > /dev/dtrace/helper, hence the requirement for /dev/dtrace/* in the jail. > > I figured as much. Enabling /dev/dtrace/* in the jail and restarting > the jail made the probes visible in the host system > > I'm still somewhat stuck. What I'm trying to do is track down some > performance problems in a large complex PHP web application. > I have done this in the past on "regular" setups without jails > and with PHP 5.6 compiled with dtrace support using > /usr/local/share/dtrace-toolkit/Php/* ... > > This setup is jailed with PHP 7.2, dtrace support seems to be the > default for the port. > > I'm specifically after > > php-fpm dtrace_execute_ex function-entry > php-fpm dtrace_execute_ex function-return > > of course, to see where the application spends it's CPU cycles. > > But regardless if I'm doing this on the host or in the jail, I only get > these results: > > dtrace -m php\* > ZEND_CATCH_SPEC_CONST_CV_HANDLER:exception-caught > php_request_shutdown:request-shutdown > php_request_startup:request-startup > zend_error:error > zend_throw_exception_internal:exception-thrown > > Nothing else. Still `dtrace -m php\* -l` does show all the probes. Indeed, I can reproduce this. Peering at the zend source code, it seems that there's a difference in how the dtrace_execute_ex hook gets installed: with 5.6, it's unconditional so long as zend is compiled with HAVE_DTRACE. In 7.2, the php process needs to have USE_ZEND_DTRACE=1 set in its environment for the dtrace function execution hook to be installed. From owner-freebsd-virtualization@freebsd.org Fri Aug 10 22:44:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9CFD7107734A for ; Fri, 10 Aug 2018 22:44:18 +0000 (UTC) (envelope-from dnpowers@me.com) Received: from mr21p32im-asmtp002.me.com (mr21p32im-asmtp002.me.com [17.111.214.11]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 30C4A7E7FF for ; Fri, 10 Aug 2018 22:44:18 +0000 (UTC) (envelope-from dnpowers@me.com) Received: from process-dkim-sign-daemon.mr21p32im-asmtp002.me.com by mr21p32im-asmtp002.me.com (Oracle Communications Messaging Server 8.0.2.2.20180531 64bit (built May 31 2018)) id <0PD900800LOY1100@mr21p32im-asmtp002.me.com> for freebsd-virtualization@freebsd.org; Fri, 10 Aug 2018 21:44:09 +0000 (GMT) Received: from icloud.com ([127.0.0.1]) by mr21p32im-asmtp002.me.com (Oracle Communications Messaging Server 8.0.2.2.20180531 64bit (built May 31 2018)) with ESMTPSA id <0PD9004QWLPB0E40@mr21p32im-asmtp002.me.com>; Fri, 10 Aug 2018 21:44:08 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-08-10_13:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 clxscore=1011 suspectscore=2 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1808100228 From: David Powers Message-id: <9077F63C-56B6-47EA-B981-91BC4B8ACC9B@me.com> MIME-version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: Bhyve Guest Network Troubles Date: Fri, 10 Aug 2018 16:43:01 -0500 In-reply-to: <1F38BF1A-AF14-49D6-95C9-F475F661959C@punkt.de> Cc: freebsd-virtualization@freebsd.org To: "Patrick M. Hausen" References: <1F38BF1A-AF14-49D6-95C9-F475F661959C@punkt.de> X-Mailer: Apple Mail (2.3445.9.1) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 22:44:19 -0000 Good afternoon, Both the host and guest are freebsd 11.2. The guest is actually a live CD boot to work out the configuration. The host does have connectivity to the Internet via its default route. Host =E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94 root@FreeBSDHost:~ # uname -a FreeBSD FreeBSDHost.davehome.local 11.2-RELEASE-p1 FreeBSD = 11.2-RELEASE-p1 #0: Sun Aug 5 12:04:13 UTC 2018 = root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 root@FreeBSDHost:~ # ifconfig -a igb0: flags=3D8943 = metric 0 mtu 1500 = options=3D6403bb ether 00:25:90:f4:74:56 hwaddr 00:25:90:f4:74:56 inet 192.168.1.75 netmask 0xffffff00 broadcast 192.168.1.255=20 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=3D8943 = metric 0 mtu 1500 = options=3D6403bb ether 00:25:90:f4:74:57 hwaddr 00:25:90:f4:74:57 inet 192.168.10.200 netmask 0xffffff00 broadcast 192.168.10.255=20= nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active igb2: flags=3D8c02 metric 0 mtu = 1500 = options=3D6403bb ether 00:25:90:f4:74:58 hwaddr 00:25:90:f4:74:58 nd6 options=3D29 media: Ethernet autoselect status: no carrier igb3: flags=3D8c02 metric 0 mtu = 1500 = options=3D6403bb ether 00:25:90:f4:74:59 hwaddr 00:25:90:f4:74:59 nd6 options=3D29 media: Ethernet autoselect status: no carrier lo0: flags=3D8049 metric 0 mtu 16384 options=3D600003 inet6 ::1 prefixlen 128=20 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5=20 inet 127.0.0.1 netmask 0xff000000=20 nd6 options=3D21 groups: lo=20 vm-snet3: flags=3D8843 metric 0 = mtu 1500 ether fa:59:16:f5:07:43 inet 192.168.3.1 netmask 0xffffff00 broadcast 192.168.3.255=20 nd6 options=3D1 groups: bridge vm-switch viid-04c92@=20 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: igb1.3 flags=3D143 ifmaxaddr 0 port 7 priority 128 path cost 55 member: tap0 flags=3D143 ifmaxaddr 0 port 12 priority 128 path cost 2000000 vm-cnet2: flags=3D8843 metric 0 = mtu 1500 ether 2e:19:74:e4:3e:dd inet 192.168.2.1 netmask 0xffffff00 broadcast 192.168.2.255=20 nd6 options=3D1 groups: bridge vm-switch viid-1e291@=20 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: igb1.2 flags=3D143 ifmaxaddr 0 port 9 priority 128 path cost 20000 igb1.2: flags=3D8943 = metric 0 mtu 1500 description: vm-vlan-cnet2-igb1.2 options=3D600303 ether 00:25:90:f4:74:57 inet6 fe80::225:90ff:fef4:7457%igb1.2 prefixlen 64 scopeid 0x9=20= nd6 options=3D21 media: Ethernet autoselect (1000baseT ) status: active vlan: 2 vlanpcp: 0 parent interface: igb1 groups: vlan vm-vlan viid-dd265@=20 vm-gnet5: flags=3D8843 metric 0 = mtu 1500 ether 02:48:27:ed:e7:d2 inet 192.168.5.1 netmask 0xffffff00 broadcast 192.168.5.255=20 nd6 options=3D1 groups: bridge vm-switch viid-13459@=20 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: igb1.5 flags=3D143 ifmaxaddr 0 port 11 priority 128 path cost 20000 igb1.5: flags=3D8943 = metric 0 mtu 1500 description: vm-vlan-gnet5-igb1.5 options=3D600303 ether 00:25:90:f4:74:57 inet6 fe80::225:90ff:fef4:7457%igb1.5 prefixlen 64 scopeid 0xb=20= nd6 options=3D21 media: Ethernet autoselect (1000baseT ) status: active vlan: 5 vlanpcp: 0 parent interface: igb1 groups: vlan vm-vlan viid-2eab2@=20 tap0: flags=3D8943 = metric 0 mtu 1500 description: vmnet-testvm-0-snet3 options=3D80000 ether 00:bd:69:70:fb:00 hwaddr 00:bd:69:70:fb:00 inet6 fe80::2bd:69ff:fe70:fb00%tap0 prefixlen 64 tentative = scopeid 0xc=20 nd6 options=3D29 media: Ethernet autoselect status: active groups: tap vm-port=20 Opened by PID 3343 igb1.3: flags=3D8943 = metric 0 mtu 1500 description: vm-vlan-snet3-igb1.3 options=3D200001 ether 00:25:90:f4:74:57 inet6 fe80::225:90ff:fef4:7457%igb1.3 prefixlen 64 scopeid 0x7=20= nd6 options=3D21 media: Ethernet autoselect (1000baseT ) status: active vlan: 3 vlanpcp: 0 parent interface: igb1 groups: vlan vm-vlan viid-20a6f@=20 vm-inet1: flags=3D8843 metric 0 = mtu 1500 ether 86:21:60:0f:9c:f1 inet 192.168.1.1 netmask 0xffffff00 broadcast 192.168.1.255=20 nd6 options=3D1 groups: bridge vm-switch viid-40cd9@=20 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: igb0 flags=3D143 ifmaxaddr 0 port 1 priority 128 path cost 20000 root@FreeBSDHost:~ # netstat -rn Routing tables Internet: Destination Gateway Flags Netif Expire default 192.168.1.254 UGS igb0 127.0.0.1 link#5 UH lo0 192.168.1.0/24 link#1 U igb0 192.168.1.1 link#13 UHS lo0 192.168.1.75 link#1 UHS lo0 192.168.2.0/24 link#8 U vm-cnet2 192.168.2.1 link#8 UHS lo0 192.168.3.0/24 link#6 U vm-snet3 192.168.3.1 link#6 UHS lo0 192.168.5.0/24 link#10 U vm-gnet5 192.168.5.1 link#10 UHS lo0 192.168.10.0/24 link#2 U igb1 192.168.10.200 link#2 UHS lo0 Internet6: Destination Gateway Flags = Netif Expire ::/96 ::1 UGRS = lo0 ::1 link#5 UH = lo0 ::ffff:0.0.0.0/96 ::1 UGRS = lo0 fe80::/10 ::1 UGRS = lo0 fe80::%lo0/64 link#5 U = lo0 fe80::1%lo0 link#5 UHS = lo0 fe80::%igb1.3/64 link#7 U = igb1.3 fe80::225:90ff:fef4:7457%igb1.3 link#7 UHS = lo0 fe80::%igb1.2/64 link#9 U = igb1.2 fe80::225:90ff:fef4:7457%igb1.2 link#9 UHS = lo0 fe80::%igb1.5/64 link#11 U = igb1.5 fe80::225:90ff:fef4:7457%igb1.5 link#11 UHS = lo0 fe80::%tap0/64 link#12 U = tap0 fe80::2bd:69ff:fe70:fb00%tap0 link#12 UHS = lo0 ff02::/16 ::1 UGRS = lo0 root@FreeBSDHost:~ #=20 Guest =E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94- root@testvm:~ # uname -a FreeBSD testvm.dvaehome.local 11.2-RELEASE FreeBSD 11.2-RELEASE #0 = r335510: Fri Jun 22 04:32:14 UTC 2018 = root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 root@testvm:~ # ifconfig -a vtnet0: flags=3D8943 = metric 0 mtu 1500 options=3D80028 ether 58:9c:fc:0e:2e:4b hwaddr 58:9c:fc:0e:2e:4b inet 192.168.3.254 netmask 0xffffff00 broadcast 192.168.3.255=20 nd6 options=3D29 media: Ethernet 10Gbase-T status: active lo0: flags=3D8049 metric 0 mtu 16384 options=3D600003 inet6 ::1 prefixlen 128=20 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2=20 inet 127.0.0.1 netmask 0xff000000=20 nd6 options=3D21 groups: lo=20 root@testvm:~ # netstat -rn Routing tables Internet: Destination Gateway Flags Netif Expire default 192.168.3.1 UGS vtnet0 127.0.0.1 link#2 UH lo0 192.168.3.0/24 link#1 U vtnet0 192.168.3.254 link#1 UHS lo0 Internet6: Destination Gateway Flags = Netif Expire ::/96 ::1 UGRS = lo0 ::1 link#2 UH = lo0 ::ffff:0.0.0.0/96 ::1 UGRS = lo0 fe80::/10 ::1 UGRS = lo0 fe80::%lo0/64 link#2 U = lo0 fe80::1%lo0 link#2 UHS = lo0 ff02::/16 ::1 UGRS = lo0 root@testvm:~ #=20 > On Aug 10, 2018, at 5:43 AM, Patrick M. Hausen = wrote: >=20 > Hi, >=20 >> Am 10.08.2018 um 11:29 schrieb David Powers via = freebsd-virtualization : >> I have a test vm running in Bhyve that is able to reach all = interfaces on its host via icmp. >> However, the guest is unable to reach the default route of the host, = and thus no Internet. >> I was hoping that someone might be able to help take a look at my = config and spot the potential issue(s), but not sure what information = would be most helpful. >=20 > What OS is the guest running? >=20 > Please provide >=20 > ifconfig -a > netstat -rn >=20 > of both host and guest. >=20 > Kind regards, > Patrick > --=20 > punkt.de GmbH Internet - Dienstleistungen - Beratung > Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 > 76133 Karlsruhe info@punkt.de http://punkt.de > AG Mannheim 108285 Gf: Juergen Egeling >=20 From owner-freebsd-virtualization@freebsd.org Fri Aug 10 22:49:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CF8011077516 for ; Fri, 10 Aug 2018 22:49:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6BB7C7E9E5 for ; Fri, 10 Aug 2018 22:49:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 313551077515; Fri, 10 Aug 2018 22:49:18 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 200451077514 for ; Fri, 10 Aug 2018 22:49:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B2FA37E9E3 for ; Fri, 10 Aug 2018 22:49:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 0D8BDA615 for ; Fri, 10 Aug 2018 22:49:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7AMnGpo031209 for ; Fri, 10 Aug 2018 22:49:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7AMnG9v031207 for virtualization@FreeBSD.org; Fri, 10 Aug 2018 22:49:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230402] With buildworld, the system can not use swap Date: Fri, 10 Aug 2018 22:49:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 22:49:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230402 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |virtualization@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Aug 10 23:46:41 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F21751078C34 for ; Fri, 10 Aug 2018 23:46:40 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9CA56817E0 for ; Fri, 10 Aug 2018 23:46:40 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1foH72-00086r-FL for freebsd-virtualization@freebsd.org; Fri, 10 Aug 2018 17:46:32 -0600 Date: Fri, 10 Aug 2018 17:46:32 -0600 From: The Doctor To: freebsd-virtualization@freebsd.org Subject: Curent Centos 7 and bhyve Message-ID: <20180810234632.GA30646@doctor.nl2k.ab.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 23:46:41 -0000 Are there issues with Current CEntos and bhyve? I have tried 3 installation method. On 2nd phase, it looks like the xfs indoe are skewered. -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising! https://www.empire.kred/ROOTNK?t=94a1f39b Look at Psalms 14 and 53 on Atheism We cannot direct the wind, but we can adjust the sails. -Bertha Calloway From owner-freebsd-virtualization@freebsd.org Sat Aug 11 00:57:03 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD7FF1079DDF for ; Sat, 11 Aug 2018 00:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4B4B983295 for ; Sat, 11 Aug 2018 00:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 0CEC81079DDC; Sat, 11 Aug 2018 00:57:03 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EFB7F1079DDB for ; Sat, 11 Aug 2018 00:57:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8E1E983293 for ; Sat, 11 Aug 2018 00:57:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D3374B870 for ; Sat, 11 Aug 2018 00:57:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7B0v1FT074399 for ; Sat, 11 Aug 2018 00:57:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7B0v1lC074398 for virtualization@FreeBSD.org; Sat, 11 Aug 2018 00:57:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230402] With buildworld, the system can not use swap Date: Sat, 11 Aug 2018 00:57:01 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 00:57:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230402 Rodney W. Grimes changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rgrimes@FreeBSD.org --- Comment #6 from Rodney W. Grimes --- I would suggest that make with -j3 on a 1024MB machine is not a reasonable expectation. It is very easy for a compile or linker process to get into = the 500MB size region and suggest you either increase avaliable memory to the V= M, or decrease the job count. Due to the fact that "runnable" processes are not swapped in FreeBSD, this leads to an OOM condition, and the kill you see. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-virtualization@freebsd.org Sat Aug 11 01:34:05 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61E6110551AC for ; Sat, 11 Aug 2018 01:34:05 +0000 (UTC) (envelope-from ganbold@gmail.com) Received: from mail-qt0-x22d.google.com (mail-qt0-x22d.google.com [IPv6:2607:f8b0:400d:c0d::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E547D84CB2 for ; Sat, 11 Aug 2018 01:34:04 +0000 (UTC) (envelope-from ganbold@gmail.com) Received: by mail-qt0-x22d.google.com with SMTP id w26-v6so12259213qto.5 for ; Fri, 10 Aug 2018 18:34:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=fNFONlv7gVEURS0ImqiY82E/7cG/pPXnvBmsLvtzJi8=; b=MiytaSAFSuyj6vr6P7T87C/b/86JVnx0iQQEVWf6DCKZ3MfMSxxKrV8rV/xFpjbU2z BAwwyac1P2R1lAs7/TtsiFTONT0CHMePgApDSk1UdYIPkUW5bCrlSdQnaRHuJlvEMsWp k1ZVloku/RLgmCUsxng9JdMhyWtUorUFXM9OdeN5Guym6TreQLVjVI3vMI3fEoPkB0xz mSx1vc9Bxi/YUpLneBboaBLGUuXM6zjCbY8hmhtlGcYo/kJNjBuLZTw5H3r+HtAv40nl +L6qI73kTNLjiZnsBxSQ/OMMjkQ7P08AaDZaAGEHRxnugIcBt3WUwbRbWqgUaxHjTfsi X7Ww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=fNFONlv7gVEURS0ImqiY82E/7cG/pPXnvBmsLvtzJi8=; b=Krb9kBzwyhbxpFNhmdElwEqJr1eVwQVIeW78kw8lrOTbODFb+jWpqhP+ZyjzIG5Ww6 I+dAfACMQRINJZOHgibSlbwKzUTzmpxGqPGsdiuLNXnGTaFkAZnbwr0AjvVOQCd1hmf/ TjcAKpFPdm0dscoEzNjh9C3KyUscOPCLFlOLcBh9qGvaWbQb4fNM843gE05rALbeTIvD fSF2N8FCE+wzSMkLkmAm/fZPgy3pAaALPagjCH4WcyQVVpB5fw5745EJOLNfpfhBmDlL l9tYV6akcY2/gpPXEK+5jGCISr8u1CKY6fs9ghz3WKYAHAWV9G6d7sEzW4LmliY1Hf3r jn3A== X-Gm-Message-State: AOUpUlFNaPyMCAs59g1i/46sYOKDtVChVsqdiEUbq+3B5mce/wzTWc/u GswAaI2Cvp05Yr6AYMf7CWD/ZhM6BTwm1kN5QvQoDAA4 X-Google-Smtp-Source: AA+uWPxf+9VjvkLr1sa3DAMRNaiH11TJiYz6Crl3ZSq78gOURe27SIZFwMDBYjPShNaRb5pcTQWldpQ3841geC48kEU= X-Received: by 2002:aed:24e7:: with SMTP id u36-v6mr8785663qtc.58.1533951244339; Fri, 10 Aug 2018 18:34:04 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:aed:29c3:0:0:0:0:0 with HTTP; Fri, 10 Aug 2018 18:34:03 -0700 (PDT) In-Reply-To: <20180810234632.GA30646@doctor.nl2k.ab.ca> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> From: Ganbold Tsagaankhuu Date: Sat, 11 Aug 2018 09:34:03 +0800 Message-ID: Subject: Re: Curent Centos 7 and bhyve To: The Doctor Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 01:34:05 -0000 On Sat, Aug 11, 2018 at 7:46 AM, The Doctor via freebsd-virtualization < freebsd-virtualization@freebsd.org> wrote: > Are there issues with Current CEntos and bhyve? > > I have tried 3 installation method. > > On 2nd phase, it looks like the xfs indoe are skewered. > Maybe try to use CentOS-7-x86_64-Minimal-1511.iso. This is 7.2.1551. Later versions default to XFS which FreeBSD grub2 doesn't seem to support. There is no known way to switch this from anaconda so you have to use the old ISO and then update. Ganbold > -- > Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@ > nl2k.ab.ca > Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist > rising! > https://www.empire.kred/ROOTNK?t=94a1f39b Look at Psalms 14 and 53 on > Atheism > We cannot direct the wind, but we can adjust the sails. -Bertha Calloway > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Sat Aug 11 01:51:21 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA8031055C84 for ; Sat, 11 Aug 2018 01:51:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 453C2858A3 for ; Sat, 11 Aug 2018 01:51:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 09C181055C80; Sat, 11 Aug 2018 01:51:21 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ECA281055C7F for ; Sat, 11 Aug 2018 01:51:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84FC08589D for ; Sat, 11 Aug 2018 01:51:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CC3E5C221 for ; Sat, 11 Aug 2018 01:51:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w7B1pJAc002829 for ; Sat, 11 Aug 2018 01:51:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w7B1pJMC002827 for virtualization@FreeBSD.org; Sat, 11 Aug 2018 01:51:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230402] With buildworld, the system can not use swap Date: Sat, 11 Aug 2018 01:51:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 01:51:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230402 --- Comment #7 from Mark Millard --- Mark Johnston has indicated that after investigations in small armv7 and aarch64 examples, such as rpi3's and rpi2's (V1.1): I do think the default [vm.pageout_oom_seq] value is too low and will get that addressed in 12.0. Mark J. had someone with rpi3 and rpi2 (V1.1) usage experiment with: sysctl vm.pageout_oom_seq=3D120 and things got much farther but it was not a cure. While not a cure but it was discovered that when some other changes were made ("lowering the pagedaemon sleep period") a fair time ago, vm.pageout_oom_seq was not rescaled to roughly match, making OOM kills happen easier. There are some patches for reporting information that Mark J. has indicated will likely have some variant become standard FreeBSD code that could be enabled without needing patches, targeting 12.0 having such. The lists have a long history tied to the investigations on arm. I'll reference the first Mark Johnston message here: https://lists.freebsd.org/pipermail/freebsd-arm/2018-August/018506.html His messages have most of the technical content tied to internal evidence his patches produced and what might be done. (Other folks produced data from there environments, mostly one person.) The prior activity does not get much into internal activity tied to the issue. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-virtualization@freebsd.org Sat Aug 11 05:53:15 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5EB1105F205 for ; Sat, 11 Aug 2018 05:53:15 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id 070A88D931 for ; Sat, 11 Aug 2018 05:53:13 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40075242; Sat, 11 Aug 2018 12:53:11 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7B5rAGP063618; Sat, 11 Aug 2018 12:53:10 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7B5r5d0063617; Sat, 11 Aug 2018 12:53:05 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Sat, 11 Aug 2018 12:53:05 +0700 From: Victor Sudakov To: The Doctor Cc: freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811055305.GA63605@admin.sibptus.transneft.ru> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180810234632.GA30646@doctor.nl2k.ab.ca> Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 05:53:15 -0000 The Doctor via freebsd-virtualization wrote: > Are there issues with Current CEntos and bhyve? Sure there are, please look at https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > I have tried 3 installation method. > > On 2nd phase, it looks like the xfs indoe are skewered. Duh! -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Sat Aug 11 13:49:44 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9BE76106D239 for ; Sat, 11 Aug 2018 13:49:44 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F28C07D5F9 for ; Sat, 11 Aug 2018 13:49:43 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-wr1-x433.google.com with SMTP id h15-v6so10548916wrs.7 for ; Sat, 11 Aug 2018 06:49:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=hmHIfGoiqiU5r+TbaaH1lMCz6HmlsKkue0kApRUaVmY=; b=QQZTZwWNNZIgzV4rCs0HzjX0FHBSeVM/pY59M3t7nTPOP/94Ah+8EiH4wu8DMXRvBd eBoUIeN7XoZH98FOm9BHlm0yamhvh72plCj14UYHKxaywuZjY1MnROcn613/s1ZgLjtq UTPo91zTrzrSwFxUMspPgktTyPiR/4drFbd/HnNVVoKn+YV8owGN77R880Mmpn/9Agle V3fQdkn+4zjzXol7zMZ5PwryFv/kjPtVkY9yjeSXWVpnhJYOJOIsvWqyIbCtmdLPAb97 d47Fs8vezxAa5vPo05rLor0ojjkgvjng3RluRTz/oCnat2uUb83W3XN4Rd4FvGv4uKto 265A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=hmHIfGoiqiU5r+TbaaH1lMCz6HmlsKkue0kApRUaVmY=; b=fwP0FSfifvXgB5jhp0UWxS0lJJw4WvytcmippCWjET5ZAagEm6ZLJRrbdTUPPjjz5p rmfWwZyyNeaFD7OpVjkRHeFgFcF+D3fzDJfnoGP6msNeb/Q5z5KjHhltOtFPWj85LWNT jOpa1YXluxPCsGFUtByGHnV+XLoXL//zgI4GEcOEf3BrQlNmwXaNQ2N1i/stSZ1dPDG2 KlQvP8namNxrmJaamcukbb97s+Oem9Rz2i7m3/9qDq8BW6BfJ/QQDtnyUvQjUpI9ZSCV NWnzlsF09+et7dcimrM3aeWru3XQ36Jp5Wtr7+4pnKdgZYpz5PwuwU5LoB/PUvhBtnOt XpuA== X-Gm-Message-State: AOUpUlFersYcpfU1k3DunW25txQFTeFEGRZEFaVH7vcak9ukXEAOJofW +PLZ3xnhw1NrduKsmnlu5LpFcY660E8= X-Google-Smtp-Source: AA+uWPwbjdc3/IkqqivXT6DApKM0fnjfJtU85TdqAfsqUOVQZCy1pbudVrs8lc4a42RnV0LUBXF4Pw== X-Received: by 2002:adf:f485:: with SMTP id l5-v6mr6913839wro.259.1533995382623; Sat, 11 Aug 2018 06:49:42 -0700 (PDT) Received: from mutt-hbsd (tor-exit01.ghettocolo.org. [142.44.154.169]) by smtp.gmail.com with ESMTPSA id y184-v6sm5009623wmg.17.2018.08.11.06.49.39 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 11 Aug 2018 06:49:41 -0700 (PDT) Date: Sat, 11 Aug 2018 09:48:47 -0400 From: Shawn Webb To: Victor Sudakov Cc: The Doctor , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811134847.2afg4ukgmpink76h@mutt-hbsd> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="snjuhhmo6jlxzwwd" Content-Disposition: inline In-Reply-To: <20180811055305.GA63605@admin.sibptus.transneft.ru> X-Operating-System: FreeBSD mutt-hbsd 12.0-CURRENT FreeBSD 12.0-CURRENT X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: NeoMutt/20180622 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 13:49:44 -0000 --snjuhhmo6jlxzwwd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Aug 11, 2018 at 12:53:05PM +0700, Victor Sudakov wrote: > The Doctor via freebsd-virtualization wrote: > > Are there issues with Current CEntos and bhyve? >=20 > Sure there are, please look at > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230453 Booting in UEFI mode works. --=20 Shawn Webb Cofounder and Security Engineer HardenedBSD Tor-ified Signal: +1 443-546-8752 Tor+XMPP+OTR: lattera@is.a.hacker.sx GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --snjuhhmo6jlxzwwd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEKrq2ve9q9Ia+iT2eaoRlj1JFbu4FAltu6ToACgkQaoRlj1JF bu6IAQ//Yo0qY0SXk9hRI/bK6bOsaVOYALqHHLpDh0tP1xyi4ppwBr09Kn6Nk6Qa /+NzDPL/A6xS+YJZDDgeMwCz9/+N3eQP9zsYMoZfXfp6pMFUlATTNyMsXIagIzrE ISNKqGV8wZo3WEABTIHvcVCwisSB99M3BfYG8uPACT74ty3pinlkYbFbsZilKUBI zY6Vvj6eT/Qn6R/3ANDdUbclcY+02tF4D/F1aCjMcx4gyrqSkrUuidyeMqtzi0fq zn1/o+FtaaIRMJO6xZMbCJx7PKNhD29k3IRusN9ordNcfFj57fTxTGPri/P+jLIv YA9KCN96S/XP2xN0l/Pp9ssNAWbwF20h/mDQjJykswoP1urtFn6tkUyLwevpHK0A PAF2SHGw7ieBF2ixOkOL3lbC0hVPIgkZ8TxxTqfIKrTZmLFerNONolEQLVYo31vS O/naAjv/Xwzvvxg5pBjEzZ/2F4CWxUWa9TZP8oQYLp2uRJd4I3g1jGT7mOI4cquk 74m6jxI2y9kbbFPWcw6A350VlNzHLi0I592XcONSkMFfR0Eijul09r4MGAD+wghS y7KJ0/e702EORSqN1M8Aof9Un/KBBVDaZQpgkaooFDS3EW+cswITOGdNxu39olEX +kSdmMa5hPdHs0/dxkU/qXIoupARg09w7Qv+6M+IYxhoAufLyTE= =YVqv -----END PGP SIGNATURE----- --snjuhhmo6jlxzwwd-- From owner-freebsd-virtualization@freebsd.org Sat Aug 11 14:02:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6F138106D91F for ; Sat, 11 Aug 2018 14:02:34 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id 8DBCD7E054 for ; Sat, 11 Aug 2018 14:02:33 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40075390; Sat, 11 Aug 2018 21:02:31 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7BE2UQf066695; Sat, 11 Aug 2018 21:02:31 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7BE2QKr066692; Sat, 11 Aug 2018 21:02:26 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Sat, 11 Aug 2018 21:02:26 +0700 From: Victor Sudakov To: Ganbold Tsagaankhuu Cc: The Doctor , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811140226.GA66565@admin.sibptus.transneft.ru> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 14:02:34 -0000 Ganbold Tsagaankhuu wrote: > On Sat, Aug 11, 2018 at 7:46 AM, The Doctor via freebsd-virtualization < > freebsd-virtualization@freebsd.org> wrote: > > > Are there issues with Current CEntos and bhyve? > > > > I have tried 3 installation method. > > > > On 2nd phase, it looks like the xfs indoe are skewered. > > > > > Maybe try to use CentOS-7-x86_64-Minimal-1511.iso. This is 7.2.1551. Later > versions default to XFS which FreeBSD grub2 doesn't seem to support. There > is no known way to switch this from anaconda so you have to use the old ISO > and then update. Does not work even if installed from CentOS-7-x86_64-Minimal-1511.iso. See what happens under FreeBSD 11.2-RELEASE, vm-bhyve-1.1.8_2: [ OK ] Reached target Basic System. [ 1.297080] vda: vda1 vda2 vda3 [ 1.508128] input: PS/2 Generic Mouse as /devices/platform/i8042/serio1/input/input2 [ 1.693391] tsc: Refined TSC clocksource calibration: 3308.829 MHz [ 1.695742] Switching to clocksource tsc seems good so far.... [ 1.693391] tsc: Refined TSC clocksource calibration: 3308.829 MHz [ 1.695742] Switching to clocksource tsc [ 124.909494] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 125.424725] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 125.937988] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 126.450692] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts ... [ 185.728954] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 185.729227] dracut-initqueue[219]: Warning: Could not boot. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Reached target Basic System. [ 124.909494] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 125.424725] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 185.728954] dracut-initqueue[219]: Warning: dracut-initqueue timeout - starting timeout scripts [ 185.729227] dracut-initqueue[219]: Warning: Could not boot. [ 185.825970] dracut-initqueue[219]: Warning: /dev/mapper/centos-root does not exist Starting Dracut Emergency Shell... Warning: /dev/mapper/centos-root does not exist Generating "/run/initramfs/rdsosreport.txt" Entering emergency mode. Exit the shell to continue. Type "journalctl" to view system logs. You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot after mounting them and attach it to a bug report. dracut:/# -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Sat Aug 11 14:19:58 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45CAC106E3D6 for ; Sat, 11 Aug 2018 14:19:58 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 95BED8064E for ; Sat, 11 Aug 2018 14:19:46 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1foUjz-0000V4-Mj; Sat, 11 Aug 2018 08:19:39 -0600 Date: Sat, 11 Aug 2018 08:19:39 -0600 From: The Doctor To: Shawn Webb Cc: Victor Sudakov , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811141939.GA1187@doctor.nl2k.ab.ca> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> <20180811134847.2afg4ukgmpink76h@mutt-hbsd> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180811134847.2afg4ukgmpink76h@mutt-hbsd> User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 14:19:58 -0000 On Sat, Aug 11, 2018 at 09:48:47AM -0400, Shawn Webb wrote: > On Sat, Aug 11, 2018 at 12:53:05PM +0700, Victor Sudakov wrote: > > The Doctor via freebsd-virtualization wrote: > > > Are there issues with Current CEntos and bhyve? > > > > Sure there are, please look at > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > Booting in UEFI mode works. > Chokes in my case. I have better luck with Debian. > -- > Shawn Webb > Cofounder and Security Engineer > HardenedBSD > > Tor-ified Signal: +1 443-546-8752 > Tor+XMPP+OTR: lattera@is.a.hacker.sx > GPG Key ID: 0x6A84658F52456EEE > GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising! https://www.empire.kred/ROOTNK?t=94a1f39b Look at Psalms 14 and 53 on Atheism We cannot direct the wind, but we can adjust the sails. -Bertha Calloway From owner-freebsd-virtualization@freebsd.org Sat Aug 11 14:34:56 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 30C86106EE9C for ; Sat, 11 Aug 2018 14:34:56 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id 7F8A08169F for ; Sat, 11 Aug 2018 14:34:55 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40075406; Sat, 11 Aug 2018 21:34:53 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7BEYqe8066907; Sat, 11 Aug 2018 21:34:53 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7BEYmYR066906; Sat, 11 Aug 2018 21:34:48 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Sat, 11 Aug 2018 21:34:48 +0700 From: Victor Sudakov To: Shawn Webb Cc: The Doctor , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811143448.GA66876@admin.sibptus.transneft.ru> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> <20180811134847.2afg4ukgmpink76h@mutt-hbsd> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180811134847.2afg4ukgmpink76h@mutt-hbsd> Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 14:34:56 -0000 Shawn Webb wrote: > On Sat, Aug 11, 2018 at 12:53:05PM +0700, Victor Sudakov wrote: > > The Doctor via freebsd-virtualization wrote: > > > Are there issues with Current CEntos and bhyve? > > > > Sure there are, please look at > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > Booting in UEFI mode works. This means we need an update to /usr/local/share/examples/vm-bhyve/centos7.conf ? It says 'loader="grub"' for the present. Do you have a vm config to boot centos7 in UEFI mode you could share? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Sat Aug 11 14:36:07 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8BC16106EEFD for ; Sat, 11 Aug 2018 14:36:07 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id DEC5981711 for ; Sat, 11 Aug 2018 14:36:06 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40075408; Sat, 11 Aug 2018 21:36:05 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7BEa5ro066931; Sat, 11 Aug 2018 21:36:05 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7BEa4sh066930; Sat, 11 Aug 2018 21:36:04 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Sat, 11 Aug 2018 21:36:04 +0700 From: Victor Sudakov To: The Doctor Cc: Shawn Webb , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811143604.GB66876@admin.sibptus.transneft.ru> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> <20180811134847.2afg4ukgmpink76h@mutt-hbsd> <20180811141939.GA1187@doctor.nl2k.ab.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180811141939.GA1187@doctor.nl2k.ab.ca> Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 14:36:07 -0000 The Doctor wrote: > > > The Doctor via freebsd-virtualization wrote: > > > > Are there issues with Current CEntos and bhyve? > > > > > > Sure there are, please look at > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > > > Booting in UEFI mode works. > > > > Chokes in my case. > > I have better luck with Debian. Yes, Ubuntu server works too, but do we have anything RPM-based that runs in bhyve? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Sat Aug 11 14:38:42 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 170F1106F092 for ; Sat, 11 Aug 2018 14:38:42 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-wr1-x443.google.com (mail-wr1-x443.google.com [IPv6:2a00:1450:4864:20::443]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 849E0819E4 for ; Sat, 11 Aug 2018 14:38:41 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-wr1-x443.google.com with SMTP id b15-v6so10598716wrv.10 for ; Sat, 11 Aug 2018 07:38:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=WOHJFOTaWNvPjeCKxz00WkPWpr/WhsAOHIxBMPbu4rk=; b=GVXoAry9c3DWdyXFJ+i8mvQwb63zxuNtznY/qJJ0pTZnKfO88Z+b2p5VuY0+3nlb5z JK53P4KAP5EtNytfLmyRMeCzxsdrEFaUsfrTJqwNtz+CB4Id+O8+PrzDcwPMd7OIFu1a RKBZUJ+qr4jF+0/cFv5hya5cBZm0u+zxZhYoeuQldCkY3f0AE/HjQrA0oLxtOuFD/gGy Mg9jK0WxTR0T35wh8ITqI9+fEY6fSYrvkp27WRLh1RDQQDFJggQppDsWtvqhr0/zgHG4 TsI9gC6qlOiepJZ71TmO38F2otakmpUmkv2l/l7ZOLzcql1Iqv0yq2aIljexW5vnPEK5 HtiA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=WOHJFOTaWNvPjeCKxz00WkPWpr/WhsAOHIxBMPbu4rk=; b=X/oRnEJzwrkEtre/FGgHEAb+4SjROfNiVsW0u2GmWujtqeJbqOFEkOotxWZDyEKMPF jdw9GEHLDwuIaKk/7bWyaePZS+Ew+2H8gmsrHwNxUdFdEuI+84iZ0w6bzPesNdAPsSQN fHGsSud2o7fs2TPGkr/I9/S6Dd5Mq75sG5Xg+DxbgKXe0djTn9MBGm/Ha5cipldNyOz6 0Yqjjkk7V0qvq6mMnzaNRvRaCX4SHsl0yybHiZ3GzFDu6gUKpU4RfIPty9PWOa7GwZUm ov8NljMQLl0PuPD44NG86wRsTs0bW2/QnK/fRZ0qH1MfTjdKBUzzO3BlnJMlPrU+fuGl g/sQ== X-Gm-Message-State: AOUpUlH0/1bRsQVQ1pEGif1PIFOx4MluRC/P7BevDyriRqP3bqdQZurx nXSgdGRNuiFM85R0X5DvdIcBwA== X-Google-Smtp-Source: AA+uWPx2IlHUxhVu/EskF9mxwd/N0O8RPewr+KnexOB7dFvXUnppLSnqq6vyL9dqJAEhsfsGWddYeA== X-Received: by 2002:adf:91e5:: with SMTP id 92-v6mr6775529wri.124.1533998320451; Sat, 11 Aug 2018 07:38:40 -0700 (PDT) Received: from mutt-hbsd ([185.220.102.8]) by smtp.gmail.com with ESMTPSA id w14-v6sm5448690wme.6.2018.08.11.07.38.38 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 11 Aug 2018 07:38:39 -0700 (PDT) Date: Sat, 11 Aug 2018 10:37:49 -0400 From: Shawn Webb To: Victor Sudakov Cc: The Doctor , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811143749.wmaxbenuaazmjpln@mutt-hbsd> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> <20180811134847.2afg4ukgmpink76h@mutt-hbsd> <20180811143448.GA66876@admin.sibptus.transneft.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="heewab4fuh5o5ttf" Content-Disposition: inline In-Reply-To: <20180811143448.GA66876@admin.sibptus.transneft.ru> X-Operating-System: FreeBSD mutt-hbsd 12.0-CURRENT FreeBSD 12.0-CURRENT X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: NeoMutt/20180622 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 14:38:42 -0000 --heewab4fuh5o5ttf Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Aug 11, 2018 at 09:34:48PM +0700, Victor Sudakov wrote: > Shawn Webb wrote: > > On Sat, Aug 11, 2018 at 12:53:05PM +0700, Victor Sudakov wrote: > > > The Doctor via freebsd-virtualization wrote: > > > > Are there issues with Current CEntos and bhyve? > > >=20 > > > Sure there are, please look at > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230453 > >=20 > > Booting in UEFI mode works. >=20 > This means we need an update to /usr/local/share/examples/vm-bhyve/centos= 7.conf ? > It says 'loader=3D"grub"' for the present. >=20 > Do you have a vm config to boot centos7 in UEFI mode you could share? I just use /usr/share/examples/bhyve/vmrun.sh. I don't use any third-party utility to manage bhyve VMs. vmrun.sh is pretty straight-forward. Thanks, --=20 Shawn Webb Cofounder and Security Engineer HardenedBSD Tor-ified Signal: +1 443-546-8752 Tor+XMPP+OTR: lattera@is.a.hacker.sx GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --heewab4fuh5o5ttf Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEKrq2ve9q9Ia+iT2eaoRlj1JFbu4FAltu9LgACgkQaoRlj1JF bu5U5xAArbfTB67Wa9e6vZQTsYHfpf4MgpdtEMNlbvq/CecP5OxpkVWUC55dUHvz LC4rHLBySfDjasLkg5r4FLEbowWUxeujDPidMBVWzojOa3w2HcEHDGhCl8ovV6h8 EmnQ/orsCBezROqTpPbiMoZc3O7OCrRvB49pDtsIVuc/1ug1CEwpnbvxF7EG21rQ 08458trxLKnRyHo44BH5xrcGxaxJzwBNSMetjZrSYJjGfcFLG/ZdYj7VkY/HAJV8 NNSU0UxC1O0X4n0rkwdt66WBnNKYiCIGPXVVL83slKh5uWFJ3niqNiQLOvMia8SM Ud8zGiDyc6FDBWCC7FNjlnEdzPCnrNaMsx+QsnhuRJzolJM+xL9z8lHywo7bWHVo p1phSXzkOmEHOOOveJ1rkK6xLYUBNn5ORBl3VaCG53iS3SHKZdQr3I1GYANH2mbI QjvYfoiqe68BCw/epHX+wV0Nnm8rXNGom+NQFsQALk9JXQ3oBOWlaNhFUvcpLJxE 0+JlliBj3eDz6wsbC2vOAb7vGjCif64ktL8Xd+SQoMNZhxLOXOSpUrqQ/VEK/eE4 kBJQzyd48Tr0emy21XRpQyfs/hkAECRVoS4h0cfz456YhwPkLkhtoFE0+TJagrnU vk8WaaxlnGZA5KH4A+n8BhmFmDXh7swpuKLtVEr7dANSnVvN66c= =0r6b -----END PGP SIGNATURE----- --heewab4fuh5o5ttf-- From owner-freebsd-virtualization@freebsd.org Sat Aug 11 15:02:35 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 293E9106FC36 for ; Sat, 11 Aug 2018 15:02:35 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id 7916D82D25 for ; Sat, 11 Aug 2018 15:02:34 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40075419; Sat, 11 Aug 2018 22:02:33 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7BF2WjN067170; Sat, 11 Aug 2018 22:02:32 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7BF2SXQ067169; Sat, 11 Aug 2018 22:02:28 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Sat, 11 Aug 2018 22:02:27 +0700 From: Victor Sudakov To: Shawn Webb Cc: The Doctor , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811150227.GB66961@admin.sibptus.transneft.ru> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> <20180811134847.2afg4ukgmpink76h@mutt-hbsd> <20180811143448.GA66876@admin.sibptus.transneft.ru> <20180811143749.wmaxbenuaazmjpln@mutt-hbsd> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180811143749.wmaxbenuaazmjpln@mutt-hbsd> Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 15:02:35 -0000 Shawn Webb wrote: > > > > > Are there issues with Current CEntos and bhyve? > > > > > > > > Sure there are, please look at > > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > > > > > Booting in UEFI mode works. > > > > This means we need an update to /usr/local/share/examples/vm-bhyve/centos7.conf ? > > It says 'loader="grub"' for the present. > > > > Do you have a vm config to boot centos7 in UEFI mode you could share? > > I just use /usr/share/examples/bhyve/vmrun.sh. I don't use any > third-party utility to manage bhyve VMs. vmrun.sh is pretty > straight-forward. Thanks for replying. However, I highly recommend vm-bhyve, maybe you should give it a try. You will love the ease of VM creation and provisioning, network management, ZFS integration (VM snapshots and cloning), console and datastore management etc. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Sat Aug 11 15:04:01 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8EB9F106FC9F for ; Sat, 11 Aug 2018 15:04:01 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 073D182DDB for ; Sat, 11 Aug 2018 15:04:01 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-wm0-x232.google.com with SMTP id q8-v6so4640447wmq.4 for ; Sat, 11 Aug 2018 08:04:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=K4zFsmDG6IO9CZH8h4gA60zj2+3T+kkdnDYYKxlDu9Q=; b=Ygq/nd6M55Mlt44jN6q14Fbf/oTSaCC4sRpSUDfaIRvFXg/sxm1kI87N5VpUhdoVZm PbWyzfOrTvF/I7vkAjPCneRb4DQ86LsuYiEVGCCDpOv+XF9M43QFiMDQ5kclANqQvzZI EUtFBCMkVk0YLHM+pu40rMOkRog6umzsbpUijQ1GqKPflTwCzqdDngBI+9D9SzuClq1b 0l1vf4Q5dgbXr7pZD3BCaH12UnrxvRmYVNxBrSxGr4Xh28pH/692WLhDCcejTBPWqjYn xSiqU9jQ4xHm4UCCqsR3A/NVtoIsY/cyEM8D3wtl+TnKrmMNx3SrojOrkxq8KDmu06UZ C+rQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=K4zFsmDG6IO9CZH8h4gA60zj2+3T+kkdnDYYKxlDu9Q=; b=VjTP0eB3Jo9Iy+wKgm6d+ziPZft6sXfyry7LLShU8/hTZYpVGU7cIXdDGLSnmsId3v t+kYqt/nIsNSPXVLN1digdh4yfVkBvVQto06w754N2YNJw/k9qb0PAyBOXw0mBDqo9Yd /GJRGoqKsyQS4XgJtVPgrd0T3zjAlkhilhLmC2C4BUsW2EKJ4WfSc3bZpZnO8CSl9Tj0 UrM6zBuVnri43xzEmsUMECxkhAjA2KR3SHPTelC0jRy5ZznmBvvS5bLAqOK8MrIHad4l PuCzpJNMKAnO/nvMeSjtnZX2sPlpbek1fpgbkPPCBozN1p/A8M/75HYH4NiXz7jm9Btn SATw== X-Gm-Message-State: AOUpUlHgeoB//srDNr0z46diCMLS586i2a9uh/4HujKPT5txLVl5Cqiv /o6hvj1Fj183FN6J6HKBtgy4Ug== X-Google-Smtp-Source: AA+uWPzScuBpDHf5I2ka2ZxoxjgGbcgmFcbHnUoyLoCnfs7LSnVv5zzgPFrnKEKrQ0EIQH5ayXJfNQ== X-Received: by 2002:a1c:ea9b:: with SMTP id g27-v6mr3812178wmi.152.1533999839873; Sat, 11 Aug 2018 08:03:59 -0700 (PDT) Received: from mutt-hbsd (lumumba.torservers.net. [77.247.181.163]) by smtp.gmail.com with ESMTPSA id h82-v6sm5494913wme.11.2018.08.11.08.03.57 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 11 Aug 2018 08:03:59 -0700 (PDT) Date: Sat, 11 Aug 2018 11:03:07 -0400 From: Shawn Webb To: Victor Sudakov Cc: The Doctor , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811150307.res2o7q4xousd3bh@mutt-hbsd> References: <20180810234632.GA30646@doctor.nl2k.ab.ca> <20180811055305.GA63605@admin.sibptus.transneft.ru> <20180811134847.2afg4ukgmpink76h@mutt-hbsd> <20180811143448.GA66876@admin.sibptus.transneft.ru> <20180811143749.wmaxbenuaazmjpln@mutt-hbsd> <20180811150227.GB66961@admin.sibptus.transneft.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="myk5v6yaswi5zl3b" Content-Disposition: inline In-Reply-To: <20180811150227.GB66961@admin.sibptus.transneft.ru> X-Operating-System: FreeBSD mutt-hbsd 12.0-CURRENT FreeBSD 12.0-CURRENT X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: NeoMutt/20180622 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 15:04:01 -0000 --myk5v6yaswi5zl3b Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Aug 11, 2018 at 10:02:27PM +0700, Victor Sudakov wrote: > Shawn Webb wrote: > > > > > > Are there issues with Current CEntos and bhyve? > > > > >=20 > > > > > Sure there are, please look at > > > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230453 > > > >=20 > > > > Booting in UEFI mode works. > > >=20 > > > This means we need an update to /usr/local/share/examples/vm-bhyve/ce= ntos7.conf ? > > > It says 'loader=3D"grub"' for the present. > > >=20 > > > Do you have a vm config to boot centos7 in UEFI mode you could share? > >=20 > > I just use /usr/share/examples/bhyve/vmrun.sh. I don't use any > > third-party utility to manage bhyve VMs. vmrun.sh is pretty > > straight-forward. >=20 > Thanks for replying. However, I highly recommend vm-bhyve, maybe you > should give it a try. You will love the ease of VM creation and > provisioning, network management, ZFS integration (VM snapshots and > cloning), console and datastore management etc. I'm aware of it. I'll pass, but thanks for the tip! --=20 Shawn Webb Cofounder and Security Engineer HardenedBSD Tor-ified Signal: +1 443-546-8752 Tor+XMPP+OTR: lattera@is.a.hacker.sx GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --myk5v6yaswi5zl3b Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEKrq2ve9q9Ia+iT2eaoRlj1JFbu4FAltu+qcACgkQaoRlj1JF bu796w/8CQtBlxt9UEJEr/Le7ybCFy8AfdvYpP9ZNzLOUZ8RfXr24naMt4dWVY1Z ip09ZRlvyiHsic2vReAnEbL2cAam0Pa0cAvQsVJN3AOEEoSii8AmPa9KubQo/Jca CwX3qW1CkGp5DrebiafLAdf6uee5otBOjbVvqHr0ClRfPIURimxEBFkkgnPcfpQ5 PEM/2zCWtIab5xAQ8CBdS3eR4fZ5kTC+xyoPJd+8xSzYPcCnDpHvSzg10sSVLjJP T0O2UIz4m36gSxzbEGWg69sEHYUyUYOuqP8Dfk2H2j0j2Iwh7tWwKxHyp5Zah9GV a6GfAVoKSVA3xl+VS7mIohFCnjyUrA7Mpi3FPPp01RFcC7gSBOGZPVSu9qAKgx0x RvmOGjc9ZL4NCx/hfmx9cjpuqVUcds0cI3e2HtfzipYP+GRzBKRt45G0UQZS8hst nag8dQHQd2/kCa1kXMkkBNEs92QAg4Yo6htZ8DQQEPJwQHQkLu39ZtCAV+OYSFx2 w6PdUarYm6HlS5MQJ01BybVxmB4tkgTObacbt/Z+KAYVEJ5WOXbGFskA6kAU9erg mLTpgcP0A6LoFmhEEDG4b1UGAFQHCPJn1mi/gRYscZeCT1iylLTi9hgPU0ao78/n O/R8SZ5TRW4O0mAvdar9is4/t79RBBFqb4EO7Bbom+tGFQSiK6s= =5I7c -----END PGP SIGNATURE----- --myk5v6yaswi5zl3b-- From owner-freebsd-virtualization@freebsd.org Sat Aug 11 15:09:11 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5481106FE73 for ; Sat, 11 Aug 2018 15:09:11 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4466082F7E for ; Sat, 11 Aug 2018 15:09:11 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w7BF99kx028179; Sat, 11 Aug 2018 08:09:09 -0700 (PDT) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w7BF99Ei028178; Sat, 11 Aug 2018 08:09:09 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201808111509.w7BF99Ei028178@pdx.rh.CN85.dnsmgr.net> Subject: Re: Curent Centos 7 and bhyve In-Reply-To: <20180811150227.GB66961@admin.sibptus.transneft.ru> To: Victor Sudakov Date: Sat, 11 Aug 2018 08:09:09 -0700 (PDT) CC: Shawn Webb , freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 15:09:11 -0000 > Shawn Webb wrote: > > > > > > Are there issues with Current CEntos and bhyve? > > > > > > > > > > Sure there are, please look at > > > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > > > > > > > Booting in UEFI mode works. > > > > > > This means we need an update to /usr/local/share/examples/vm-bhyve/centos7.conf ? > > > It says 'loader="grub"' for the present. > > > > > > Do you have a vm config to boot centos7 in UEFI mode you could share? > > > > I just use /usr/share/examples/bhyve/vmrun.sh. I don't use any > > third-party utility to manage bhyve VMs. vmrun.sh is pretty > > straight-forward. > > Thanks for replying. However, I highly recommend vm-bhyve, maybe you > should give it a try. You will love the ease of VM creation and > provisioning, network management, ZFS integration (VM snapshots and > cloning), console and datastore management etc. Though it has a lot of features, it also has some short comings, like you can not spec a vm to be wired in memory, which IMHO is the only way to insure consistent VM performance. Its artificial restriction of 16 character VM names is also a fair bit annoying. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Sat Aug 11 16:22:22 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 79556107204B for ; Sat, 11 Aug 2018 16:22:22 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from relay2.tomsk.ru (mail.sibptus.tomsk.ru [212.73.124.5]) by mx1.freebsd.org (Postfix) with ESMTP id CE00685B9D for ; Sat, 11 Aug 2018 16:22:21 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) X-Virus-Scanned: by clamd daemon 0.100.1 for FreeBSD at relay.sibptus.ru Received: from [212.73.125.240] (HELO admin.sibptus.transneft.ru) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.16) with ESMTPS id 40075457; Sat, 11 Aug 2018 23:22:20 +0700 Received: from admin.sibptus.transneft.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.transneft.ru (8.15.2/8.15.2) with ESMTP id w7BGMJEg067693; Sat, 11 Aug 2018 23:22:20 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) Received: (from sudakov@localhost) by admin.sibptus.transneft.ru (8.15.2/8.15.2/Submit) id w7BGMEbO067692; Sat, 11 Aug 2018 23:22:14 +0700 (+07) (envelope-from vas@mpeks.tomsk.su) X-Authentication-Warning: admin.sibptus.transneft.ru: sudakov set sender to vas@mpeks.tomsk.su using -f Date: Sat, 11 Aug 2018 23:22:14 +0700 From: Victor Sudakov To: "Rodney W. Grimes" Cc: Shawn Webb , freebsd-virtualization@freebsd.org Subject: Re: Curent Centos 7 and bhyve Message-ID: <20180811162214.GA67623@admin.sibptus.transneft.ru> References: <20180811150227.GB66961@admin.sibptus.transneft.ru> <201808111509.w7BF99Ei028178@pdx.rh.CN85.dnsmgr.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201808111509.w7BF99Ei028178@pdx.rh.CN85.dnsmgr.net> Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 16:22:22 -0000 Rodney W. Grimes wrote: > > > > > > > Are there issues with Current CEntos and bhyve? > > > > > > > > > > > > Sure there are, please look at > > > > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > > > > > > > > > Booting in UEFI mode works. > > > > > > > > This means we need an update to /usr/local/share/examples/vm-bhyve/centos7.conf ? > > > > It says 'loader="grub"' for the present. > > > > > > > > Do you have a vm config to boot centos7 in UEFI mode you could share? > > > > > > I just use /usr/share/examples/bhyve/vmrun.sh. I don't use any > > > third-party utility to manage bhyve VMs. vmrun.sh is pretty > > > straight-forward. > > > > Thanks for replying. However, I highly recommend vm-bhyve, maybe you > > should give it a try. You will love the ease of VM creation and > > provisioning, network management, ZFS integration (VM snapshots and > > cloning), console and datastore management etc. > > Though it has a lot of features, it also has some short comings, > like you can not spec a vm to be wired in memory, which IMHO is > the only way to insure consistent VM performance. Well, we have "bhyve_options" configuration option in the vm config, why not put "-S" there, is that what you mean by wiring the vm in memory? > > Its artificial restriction of 16 character VM names is also > a fair bit annoying. Maybe. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN AS43859 From owner-freebsd-virtualization@freebsd.org Sat Aug 11 16:34:03 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D56781072DCA for ; Sat, 11 Aug 2018 16:34:03 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5EB4D872D3 for ; Sat, 11 Aug 2018 16:34:03 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id w7BGY1nm028599; Sat, 11 Aug 2018 09:34:01 -0700 (PDT) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id w7BGY1J3028598; Sat, 11 Aug 2018 09:34:01 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201808111634.w7BGY1J3028598@pdx.rh.CN85.dnsmgr.net> Subject: Re: Curent Centos 7 and bhyve In-Reply-To: <20180811162214.GA67623@admin.sibptus.transneft.ru> To: Victor Sudakov Date: Sat, 11 Aug 2018 09:34:01 -0700 (PDT) CC: Shawn Webb , freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2018 16:34:04 -0000 > Rodney W. Grimes wrote: > > > > > > > > Are there issues with Current CEntos and bhyve? > > > > > > > > > > > > > > Sure there are, please look at > > > > > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230453 > > > > > > > > > > > > Booting in UEFI mode works. > > > > > > > > > > This means we need an update to /usr/local/share/examples/vm-bhyve/centos7.conf ? > > > > > It says 'loader="grub"' for the present. > > > > > > > > > > Do you have a vm config to boot centos7 in UEFI mode you could share? > > > > > > > > I just use /usr/share/examples/bhyve/vmrun.sh. I don't use any > > > > third-party utility to manage bhyve VMs. vmrun.sh is pretty > > > > straight-forward. > > > > > > Thanks for replying. However, I highly recommend vm-bhyve, maybe you > > > should give it a try. You will love the ease of VM creation and > > > provisioning, network management, ZFS integration (VM snapshots and > > > cloning), console and datastore management etc. > > > > Though it has a lot of features, it also has some short comings, > > like you can not spec a vm to be wired in memory, which IMHO is > > the only way to insure consistent VM performance. > > Well, we have "bhyve_options" configuration option in the vm config, > why not put "-S" there, is that what you mean by wiring the vm in > memory? I believe that fails as that only adds the -S to bhyve, and you must specify it both on bhyveload and bhyve for it to work. > > > > Its artificial restriction of 16 character VM names is also > > a fair bit annoying. > > Maybe. Maybe? No, factually. I migrated a number of ESXi VM's and had to patch vm-bhyve to not have this restriction, so it is annoying. -- Rod Grimes rgrimes@freebsd.org