From owner-freebsd-virtualization@freebsd.org Sun Feb 24 10:09:44 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 286A215198F4 for ; Sun, 24 Feb 2019 10:09:44 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7BAD28E1C3 for ; Sun, 24 Feb 2019 10:09:43 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: by mailman.ysv.freebsd.org (Postfix) id 3A23C15198F1; Sun, 24 Feb 2019 10:09:43 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 15D8915198EF for ; Sun, 24 Feb 2019 10:09:43 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D1A4D8E1C0 for ; Sun, 24 Feb 2019 10:09:41 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=Z7nKJ1emJmwREFTaWykUQirPkCDo88hnPnreoQMB/D4=; b=muiBa8cFBOnaMj0+wwdLQE16Qx 12NWho0NW+tu+vzsPWQR7siUn6C3feWcypZT91PX1qSdsV9gU6WZFFpLgETWeAPYsS7RIckacuEZD Hc+ksf11V/4TYqlqxiSWeWeEUHZB3MigzlgH/OYn28Ez15IvzOOpKylzxlVaGBt+z6BA=; Received: from vas by admin.sibptus.ru with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1gxqj5-000E45-Bl for virtualization@freebsd.org; Sun, 24 Feb 2019 17:09:39 +0700 Date: Sun, 24 Feb 2019 17:09:39 +0700 From: Victor Sudakov To: "freebsd-virtualization@freebsd.org" Subject: Re: NVMe and Bhyve Message-ID: <20190224100939.GA52753@admin.sibptus.ru> References: <20190212130506.GA62989@admin.sibptus.ru> <20190215044134.GA52633@admin.sibptus.ru> <20190216041134.GA75357@admin.sibptus.ru> <20190217155811.GA99389@admin.sibptus.ru> <20190218010901.GA8125@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="fdj2RfSjLxBAspz7" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.11.2 (2019-01-07) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 10:09:44 -0000 --fdj2RfSjLxBAspz7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Jason Tubnor wrote: >=20 > > > > Well, disk0 will be the guest HDD to install to, disk1 will be the ISO = with > > drivers, and which disk will be the ISO attached by the "vm install" > > command? > > > > > From a user perspective, this is not of any value to know. vm-bhyve > manages that in the background and usually puts the regular disk0 as -s 4= :0 > regardless of normal boot or install and when the installer is invoked, > puts the installer iso in as -s 3:0 Oh, if vm-bhyve manages that the installer ISO is always attached before other ancillary ISOs, that's fine with me. >=20 > So based on previous examples, you'd see something like this in the log: > -s 3:0,ahci-cd,/vm/.iso/myinstaliso.iso -s > 4:0,ahci-hd,/dev/zvol/mypool/vm/myserver/disk0 -s > 5:0,ahci-cd,/vm/myserver/virtio-win-0.1.164.iso I see. I have tried this and it works as you describe, which is good news. However, there is bad news too. I've tried to install Windows 10 and Windows Server 2012R2 onto the virtio-blk device, but... The guest installer says that there are no disks to install to and no drivers, and suggests a driver to be loaded. It can be told to find the appropriate driver in my virtio-win-0.1.141.iso CD: http://admin.sibptus.ru/~vas/bhyve1.png but when it begins loading the viostor driver, the VM crashes with "bhyve exited with status 134" Therefore I ask again if someone has an actual success story of running a Windows guest on a virtio-blk device. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --fdj2RfSjLxBAspz7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJccm1jAAoJEA2k8lmbXsY02MIIAJk5Q7SxDlG7905+M5ZY3WeB cZYOnUVr9vhaJ9iCq5x9FviSGNMolZtk3V3wcYlxvUzUHhtgHvGWNimOcsUgXcDC 7z3eaeJD6J0zWz0/+BfeclcFO4qFb0LsXn9qVXac6/2qeFAc+Qb972unhE29bfeL qnSNWlwC8uCa/S+YVqpPJEmyeLTGUqsLKotjYL1BxeGjTGtOBc1GWSeh1sg+gwYt JhWlWf+9sdU7DjgCNAfME28U5kKWhBR+xTRABUvek4wWm4rlpCEYaFk18StLS5yY tiYeGzOXBplsz2GzIrT7TV9mQA5Q+aJOBL/Ixp/UEpbsuNdFkEZCc84Cf8PGXJ8= =A4/2 -----END PGP SIGNATURE----- --fdj2RfSjLxBAspz7-- From owner-freebsd-virtualization@freebsd.org Sun Feb 24 14:52:31 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 476B6150043F for ; Sun, 24 Feb 2019 14:52:31 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3CC70700E0 for ; Sun, 24 Feb 2019 14:52:27 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=bV0vBmOqyBzKbJ3qmguWhTBPp/a9th7kiROEGI38BYw=; b=j76sJPUY/mq70QF5KzPj12LJ0Q BCWSTtfXQy4iS8fN/5xk8oeKauvPTjr8XLCQVehNcCRrJ5oCisSJ1GslE2WbK7F3sjnN3Qxyo7Cyl j1aJLfpOsRsMVBOzscmEXa3//sAYvXlJ8n1ZE7fREctt3i8osRq+pAgtyfoaa58veQPw=; Received: from vas by admin.sibptus.ru with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1gxv8k-000Jpm-1H for freebsd-virtualization@freebsd.org; Sun, 24 Feb 2019 21:52:26 +0700 Date: Sun, 24 Feb 2019 21:52:26 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: Re: NVMe and Bhyve Message-ID: <20190224145226.GA76175@admin.sibptus.ru> References: <20190212130506.GA62989@admin.sibptus.ru> <20190215044134.GA52633@admin.sibptus.ru> <20190216041134.GA75357@admin.sibptus.ru> <20190217155811.GA99389@admin.sibptus.ru> <20190218010901.GA8125@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 14:52:31 -0000 Jason Tubnor wrote: > > > > > Well, disk0 will be the guest HDD to install to, disk1 will be the ISO with > > drivers, and which disk will be the ISO attached by the "vm install" > > command? > > > > > From a user perspective, this is not of any value to know. vm-bhyve > manages that in the background and usually puts the regular disk0 as -s 4:0 > regardless of normal boot or install and when the installer is invoked, > puts the installer iso in as -s 3:0 Oh, if vm-bhyve manages that the installer ISO is always attached before other ancillary ISOs, that's fine with me. > > So based on previous examples, you'd see something like this in the log: > -s 3:0,ahci-cd,/vm/.iso/myinstaliso.iso -s > 4:0,ahci-hd,/dev/zvol/mypool/vm/myserver/disk0 -s > 5:0,ahci-cd,/vm/myserver/virtio-win-0.1.164.iso I see. I have tried this and it works as you describe, which is good news. However, there is bad news too. I've tried to install Windows 10 and Windows Server 2012R2 onto the virtio-blk device, but... The guest installer says that there are no disks to install to and no drivers, and suggests a driver to be loaded. It can be told to find the appropriate driver in my virtio-win-0.1.141.iso CD: http://admin.sibptus.ru/~vas/bhyve1.png but when it begins loading the viostor driver, the VM crashes with "bhyve exited with status 134" Therefore I ask again if someone has an actual success story of running a Windows guest on a virtio-blk device. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Sun Feb 24 23:37:56 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23F251511B00 for ; Sun, 24 Feb 2019 23:37:56 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B960C8E420 for ; Sun, 24 Feb 2019 23:37:55 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 9474321F0A for ; Sun, 24 Feb 2019 18:37:54 -0500 (EST) Received: from imap6 ([10.202.2.56]) by compute7.internal (MEProxy); Sun, 24 Feb 2019 18:37:54 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=skunkwerks.at; h=message-id:in-reply-to:references:date:from:to:subject :content-type; s=fm1; bh=y2bR0yLemhgfwC+u2ixSBWbrWtsacpMCF2Xf2+L JgOM=; b=ChHrnAc6kbvcza4XsLBg5Tvl4Xs8qSf2wPnWH+xf7lXJDbgKa9FvapB Y5O4aAowmL00k02LHVqzPo5DIjAF06+MZrWadz4887BVazKAfTiGYKsp/IbNX19L fFv+xzdLpn+l0xjzHMYVoInhxSQIak0B9twxJfPtjA+4KDFiIyQG+kj94Lo4Qyp3 8a+7yqhqi51x+MWbTXeqvgCqXqWysE0diF36JcOTYJngK4REusOkdkKWhevwtw1L wMghVZ0Gp6XKyTeGfRfk9eQeG4FF2wlubTKmZcZE6cwkcqIERCb3aj4rZViOKgx+ 7oZ43f/nUw3+Tv7TW8BfVetjTBsk0zA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:references:subject:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=y2bR0yLemhgfwC+u2 ixSBWbrWtsacpMCF2Xf2+LJgOM=; b=q9k3UlrijdH7ABlOTTU9IRSKj5MayDVa8 OBqVJApR9oOXmoufjfqScvAaOCPSjB4z6vBtcGoVB1RG6t64yRgFAr9ZgZdvhPc7 v6CVda19OLNXWPE6ExMNobRrJrZz0xFDSWVmsB5KW2JF8F2/l8TQm4imldZa3yls 89BYJQakxyOghH7BGFH0msM+oTzmbZPn0Bo0Z8YcHwoQey6medC49MUyXuuwGvz4 3VjhDY/NDJ/dpv/IMbBXPE31s8OfFzh3OAqDv7wAE8s5+XPZv+9qC2x6aqlMPVlv GmStViD4RxhCKcvii4JofyuVccXgRlLK0qpTn8McKDFzL7uBVgKnQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedutddrudehgddtleculddtuddrgedtledrtddtmd cutefuodetggdotefrodftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfhuthen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgfkjghffffhvffutgesrgdtre erreerjeenucfhrhhomhepfdffrghvvgcuvehothhtlhgvhhhusggvrhdfuceouggthhes shhkuhhnkhifvghrkhhsrdgrtheqnecuffhomhgrihhnpehhrggtkhhmugdrihhopdhsih gsphhtuhhsrdhruhenucfrrghrrghmpehmrghilhhfrhhomhepuggthhesshhkuhhnkhif vghrkhhsrdgrthenucevlhhushhtvghrufhiiigvpedt X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id A4D8082678; Sun, 24 Feb 2019 18:37:53 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.1.5-895-g0d23ba6-fmstable-20190213v1 X-Me-Personality: 20903217 Message-Id: In-Reply-To: <20190224145226.GA76175@admin.sibptus.ru> References: <20190212130506.GA62989@admin.sibptus.ru> <20190215044134.GA52633@admin.sibptus.ru> <20190216041134.GA75357@admin.sibptus.ru> <20190217155811.GA99389@admin.sibptus.ru> <20190218010901.GA8125@admin.sibptus.ru> <20190224145226.GA76175@admin.sibptus.ru> Date: Sun, 24 Feb 2019 18:37:53 -0500 From: "Dave Cottlehuber" To: freebsd-virtualization@freebsd.org Subject: Re: NVMe and Bhyve X-Rspamd-Queue-Id: B960C8E420 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.996,0] Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2019 23:37:56 -0000 On Sun, 24 Feb 2019, at 21:43, Victor Sudakov wrote: > The guest installer says that there are no disks to install to and no > drivers, and suggests a driver to be loaded. It can be told to find th= e > appropriate driver in my virtio-win-0.1.141.iso CD: >=20 > http://admin.sibptus.ru/~vas/bhyve1.png >=20 > but when it begins loading the viostor driver, the VM crashes with > "bhyve exited with status 134" >=20 > Therefore I ask again if someone has an actual success story of runnin= g > a Windows guest on a virtio-blk device. Hi Viktor Looking through my notes I'm not using virtio-blk I think, but I had no = issues with the specific driver version linked to below https://hackmd.i= o/s/rJvJuE-CW# albeit with win7 Hope that=E2=80=99s helpful. Dave From owner-freebsd-virtualization@freebsd.org Tue Feb 26 03:09:30 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5027D150480A for ; Tue, 26 Feb 2019 03:09:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D8E2193CD1 for ; Tue, 26 Feb 2019 03:09:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 9A4E71504804; Tue, 26 Feb 2019 03:09:29 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8734B1504803 for ; Tue, 26 Feb 2019 03:09:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1DBB993CCB for ; Tue, 26 Feb 2019 03:09:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6491217DA7 for ; Tue, 26 Feb 2019 03:09:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x1Q39S4L087020 for ; Tue, 26 Feb 2019 03:09:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x1Q39SIF087012 for virtualization@FreeBSD.org; Tue, 26 Feb 2019 03:09:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236042] Windows Server 2016 Hyper-V snapshot triggers SCSI errors Date: Tue, 26 Feb 2019 03:09:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 03:09:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236042 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |virtualization@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 26 14:40:59 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C4D6A151B597 for ; Tue, 26 Feb 2019 14:40:59 +0000 (UTC) (envelope-from joneum@FreeBSD.org) Received: from toco-domains.de (mail.toco-domains.de [IPv6:2a01:4f8:150:50a5::6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 39F8088323; Tue, 26 Feb 2019 14:40:59 +0000 (UTC) (envelope-from joneum@FreeBSD.org) Received: from phantomias.home.jochen-neumeister.de (p5B0FDBB5.dip0.t-ipconnect.de [91.15.219.181]) by toco-domains.de (Postfix) with ESMTPA id 120FE135136B; Tue, 26 Feb 2019 15:40:56 +0100 (CET) To: freebsd-virtualization@freebsd.org, decke@FreeBSD.org From: Jochen Neumeister Subject: sysutils/docker-freebsd: Searching for people to help Message-ID: <9dccf99d-1a29-b7ed-6a32-fe5e8a0ca9de@FreeBSD.org> Date: Tue, 26 Feb 2019 15:40:55 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: de-DE X-Rspamd-Queue-Id: 39F8088323 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.97 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; NEURAL_HAM_SHORT(-0.97)[-0.969,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 14:40:59 -0000 Hello everybody. Currently @decke and I are working on the update of the port. We try to change it completely to moby, and then of course, that the port is working properly. For this we are still looking for people who want to work on this very large update, or later can test the work. If you want, you can get it on Freenode on IRC #freebsd-docker. We try to coordinate it there. Cheers Jochen From owner-freebsd-virtualization@freebsd.org Tue Feb 26 15:05:37 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7147A151C0FA for ; Tue, 26 Feb 2019 15:05:37 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [140.82.23.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D91618968D; Tue, 26 Feb 2019 15:05:35 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.102] (cpe-23-243-162-239.socal.res.rr.com [23.243.162.239]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 1faec66f TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; Tue, 26 Feb 2019 06:58:53 -0800 (PST) Date: Tue, 26 Feb 2019 06:57:23 -0800 Subject: Re: sysutils/docker-freebsd: Searching for people to help Message-ID: <02fecac8-5267-4681-9050-53a031062c3a@email.android.com> X-Android-Message-ID: <02fecac8-5267-4681-9050-53a031062c3a@email.android.com> In-Reply-To: <9dccf99d-1a29-b7ed-6a32-fe5e8a0ca9de@FreeBSD.org> From: Pete Wright To: Jochen Neumeister Cc: freebsd-virtualization@freebsd.org, decke@FreeBSD.org Importance: Normal X-Priority: 3 X-MSMail-Priority: Normal X-Rspamd-Queue-Id: D91618968D X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 140.82.23.70 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-3.26 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_SOME(0.00)[]; DMARC_NA(0.00)[nomadlogic.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-2.48)[ip: (-8.72), ipnet: 140.82.16.0/21(-4.36), asn: 20473(0.74), country: US(-0.07)]; MX_GOOD(-0.01)[mail.nomadlogic.org]; MIME_BASE64_TEXT(0.10)[]; HAS_X_PRIO_THREE(0.00)[3]; NEURAL_HAM_SHORT(-0.86)[-0.865,0]; MIME_HTML_ONLY(0.20)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MISSING_MIMEOLE(2.00)[]; ASN(0.00)[asn:20473, ipnet:140.82.16.0/21, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 15:05:37 -0000 From owner-freebsd-virtualization@freebsd.org Tue Feb 26 16:14:28 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1E8BF151E005 for ; Tue, 26 Feb 2019 16:14:28 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3996C8C346 for ; Tue, 26 Feb 2019 16:14:26 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=BGkoEDeJ9xqwKDFgm6OUIXwirdaMQI7wYa9RDsEToQU=; b=Zq372zqsMjsich5Fqb+kv2CJAu UtLNKrkDJPNDTocHNZ8txcboheIMVXAg+wxDiK1WW1uUUhNAf51TVlDZQTXPtrngTTwPBgD9tLT8F 2IfNWICgLJNpwh/glRtTCqRGl4GT6OPPR0PwJUe76Pcof7V3JNqj8UAqQJquN38xbZ+M=; Received: from vas by admin.sibptus.ru with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1gyfNB-000CIy-Bs for freebsd-virtualization@freebsd.org; Tue, 26 Feb 2019 23:14:25 +0700 Date: Tue, 26 Feb 2019 23:14:25 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: Re: NVMe and Bhyve Message-ID: <20190226161425.GA44771@admin.sibptus.ru> References: <20190215044134.GA52633@admin.sibptus.ru> <20190216041134.GA75357@admin.sibptus.ru> <20190217155811.GA99389@admin.sibptus.ru> <20190218010901.GA8125@admin.sibptus.ru> <20190224145226.GA76175@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="lrZ03NoBR/3+SXJZ" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.11.2 (2019-01-07) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 16:14:28 -0000 --lrZ03NoBR/3+SXJZ Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Dave Cottlehuber wrote: > On Sun, 24 Feb 2019, at 21:43, Victor Sudakov wrote: > > The guest installer says that there are no disks to install to and no > > drivers, and suggests a driver to be loaded. It can be told to find the > > appropriate driver in my virtio-win-0.1.141.iso CD: > >=20 > > http://admin.sibptus.ru/~vas/bhyve1.png > >=20 > > but when it begins loading the viostor driver, the VM crashes with > > "bhyve exited with status 134" > >=20 > > Therefore I ask again if someone has an actual success story of running > > a Windows guest on a virtio-blk device. >=20 > Hi Viktor >=20 > Looking through my notes I'm not using virtio-blk I think, but I had > no issues with the specific driver version linked to below > https://hackmd.io/s/rJvJuE-CW# albeit with win7 Hope that=E2=80=99s helpf= ul. Not so much unfortunately. I've tried virtio-win-0.1.96.iso from your article. Windows 2012R2 server crashes on it, and Windows10 drivers are missing from it altogether. I've been using virtio-win-0.1.141.iso, which seems younger than yours, it contains Windows10 drivers, but it still crashes both Windows 2012R2 server and Windows10 guests. There is virtio-win-0.1.164.iso available at https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-vi= rtio/virtio-win-0.1.164-1/ I'll try that and report. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --lrZ03NoBR/3+SXJZ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcdWXhAAoJEA2k8lmbXsY0xbgIAIM3fY2Ed4TjAITyQgeCa7OA 05GyFomItJ84hM3LTTyXp37/keXkI3fY89hezh2f+fdHT8XfoKXVT2llVzJithbF Z76V1IIhN0UerI2jwcD/aJHI+fscuLu75y8JFX317CkWYO2aGO8amgBsUlApT6MN NB7glcGxyR7qsXjOQjZRPYH4P9SBRVND5VU8FZyKGmI9p9JNH6C71Gmq04K2JBMA xNyNCoY0IrqrRRsJzJcj+PSnY7Ua7Y340mF0e0nvbMq/sCaNKMCJ/mhcU0CaZuWM vp5A7CLdCs0ORgV51nDM3AP17goMofjhMfiV9h0fSDYbSBwPdDWTXHTITXUkzKA= =+hyZ -----END PGP SIGNATURE----- --lrZ03NoBR/3+SXJZ-- From owner-freebsd-virtualization@freebsd.org Tue Feb 26 16:31:37 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6EBA0151E6CE for ; Tue, 26 Feb 2019 16:31:37 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B0C2C8CE0B for ; Tue, 26 Feb 2019 16:31:36 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=1Ep/HU575XHeiCToB8X0zVRROmfFDjef1B4/GJH5KfA=; b=bG6X0hZhhdWSqJIseSeTUlzDOF TTIRch93Nwz0IFSX2zWzVb0iE2z0l9x46a9nxF5Pw9U6FPHp43aiI907yk0d0gieYHGUb4/XkXEMS GUa+i7yEDYCzXwog7MMZUGe2xlJpAhIqbuh66YgCAet8VwZIQYQb2xp8tFiKjBogr1sg=; Received: from vas by admin.sibptus.ru with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1gyfdn-000Cks-QT for freebsd-virtualization@freebsd.org; Tue, 26 Feb 2019 23:31:35 +0700 Date: Tue, 26 Feb 2019 23:31:35 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: Re: NVMe and Bhyve Message-ID: <20190226163135.GA48895@admin.sibptus.ru> References: <20190215044134.GA52633@admin.sibptus.ru> <20190216041134.GA75357@admin.sibptus.ru> <20190217155811.GA99389@admin.sibptus.ru> <20190218010901.GA8125@admin.sibptus.ru> <20190224145226.GA76175@admin.sibptus.ru> <20190226161425.GA44771@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="KsGdsel6WgEHnImy" Content-Disposition: inline In-Reply-To: <20190226161425.GA44771@admin.sibptus.ru> X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.11.2 (2019-01-07) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 16:31:37 -0000 --KsGdsel6WgEHnImy Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Victor Sudakov wrote: > > > Therefore I ask again if someone has an actual success story of runni= ng > > > a Windows guest on a virtio-blk device. > >=20 > > Hi Viktor > >=20 > > Looking through my notes I'm not using virtio-blk I think, but I had > > no issues with the specific driver version linked to below > > https://hackmd.io/s/rJvJuE-CW# albeit with win7 Hope that=E2=80=99s hel= pful. >=20 > Not so much unfortunately. I've tried virtio-win-0.1.96.iso from your > article. Windows 2012R2 server crashes on it, and Windows10 drivers are > missing from it altogether. >=20 > I've been using virtio-win-0.1.141.iso, which seems younger than yours, > it contains Windows10 drivers, but it still crashes both Windows 2012R2 > server and Windows10 guests. >=20 > There is virtio-win-0.1.164.iso available at > https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-= virtio/virtio-win-0.1.164-1/ > I'll try that and report. virtio-win-0.1.164.iso still crashes the guest with Windows 2012R2 server i= nside. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --KsGdsel6WgEHnImy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcdWnnAAoJEA2k8lmbXsY09QIH/3YXDB4B7M+vCDrb7GCVp7q8 VckgaHMTr4lGs12NjDI3ZDUXnheGRDF1LDNBkNWM1PYJzw9xwVX1Gyt4BmrR5i18 zijhR6TR11Hj8LCvoGIf4yzuaLgjQf6XB2uV80DXrodobg07Gs6VvJJ7BFaTiizI KQhDTX4RJnJF3EvB4x4FAXc/uFGGwig2Ix7+hpS4CnJABzv1GAPbG+OfBppPeIX4 Bci8pAgAjpMownprzVnUoiP5xyX+udMupp9WYuDJO/esRFQeWOydTYplmZqJjn+f yyqFrmrK5R/9EvCvag+WMvs63ndA3qLAz6y2Eka1eN6pcvr+nAWBpXoatbiiqQ4= =CzIY -----END PGP SIGNATURE----- --KsGdsel6WgEHnImy-- From owner-freebsd-virtualization@freebsd.org Tue Feb 26 17:57:05 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 88AA41521088 for ; Tue, 26 Feb 2019 17:57:05 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [140.82.23.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 193016AE17; Tue, 26 Feb 2019 17:57:03 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from duke.gem.co (cpe-76-175-75-27.socal.res.rr.com [76.175.75.27]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 3d4a4384 TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; Tue, 26 Feb 2019 09:57:01 -0800 (PST) Subject: Re: sysutils/docker-freebsd: Searching for people to help To: Jochen Neumeister , freebsd-virtualization@freebsd.org, decke@FreeBSD.org References: <9dccf99d-1a29-b7ed-6a32-fe5e8a0ca9de@FreeBSD.org> From: Pete Wright Message-ID: Date: Tue, 26 Feb 2019 09:57:01 -0800 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.1 MIME-Version: 1.0 In-Reply-To: <9dccf99d-1a29-b7ed-6a32-fe5e8a0ca9de@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: 193016AE17 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 140.82.23.70 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-5.35 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[nomadlogic.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; IP_SCORE(-2.50)[ip: (-8.75), ipnet: 140.82.16.0/21(-4.38), asn: 20473(0.72), country: US(-0.07)]; MX_GOOD(-0.01)[cached: mail.nomadlogic.org]; NEURAL_HAM_SHORT(-0.54)[-0.541,0]; RECEIVED_SPAMHAUS_PBL(0.00)[27.75.175.76.zen.spamhaus.org : 127.0.0.10]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20473, ipnet:140.82.16.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 17:57:05 -0000 On 2/26/19 6:40 AM, Jochen Neumeister wrote: > Hello everybody. > > Currently @decke and I are working on the update of the port. We try > to change it completely to moby, and then of course, that the port is > working properly. > > For this we are still looking for people who want to work on this very > large update, or later can test the work. > > If you want, you can get it on Freenode on IRC #freebsd-docker. We try > to coordinate it there. > (sorry if dupe, first message seemed to get filtered out) Is there a source code repository that is being used for this work? thanks in advance! -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-virtualization@freebsd.org Tue Feb 26 18:14:12 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47B5F1521DE2 for ; Tue, 26 Feb 2019 18:14:12 +0000 (UTC) (envelope-from jason@corrupted.io) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 198576C414 for ; Tue, 26 Feb 2019 18:14:09 +0000 (UTC) (envelope-from jason@corrupted.io) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.west.internal (Postfix) with ESMTP id 669E734D3 for ; Tue, 26 Feb 2019 13:14:02 -0500 (EST) Received: from imap3 ([10.202.2.53]) by compute6.internal (MEProxy); Tue, 26 Feb 2019 13:14:02 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=corrupted.io; h= message-id:in-reply-to:references:date:from:to:subject :content-type; s=mesmtp; bh=7Brdel39m1Yp+7+YrqXU1LssjarURlZ80gPB aRIkhQQ=; b=hKPMBr1UEqVRtWNLZ64AtQuuf3Sx7fuAMdqI0L4e9bPI2h28oeWw WjphG8Gm5qtcBqMF2Hi3bLXIicuPRUjd1qTfbaaZxUiF1TBVgEW+AuUzbq3d6VCj 50qwiXYo/rzzGsbtmVykF+MyQpDpcsvgdKM5MWX8VPcmwlUjoAnjtCA= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:references:subject:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=7Brdel39m1Yp+7+Yr qXU1LssjarURlZ80gPBaRIkhQQ=; b=bQU6N7UDYV52Dt8TRmM6E9f3w1qRqtmIc yJixdJPhQsIUT1slky4DjuJs8xYnUd2G0QyeWGq3/frYwP7TzhPbOL4sniNydVl5 HiY3LP9Jz9098Qud059a8AKU1tcrgmBTYncKw3Cgn/nGV08EHHVlPJcW+heWy8va 7YuaDvGgEDYornNd4WPc+IYtRegSLP+EyGKXxwEz/DqVFsTSvgDxIGsRfbtV4Z2S 1nPiP4yYBmXihAC/I4laGZjFHWkEnGXP63Gp4r3HtXSmyjx3kd/W+Nk45TrDW7C/ YoTDhnVnI1B9FXinyhUwq5Hdp4i1KuZxeXr3ipq280b1qnhZp9cMg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedutddrudelgdduudefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgfkjghffffhvffutgesthdtre dtreertdenucfhrhhomhepfdflrghsohhnuceurghrsghivghrfdcuoehjrghsohhnsegt ohhrrhhuphhtvggurdhioheqnecuffhomhgrihhnpehfrhgvvggsshgurdhorhhgpdhkvg ihsggrshgvrdhiohenucfrrghrrghmpehmrghilhhfrhhomhepjhgrshhonhestghorhhr uhhpthgvugdrihhonecuvehluhhsthgvrhfuihiivgeptd X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 895CD7C1E5; Tue, 26 Feb 2019 13:14:01 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.1.5-895-g0d23ba6-fmstable-20190213v1 X-Me-Personality: 64405576 Message-Id: <7ed29bb5-aca9-4aed-90e5-a3dc6b87cb39@www.fastmail.com> In-Reply-To: <9dccf99d-1a29-b7ed-6a32-fe5e8a0ca9de@FreeBSD.org> References: <9dccf99d-1a29-b7ed-6a32-fe5e8a0ca9de@FreeBSD.org> Date: Tue, 26 Feb 2019 13:14:01 -0500 From: "Jason Barbier" To: freebsd-virtualization@freebsd.org Subject: Re: sysutils/docker-freebsd: Searching for people to help Content-Type: text/plain X-Rspamd-Queue-Id: 198576C414 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=corrupted.io header.s=mesmtp header.b=hKPMBr1U; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=bQU6N7UD; dmarc=pass (policy=none) header.from=corrupted.io; spf=pass (mx1.freebsd.org: domain of jason@corrupted.io designates 64.147.123.25 as permitted sender) smtp.mailfrom=jason@corrupted.io X-Spamd-Result: default: False [-6.89 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[corrupted.io:s=mesmtp,messagingengine.com:s=fm2]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; IP_SCORE(-3.38)[ip: (-8.87), ipnet: 64.147.123.0/24(-4.43), asn: 11403(-3.52), country: US(-0.07)]; DKIM_TRACE(0.00)[corrupted.io:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[corrupted.io,none]; MX_GOOD(-0.01)[aspmx.l.google.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,aspmx.l.google.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com]; NEURAL_HAM_SHORT(-0.92)[-0.917,0]; RCVD_IN_DNSWL_LOW(-0.10)[25.123.147.64.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_WWW(0.50)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 18:14:12 -0000 Sounds like fun, Ill try to pop into the IRC channel. --- Jason Barbier | E: jason@corrupted.io GPG: 0x40B8FA1D72EF0D89 (https://keybase.io/kusuriya) On Tue, Feb 26, 2019, at 6:42 AM, Jochen Neumeister wrote: > Hello everybody. > > Currently @decke and I are working on the update of the port. We try to > change it completely to moby, and then of course, that the port is > working properly. > > For this we are still looking for people who want to work on this very > large update, or later can test the work. > > If you want, you can get it on Freenode on IRC #freebsd-docker. We try > to coordinate it there. > > > Cheers > > Jochen > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Tue Feb 26 21:32:04 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7743D150491E for ; Tue, 26 Feb 2019 21:32:04 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: from mail-it1-x136.google.com (mail-it1-x136.google.com [IPv6:2607:f8b0:4864:20::136]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D5C17480D for ; Tue, 26 Feb 2019 21:32:02 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: by mail-it1-x136.google.com with SMTP id z131so6154094itf.5 for ; Tue, 26 Feb 2019 13:32:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dragondata.com; s=google; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=wcF/wL+maRrXtda86VwJpBGtBumYwy48VHTydg+MznU=; b=iIuBbYCr++G6S7U5MKev79oA2sCm9YeJjMhk21lajxrJw0nmJ3iMRSEFU4fNtTF00B EnQeIC4SA/mG59JFZKgwDob5Vyv71uJz3z/IqALY1fYpXZCrvfIz9BVY9Rf24wwU1+3c FBaALyzatIihzjcQi2cbkAXF/UMiJTW9YymGs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=wcF/wL+maRrXtda86VwJpBGtBumYwy48VHTydg+MznU=; b=MePy2NrcKnXyiZiTvtrTzPJdkoRMMkO89Fw1AzSVMdR84FJiHcrK2O/TMQb3Fc+oSs ufZL8I2NW8ng51C5Kn9tuYjl3tw+Q5dZjfwhGYnc4ovqscjKTkUzPXH4mvy756yxDwXe GvjFKToGI2d5eIfnoISbny5iLTxlViKwvDZmIPr1Hygcj5SNyXxGrnKUWEJu23o/NrmX PY9p8d+JIyaFaJx+/w500LeYXUIem5dRcciu0CWYtFFcNldsYmW+skChljhYmRwOnzT+ zpvIKJMy+9r4t0P40Z1VIQiOXzzatGPF4XVjIVDlngbj/d77EiJDUo9Yc/+cyPfEuQPc v2AA== X-Gm-Message-State: APjAAAXHNZfi8na4rsc/wGrAhCv0BXUBO13hf/SkOASEhzY4ljy0xRFT mDSUdeHAZ81FmBLrDFZZPe6pYayZquY= X-Google-Smtp-Source: AHgI3IZzmVGqtG7jk70nsDBM2yyOKVzI9nbJUztUOIy2iyoQlGaw6nnDIlaM2uk+Qt3X3D6ldE1oyw== X-Received: by 2002:a24:4692:: with SMTP id j140mr3958400itb.170.1551216721976; Tue, 26 Feb 2019 13:32:01 -0800 (PST) Received: from i82.cfv.net (i82.cfv.net. [204.9.51.82]) by smtp.gmail.com with ESMTPSA id i5sm169523itb.3.2019.02.26.13.32.01 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 26 Feb 2019 13:32:01 -0800 (PST) From: Kevin Day Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: bhyve PCIe passthrough on AMD Epyc Message-Id: <2E994604-BD27-464D-9D8C-14FF3C987D54@dragondata.com> Date: Tue, 26 Feb 2019 15:32:00 -0600 To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 0D5C17480D X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dragondata.com header.s=google header.b=iIuBbYCr X-Spamd-Result: default: False [-4.78 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[dragondata.com:+]; MX_GOOD(-0.01)[ASPMX3.GOOGLEMAIL.com,ALT2.ASPMX.L.GOOGLE.com,ASPMX.L.GOOGLE.com,ALT1.ASPMX.L.GOOGLE.com,ASPMX5.GOOGLEMAIL.com,ASPMX4.GOOGLEMAIL.com,ASPMX2.GOOGLEMAIL.com]; NEURAL_HAM_SHORT(-0.95)[-0.945,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; R_DKIM_ALLOW(-0.20)[dragondata.com:s=google]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[dragondata.com]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.53)[ip: (-7.88), ipnet: 2607:f8b0::/32(-2.68), asn: 15169(-2.01), country: US(-0.07)]; RCVD_IN_DNSWL_NONE(0.00)[6.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Feb 2019 21:32:04 -0000 I'm trying to get PCIe device (video card) passthrough working to a = Windows bhyve VM, should this work now? I have the device blocked off in loader.conf, and added = hw.vmm.amdvi.enable=3D"1". After doing so this is how it appears in = pciconf: ppt0@pci0:97:0:0: class=3D0x030000 card=3D0x27173842 = chip=3D0x128b10de rev=3D0xa1 hdr=3D0x00 bar [10] =3D type Memory, range 32, base 0xe0000000, size = 16777216, disabled bar [14] =3D type Prefetchable Memory, range 64, base = 0xfcf0000000, size 134217728, disabled bar [1c] =3D type Prefetchable Memory, range 64, base = 0xfcf8000000, size 33554432, disabled bar [24] =3D type I/O Port, range 32, base 0x3000, size 128, = disabled cap 01[60] =3D powerspec 3 supports D0 D3 current D0 cap 05[68] =3D MSI supports 1 message, 64 bit cap 10[78] =3D PCI-Express 2 legacy endpoint max data 256(256) RO NS link x8(x8) speed 5.0(5.0) ecap 0002[100] =3D VC 1 max VC0 ecap 0004[128] =3D Power Budgeting 1 ecap 000b[600] =3D Vendor 1 ID 1 When trying to attach it to a VM with "-s 9:0,passthru,97/0/0" I get = this almost immediately after it starts up: Assertion failed: (error =3D=3D 0), function modify_bar_registration, = file /usr/src/usr.sbin/bhyve/pci_emul.c, line 504. Also on the console I'm seeing a lot of messages like: ivhd0: Error: completion failed tail:0x1c0, head:0x0. ivhd0: Dump all the commands: [CMD0, off:0xff0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD1, off:0x0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD2, off:0x10] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD3, off:0x20] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD4, off:0x30] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD5, off:0x40] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD6, off:0x50] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD7, off:0x60] opcode=3D 0x2 0x6101 0x0 0x0 [CMD8, off:0x70] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD9, off:0x80] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD10, off:0x90] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD11, off:0xa0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD12, off:0xb0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD13, off:0xc0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD14, off:0xd0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD15, off:0xe0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD16, off:0xf0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD17, off:0x100] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD18, off:0x110] opcode=3D 0x2 0x6100 0x0 0x0 [CMD19, off:0x120] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD20, off:0x130] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD21, off:0x140] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD22, off:0x150] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD23, off:0x160] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD24, off:0x170] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD25, off:0x180] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD26, off:0x190] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD27, off:0x1a0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 [CMD28, off:0x1b0] opcode=3D 0x1 0x304f1629 0x30 0xa5a5 From owner-freebsd-virtualization@freebsd.org Wed Feb 27 06:32:14 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2339B1512AEE for ; Wed, 27 Feb 2019 06:32:14 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0208B8FBD8 for ; Wed, 27 Feb 2019 06:32:12 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id x1R6W8hg049420; Tue, 26 Feb 2019 22:32:08 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id x1R6W8ec049419; Tue, 26 Feb 2019 22:32:08 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201902270632.x1R6W8ec049419@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve PCIe passthrough on AMD Epyc In-Reply-To: <2E994604-BD27-464D-9D8C-14FF3C987D54@dragondata.com> To: Kevin Day Date: Tue, 26 Feb 2019 22:32:08 -0800 (PST) CC: freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 0208B8FBD8 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [1.96 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.50)[0.500,0]; NEURAL_HAM_LONG(-0.01)[-0.012,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.58)[0.575,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: pdx.rh.CN85.dnsmgr.net]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.01)[ip: (0.06), ipnet: 69.59.192.0/19(0.03), asn: 13868(0.01), country: US(-0.07)] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Feb 2019 06:32:14 -0000 > I'm trying to get PCIe device (video card) passthrough working to a Windows bhyve VM, should this work now? No, this should not work now. > I have the device blocked off in loader.conf, and added hw.vmm.amdvi.enable="1". After doing so this is how it appears in pciconf: > > ppt0@pci0:97:0:0: class=0x030000 card=0x27173842 chip=0x128b10de rev=0xa1 hdr=0x00 > bar [10] = type Memory, range 32, base 0xe0000000, size 16777216, disabled > bar [14] = type Prefetchable Memory, range 64, base 0xfcf0000000, size 134217728, disabled > bar [1c] = type Prefetchable Memory, range 64, base 0xfcf8000000, size 33554432, disabled > bar [24] = type I/O Port, range 32, base 0x3000, size 128, disabled > cap 01[60] = powerspec 3 supports D0 D3 current D0 > cap 05[68] = MSI supports 1 message, 64 bit > cap 10[78] = PCI-Express 2 legacy endpoint max data 256(256) RO NS > link x8(x8) speed 5.0(5.0) > ecap 0002[100] = VC 1 max VC0 > ecap 0004[128] = Power Budgeting 1 > ecap 000b[600] = Vendor 1 ID 1 > > When trying to attach it to a VM with "-s 9:0,passthru,97/0/0" I get this almost immediately after it starts up: > > Assertion failed: (error == 0), function modify_bar_registration, file /usr/src/usr.sbin/bhyve/pci_emul.c, line 504. > > Also on the console I'm seeing a lot of messages like: > > ivhd0: Error: completion failed tail:0x1c0, head:0x0. > ivhd0: Dump all the commands: > [CMD0, off:0xff0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD1, off:0x0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD2, off:0x10] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD3, off:0x20] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD4, off:0x30] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD5, off:0x40] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD6, off:0x50] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD7, off:0x60] opcode= 0x2 0x6101 0x0 0x0 > [CMD8, off:0x70] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD9, off:0x80] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD10, off:0x90] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD11, off:0xa0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD12, off:0xb0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD13, off:0xc0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD14, off:0xd0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD15, off:0xe0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD16, off:0xf0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD17, off:0x100] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD18, off:0x110] opcode= 0x2 0x6100 0x0 0x0 > [CMD19, off:0x120] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD20, off:0x130] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD21, off:0x140] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD22, off:0x150] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD23, off:0x160] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD24, off:0x170] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD25, off:0x180] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD26, off:0x190] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD27, off:0x1a0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > [CMD28, off:0x1b0] opcode= 0x1 0x304f1629 0x30 0xa5a5 > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Thu Feb 28 04:38:24 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 18E0A1516B87 for ; Thu, 28 Feb 2019 04:38:24 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: from mail-it1-x12f.google.com (mail-it1-x12f.google.com [IPv6:2607:f8b0:4864:20::12f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A5F12754FF for ; Thu, 28 Feb 2019 04:38:21 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: by mail-it1-x12f.google.com with SMTP id l15so13744781iti.4 for ; Wed, 27 Feb 2019 20:38:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dragondata.com; s=google; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=nSSI4lTssWPS1UHaYV6UahcsaGnBtuKPyiEhUo5ZKNU=; b=f+imOoX/zmKyg6sGY3ZW1pusFHhIYXtPhaaaRZsUAvhGhaHTJBdAQeMfjPbYsSZPvI WtnwrYlWXlpq7qbAF786V9wAqmlA9d4t9seqr6T3LyI05aiU8iYtSTxggX8IW3XAU6T1 xqRMpICujSgzgQLlcT/6LLkFqYB3qbVp0Hh9I= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=nSSI4lTssWPS1UHaYV6UahcsaGnBtuKPyiEhUo5ZKNU=; b=gHKKW7wdi3caSX7s5d7DyHNQoiGkoVT3XFYoA3PbNKmq91f+pmZvkGAjj0TIBSw7vD c2mf+wi/4fZ8vy5AxhTDS34le6un6UpKiklfsBZyIcjcIyuu9YeSakTmSxdb1vTWcYyg wLnzP8eL+HQFD4JtB14OPZ61JD+kK0+e/BpkVlfY3fLuDVo+5mIEbLf4FTJPo9sgZEpH kPt4u12NL9jIgHLsPnHx3w3nqU96iQkrSMzf42V9vDaH386nslUocHMPQnlpgOu7475V NPMLE5hR2EPMTkUb8m9ABYwrjiw83N0KCgAeW8w+L+GNLjvtISBiOxkrr/73TfX33KeB Stmg== X-Gm-Message-State: APjAAAXoFE4EuU0aFxjCWXi1cnvWAxUMUyiRPlot+GXh7Gs5dQXzuTVr EkfxfkXt1Qro/zbPDxSf6vNnHwfz+jI= X-Google-Smtp-Source: APXvYqxbSUygCqQEuRGsK1U8EHvDQKTIg+u3Ca0h1lNaq+5Ncf7l/k6HcnwLBsZaXGn2iib1Kkoe+g== X-Received: by 2002:a24:6948:: with SMTP id e69mr1733110itc.140.1551328700268; Wed, 27 Feb 2019 20:38:20 -0800 (PST) Received: from i82.cfv.net (i82.cfv.net. [204.9.51.82]) by smtp.gmail.com with ESMTPSA id f24sm7084631ioo.24.2019.02.27.20.38.19 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 27 Feb 2019 20:38:19 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: bhyve PCIe passthrough on AMD Epyc From: Kevin Day In-Reply-To: <201902270632.x1R6W8ec049419@pdx.rh.CN85.dnsmgr.net> Date: Wed, 27 Feb 2019 22:38:18 -0600 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <8A44404F-C6E5-47BF-82E8-3CF94D5487E9@dragondata.com> References: <201902270632.x1R6W8ec049419@pdx.rh.CN85.dnsmgr.net> To: "Rodney W. Grimes" X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: A5F12754FF X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dragondata.com header.s=google header.b=f+imOoX/ X-Spamd-Result: default: False [-5.54 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[dragondata.com:s=google]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[dragondata.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[dragondata.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[f.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[ASPMX3.GOOGLEMAIL.com,ALT2.ASPMX.L.GOOGLE.com,ASPMX.L.GOOGLE.com,ALT1.ASPMX.L.GOOGLE.com,ASPMX5.GOOGLEMAIL.com,ASPMX4.GOOGLEMAIL.com,ASPMX2.GOOGLEMAIL.com]; R_SPF_NA(0.00)[]; NEURAL_HAM_SHORT(-0.96)[-0.957,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-2.78)[ip: (-9.10), ipnet: 2607:f8b0::/32(-2.69), asn: 15169(-2.02), country: US(-0.07)] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Feb 2019 04:38:24 -0000 > On Feb 27, 2019, at 12:32 AM, Rodney W. Grimes = wrote: >=20 >> I'm trying to get PCIe device (video card) passthrough working to a = Windows bhyve VM, should this work now? >=20 > No, this should not work now. Ok, easy enough. Should *any* PCIe passthrough work on Epyc right now? = Just trying the same thing with a simple PCIe USB card gives me: CPU0: local APIC error 0x40 CPU0: local APIC error 0x40 ivhd0: Error: completion failed tail:0xda0, head:0x0. ivhd0: Dump all the commands: [CMD0, off:0xff0] opcode=3D 0x0 0x0 0x0 0x0 [CMD1, off:0x0] opcode=3D 0x3 0x0 0x0 0x7ffffffffffff003 [CMD2, off:0x10] opcode=3D 0x0 0x0 0x0 0x0 [CMD3, off:0x20] opcode=3D 0x2 0x0 0x0 0x0 [CMD4, off:0x30] opcode=3D 0x2 0x2 0x0 0x0 [...snip... lots of similar stuff] Then I get a bunch more APIC errors, and the system freezes for about 60 = seconds before recovering. -- Kevin From owner-freebsd-virtualization@freebsd.org Thu Feb 28 05:34:28 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E53C215197A6 for ; Thu, 28 Feb 2019 05:34:27 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D1D137772B for ; Thu, 28 Feb 2019 05:34:26 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id x1S5YMk9054622; Wed, 27 Feb 2019 21:34:22 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id x1S5YMQS054621; Wed, 27 Feb 2019 21:34:22 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201902280534.x1S5YMQS054621@pdx.rh.CN85.dnsmgr.net> Subject: Re: bhyve PCIe passthrough on AMD Epyc In-Reply-To: <8A44404F-C6E5-47BF-82E8-3CF94D5487E9@dragondata.com> To: Kevin Day Date: Wed, 27 Feb 2019 21:34:22 -0800 (PST) CC: freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: D1D137772B X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [2.34 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.92)[0.919,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.23)[0.227,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: pdx.rh.CN85.dnsmgr.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.30)[0.296,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.01)[ip: (0.06), ipnet: 69.59.192.0/19(0.03), asn: 13868(0.01), country: US(-0.07)] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Feb 2019 05:34:28 -0000 > > On Feb 27, 2019, at 12:32 AM, Rodney W. Grimes wrote: > > > >> I'm trying to get PCIe device (video card) passthrough working to a Windows bhyve VM, should this work now? > > > > No, this should not work now. > > Ok, easy enough. Should *any* PCIe passthrough work on Epyc right now? I do not know what would be special about Epyc so can not say for certain. > Just trying the same thing with a simple PCIe USB card gives me: > > CPU0: local APIC error 0x40 > CPU0: local APIC error 0x40 > ivhd0: Error: completion failed tail:0xda0, head:0x0. > ivhd0: Dump all the commands: > [CMD0, off:0xff0] opcode= 0x0 0x0 0x0 0x0 > [CMD1, off:0x0] opcode= 0x3 0x0 0x0 0x7ffffffffffff003 > [CMD2, off:0x10] opcode= 0x0 0x0 0x0 0x0 > [CMD3, off:0x20] opcode= 0x2 0x0 0x0 0x0 > [CMD4, off:0x30] opcode= 0x2 0x2 0x0 0x0 > [...snip... lots of similar stuff] > > Then I get a bunch more APIC errors, and the system freezes for about 60 seconds before recovering. You do not get any host dmesg errors about unaligned BAR ranges or sizes? Can you get the pciconf -l -b info for the device you passed, something like: # pciconf -l -b uhci0 uhci0@pci0:0:26:0: class=0x0c0300 card=0x20f017aa chip=0x29378086 rev=0x03 hdr=0x00 bar [20] = type I/O Port, range 32, base 0x1840, size 32, enabled > -- Kevin -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Thu Feb 28 17:58:20 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 885351511007 for ; Thu, 28 Feb 2019 17:58:20 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: from mail-io1-xd33.google.com (mail-io1-xd33.google.com [IPv6:2607:f8b0:4864:20::d33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 78C5F7705E for ; Thu, 28 Feb 2019 17:58:19 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: by mail-io1-xd33.google.com with SMTP id p196so17284035iod.9 for ; Thu, 28 Feb 2019 09:58:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dragondata.com; s=google; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=aooDo02jrIeTwma6d/outuNA/CPqkrbbqp8lV0j01bk=; b=WtRHbOaFLCW+t15rVHGK3GtZvfXONPWKeu2b6WwfUlghO1PxdIUNm52uGuCxdFKrFE 5ShjmLIjqC0p0Qf07ciQt0zBAf0KSzJQEBFAsCIYE/1+nWRRhbxPavogzNsZFilG6mMY vhRI6Z9rVuHxMxswjWvL5FvRU7iLhPVBMc4F8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=aooDo02jrIeTwma6d/outuNA/CPqkrbbqp8lV0j01bk=; b=EDdbI8nFBJ88ta37nkG8BNSX6t9FA/wzshAtXg7Ndo6XJEAiKekDE7QVdzaivx6ABc RYy7I3BxqQ+7oZiyFHD7Whqbr6GoE3r+efaeT2lWvkEC2R19rjJKOS2DfLMjP3GOJbVC JhxHdO3VDQS9Sr8XtHwsd4R8mEF8KaZyBngq6SjQOvoqHx/t4cCNhOkaZhO68/3V3beI /V2bLH9QxKasWZal/TCFdp8UesbKcpjYnNnekVI3ZSjmWloKfici9L8I3Y1ICPiHJ40o ca/Q0aDzsJTD6Zse+S5TZhYYyZwBqHC+xgZ1z+sSCWoXbWO8ZfVZqmeCe3DSZnbEJOmC ncmg== X-Gm-Message-State: APjAAAVFH/cXbgY/GXP8k+j7Ze3sG4jZuOGK7+bEZNBvD9ZSZCoA2VYF AtF3z4P74Jwc7lxJz+3ryIzoa54u/No= X-Google-Smtp-Source: APXvYqwK/AXpSSB+d2MhUB9b6Rwnz5FJhvB+da2Jed4sL+eWzoYGfO52mVwgnMaGubLUPoF1vePFOA== X-Received: by 2002:a5d:8c98:: with SMTP id g24mr348921ion.103.1551376698364; Thu, 28 Feb 2019 09:58:18 -0800 (PST) Received: from i82.cfv.net (i82.cfv.net. [204.9.51.82]) by smtp.gmail.com with ESMTPSA id z24sm7618505ioh.57.2019.02.28.09.58.17 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 28 Feb 2019 09:58:17 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: bhyve PCIe passthrough on AMD Epyc From: Kevin Day In-Reply-To: <201902280534.x1S5YMQS054621@pdx.rh.CN85.dnsmgr.net> Date: Thu, 28 Feb 2019 11:58:16 -0600 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <98792A76-1723-458D-A7B4-BB3F74D9F26C@dragondata.com> References: <201902280534.x1S5YMQS054621@pdx.rh.CN85.dnsmgr.net> To: "Rodney W. Grimes" X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 78C5F7705E X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dragondata.com header.s=google header.b=WtRHbOaF X-Spamd-Result: default: False [-5.44 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[dragondata.com:s=google]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[dragondata.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[dragondata.com:+]; MX_GOOD(-0.01)[cached: ASPMX3.GOOGLEMAIL.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[3.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.940,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-2.69)[ip: (-8.66), ipnet: 2607:f8b0::/32(-2.71), asn: 15169(-2.03), country: US(-0.07)] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Feb 2019 17:58:20 -0000 > On Feb 27, 2019, at 11:34 PM, Rodney W. Grimes = wrote: >=20 >>> On Feb 27, 2019, at 12:32 AM, Rodney W. Grimes = wrote: >>>=20 >>>> I'm trying to get PCIe device (video card) passthrough working to a = Windows bhyve VM, should this work now? >>>=20 >>> No, this should not work now. >>=20 >> Ok, easy enough. Should *any* PCIe passthrough work on Epyc right = now? > I do not know what would be special about Epyc so can not say > for certain. I'm just pointing out that it's an AMD Epyc because I know the AMD = IOMMU/AMD-Vi code was added somewhat more recently than Intel's and is = maybe less tested. >> Just trying the same thing with a simple PCIe USB card gives me: >>=20 >> CPU0: local APIC error 0x40 >> CPU0: local APIC error 0x40 >> ivhd0: Error: completion failed tail:0xda0, head:0x0. >> ivhd0: Dump all the commands: >> [CMD0, off:0xff0] opcode=3D 0x0 0x0 0x0 0x0 >> [CMD1, off:0x0] opcode=3D 0x3 0x0 0x0 0x7ffffffffffff003 >> [CMD2, off:0x10] opcode=3D 0x0 0x0 0x0 0x0 >> [CMD3, off:0x20] opcode=3D 0x2 0x0 0x0 0x0 >> [CMD4, off:0x30] opcode=3D 0x2 0x2 0x0 0x0 >> [...snip... lots of similar stuff] >>=20 >> Then I get a bunch more APIC errors, and the system freezes for about = 60 seconds before recovering. >=20 > You do not get any host dmesg errors about unaligned BAR > ranges or sizes? >=20 Correct. I did with the video card, but not with the xhci USB card. I = get a ton of dmesg errors, and the host system repeatedly freezes until = I stop the VM. (Console is non-responsive, no ICMP replies, etc) I didn't actually look at this until now, but Windows actually does see = the USB controller, but it complains that "port reset failed" on any = device I attach to it. > Can you get the pciconf -l -b info for the device you passed, = something like: > # pciconf -l -b uhci0 > uhci0@pci0:0:26:0: class=3D0x0c0300 card=3D0x20f017aa = chip=3D0x29378086 rev=3D0x03 hdr=3D0x00 > bar [20] =3D type I/O Port, range 32, base 0x1840, size 32, = enabled xhci3@pci0:97:0:0: class=3D0x0c0330 card=3D0xffffffff = chip=3D0x00151912 rev=3D0x02 hdr=3D0x00 bar [10] =3D type Memory, range 64, base 0xe1d00000, size 8192, = enabled cap 01[50] =3D powerspec 3 supports D0 D3 current D0 cap 05[70] =3D MSI supports 8 messages, 64 bit enabled with 1 = message cap 11[90] =3D MSI-X supports 8 messages Table in map 0x10[0x1000], PBA in map 0x10[0x1080] cap 10[a0] =3D PCI-Express 2 endpoint max data 128(128) NS link x1(x1) speed 5.0(5.0) ASPM L1(L0s/L1) ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 1 corrected ecap 0018[150] =3D LTR 1 Also just in case it's relevant, "acpidump" on this system hangs after = allocating ~3GB of ram and just spins at 100% CPU. I am seeing that = AMD-Vi is enabled in the boot dmesg though: AMD-Vi: IVRS Info VAsize =3D 64 PAsize =3D 48 GVAsize =3D 2 flags:0 From owner-freebsd-virtualization@freebsd.org Thu Feb 28 18:28:44 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0E62F1512586 for ; Thu, 28 Feb 2019 18:28:44 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wr1-x432.google.com (mail-wr1-x432.google.com [IPv6:2a00:1450:4864:20::432]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E8390807FB for ; Thu, 28 Feb 2019 18:28:42 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wr1-x432.google.com with SMTP id o17so23110306wrw.3 for ; Thu, 28 Feb 2019 10:28:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=lEwAWBmUIJLyLMaqr3HiVnU8CTj7S/bkrxcGDIp3Sko=; b=IPg/cteTVoEdAtJsJXi1Jh020PzTjiJCtOG1jLRGWsBCks/MhWp7QfVqv0Vta76kRh veAM7Q0pkbvmGdhbNDJWn/2LgE+AelLyYPtpOmgITElpI5P9Dhq4dOTjRy4YB4l6Y5UK UA4BWx5TK5RiTKLhhUoE/OrYN+lRYyzMZR9rak7UywQ0FfiIba/+8uAf1XHJwrqq5Kr5 QDyc0Eo053Xtf4gMky3lWa+cgrQuIXGsUHlVJLssQavyTcuAMI0vkK7RvRlb+x23DUEZ HHnclYtS8qPPMZOklDvL35cySfcEI8NT2cNGmPMRYoaFJMsyvP9FCAxVK1n7uzYk6wvC +P4A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=lEwAWBmUIJLyLMaqr3HiVnU8CTj7S/bkrxcGDIp3Sko=; b=KLTquaSBr3LUpL7m4cSaDJbnArVThhp3O0YYnp3geThMvJ+pr+yBOQCMkQVS3mJFzq 8JyfL2mHJAOVOPxRr0FjWefPiNkXssImAKYtqATdsLqCZjT7P/GOib8XDdyEcyiM4Jar lhU5M7RdiIEW1qtH0ANXokHom0idmuWEbdI1uq6kK604gTr0IGt2x45P3qcQCgahXUdF VwucAgBuoZerNQBemxzhYD27mdZI6iR1yCb66vPoB3/xxFH1cCR9V7QaGMD4sYRGN8Sz WL/W75K2UZ3WEloS5a2nd6Y/LOJojkUo1D9k/+WWMZ+Ac+9Ye0Uue9Epex8fECf1XPut njXw== X-Gm-Message-State: APjAAAUs0Kp14nYaeKRTQrPnTBnCMRx7QSDcLKMR+EOLSr38Kxl/7tRF Cb3M+CYwIYKqm0zK0zcvB1JvdHvYtI6GVSeMEPwUvjBldvE= X-Google-Smtp-Source: APXvYqzpmfjKEHKo5myZgQwWbaF2J8ReGPgXFEFeo5Rx4KVmDrviCmMUOZkstLX52V3pHE5/e5keYlMk586t4IYsyxY= X-Received: by 2002:adf:f5d0:: with SMTP id k16mr489529wrp.325.1551378521636; Thu, 28 Feb 2019 10:28:41 -0800 (PST) MIME-Version: 1.0 References: <201902280534.x1S5YMQS054621@pdx.rh.CN85.dnsmgr.net> <98792A76-1723-458D-A7B4-BB3F74D9F26C@dragondata.com> In-Reply-To: <98792A76-1723-458D-A7B4-BB3F74D9F26C@dragondata.com> From: Anish Date: Thu, 28 Feb 2019 10:28:30 -0800 Message-ID: Subject: Re: bhyve PCIe passthrough on AMD Epyc To: Kevin Day Cc: "Rodney W. Grimes" , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: E8390807FB X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=IPg/cteT; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::432 as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-6.82 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.98)[-0.984,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.83)[ip: (-9.77), ipnet: 2a00:1450::/32(-2.28), asn: 15169(-2.03), country: US(-0.07)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Feb 2019 18:28:44 -0000 Hi Kevin, >I'm just pointing out that it's an AMD Epyc because I know the AMD IOMMU/AMD-Vi code was added somewhat more recently than Intel's and is maybe less tested. I tested on Ryzen-I, not sure if anyone tried it on newer Ryzen/Epyc systems. >CPU0: local APIC error 0x40 This is concerning, as per AMD docs, bit6 is for illegal vector which indicate CPU is getting invalid interrupts. Can you share hw.vmm sysctl output? -Anish On Thu, Feb 28, 2019 at 9:59 AM Kevin Day wrote: > > > > On Feb 27, 2019, at 11:34 PM, Rodney W. Grimes < > freebsd-rwg@pdx.rh.CN85.dnsmgr.net> wrote: > > > >>> On Feb 27, 2019, at 12:32 AM, Rodney W. Grimes < > freebsd-rwg@pdx.rh.CN85.dnsmgr.net> wrote: > >>> > >>>> I'm trying to get PCIe device (video card) passthrough working to a > Windows bhyve VM, should this work now? > >>> > >>> No, this should not work now. > >> > >> Ok, easy enough. Should *any* PCIe passthrough work on Epyc right now? > > I do not know what would be special about Epyc so can not say > > for certain. > > I'm just pointing out that it's an AMD Epyc because I know the AMD > IOMMU/AMD-Vi code was added somewhat more recently than Intel's and is > maybe less tested. > > >> Just trying the same thing with a simple PCIe USB card gives me: > >> > >> CPU0: local APIC error 0x40 > >> CPU0: local APIC error 0x40 > >> ivhd0: Error: completion failed tail:0xda0, head:0x0. > >> ivhd0: Dump all the commands: > >> [CMD0, off:0xff0] opcode= 0x0 0x0 0x0 0x0 > >> [CMD1, off:0x0] opcode= 0x3 0x0 0x0 0x7ffffffffffff003 > >> [CMD2, off:0x10] opcode= 0x0 0x0 0x0 0x0 > >> [CMD3, off:0x20] opcode= 0x2 0x0 0x0 0x0 > >> [CMD4, off:0x30] opcode= 0x2 0x2 0x0 0x0 > >> [...snip... lots of similar stuff] > >> > >> Then I get a bunch more APIC errors, and the system freezes for about > 60 seconds before recovering. > > > > You do not get any host dmesg errors about unaligned BAR > > ranges or sizes? > > > > Correct. I did with the video card, but not with the xhci USB card. I get > a ton of dmesg errors, and the host system repeatedly freezes until I stop > the VM. (Console is non-responsive, no ICMP replies, etc) > > I didn't actually look at this until now, but Windows actually does see > the USB controller, but it complains that "port reset failed" on any device > I attach to it. > > > Can you get the pciconf -l -b info for the device you passed, something > like: > > # pciconf -l -b uhci0 > > uhci0@pci0:0:26:0: class=0x0c0300 card=0x20f017aa chip=0x29378086 > rev=0x03 hdr=0x00 > > bar [20] = type I/O Port, range 32, base 0x1840, size 32, enabled > > xhci3@pci0:97:0:0: class=0x0c0330 card=0xffffffff chip=0x00151912 > rev=0x02 hdr=0x00 > bar [10] = type Memory, range 64, base 0xe1d00000, size 8192, enabled > cap 01[50] = powerspec 3 supports D0 D3 current D0 > cap 05[70] = MSI supports 8 messages, 64 bit enabled with 1 message > cap 11[90] = MSI-X supports 8 messages > Table in map 0x10[0x1000], PBA in map 0x10[0x1080] > cap 10[a0] = PCI-Express 2 endpoint max data 128(128) NS > link x1(x1) speed 5.0(5.0) ASPM L1(L0s/L1) > ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected > ecap 0018[150] = LTR 1 > > Also just in case it's relevant, "acpidump" on this system hangs after > allocating ~3GB of ram and just spins at 100% CPU. I am seeing that AMD-Vi > is enabled in the boot dmesg though: > > AMD-Vi: IVRS Info VAsize = 64 PAsize = 48 GVAsize = 2 flags:0 > > > > > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Thu Feb 28 18:30:50 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 11351151263C for ; Thu, 28 Feb 2019 18:30:50 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: from mail-it1-x12c.google.com (mail-it1-x12c.google.com [IPv6:2607:f8b0:4864:20::12c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1288A808E8 for ; Thu, 28 Feb 2019 18:30:49 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: by mail-it1-x12c.google.com with SMTP id l139so15089398ita.5 for ; Thu, 28 Feb 2019 10:30:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dragondata.com; s=google; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=QGZsIUYn/uXrg9gNYx7H0nvpISnPh9LV2wWc7f34BPo=; b=m5dIx3FrgrGefFpOOUwraNiL73Km2noZVfE3E7iOkmrJidm3x0c7wLKu616q1MkBU2 ypfknbEjJGVT2gdPFdFgWc4Ko/wnVQKDz+rBd2Akq7iSk/TKsLxNK+OPKYGRgJpkqhus 7LmyHfT/SGmbhFvLryuxJ4DzjVlWXLlZ5liRw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=QGZsIUYn/uXrg9gNYx7H0nvpISnPh9LV2wWc7f34BPo=; b=bHTUqFNwIV8C+IDzSB1Xy6Y2yf66szlgz6sK3c1r1qLk5KvoFHP5Ka/jxFDI34CyQN vpLiDkN4cwc2ycQBtu7NRkiOLlfLfzmNx9YxrL3OQnHVG1pgo8FWv6JUGQUUWUUbUzl4 9Kez8T6U0+I+E3ENPECrOZa3LwLDQ04JUcYEM3IVUs51AxxtmtTw6DW+ZTmjDS+42mBi VJjsw/8yYv+iF15azEDqVW8RKW4gwBTuH6HmgEC2Rh9U+nc0omcrevejBCE5iNVyX2tp LC0WX2aJNI+NMisJirkET3/oYiN8VLHXmoj/9LE+BF3ba0OJFDbliBRGHLcu1WyHlm8y hilg== X-Gm-Message-State: APjAAAUKRBlpjfALC8NZgvru8G4wjl2cgG57IBb1fRxaZrP8uQQLHNaS gD2bCUMX7+J/mpU4NyNuNq/XmQ== X-Google-Smtp-Source: APXvYqxJ4H+Sa2hhLOuFFs25FJBxXT8Tnh/qb2A0ePGljVPij4AeSmO3bgOZW1YPyORZBt+mmvzzAQ== X-Received: by 2002:a02:4f1c:: with SMTP id c28mr272981jab.112.1551378648196; Thu, 28 Feb 2019 10:30:48 -0800 (PST) Received: from i82.cfv.net (i82.cfv.net. [204.9.51.82]) by smtp.gmail.com with ESMTPSA id a4sm3144841ita.41.2019.02.28.10.30.46 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 28 Feb 2019 10:30:47 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: bhyve PCIe passthrough on AMD Epyc From: Kevin Day In-Reply-To: Date: Thu, 28 Feb 2019 12:30:46 -0600 Cc: "Rodney W. Grimes" , "freebsd-virtualization@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <201902280534.x1S5YMQS054621@pdx.rh.CN85.dnsmgr.net> <98792A76-1723-458D-A7B4-BB3F74D9F26C@dragondata.com> To: Anish X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 1288A808E8 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dragondata.com header.s=google header.b=m5dIx3Fr X-Spamd-Result: default: False [-5.55 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[dragondata.com:+]; MX_GOOD(-0.01)[cached: ASPMX3.GOOGLEMAIL.com]; NEURAL_HAM_SHORT(-0.99)[-0.987,0]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[dragondata.com:s=google]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[dragondata.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[c.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; IP_SCORE(-2.76)[ip: (-8.98), ipnet: 2607:f8b0::/32(-2.71), asn: 15169(-2.03), country: US(-0.07)] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Feb 2019 18:30:50 -0000 > On Feb 28, 2019, at 12:28 PM, Anish wrote: >=20 > Hi Kevin, > >I'm just pointing out that it's an AMD Epyc because I know the AMD = IOMMU/AMD-Vi code was added somewhat more recently than Intel's and is = maybe less tested. > I tested on Ryzen-I, not sure if anyone tried it on newer Ryzen/Epyc = systems. >=20 > >CPU0: local APIC error 0x40 > This is concerning, as per AMD docs, bit6 is for illegal vector which = indicate CPU is getting invalid interrupts. >=20 > Can you share hw.vmm sysctl output? >=20 > -Anish Sure: hw.vmm.amdvi.domain_id: 4 hw.vmm.amdvi.disable_io_fault: 0 hw.vmm.amdvi.ptp_level: 4 hw.vmm.amdvi.host_ptp: 1 hw.vmm.amdvi.enable: 1 hw.vmm.amdvi.count: 8 hw.vmm.npt.pmap_flags: 507 hw.vmm.svm.num_asids: 32768 hw.vmm.svm.disable_npf_assist: 0 hw.vmm.svm.features: 113919 hw.vmm.svm.vmcb_clean: 1023 hw.vmm.vmx.l1d_flush_sw: 0 hw.vmm.vmx.l1d_flush: 0 hw.vmm.vmx.vpid_alloc_failed: 0 hw.vmm.vmx.posted_interrupt_vector: -1 hw.vmm.vmx.cap.posted_interrupts: 0 hw.vmm.vmx.cap.virtual_interrupt_delivery: 0 hw.vmm.vmx.cap.invpcid: 0 hw.vmm.vmx.cap.monitor_trap: 0 hw.vmm.vmx.cap.unrestricted_guest: 0 hw.vmm.vmx.cap.pause_exit: 0 hw.vmm.vmx.cap.halt_exit: 0 hw.vmm.vmx.initialized: 0 hw.vmm.vmx.cr4_zeros_mask: 0 hw.vmm.vmx.cr4_ones_mask: 0 hw.vmm.vmx.cr0_zeros_mask: 0 hw.vmm.vmx.cr0_ones_mask: 0 hw.vmm.vmx.no_flush_rsb: 0 hw.vmm.ept.pmap_flags: 0 hw.vmm.vrtc.flag_broken_time: 1 hw.vmm.ppt.devices: 1 hw.vmm.iommu.enable: 1 hw.vmm.iommu.initialized: 1 hw.vmm.bhyve_xcpuids: 312 hw.vmm.topology.cpuid_leaf_b: 1 hw.vmm.create: beavis hw.vmm.destroy: beavis hw.vmm.trace_guest_exceptions: 0 hw.vmm.ipinum: 251 hw.vmm.halt_detection: 1 From owner-freebsd-virtualization@freebsd.org Sat Mar 2 09:48:31 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CDDE5151B207 for ; Sat, 2 Mar 2019 09:48:31 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CF77A869BB for ; Sat, 2 Mar 2019 09:48:30 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=3rNzu27mu76IlgCX6CAfl9BpwGpGrB+aLULGYCLTrsk=; b=N03jf/V1hNKO1FkqT38fDrDCKT xbbcGLyUrHdGle3q9YSO2biKBYP9LIZvh+Ia/YSuXvt0rzbYlLvrstpixdswifcO8fk4BmySeNLvc RHJvSWwQAMhkl9BBV0R1iLwL9dPQsNH3VSBVQcKELAoBz7t/P1hN35adMU9td1296fso=; Received: from vas by admin.sibptus.ru with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1h01Ft-000CdA-8u for freebsd-virtualization@freebsd.org; Sat, 02 Mar 2019 16:48:29 +0700 Date: Sat, 2 Mar 2019 16:48:29 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: Re: Windows 2019 server Message-ID: <20190302094829.GA48523@admin.sibptus.ru> References: <20190216123859.GA24315@doctor.nl2k.ab.ca> <40ddfdd6-a1c4-ac00-f088-2880a7d372ce@smeets.xyz> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VbJkn9YxBvnuCH5J" Content-Disposition: inline In-Reply-To: <40ddfdd6-a1c4-ac00-f088-2880a7d372ce@smeets.xyz> X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.11.2 (2019-01-07) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 02 Mar 2019 09:48:32 -0000 --VbJkn9YxBvnuCH5J Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Florian Smeets via freebsd-virtualization wrote: > On 16.02.19 13:38, The Doctor via freebsd-virtualization wrote: > > Anyone got Windows 2019 server running in bhyve ? > >=20 >=20 > Yes, on stable/12 (r343339) using > https://github.com/churchers/vm-bhyve/wiki/Running-Window. Worked like a > charm. Which kind of storage did you present to the Windows 2019 guest, paravirtualized or ahcd-hd ? --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --VbJkn9YxBvnuCH5J Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcelFtAAoJEA2k8lmbXsY01lMH/R2w/LlfQeAagSVccON3ffbo WTw+sqoneLEBtqtDWaiHaQAbVDt7YVLOfYwwKKs1m5eIWtUyjrm55bq1wsjqNvqt pbXbopgBNvmczkc/LbeSxVZ/JoKUY7qzWzz2ffdSbJNHTJWXoWMsWtd91Y8bHgHo ROR41UzTDmraSqiB+F0nuJdT/EvaC/UGZ5OKeyvjPcwWuxQ2FOHvbTNk5U4cZ59v QzERTJdEtbkBszVf2lDzIQrZxzW0O+DNRpHVIZ6QwkMIXFwdNBVLopZR2WfnoTWi DL2Eef+TGEEUwXMCd0Ji4aCbtBoT/HPlpa0ZYigzgfa1xraN7ZwgvU28nngGDCo= =/RYU -----END PGP SIGNATURE----- --VbJkn9YxBvnuCH5J--