From owner-freebsd-virtualization@freebsd.org Wed Jan 8 21:59:28 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D28661FC5C3 for ; Wed, 8 Jan 2020 21:59:28 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-oi1-f195.google.com (mail-oi1-f195.google.com [209.85.167.195]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47tNSc0z72z4ClP for ; Wed, 8 Jan 2020 21:59:27 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-oi1-f195.google.com with SMTP id p125so4065640oif.10 for ; Wed, 08 Jan 2020 13:59:27 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=wnoncx8YjYNzbsH4c01G7CeSFXENAP5jMmYc0c58pto=; b=SCuZbcc4hfFmeDCGfJizMb0v8et/2R0/4Y0FQK4Nputm1+UVw6rj9ZTCC2ZTmdSXM/ XXmD7uoisxTesicXWOOO7SXFF8ypeygJKx0Q2F/9Tbppaac6VW8gpXInnT0sp7Jxklkz DqoWbUAzty3sq60ViwshpkNstH4q51Bx1kaAXraiZslGKLnOAzVnUaCI6nLoW/iX9j2J hwABuf4n3FMyrRN4QyqzcD5ipbXkoWGic0EycCs7Npuw3emurG27Px6/hp8a5EGPyGPW wBe3mJdqbfdT6AKSfwv4cRuVY6pglHxQmxmhZ9IxQNJfNAL6LyrISInK36rFYABQ12Z2 cSdA== X-Gm-Message-State: APjAAAWEmr9nV4zE6h9SCrEhssLht1MaBMboD+V71cp8Y64fS6MBD27F yo+yceOXzqXOb8Vtl+aIiaWvauIA8QVsqK3xGboHzMzN X-Google-Smtp-Source: APXvYqyHIGeEnHbqlcXfXj7mSwxJMkz5R5X7FhZASiVIaiZjfv4AZSLznoVQu9OH945RfI9XU9lfhKfkKhbRhWTmeBQ= X-Received: by 2002:aca:f20b:: with SMTP id q11mr616081oih.78.1578520765705; Wed, 08 Jan 2020 13:59:25 -0800 (PST) MIME-Version: 1.0 References: <202001082137.008LbZl9091675@gndrsh.dnsmgr.net> In-Reply-To: <202001082137.008LbZl9091675@gndrsh.dnsmgr.net> From: Jason Tubnor Date: Thu, 9 Jan 2020 08:59:14 +1100 Message-ID: Subject: Re: bhyve issues on Dell C6220 node To: "Rodney W. Grimes" Cc: Matt Churchyard , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 47tNSc0z72z4ClP X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.167.195 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[tubnor.net]; TO_DN_SOME(0.00)[]; URI_COUNT_ODD(1.00)[3]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[195.167.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.00)[ipnet: 209.85.128.0/17(-3.10), asn: 15169(-1.85), country: US(-0.05)]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[195.167.85.209.rep.mailspike.net : 127.0.0.17]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jan 2020 21:59:28 -0000 On Thu, 9 Jan 2020 at 08:37, Rodney W. Grimes wrote: > > > > Loading kernel... > > /boot/kernel/kernel text=0x168fdf1 data=0x1d0a68+0x768d80 > syms=[0x8+0x178bc0+0x8+0x1969d5] > > Loading configured modules... > > can't find '/boot/entropy' > > / > > " > > > > I get either a "|" or "/" character, then nothing else. > > My experience has been when I see this it is a "wrong console" issue, ie > the kernel > has decided to use something else for a console and your output is going > there. > > It might be your setup using a UEFI with a fb console up to the end of the > loader, > then the kernel decides it is using a serial console. Or vice versa. > > Rod is correct. I came across this issue in 12.0 and probably is also in 11.3 by now. See here: https://wiki.freebsd.org/bhyve/UEFI for some tips that may help you work out where your console is redirecting. I use UEFI for all guest operating systems with a custom UEFI loader that has been fixed to handle OpenBSD (as you know :-) ). > > > I've also tested a windows server 2016 guest, and while that will > actually install via UEFI, it is noticeably slow - over a minute to boot to > the login screen and everything crawls along > > > 2016 is slow (even slower doing windows updates). 2019 is much better. A tip I have found is a minimum of 1 cpu, 2 cores and 4 threads to get decent speed from that OS (more CPUs in bhyve tends to make performance worse - in my observations - in 2016). Also, use the Virtio collection from RedHat for vionet and viostor. We are currently using 0.1.171 without issue. The ahci emulation in itself is extremely slow. NVMe and virtio is really the only way to go.