From owner-freebsd-hackers@freebsd.org Mon Aug 19 16:59:44 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DED0ECB52C for ; Mon, 19 Aug 2019 16:59:44 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46C0XH72Nrz42Sn for ; Mon, 19 Aug 2019 16:59:43 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x829.google.com with SMTP id x4so2663299qts.5 for ; Mon, 19 Aug 2019 09:59:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=iusklYsgUNQJmX9+v1EnCRTiIVPfeZ9TwBeAtUuiz6U=; b=Pg4UXN4ijsHtkUy/4qcIfJsWyAEr+NDlz5vojuq83BfwsUQnE7DRazJQ/LtDmhuUA1 4OCXUej2ti9+YVhPs5hoZDezprK8lNuBzHAVFvo8bW/X4sggPg5j6mB6Lfaho7jmlUAI DdT566pS7QV0z4dcAXORnbrRQV3TU0cYfrhNpVzkCV3lolt9YR3r7UgOs+DTvLj6q0+q psNHonHcXJobV6+VIMS7Za3NYlJD1QLmVWYsRz5vo+9kI5V6lXlxW+FU9J8/FiloUiGG avuzPwZv2lB9TGKOj4R9N4vulPkA8pO/SOvvPghXBVHOen4gSGnA1e1UB/bckI7KmY5u WYZg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=iusklYsgUNQJmX9+v1EnCRTiIVPfeZ9TwBeAtUuiz6U=; b=HYHkVSb2hPsy3AXsiktopAO9yTxiwh04AvqPwWzLUNBDPgkMh01VSPj9NE3rJLCeMJ Bd9RX/CnyVfgKMw6EMeujyArzmCni50Xyb/sGNgwBA3pjn6U6j0clgJ8rvHNnoRTSSse mWEDXbdp1DNsPhnOHhmWiFsCl/bOXQ0/rANQ8g+2OaX41IERkbDgsaKnya31vGlVWa0b Q3PTXZ6X8w3yNuMJ1zmxl1woT+H6ZoF2nspUZbdD9dCqEbPImA9o4cyu82YeQzYmCFXW CiCAhrD5RGNMvYviJC6o7hMlkBtC6rcZXYrQEgtLXaK72RIypQtUMP9UT9FtZHKp5xRo SG2A== X-Gm-Message-State: APjAAAXPxszukTkVVrBcUTaChODy7OK1IWl0rWN1N+m071IEROQGA41Y EU8nRaBdKUzZYB2ErYr1Pn2tc9gCZYBbRpTBiPOTgvD3bMQ= X-Google-Smtp-Source: APXvYqxIKYjNX0aKvav8MI1iXZeQRk+DpsWzQzssoDC5MXELbNcevnLoS6Em+3x0y51E03S9CnKluJiDd4f9+hqTwaY= X-Received: by 2002:ac8:6907:: with SMTP id e7mr2257689qtr.32.1566233982190; Mon, 19 Aug 2019 09:59:42 -0700 (PDT) MIME-Version: 1.0 References: <201908191529.x7JFT4lN045007@gndrsh.dnsmgr.net> In-Reply-To: <201908191529.x7JFT4lN045007@gndrsh.dnsmgr.net> From: Warner Losh Date: Mon, 19 Aug 2019 10:59:31 -0600 Message-ID: Subject: Re: bhyve problem To: "Rodney W. Grimes" Cc: Wojciech Puchar , FreeBSD Hackers X-Rspamd-Queue-Id: 46C0XH72Nrz42Sn X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=Pg4UXN4i; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::829) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-4.94 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-0.996,0]; RCVD_IN_DNSWL_NONE(0.00)[9.2.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; HTTP_TO_IP(1.00)[]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; IP_SCORE(-2.95)[ip: (-9.39), ipnet: 2607:f8b0::/32(-2.93), asn: 15169(-2.37), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Aug 2019 16:59:44 -0000 On Mon, Aug 19, 2019 at 9:29 AM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > I wonder which kernel interface changed in an incompatible way... > > The fact that he had a new user land with an ioctl that > does not exist in his kernel would be the "incompatible way". > > The ioctl didnt exist so an error was returned. > Nothing more in the name of compatibility could be done. > I'm concerned that the errors weren't properly reported so the OP had to send mail to the mailing list. Either we need a better error reporting mechanism or need to back to the old way of doing things when the new way fails... Warner > > Warner > > > > On Mon, Aug 19, 2019, 1:05 AM Wojciech Puchar wrote: > > > > > the problem was that i upgraded userland, compiled kernel but forgot to > > > install kernel. > > > > > > > > > On Sun, 18 Aug 2019, Rodney W. Grimes wrote: > > > > > > >> after updating system to > > > >> > > > >> FreeBSD puchar.net 11.3-PRERELEASE FreeBSD 11.3-PRERELEASE #2 > r347617: > > > Sat > > > >> Jun 1 18:32:23 CEST 2019 > > > >> root@puchar.net:/h/backup1/src/sys/amd64/compile/puchar amd64 > > > >> > > > >> bhyve no longer works > > > >> > > > >> attempts to start VM that worked normally like > > > >> > > > >> nice -n -20 /usr/sbin/bhyve -s 0,hostbridge -m 2048M -P -H -c 2 \ > > > > ^^^^ > > > > This is the topology, it looks fine. Hummm... > > > > You could try "-c cpus=2" but that should make no difference at all. > > > > > > > > Are you by any chance having syctl's for cpu topology set? > > > > hw.vmm.topology.cores_per_package > > > > hw.vmm.topology.threads_per_core > > > > > > > > Can you show me the output of: > > > > sysctl -a hw.vmm.topology > > > > > > > > > > > >> -s 7,fbuf,rfb=10.0.1.1:5902,password=2j74uo5 \ > > > >> -s > > > > 3,ahci-hd,/dev/label/Windows2-C.eli,hd:/dev/label/Windows2-U.eli,hd:/dev/label/Windows2-V.eli > > > \ > > > >> -s 5,virtio-net,tap5,mac=08:00:27:b7:ca:0b \ > > > >> -s 30,virtio-rnd -s 31,lpc -U dc53b3f7-7eb0-11e7-b5b8-54ee7513f26b \ > > > >> -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -w windows2 > > > >> /usr/sbin/bhyvectl --destroy --vm=windows2 > > > >> > > > >> > > > >> results in > > > >> > > > >> bhyve: vm_set_topology > > > > > > > > Humm.. you have 2 commands above, which one produced this error? > > > > I think you actually only ran the first command which failed, and > > > > you never actually ran the second command. > > > > > > > > If it is the first command that is failing can you do a > > > > ls -lag /dev/vmm/windows2 > > > > BEFORE you run that command, I want to see if this might > > > > be a reinit attempt. > > > > > > > >> on console > > > >> > > > >> and bhyve exits. no more messages. no VM. > > > >> > > > >> what's wrong? > > > > > > > > -- > > > > Rod Grimes > > > rgrimes@freebsd.org > > > > _______________________________________________ > > > > freebsd-hackers@freebsd.org mailing list > > > > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > > > To unsubscribe, send any mail to " > > > freebsd-hackers-unsubscribe@freebsd.org" > > > > > > > > > > > _______________________________________________ > > > freebsd-hackers@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > > To unsubscribe, send any mail to " > freebsd-hackers-unsubscribe@freebsd.org" > > > > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to " > freebsd-hackers-unsubscribe@freebsd.org" > > > > -- > Rod Grimes > rgrimes@freebsd.org >