From owner-freebsd-virtualization@freebsd.org Sun Sep 13 06:30:22 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 985DF3EE79E for ; Sun, 13 Sep 2020 06:30:22 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from vito-vars.onthenet.com.au (vito-vars.OntheNet.com.au [203.13.68.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bq03f0fgVz3WyY for ; Sun, 13 Sep 2020 06:30:21 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by vito-vars.onthenet.com.au (Postfix) with ESMTPS id 9BB3C2094E69 for ; Sun, 13 Sep 2020 16:30:16 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 8417A20AE980 for ; Sun, 13 Sep 2020 16:30:16 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 7A4E9209C01F for ; Sun, 13 Sep 2020 16:30:16 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id ZcSsfQ3yxNvZ for ; Sun, 13 Sep 2020 16:30:16 +1000 (AEST) Received: from MacBook-Air-4.local (CPE-120-29-42-110.dsl.OntheNet.net [120.29.42.110]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 98AA2209C01A; Sun, 13 Sep 2020 16:30:14 +1000 (AEST) Subject: Re: Nested Virtualization Under KVM Hypervisor To: Pete Wright Cc: FreeBSD virtualization References: <5eacd0a5-89bd-cc98-6c5a-d5490e33b100@freebsd.org> <5e62480f-14cb-5963-f753-8562aab381e3@nomadlogic.org> From: Peter Grehan Message-ID: <5ffc62fe-96ac-a834-1682-1be2a9f50d6d@freebsd.org> Date: Sun, 13 Sep 2020 16:30:14 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=bM+N3M2Z c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=reM5J-MqmosA:10 a=6I5d2MoRAAAA:8 a=csACVZsZR9-lm7JpNIUA:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=LtAJNkVc c=1 sm=1 tr=0 a=eF5wA05EhuPcU0j7PNT2Vg==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=reM5J-MqmosA:10 a=6I5d2MoRAAAA:8 a=csACVZsZR9-lm7JpNIUA:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 X-Rspamd-Queue-Id: 4Bq03f0fgVz3WyY X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Sep 2020 06:30:22 -0000 Hi Pete, > Ah I see - once I realized we had a newer kernel I didn't focus too much > on the first bug - here's the MSR's > > > MSR 0x480: 0x00981000 0x11e57ed0 > MSR 0x482: 0xfff9fffe 0x0401e172 > MSR 0x48b: 0x000003fb 0x00000000 > MSR 0x48c: 0x00000f01 0x04114040 This looks very similar to comment 14 in the bug report https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203994#c14 INS/OUTS isn't marked as supported, and single-context INVEPT is missing. As mentioned in comment 17, these are simple to work around but other issues started to show up, indicating that other problems are at play. Given kernel 4.15 looks like it could be from Ubuntu 16-LTS, I'd recommend moving to 18-LTS if that is possible, since that kernel version is known to work. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Sep 13 21:01:10 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2B8A03E8B2E for ; Sun, 13 Sep 2020 21:01:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BqMNP6sBqz3XrR for ; Sun, 13 Sep 2020 21:01:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id CCB973E8B2B; Sun, 13 Sep 2020 21:01:09 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CC5343E8B2A for ; Sun, 13 Sep 2020 21:01:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqMNP0z5dz3Y0K for ; Sun, 13 Sep 2020 21:01:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A6356C3AE for ; Sun, 13 Sep 2020 21:01:08 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08DL18fB050601 for ; Sun, 13 Sep 2020 21:01:08 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08DL18kX050600 for virtualization@FreeBSD.org; Sun, 13 Sep 2020 21:01:08 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202009132101.08DL18kX050600@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 13 Sep 2020 21:01:08 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Sep 2020 21:01:10 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon Sep 14 02:48:46 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 230EE3EF964 for ; Mon, 14 Sep 2020 02:48:46 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [174.136.98.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqW5S5wp8z455W; Mon, 14 Sep 2020 02:48:44 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.50] (cpe-23-243-161-111.socal.res.rr.com [23.243.161.111]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 019a2ab1 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Mon, 14 Sep 2020 02:48:37 +0000 (UTC) Subject: Re: Nested Virtualization Under KVM Hypervisor To: Peter Grehan Cc: FreeBSD virtualization References: <5eacd0a5-89bd-cc98-6c5a-d5490e33b100@freebsd.org> <5e62480f-14cb-5963-f753-8562aab381e3@nomadlogic.org> <5ffc62fe-96ac-a834-1682-1be2a9f50d6d@freebsd.org> From: Pete Wright Message-ID: <8ce4ea45-f6e8-7560-1e4c-dfa24e5b2289@nomadlogic.org> Date: Sun, 13 Sep 2020 19:48:32 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <5ffc62fe-96ac-a834-1682-1be2a9f50d6d@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4BqW5S5wp8z455W X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 174.136.98.114 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-2.74 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[nomadlogic.org]; NEURAL_HAM_LONG(-1.03)[-1.034]; RECEIVED_SPAMHAUS_PBL(0.00)[23.243.161.111:received]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.41)[-0.412]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:25795, ipnet:174.136.96.0/20, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 02:48:46 -0000 On 9/12/20 11:30 PM, Peter Grehan wrote: > Hi Pete, > >> Ah I see - once I realized we had a newer kernel I didn't focus too >> much on the first bug - here's the MSR's >> >> >> MSR 0x480: 0x00981000 0x11e57ed0 >> MSR 0x482: 0xfff9fffe 0x0401e172 >> MSR 0x48b: 0x000003fb 0x00000000 >> MSR 0x48c: 0x00000f01 0x04114040 > >  This looks very similar to comment 14 in the bug report >      https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203994#c14 > >  INS/OUTS isn't marked as supported, and single-context INVEPT is > missing. As mentioned in comment 17, these are simple to work around > but other issues started to show up, indicating that other problems > are at play. > >  Given kernel 4.15 looks like it could be from Ubuntu 16-LTS, I'd > recommend moving to 18-LTS if that is possible, since that kernel > version is known to work. > Thanks Peter for this feedback!  I'll relay this info back to my hosting provider. Cheers, -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-virtualization@freebsd.org Mon Sep 14 08:12:47 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 23D073F6808 for ; Mon, 14 Sep 2020 08:12:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BqfHM0DMfz4NMJ for ; Mon, 14 Sep 2020 08:12:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 07B8B3F646D; Mon, 14 Sep 2020 08:12:47 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 077E73F66A7 for ; Mon, 14 Sep 2020 08:12:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqfHL6Qbxz4NPr for ; Mon, 14 Sep 2020 08:12:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BE4CB13EF5 for ; Mon, 14 Sep 2020 08:12:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08E8Ckam038829 for ; Mon, 14 Sep 2020 08:12:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08E8CkQm038826 for virtualization@FreeBSD.org; Mon, 14 Sep 2020 08:12:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 229167] [Hyper-V] [Jun 19, 2018] Recently FreeBSD VM panics during boot-up, especially with Mellanox VF configured Date: Mon, 14 Sep 2020 08:12:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: weh@microsoft.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 08:12:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229167 --- Comment #37 from Wei Hu --- I hit this bug on FreeBSD 12.1 image in Azure with Mellanox CX3 VF. Looks t= he root file system is not available at the time mlx4 driver is trying to load mlx4en kernel module. Adding one second sleep in mlx4_request_modules makes= the problem go away. But it doesn't look like a fix to me. At least namei() or vrefact() should check if the vnode is NULL to avoid the panic.=20 Here is the detailed troubleshooting in debugger I did when the crash happe= ned. The panic on console: ---------------------- pci1: on pcib1 mlx4_core0: at device 2.0 on pci1 <6>mlx4_core: Mellanox ConnectX core driver v3.5.1 (April 2019) mlx4_core: Initializing mlx4_core mlx4_core0: Detected virtual function - running in slave mode mlx4_core0: Sending reset mlx4_core0: Sending vhcr0 mlx4_core0: HCA minimum page size:512 mlx4_core0: Timestamping is not supported in slave mode mlx4_en mlx4_core0: Activating port:1 mlxen0: Ethernet address: 00:0d:3a:e8:16:18 <4>mlx4_en: mlx4_core0: Port 1: Using 4 TX rings mlxen0: link state changed to DOWN <4>mlx4_en: mlx4_core0: Port 1: Using 4 RX rings <4>mlx4_en: mlxen0: Using 4 TX rings hn0: link state changed to DOWN <4>mlx4_en: mlxen0: Using 4 RX rings <4>mlx4_en: mlxen0: Initializing port mlx4_core0: About to load mlx4_en Fatal trap 12: page fault while in kernel mode cpuid =3D 2; apic id =3D 02 fault virtual address =3D 0x1d8 <- 0x1d8 is the offset of (struct vnode *)->v_type=20 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80cb5c34 stack pointer =3D 0x28:0xfffffe00004f4960 frame pointer =3D 0x28:0xfffffe00004f4960 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (vmbusdev) trap number =3D 12 panic: page fault cpuid =3D 2 time =3D 1599838711 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00004f4= 610 vpanic() at vpanic+0x19d/frame 0xfffffe00004f4660 panic() at panic+0x43/frame 0xfffffe00004f46c0 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe00004f4720 trap_pfault() at trap_pfault+0x49/frame 0xfffffe00004f4780 trap() at trap+0x29f/frame 0xfffffe00004f4890 calltrap() at calltrap+0x8/frame 0xfffffe00004f4890 --- trap 0xc, rip =3D 0xffffffff80cb5c34, rsp =3D 0xfffffe00004f4960, rbp = =3D 0xfffffe00004f4960 --- vrefact() at vrefact+0x4/frame 0xfffffe00004f4960 namei() at namei+0x172/frame 0xfffffe00004f4a20 vn_open_cred() at vn_open_cred+0x221/frame 0xfffffe00004f4b70 linker_load_module() at linker_load_module+0x480/frame 0xfffffe00004f4e90 kern_kldload() at kern_kldload+0xc3/frame 0xfffffe00004f4ee0 mlx4_request_modules() at mlx4_request_modules+0xc2/frame 0xfffffe00004f4fa0 mlx4_load_one() at mlx4_load_one+0x349c/frame 0xfffffe00004f5660 mlx4_init_one() at mlx4_init_one+0x3f0/frame 0xfffffe00004f56b0 linux_pci_attach() at linux_pci_attach+0x432/frame 0xfffffe00004f5710 device_attach() at device_attach+0x3e1/frame 0xfffffe00004f5760 bus_generic_attach() at bus_generic_attach+0x5c/frame 0xfffffe00004f5790 pci_attach() at pci_attach+0xd5/frame 0xfffffe00004f57d0 device_attach() at device_attach+0x3e1/frame 0xfffffe00004f5820 bus_generic_attach() at bus_generic_attach+0x5c/frame 0xfffffe00004f5850 vmbus_pcib_attach() at vmbus_pcib_attach+0x75e/frame 0xfffffe00004f5930 device_attach() at device_attach+0x3e1/frame 0xfffffe00004f5980 device_probe_and_attach() at device_probe_and_attach+0x42/frame 0xfffffe00004f59b0 vmbus_add_child() at vmbus_add_child+0x7b/frame 0xfffffe00004f59e0 taskqueue_run_locked() at taskqueue_run_locked+0x154/frame 0xfffffe00004f5a= 40 taskqueue_thread_loop() at taskqueue_thread_loop+0x98/frame 0xfffffe00004f5= a70 fork_exit() at fork_exit+0x83/frame 0xfffffe00004f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f5ab0 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- KDB: enter: panic [ thread pid 0 tid 100080 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> x/i vrefact,10 vrefact: pushq %rbp vrefact+0x1: movq %rsp,%rbp vrefact+0x4: cmpl $0x4,ll+0x1b7(%rdi) <-- if (__predict_false(vp->v_= type =3D=3D VCHR)) in vrefact() vrefact+0xb: jz vrefact+0x1f vrefact+0xd: lock addl $0x1,ll+0x19b(%rdi) vrefact+0x15: lock addl $0x1,ll+0x19f(%rdi) vrefact+0x1d: popq %rbp vrefact+0x1e: ret db> x/i namei+0x160,10 namei+0x160: call _sx_slock_int namei+0x165: movq 0x10(%r13),%rdi namei+0x169: movq %rdi,ll+0x7(%rbx) namei+0x16d: call vrefact <--- Place in namei() calling vrefact() namei+0x172: movq 0x18(%r13),%rax namei+0x176: movq %rax,ll+0xf(%rbx) namei+0x17a: movq ll+0x77(%rbx),%rax This is the code in namei(): /* * Get starting point for the translation. */ FILEDESC_SLOCK(fdp); ndp->ni_rootdir =3D fdp->fd_rdir; vrefact(ndp->ni_rootdir); <--- here ndp->ni_topdir =3D fdp->fd_jdir; And fdp is (struct filedesc *) and got assigned earlier to the current proc= 's p_fd: p =3D td->td_proc; ... fdp =3D p->p_fd; db> show thread Thread 100080 at 0xfffff80004a95000: proc (pid 0): 0xffffffff81ff2060 <--- pointer to proc name: vmbusdev stack: 0xfffffe00004f2000-0xfffffe00004f5fff flags: 0x4 pflags: 0x200000 state: RUNNING (CPU 2) priority: 8 container lock: sched lock 2 (0xffffffff81eb3540) last voluntary switch: 50 ms ago db> x/gx 0xffffffff81ff2060,20 (struct proc) proc0: 0 fffff80003609a60=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20 ffffffff81ff25a0 proc0+0x18: fffff80009866010 ffffffff81332c23 proc0+0x28: 30000 0 proc0+0x38: 0 fffff8000308ad00 proc0+0x48: fffff800035168a0 (p_fd) 0 proc0+0x58: fffff80003084e00 fffff8000308ac00 db> x/gx 0xfffff800035168a0, 10 (struct filedesc) 0xfffff800035168a0: fffff80003516920 0 0xfffff800035168b0: 0 (fd_rdir) 0 0xfffff800035168c0: fffff80003516ce8 ffffffff 0xfffff800035168d0: 100000012 1 0xfffff800035168e0: ffffffff812c4e35 2330000 0xfffff800035168f0: 0 21 0xfffff80003516900: 0 0 0xfffff80003516910: 0 0 So at the moment the fd_rdir (root directory) is still NULL. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon Sep 14 23:28:29 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 410EB3E5328 for ; Mon, 14 Sep 2020 23:28:29 +0000 (UTC) (envelope-from ctuffli@gmail.com) Received: from mail-qt1-f181.google.com (mail-qt1-f181.google.com [209.85.160.181]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Br2bw1FyMz4SwS for ; Mon, 14 Sep 2020 23:28:27 +0000 (UTC) (envelope-from ctuffli@gmail.com) Received: by mail-qt1-f181.google.com with SMTP id e7so1710803qtj.11 for ; Mon, 14 Sep 2020 16:28:27 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=hEHVf0YkMhTRB1hwWL+bcPITr8rySpkrEbehtZCKMnI=; b=rHnaoIxBBnKKeMonj+q8DCVAmMzaXCClx9Oyg+JC/jG2GljDdDETZ3aTGp1Q15rT7P PSZQnW29SOdZcwTTwpsdku73JpxrAgGvmhTy67+MEGtJvPmVJs0km4pOKL6M+QxUWWqC qvSEcU9QillJsgDqqEGZx1R2O8VP4RZvA/eL7lpIOsoCnh2PrmOVuqQ4z9GSpsIWoLhD lLBygISEjm4S1G08UFIm9e9L9QvHKxQustJJXIJaQ1xmOtFV9lpWoK/lb//4zksByOcf yjI786THgDiW1OplhXMk9+5amYRL3SwiK/19NQ9wpjrWeMIWfgJF197cOmj1WrLdzw3N 8kfQ== X-Gm-Message-State: AOAM530rf2inKqOlz+W5PXd+vRdV8mIRU8+o0hXBr+T90GTu9en+40c1 2cxpMJxSE3eyUKyFCCCvs7MpMzRVrfY= X-Google-Smtp-Source: ABdhPJwr2d2wsSQaajfeeL6RdUeDYGbMUIRNDAr9WP1LLx1fdKNgpJynvKWfRXFEE5pu178hhBOA7A== X-Received: by 2002:ac8:22fb:: with SMTP id g56mr15527395qta.141.1600126106964; Mon, 14 Sep 2020 16:28:26 -0700 (PDT) Received: from mail-yb1-f172.google.com (mail-yb1-f172.google.com. [209.85.219.172]) by smtp.gmail.com with ESMTPSA id g8sm15044105qkl.28.2020.09.14.16.28.26 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 14 Sep 2020 16:28:26 -0700 (PDT) Received: by mail-yb1-f172.google.com with SMTP id p81so1089436ybc.12 for ; Mon, 14 Sep 2020 16:28:26 -0700 (PDT) X-Received: by 2002:a25:e70c:: with SMTP id e12mr8996274ybh.238.1600126106560; Mon, 14 Sep 2020 16:28:26 -0700 (PDT) MIME-Version: 1.0 From: Chuck Tuffli Date: Mon, 14 Sep 2020 16:28:15 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: grub-bhyve device map file usage To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Br2bw1FyMz4SwS X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ctuffli@gmail.com designates 209.85.160.181 as permitted sender) smtp.mailfrom=ctuffli@gmail.com X-Spamd-Result: default: False [-1.99 / 15.00]; RCVD_TLS_ALL(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[209.85.160.181:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.91)[-0.914]; RCVD_COUNT_THREE(0.00)[4]; ARC_NA(0.00)[]; NEURAL_HAM_SHORT(-0.23)[-0.225]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.181:from]; NEURAL_HAM_MEDIUM(-0.85)[-0.846]; FORGED_SENDER(0.30)[chuck@freebsd.org,ctuffli@gmail.com]; DMARC_NA(0.00)[freebsd.org]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[chuck@freebsd.org,ctuffli@gmail.com]; MAILMAN_DEST(0.00)[freebsd-virtualization]; TO_DOM_EQ_FROM_DOM(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 23:28:29 -0000 Hi I'm working on an update to grub-bhyve and wanted to know if people's map files differ from: (hd0) /some/path/to/the/disk.img Primarily, I'm interested if the map files use a device other than 'hd', but I'd also be curious about use cases involving more than one entry. TIA! --chuck From owner-freebsd-virtualization@freebsd.org Tue Sep 15 00:28:48 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E5F763E6C8A for ; Tue, 15 Sep 2020 00:28:48 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from vito-vars.onthenet.com.au (vito-vars.OntheNet.com.au [203.13.68.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Br3xW61P6z4X6y for ; Tue, 15 Sep 2020 00:28:47 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by vito-vars.onthenet.com.au (Postfix) with ESMTPS id 00A2620849C2 for ; Tue, 15 Sep 2020 10:28:38 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id DDFDF20AE981 for ; Tue, 15 Sep 2020 10:28:37 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id CF6FB20F4D37 for ; Tue, 15 Sep 2020 10:28:37 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 1lcDH7EiOrCA for ; Tue, 15 Sep 2020 10:28:37 +1000 (AEST) Received: from MacBook-Air-4.local (CPE-120-29-42-110.dsl.OntheNet.net [120.29.42.110]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id A729520F4D27; Tue, 15 Sep 2020 10:28:37 +1000 (AEST) Subject: Re: grub-bhyve device map file usage To: Chuck Tuffli References: From: Peter Grehan Cc: freebsd-virtualization@freebsd.org Message-ID: <18cb3f46-e44e-435f-cb72-3c967e5084c0@freebsd.org> Date: Tue, 15 Sep 2020 10:28:37 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=bM+N3M2Z c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=reM5J-MqmosA:10 a=GgzEW1swoRsmkcCujrwA:9 a=QEXdDO2ut3YA:10 X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=LtAJNkVc c=1 sm=1 tr=0 a=eF5wA05EhuPcU0j7PNT2Vg==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=reM5J-MqmosA:10 a=GgzEW1swoRsmkcCujrwA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 4Br3xW61P6z4X6y X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Sep 2020 00:28:49 -0000 Hi Chuck, > I'm working on an update to grub-bhyve and wanted to know if people's > map files differ from: > (hd0) /some/path/to/the/disk.img > Primarily, I'm interested if the map files use a device other than > 'hd', but I'd also be curious about use cases involving more than one > entry. TIA! I use 'cd' as well as 'hd', and often have files with multiple entries for those e.g. "debian.map" that has a cd/hd for each version I was testing. The -r parameter was used to pick which one would be the bootable filesystem image. later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Sep 15 11:41:19 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 531B83F7CA1 for ; Tue, 15 Sep 2020 11:41:19 +0000 (UTC) (envelope-from list+org.freebsd.virtualization@io7m.com) Received: from mail.io7m.com (mail.io7m.com [45.77.76.92]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.io7m.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BrLsV4138z3yc5; Tue, 15 Sep 2020 11:41:18 +0000 (UTC) (envelope-from list+org.freebsd.virtualization@io7m.com) Received: from sunflower.int.arc7.info (unknown [IPv6:2a02:390:7502:2:0:2:4:0]) by mail.io7m.com (Postfix) with ESMTPSA id 852CD1F12A; Tue, 15 Sep 2020 11:41:10 +0000 (UTC) Date: Tue, 15 Sep 2020 11:40:59 +0000 From: Mark Raynsford To: Chuck Tuffli Cc: freebsd-virtualization@freebsd.org Subject: Re: grub-bhyve device map file usage Message-ID: <20200915114059.2ed1837a@sunflower.int.arc7.info> In-Reply-To: References: Organization: io7m.com OpenPGP: id=E36981ED130DB4F68D420248BBFFDB755BAED95D; url=http://www.io7m.com/pgp/E369_81ED_130D_B4F6_8D42_0248_BBFF_DB75_5BAE_D95D.key MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/97viY9XF/NyX=/RaAkspl57"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Rspamd-Queue-Id: 4BrLsV4138z3yc5 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.08 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[io7m.com:s=mail]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; NEURAL_SPAM_SHORT(0.06)[0.056]; NEURAL_HAM_LONG(-1.01)[-1.006]; HAS_ORG_HEADER(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.033]; DKIM_TRACE(0.00)[io7m.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[io7m.com,quarantine]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:45.77.76.0/22, country:US]; TAGGED_FROM(0.00)[org.freebsd.virtualization]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Sep 2020 11:41:19 -0000 --Sig_/97viY9XF/NyX=/RaAkspl57 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On 2020-09-14T16:28:15 -0700 Chuck Tuffli wrote: > Hi >=20 > I'm working on an update to grub-bhyve and wanted to know if people's > map files differ from: > (hd0) /some/path/to/the/disk.img > Primarily, I'm interested if the map files use a device other than > 'hd', but I'd also be curious about use cases involving more than one > entry. TIA! =46rom a production machine here: (hd0) /dev/zvol/storage/vm/66d99c52-9be0-434e-935e-7c7105952308/disk-0_1_0 (hd1) /dev/zvol/storage/vm/66d99c52-9be0-434e-935e-7c7105952308/disk-0_5_0 (cd0) /storage/images/debian-10.5.0-amd64-xfce-CD-1.iso hd0 is the boot device. hd1 is a larger disk image used to hold a database. cd0 is the installation media (and kept there in case we need to do some sort of rescue boot). --=20 Mark Raynsford | https://www.io7m.com --Sig_/97viY9XF/NyX=/RaAkspl57 Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQTjaYHtEw209o1CAki7/9t1W67ZXQUCX2CoTAAKCRC7/9t1W67Z XbcJAPsG937V/AGO6X9fa3CqAfWm6MNTR6BUrZ3CMQyVvQKspAEA4UiZZ0L7FU8S TCiMsQJr+qdSqnTPrCo4lGmQues+uQk= =c3iI -----END PGP SIGNATURE----- --Sig_/97viY9XF/NyX=/RaAkspl57-- From owner-freebsd-virtualization@freebsd.org Wed Sep 16 07:01:07 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6D1FC3D9ED7 for ; Wed, 16 Sep 2020 07:01:07 +0000 (UTC) (envelope-from weh@microsoft.com) Received: from APC01-PU1-obe.outbound.protection.outlook.com (mail-eopbgr1320117.outbound.protection.outlook.com [40.107.132.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Brrbj5RjVz4L7x for ; Wed, 16 Sep 2020 07:01:05 +0000 (UTC) (envelope-from weh@microsoft.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AEreIcOVIYop9kEgIIf06Rmmuvynv2tNrLRaFSb7cpaGmppEAJoeMoXeCD+NLibWK+tfo3lE+MXNgRzt+jxTeThD3zpc9ytPw62DpBKAc+zlpyYnMSpXAb2YC5hX/XcTJcy28sa1WmjrzDPQHyZoj6Gys5YqI2xJNLpn/oc1V9t5eL8ysWzIGeg1oSKwNpuIJ0jeJjZX/2VqUGpuO3Szrsli7wZsjyBJOv7AwNdpg1LVLN0d9g69cS1a3FdOAEwjeWXzSEDQajkSU+gVTPm0HIihbPuyYobIgXQp+UCpsfTszdXnqUYo0kMBl8zGjAjh+cAIksC7zP3PrekxqYiekQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fxUT2SrVF8C7K5J7ywkewurRY7ph7m0sFyBkTW+lsHA=; b=FusyJ4WDXpJqsSdf7VZKxPFb0ycZLCGKb+5bEkDirAzRLN/XeQJjEVekAZWrlzRCI3K6p15s7mLwQeWGGsryd0K0xFUcTzl6ifVeUHrf5GuHkiBVMS+E83veHxz2/LywNGTxkmie9kFdqkYyGFhFllPRupOuD2a8m/Tlm37Z79Jz4Y6ux1gF4EIj4y8+mADANksHTso3QXVL7AZGxkYhr27cDbw1wl1Zcgur/n87ptNuCOTHjFK8ZruCAe65diSztID98jdcCnscCovLrd81sPW/YTb45cM6IFMHQoHWjnWMCJXF9gXwvPJzdDHl0GHRN7OKEbJt7ekr+s2DrZ+1cQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none Received: from SG2P153MB0352.APCP153.PROD.OUTLOOK.COM (2603:1096:4:d4::23) by SG2P15301MB0062.APCP153.PROD.OUTLOOK.COM (2603:1096:3:10::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3412.3; Wed, 16 Sep 2020 07:00:59 +0000 Received: from SG2P153MB0352.APCP153.PROD.OUTLOOK.COM ([fe80::e1d4:23b8:2c19:4745]) by SG2P153MB0352.APCP153.PROD.OUTLOOK.COM ([fe80::e1d4:23b8:2c19:4745%6]) with mapi id 15.20.3412.003; Wed, 16 Sep 2020 07:00:59 +0000 From: Wei Hu To: "freebsd-virtualization@freebsd.org" Subject: MSR accesses that slows down the hypervisor/host Thread-Topic: MSR accesses that slows down the hypervisor/host Thread-Index: AdaL9HYbtJyLPxf3TL+CSKzmJaxdTwAApTvQ Date: Wed, 16 Sep 2020 07:00:58 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [167.220.255.32] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 3946e74f-8079-4f21-41b1-08d85a0e4416 x-ms-traffictypediagnostic: SG2P15301MB0062: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: KB810QaTzuFwAHBPesxFLACm3CYCc024fpGiyWL1VvT6ZUofZLT5HoIUB2Y7cBqOHf1IFoAnjSr4mpjdWG1LyyP2RNYQmAMHRNIepXqBwb+mJQJM/OhwbYyviBCN41kuTZUSNsKlK4tRCk0josfi/Zl0ZuDh5mGta9/lnDv6Diped5N2IVhR3j4JloqB0+wuGNDrtAvb5BBALhSw5ws2ZYVbYeXyi5Kpyj6jULQn5D2aKs207M5ZXmhyv9xKBt7O0UW2rfU4cTYySgIRrAh96m6C8sCdKcEL1XWtLbzYSJ/SpVDbOYCvvoWBYUueNxNYsU/dY6uda5hxli+q2YeuEtLuPxnuww27WpnghxRjkG/MDK56RcIxHrx3mPvweyDD x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SG2P153MB0352.APCP153.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(4636009)(376002)(39860400002)(346002)(136003)(366004)(396003)(478600001)(7696005)(10290500003)(2906002)(6506007)(5660300002)(8676002)(8936002)(71200400001)(52536014)(186003)(83380400001)(26005)(33656002)(316002)(82960400001)(82950400001)(86362001)(76116006)(66446008)(64756008)(66556008)(66476007)(66946007)(4744005)(2940100002)(8990500004)(9686003)(55016002)(6916009); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: XbrFHvEBECB+PXXyC2dusx7c/d/VNdxSI6WssCA7V0albjoaTMrOA82tdM9uRy4ZAzX0kxh+iw8w9rfS0ZnqLV7a2rfEW9H3MiwCk7mMWjfrhLh0oRbg+PKj9SwS9+R2gKS7tnNTQ0OhqyuCRo+/GzpP0xP5Ta119hR5gW/5ey+zNiOXninMukQ73R481qmcL+asOHUZ0sJ0E4pwt93/lrUc7bl3l437dZmumJ2GP9DGHtJXAKC2QKALU+52FDCFqbiQN8Dnth258MwW97jlrRhXYEfAR+OTwYFfLD5cUmidz/vl8F1YKcrrdhpTzJtUrRHh8D07mdCtfRDmWb2sG4VnKraW/GLVmMbW77X23gNB4sGdYwq+dxA3VeeiK6YqiEONqz2NMLRTVOU+q2oPvIR/WVapfpBza1n+yABHGD/mh2BcJSyK96AzoM+Rudjq2jUGdldtPQWoFz0dLLK8nN7hOzzsptMppT/j2w3eZc5EHNTQ9U56fCgcIVXlNRW9eektLsD0e0p6/YIc2H1U9pvWVV1RRbKHNTVmZaLt8Zpu5rVZzd8wBpQvd4RruS5DMlf7lzKhsiARafwJYx+UOdtNdRrvOW3LB8LNEV3wbEd8mZcpAPtaaQNFUcZ9Q/xRjr3vkEJVkfKPfV1fZqGcHw== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SG2P153MB0352.APCP153.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 3946e74f-8079-4f21-41b1-08d85a0e4416 X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Sep 2020 07:00:58.6419 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: qVE1xiNW+Kz0I1WxAl6/5ja0ePUmUIYHRb4AhSYcHUJdlC5C0E8N5aipD828se0w2HXDAYuvMKg+QNHL6E/qhw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2P15301MB0062 X-Rspamd-Queue-Id: 4Brrbj5RjVz4L7x X-Spamd-Bar: --------- X-Spamd-Result: default: False [-9.95 / 15.00]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.016]; R_DKIM_ALLOW(-0.20)[microsoft.com:s=selector2]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[microsoft.com:dkim]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.005]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.132.117:from]; DKIM_TRACE(0.00)[microsoft.com:+]; DMARC_POLICY_ALLOW(-0.50)[microsoft.com,reject]; NEURAL_HAM_SHORT(-0.83)[-0.831]; TO_DN_EQ_ADDR_ALL(0.00)[]; WHITELIST_SPF_DKIM(-3.00)[microsoft.com:d:+,microsoft.com:s:+]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_IN_DNSWL_LOW(-0.10)[40.107.132.117:from] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 07:01:07 -0000 Hello, There are couple AMD processor related MSRs which are being accessed in Fre= eBSD.=20 #define MSR_AMDK8_IPM 0xc0010055 #define MSR_LS_CFG 0xc0011020 We are seeing a lot of CPU time being spent in the host (Hyper-V) in handli= ng traps when accessing these MSRs. Especially the first MRS is frequently = being accessed in cpu_idle() so the performance impact to host is significa= nt. We noted that Linux made some code changes in the 4.10 kernel to access the= first MSR much less frequently. So we are wondering if there are similar c= hanges in FreeBSD that might be in the plan. Microsoft Hyper-V team is also= planning some work to speed up the accesses to these MSRs. However any sug= gestions or plan to improve in the FreeBSD guest are welcome. Thanks, Wei From owner-freebsd-virtualization@freebsd.org Fri Sep 18 05:42:11 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C67373D8E2D for ; Fri, 18 Sep 2020 05:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt2ll4z8bz47f8 for ; Fri, 18 Sep 2020 05:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id AA8343D8E2C; Fri, 18 Sep 2020 05:42:11 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AA4713D8E2B for ; Fri, 18 Sep 2020 05:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt2ll462gz47hS for ; Fri, 18 Sep 2020 05:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 705C9162FE for ; Fri, 18 Sep 2020 05:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I5gBrY048988 for ; Fri, 18 Sep 2020 05:42:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I5gBIx048987 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 05:42:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 168298] VirtualBox using AIO on a zvol crashes Date: Fri, 18 Sep 2020 05:42:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: arrowd@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 05:42:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D168298 Gleb Popov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |arrowd@FreeBSD.org --- Comment #25 from Gleb Popov --- Created attachment 218039 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D218039&action= =3Dedit turns off aio completely I made a patch to turn off aio_* completely and deployed it on several production machines. It seems to work great so far - no more hangs spotted. I believe this is more correct fix rather than tweaking sysctls. How about committing it and removing the pkg-message suggestion? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 05:55:52 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 729F03D914E for ; Fri, 18 Sep 2020 05:55:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt33X2Vkxz48jb for ; Fri, 18 Sep 2020 05:55:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 542C53D8F57; Fri, 18 Sep 2020 05:55:52 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 53EDE3D9339 for ; Fri, 18 Sep 2020 05:55:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt33X1b5gz489F for ; Fri, 18 Sep 2020 05:55:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1A8EE16745 for ; Fri, 18 Sep 2020 05:55:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I5tp10066420 for ; Fri, 18 Sep 2020 05:55:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I5tppX066419 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 05:55:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 168298] VirtualBox using AIO on a zvol crashes Date: Fri, 18 Sep 2020 05:55:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rkoberman@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 05:55:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D168298 --- Comment #26 from rkoberman@gmail.com --- Comment on attachment 218039 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D218039 turns off aio completely This looks completely appropriate to me. I have never been comfortable with= the parameters and their possible impact on systems. I was just hoping to get CB working again and that worked, but was probably excessive and the whole ide= a of adjusting these parameters system wide when only VB was impacted was pretty questionable. While the patch looks good to me, I'm hardly competent to speak to its correctness. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 09:04:01 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED2FC3DDCA3 for ; Fri, 18 Sep 2020 09:04:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt7Dd5xNrz4KwC for ; Fri, 18 Sep 2020 09:04:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id CA1443DD668; Fri, 18 Sep 2020 09:04:01 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C9D733DDD62 for ; Fri, 18 Sep 2020 09:04:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt7Dd4y3gz4KYf for ; Fri, 18 Sep 2020 09:04:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8E76318B9D for ; Fri, 18 Sep 2020 09:04:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I941u1098997 for ; Fri, 18 Sep 2020 09:04:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I941OP098993 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 09:04:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 249427] Creating bHyve virtual machines cause network flaps Intel Date: Fri, 18 Sep 2020 09:04:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: unspam@crystalforest.tf X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 09:04:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249427 Bug ID: 249427 Summary: Creating bHyve virtual machines cause network flaps Intel Product: Base System Version: 12.1-STABLE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: unspam@crystalforest.tf Created attachment 218042 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D218042&action= =3Dedit dmesg output Version: FreeBSD 12.2-BETA1 Server 1: Intel(R) PRO/1000 PCI-Express Network Driver Server 2: Broadcom NetXtreme Gigabit Ethernet I have two servers, one with intel (igb) and one with broadcom (bge). I have also setup a bridge for bHyve but whenever I start or stop a bHyve Virtual Machine on the server with the Intel Network Adapter, I get a brief network flap Server 1 - Intel igb3: link state changed to UP tap0: link state changed to DOWN igb3: link state changed to DOWN igb3: link state changed to UP Server 2 - Broadcom tap0: link state changed to DOWN tap0: Ethernet address: tap0: promiscuous mode enabled nd6_dad_timer: cancel DAD on tap0 because of ND6_IFF_IFDISABLED. tap0: link state changed to UP --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 09:04:12 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C95983DDBB4 for ; Fri, 18 Sep 2020 09:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt7Dr52kHz4Kfd for ; Fri, 18 Sep 2020 09:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id AD13C3DDCAC; Fri, 18 Sep 2020 09:04:12 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ACE273DDDC7 for ; Fri, 18 Sep 2020 09:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt7Dr49NZz4KnJ for ; Fri, 18 Sep 2020 09:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 73EA618B0F for ; Fri, 18 Sep 2020 09:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I94CIU099184 for ; Fri, 18 Sep 2020 09:04:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I94CbQ099181 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 09:04:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 249427] Creating bHyve virtual machines cause network flaps intel Date: Fri, 18 Sep 2020 09:04:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: unspam@crystalforest.tf X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 09:04:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249427 unspam@crystalforest.tf changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|Creating bHyve virtual |Creating bHyve virtual |machines cause network |machines cause network |flaps Intel |flaps intel --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 09:10:01 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E569E3DDCEB for ; Fri, 18 Sep 2020 09:10:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt7MY5rVZz4L2l for ; Fri, 18 Sep 2020 09:10:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C895D3DE037; Fri, 18 Sep 2020 09:10:01 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C85E33DDFA4 for ; Fri, 18 Sep 2020 09:10:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt7MY4w3Zz4Kvq for ; Fri, 18 Sep 2020 09:10:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8CEAC188DD for ; Fri, 18 Sep 2020 09:10:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I9A1X3004823 for ; Fri, 18 Sep 2020 09:10:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I9A1Sl004822 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 09:10:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 249427] Creating bHyve virtual machines cause network flaps intel Date: Fri, 18 Sep 2020 09:10:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: unspam@crystalforest.tf X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 09:10:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249427 --- Comment #1 from unspam@crystalforest.tf --- Created attachment 218044 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D218044&action= =3Dedit ifconfig output --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 09:10:27 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1C6F93DDC74 for ; Fri, 18 Sep 2020 09:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt7N300w9z4Klv for ; Fri, 18 Sep 2020 09:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 0033B3DE192; Fri, 18 Sep 2020 09:10:27 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F422B3DDC73 for ; Fri, 18 Sep 2020 09:10:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt7N26HTxz4Klt for ; Fri, 18 Sep 2020 09:10:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BCB6B18BA2 for ; Fri, 18 Sep 2020 09:10:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I9AQbf005235 for ; Fri, 18 Sep 2020 09:10:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I9AQ0E005234 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 09:10:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 249427] Creating bHyve virtual machines cause network flaps intel Date: Fri, 18 Sep 2020 09:10:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: unspam@crystalforest.tf X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 09:10:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249427 --- Comment #2 from unspam@crystalforest.tf --- Created attachment 218045 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D218045&action= =3Dedit bootloader output --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 09:11:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 47D763DE063 for ; Fri, 18 Sep 2020 09:11:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt7Nl6CQbz4Kxs for ; Fri, 18 Sep 2020 09:11:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D525E3DDF37; Fri, 18 Sep 2020 09:11:03 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D4F033DE217 for ; Fri, 18 Sep 2020 09:11:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt7Nl5Kk4z4L5T for ; Fri, 18 Sep 2020 09:11:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9A62818966 for ; Fri, 18 Sep 2020 09:11:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I9B328005852 for ; Fri, 18 Sep 2020 09:11:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I9B3tE005851 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 09:11:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 249427] Creating bHyve virtual machines cause network flaps intel Date: Fri, 18 Sep 2020 09:11:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: unspam@crystalforest.tf X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 09:11:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249427 --- Comment #3 from unspam@crystalforest.tf --- Created attachment 218046 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D218046&action= =3Dedit sysctl output --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Sep 18 09:38:11 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DAE393DE885 for ; Fri, 18 Sep 2020 09:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bt8035XKnz4M04 for ; Fri, 18 Sep 2020 09:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BC2F03DE75C; Fri, 18 Sep 2020 09:38:11 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BBF473DE884 for ; Fri, 18 Sep 2020 09:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt8034XGZz4MDG for ; Fri, 18 Sep 2020 09:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7F06818D5C for ; Fri, 18 Sep 2020 09:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08I9cBXl040806 for ; Fri, 18 Sep 2020 09:38:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08I9cB67040805 for virtualization@FreeBSD.org; Fri, 18 Sep 2020 09:38:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 168298] VirtualBox using AIO on a zvol crashes Date: Fri, 18 Sep 2020 09:38:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pete@twisted.org.uk X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 09:38:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D168298 --- Comment #27 from pete@twisted.org.uk --- Yes, this looks good to me too. My original suggested fix was not to load A= IO if you can avoid it, but actually thats not always practical. So having AIO disabled for virtual box instead of tweaking loads of parameters would appe= al to me as a more correct fix. Having said that, its been stable for me with the tweaks parameters for yea= rs now, but this looks like a more rock-solid solution. --=20 You are receiving this mail because: You are the assignee for the bug.=