From owner-freebsd-virtualization@freebsd.org Sun Aug 30 08:19:05 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CBB253AA781 for ; Sun, 30 Aug 2020 08:19:05 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BfR7Y4D1pz4tTT for ; Sun, 30 Aug 2020 08:19:05 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 8F22A3AA780; Sun, 30 Aug 2020 08:19:05 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8EEB43AA4BA for ; Sun, 30 Aug 2020 08:19:05 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BfR7X0B7yz4tD3 for ; Sun, 30 Aug 2020 08:19:03 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id CFC3B5C00E1 for ; Sun, 30 Aug 2020 04:19:01 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Sun, 30 Aug 2020 04:19:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xsmail.com; h=to :from:subject:message-id:date:mime-version:content-type :content-transfer-encoding; s=fm3; bh=Bg8LTFvr9Ae4spwL4bWmuCpxyn H6HEaHDiwIgJLmEQc=; b=qxZOrx/AmRKO+Y7t0z8XEyRSPWSfFhQ+frfs7gp7Pp i/c4Zf96uiNeL/rC1i01faIPSQC4IjPweHBBNrdb4cQhnpXY7QjBHTN827daT/4R aMnKwuD383qW9qNinMeYeZKoNQi7efYvI8UtlWQtezBCo/bPAAsQE8rw1bNSNrrj Wx1lMq7iaMnvjRL6OAntMfPNFFWg5MEvTvKE84POmeUfHfsqf+S+860SPc7j+NBS l3tCIJIesFg8NNWa7f8iQcOLp/F8Qs6ngJJTc6X/aL6dg+PfZKytQhaKXrbsfM/S QAKrQw/KqqQzCNwjRHWBRxtCX4tzwabetVuZtgmEXdfg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=Bg8LTF vr9Ae4spwL4bWmuCpxynH6HEaHDiwIgJLmEQc=; b=syQaTkU3Mk2I1RVxClrVm8 EFe2IeG0sdCe7dNQAwZGJ072e1nghztnDI/2IUktkdESQIgoDOXVPeDyZpzyan5i 4rQupt9NNcTRqAsjozoGLbhG+o+NJUc2NPZW93oeioi9NzkB1tWkHHzqvwcKzqIG XBi0ZnCpgMwjR7Ir88Q7v7WdnWbTU98QuFrWw04pfHt4iXgH8YCwlH9bJ5EfUv79 Pjk/NGvHYdciPzTHnFh9XQgu1cIR+8i2qI2pIcz5IgqX67pvKViReTNNYp03DpTv wqqe/CbFi0pFaeSPcwqKS2k49bIc8O8xKXkY2PdRiGvsQ+XCD8rQbCd4YNMCNqZA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudeffedgtdefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefvhffukffffgggtgfgsehtjeertd dtfeejnecuhfhrohhmpegjuhhrihcurfgrnhhkohhvuceohihprghnkhhovhesgihsmhgr ihhlrdgtohhmqeenucggtffrrghtthgvrhhnpefgveeftedtveelhfekveeutdeltefhhe dvieeihfetfeevudffkeefleefhfelhfenucfkphepledurddvgedtrdduvdegrdduledt necuufhprghmkfhppfgvthifohhrkhepledurddvgedtrdduvdegrdduledtnecuvehluh hsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhephihprghnkhhovhes gihsmhgrihhlrdgtohhm X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id 4BEA0306005F for ; Sun, 30 Aug 2020 04:19:01 -0400 (EDT) To: virtualization@freebsd.org From: Yuri Pankov Subject: bhyve/e1000: Assertion failed: (dtype == ntype), function e82545_transmit with win10 guest Message-ID: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> Date: Sun, 30 Aug 2020 11:18:58 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4BfR7X0B7yz4tD3 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=xsmail.com header.s=fm3 header.b=qxZOrx/A; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=syQaTkU3; dmarc=pass (policy=none) header.from=xsmail.com; spf=pass (mx1.freebsd.org: domain of ypankov@xsmail.com designates 66.111.4.26 as permitted sender) smtp.mailfrom=ypankov@xsmail.com X-Spamd-Result: default: False [-3.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.26:from]; FREEMAIL_FROM(0.00)[xsmail.com]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[xsmail.com:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[xsmail.com,none]; NEURAL_HAM_SHORT(-0.75)[-0.750]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[xsmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.04)[-1.042]; R_DKIM_ALLOW(-0.20)[xsmail.com:s=fm3,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.004]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MAILMAN_DEST(0.00)[virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Aug 2020 08:19:05 -0000 I'm getting the following periodically when Windows 10 (2004) guest is booting: Assertion failed: (dtype == ntype), function e82545_transmit, file /usr/src/usr.sbin/bhyve/pci_e82545.c, line 1139. Abort trap It's especially unhelpful when booting the guest first time after installation as it completely breaks it and requires reinstall. Running -current r364965. From owner-freebsd-virtualization@freebsd.org Sun Aug 30 08:41:10 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A79153AACC3 for ; Sun, 30 Aug 2020 08:41:10 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BfRd233fKz4vLt for ; Sun, 30 Aug 2020 08:41:10 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 68FC63AB1C1; Sun, 30 Aug 2020 08:41:10 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 68BF93AB203 for ; Sun, 30 Aug 2020 08:41:10 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BfRd14Z3Nz4vZF for ; Sun, 30 Aug 2020 08:41:09 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 496AF5C0108 for ; Sun, 30 Aug 2020 04:41:09 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Sun, 30 Aug 2020 04:41:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xsmail.com; h= subject:from:to:references:message-id:date:mime-version :in-reply-to:content-type:content-transfer-encoding; s=fm3; bh=u jKxFukIPbkOm2mOp3ogcFWOrCaQdlzZ5qCeZb6uNsA=; b=lRlXnoEd7GyAUebz3 dboSliuPWh4qIxpQ+F6JtW2T/4ntLgpsFy83keY95/9XLi26zhpwYPDKSvaZnddC AyLwZfHF+s540MKJUIx7FKx8FpIFefxNovQvEOMNOW8p4fGhYLCL+K1sUpOA9jSO OCYjGm0/uuYI4Gdg1OCYkv9mOhFKguClFOGxKOpww51dOaWdDMrALAwEIhVYZF6f HmHoPTSwNTXEl+LZ7ZxKq09eMFRcBaoNH/vCz9/2lYevvJ6JogXyXAjbZ705PbkX IhARcc7HoXD9tIVKKrxHVFejoJ+WmM81LSmpocs8QkgmsCC8yeiicFNZiupUTMRh JSjzA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=ujKxFukIPbkOm2mOp3ogcFWOrCaQdlzZ5qCeZb6uN sA=; b=rhOTyv3zswfW+kUhlY7J9MtCIonVC6YGCXOqK5XUNJ92Id2wXhAEUvzlF +3xpTWEicpd4U94sqPpZOS6X0Rl+qPPAaBg8H23YOz/y57FzCFRO9pYlOLHBgOx6 JLcMIywLZooO3ICm7taKFD+rer7TakRSuYOJ0490GUL39+uP4qGwhyGKTgZz9hhV tXjYMJJIZ3NrE81gqKww0FgzHOl9K84eq19tn+khQTGf/c5TG5l/F9nTFMDXtdkD vjIsGLejpk/Ysk7K5TS3OJkJL+rrEL/10z3NkIBlWVL8f1A8QlMkYcBxXlNCRuNH oiKWiWmbph9rXv55F5kuSSafVJgcw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudeffedgtdejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefuhffvfhfkffgfgggjtgfgsehtje ertddtfeejnecuhfhrohhmpegjuhhrihcurfgrnhhkohhvuceohihprghnkhhovhesgihs mhgrihhlrdgtohhmqeenucggtffrrghtthgvrhhnpefhtdfhveeggeegjeevffejleevke ffieehjeehgfelteetueffveejhfdvveevvdenucfkphepledurddvgedtrdduvdegrddu ledtnecuufhprghmkfhppfgvthifohhrkhepledurddvgedtrdduvdegrdduledtnecuve hluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhephihprghnkhho vhesgihsmhgrihhlrdgtohhm X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id AD631306005E for ; Sun, 30 Aug 2020 04:41:08 -0400 (EDT) Subject: Re: bhyve/e1000: Assertion failed: (dtype == ntype), function e82545_transmit with win10 guest From: Yuri Pankov To: virtualization@freebsd.org References: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> Message-ID: <1efa232f-e9ba-869c-381f-fe1a45e961b7@xsmail.com> Date: Sun, 30 Aug 2020 11:41:07 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4BfRd14Z3Nz4vZF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=xsmail.com header.s=fm3 header.b=lRlXnoEd; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=rhOTyv3z; dmarc=pass (policy=none) header.from=xsmail.com; spf=pass (mx1.freebsd.org: domain of ypankov@xsmail.com designates 66.111.4.26 as permitted sender) smtp.mailfrom=ypankov@xsmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.26:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26:c]; FREEMAIL_FROM(0.00)[xsmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[xsmail.com:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[xsmail.com,none]; NEURAL_HAM_SHORT(-0.82)[-0.823]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[xsmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.06)[-1.064]; R_DKIM_ALLOW(-0.20)[xsmail.com:s=fm3,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.009]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MAILMAN_DEST(0.00)[virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Aug 2020 08:41:10 -0000 Yuri Pankov wrote: > I'm getting the following periodically when Windows 10 (2004) guest is > booting: > > Assertion failed: (dtype == ntype), function e82545_transmit, file > /usr/src/usr.sbin/bhyve/pci_e82545.c, line 1139. > Abort trap > > It's especially unhelpful when booting the guest first time after > installation as it completely breaks it and requires reinstall. > > Running -current r364965. Adding a WPRINTF() instead of assert() gives me the following: e82545: dtype=540016640 ntype=0 e82545: dtype=540016640 ntype=0 e82545: dtype=552599552 ntype=0 e82545: dtype=540016640 ntype=0 e82545: dtype=552599552 ntype=0 e82545: dtype=540016640 ntype=0 e82545: dtype=552599552 ntype=0 Segmentation fault From owner-freebsd-virtualization@freebsd.org Sun Aug 30 11:26:35 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EBD923AF802 for ; Sun, 30 Aug 2020 11:26:35 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BfWHv61Rhz3bTT for ; Sun, 30 Aug 2020 11:26:35 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id CE7CD3AF78B; Sun, 30 Aug 2020 11:26:35 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CE46D3AF801 for ; Sun, 30 Aug 2020 11:26:35 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from vito-vars.onthenet.com.au (vito-vars.OntheNet.com.au [203.13.68.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BfWHv27gWz3b6q for ; Sun, 30 Aug 2020 11:26:34 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by vito-vars.onthenet.com.au (Postfix) with ESMTPS id 7B6502094E51 for ; Sun, 30 Aug 2020 21:00:05 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 64B3B20AC0A0 for ; Sun, 30 Aug 2020 21:00:05 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 11F2320F4D28 for ; Sun, 30 Aug 2020 21:00:05 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id Pp4DOxnoTTr1 for ; Sun, 30 Aug 2020 21:00:05 +1000 (AEST) Received: from MacBook-Air-4.local (CPE-120-29-42-110.dsl.OntheNet.net [120.29.42.110]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id AAC3220F4D27; Sun, 30 Aug 2020 21:00:03 +1000 (AEST) Subject: Re: bhyve/e1000: Assertion failed: (dtype == ntype), function e82545_transmit with win10 guest To: Yuri Pankov References: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> Cc: virtualization@freebsd.org From: Peter Grehan Message-ID: <8467c97d-fba3-bd29-056e-de83a0277cbb@freebsd.org> Date: Sun, 30 Aug 2020 21:00:01 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=bM+N3M2Z c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=y4yBn9ojGxQA:10 a=2sAd9kicomeRs8kULKoA:9 a=QEXdDO2ut3YA:10 X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=LtAJNkVc c=1 sm=1 tr=0 a=eF5wA05EhuPcU0j7PNT2Vg==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=y4yBn9ojGxQA:10 a=2sAd9kicomeRs8kULKoA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 4BfWHv27gWz3b6q X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Aug 2020 11:26:36 -0000 > I'm getting the following periodically when Windows 10 (2004) guest is > booting:> > Assertion failed: (dtype == ntype), function e82545_transmit, file > /usr/src/usr.sbin/bhyve/pci_e82545.c, line 1139.> Abort trap> > It's especially unhelpful when booting the guest first time after > installation as it completely breaks it and requires reinstall. I was able to reproduce this. Looking at it now. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Aug 30 21:00:10 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E3D33C9F09 for ; Sun, 30 Aug 2020 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bfm1k17v9z4Y3q for ; Sun, 30 Aug 2020 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1F96E3C9E15; Sun, 30 Aug 2020 21:00:10 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1EF203C9F08 for ; Sun, 30 Aug 2020 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bfm1j4htcz4Y35 for ; Sun, 30 Aug 2020 21:00:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 79D561CC34 for ; Sun, 30 Aug 2020 21:00:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 07UL09Qq033131 for ; Sun, 30 Aug 2020 21:00:09 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 07UL09dq033129 for virtualization@FreeBSD.org; Sun, 30 Aug 2020 21:00:09 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202008302100.07UL09dq033129@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 30 Aug 2020 21:00:09 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Aug 2020 21:00:10 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly 1 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon Aug 31 12:38:53 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BAC0A3C073F for ; Mon, 31 Aug 2020 12:38:53 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bg8rs4Yjcz4ShN for ; Mon, 31 Aug 2020 12:38:53 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 9AA8B3C04CF; Mon, 31 Aug 2020 12:38:53 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9A7233C04CC for ; Mon, 31 Aug 2020 12:38:53 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from vito-vars.onthenet.com.au (vito-vars.OntheNet.com.au [203.13.68.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bg8rs0sBWz4SSp for ; Mon, 31 Aug 2020 12:38:52 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by vito-vars.onthenet.com.au (Postfix) with ESMTPS id 87C212094E64 for ; Mon, 31 Aug 2020 22:38:42 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 6F10F20AE981 for ; Mon, 31 Aug 2020 22:38:42 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 61D97209C01C for ; Mon, 31 Aug 2020 22:38:42 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id iIlT-ucOsHWX for ; Mon, 31 Aug 2020 22:38:42 +1000 (AEST) Received: from MacBook-Air-4.local (CPE-120-29-42-110.dsl.OntheNet.net [120.29.42.110]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id EA29420B4D44; Mon, 31 Aug 2020 22:38:40 +1000 (AEST) Subject: Re: bhyve/e1000: Assertion failed: (dtype == ntype), function e82545_transmit with win10 guest From: Peter Grehan To: Yuri Pankov Cc: virtualization@freebsd.org References: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> <8467c97d-fba3-bd29-056e-de83a0277cbb@freebsd.org> Message-ID: <320e0627-4497-6f89-3d45-7470610da8b0@freebsd.org> Date: Mon, 31 Aug 2020 22:38:40 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: <8467c97d-fba3-bd29-056e-de83a0277cbb@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=bM+N3M2Z c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=y4yBn9ojGxQA:10 a=APdOUkJWVOBGPwbbHvcA:9 a=QEXdDO2ut3YA:10 X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=LtAJNkVc c=1 sm=1 tr=0 a=eF5wA05EhuPcU0j7PNT2Vg==:117 a=jXL/WSj5nX36MkVNSbrI6Q==:17 a=IkcTkHD0fZMA:10 a=y4yBn9ojGxQA:10 a=APdOUkJWVOBGPwbbHvcA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 4Bg8rs0sBWz4SSp X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2020 12:38:53 -0000 This appears to be an MP issue: if the number of vCPUs in the win10 guest is set to 1, I'm unable to trigger this. However, it happens almost immediately with vCPUs > 1. Even with a single vCPU there looks to be some false triggering of the transmit process: still debugging that. later, Peter. From owner-freebsd-virtualization@freebsd.org Mon Aug 31 12:44:39 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CBB213C0AB9 for ; Mon, 31 Aug 2020 12:44:39 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bg8zW55vYz4THV for ; Mon, 31 Aug 2020 12:44:39 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id AF24B3C0AB8; Mon, 31 Aug 2020 12:44:39 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AEECE3C0D65 for ; Mon, 31 Aug 2020 12:44:39 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from mouf.net (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mouf.net", Issuer "mouf.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bg8zW0SJmz4T6L; Mon, 31 Aug 2020 12:44:38 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from lrrr.mouf.net (cpe-76-182-16-135.nc.res.rr.com [76.182.16.135]) (authenticated bits=0) by mouf.net (8.14.9/8.14.9) with ESMTP id 07VCiJ89034117 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 31 Aug 2020 12:44:26 GMT (envelope-from swills@FreeBSD.org) Subject: Re: bhyve/e1000: Assertion failed: (dtype == ntype), function e82545_transmit with win10 guest To: Peter Grehan , Yuri Pankov Cc: virtualization@freebsd.org References: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> <8467c97d-fba3-bd29-056e-de83a0277cbb@freebsd.org> <320e0627-4497-6f89-3d45-7470610da8b0@freebsd.org> From: Steve Wills Message-ID: Date: Mon, 31 Aug 2020 08:44:14 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: <320e0627-4497-6f89-3d45-7470610da8b0@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mouf.net [199.48.129.64]); Mon, 31 Aug 2020 12:44:27 +0000 (UTC) X-Spam-Status: No, score=-0.4 required=4.5 tests=KHOP_HELO_FCRDNS, NICE_REPLY_A autolearn=unavailable autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mouf.net X-Virus-Scanned: clamav-milter 0.99.2 at mouf.net X-Virus-Status: Clean X-Rspamd-Queue-Id: 4Bg8zW0SJmz4T6L X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; ASN(0.00)[asn:36236, ipnet:2607:fc50::/36, country:US]; REPLY(-4.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2020 12:44:39 -0000 Hmm, I think I saw this when using the -W flag to bhyve and removing that avoided it. Steve On 8/31/20 8:38 AM, Peter Grehan wrote: > This appears to be an MP issue: if the number of vCPUs in the win10 > guest is set to 1, I'm unable to trigger this. However, it happens > almost immediately with vCPUs > 1. > > Even with a single vCPU there looks to be some false triggering of the > transmit process: still debugging that. > > later, > > Peter. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Mon Aug 31 12:48:03 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 127B53C09D9 for ; Mon, 31 Aug 2020 12:48:03 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bg93Q5rJkz4TfH for ; Mon, 31 Aug 2020 12:48:02 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id C87263C09D7; Mon, 31 Aug 2020 12:48:02 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C83C73C0BE1 for ; Mon, 31 Aug 2020 12:48:02 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bg93P6QCPz4TRY; Mon, 31 Aug 2020 12:48:01 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 479D35C013F; Mon, 31 Aug 2020 08:48:01 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Mon, 31 Aug 2020 08:48:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xsmail.com; h= subject:to:cc:references:from:message-id:date:mime-version :in-reply-to:content-type:content-transfer-encoding; s=fm3; bh=P 3SmgA5xT+/u4SAEBTFftaqfnIlzgLfLw2sK9h8dmxI=; b=hMQY6JMtAAUE1CK5M SicMKhVmoGP4FcYnCr3o8lmvxKMkSEob0xP+ggbMKCWcufOYm6gkqeIFDz8Y/7cn fYtKf4mATywiG/cWGGojgtGm87xWpEnWlfR+GkxbioqfbQVpmBNMiFXCJk8v4xNR CO8fipvBGxXsdNvOcIGpgzU6cPVWva6OxkKC91JGVlhIIL5oI3njL2siAMnNFn0C z6z4C/a+kHs51DyfGY9tsr4mQ4a8hmYK6VyvhcmUBL63IFkVQiwaTMyu10Bp3adq tXnXEbCoFytGZw3G7qtyrDlLEqSiKxflJx3Hwj0OgTNTkJ3oCgJSV3VBmY7MefaJ pv/Bw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=P3SmgA5xT+/u4SAEBTFftaqfnIlzgLfLw2sK9h8dm xI=; b=feOhrdeJMb9fWxMLwuWSQqMKuKMIEU4gsZK7pcZiQgaJqdAGs/GcfS3d2 12GCflPy3sDOnEltyPqfxH1/HRLdtydjGnzSzQ+uVhtxGH3MeXg8fb8r3O4I2qwe qcvsPliQcRC/ftoAmaLTap+yyXEB43fjgG77wGV969qX9hNUpB4/fMg2AQF1G6zd hbIH284VG+kxixwwAA+6NZauSJA/Vt/tSPm+0C8ivCPRzVeqnHmEFY8xzHXM3O+7 ZMsrd5lpLMOjTv0Kso6xHQi7WtQVz7o1fQONjhUpD9UnJBnBJQn1FSB2DgV+ZeQ6 +qfR3Nxqm5rhpLA4V37lx1ZR4m3iw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudefhedgheeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepuffvfhfhkffffgggjggtgfesthejredttdefjeenucfhrhhomhepjghurhhi ucfrrghnkhhovhcuoeihphgrnhhkohhvseigshhmrghilhdrtghomheqnecuggftrfgrth htvghrnhephfdvvefhkeekkeehfeefveejveejudfhjefgjeefiedugeehueeuteehieeh uddvnecukfhppeeluddrvdegtddruddvgedrudeltdenucfuphgrmhfkphfpvghtfihorh hkpeeluddrvdegtddruddvgedrudeltdenucevlhhushhtvghrufhiiigvpedtnecurfgr rhgrmhepmhgrihhlfhhrohhmpeihphgrnhhkohhvseigshhmrghilhdrtghomh X-ME-Proxy: Received: from [192.168.1.6] (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id 7392F3060067; Mon, 31 Aug 2020 08:48:00 -0400 (EDT) Subject: Re: bhyve/e1000: Assertion failed: (dtype == ntype), function e82545_transmit with win10 guest To: Steve Wills , Peter Grehan Cc: virtualization@freebsd.org References: <82d1db05-2454-a045-62cb-e62117e3cb22@xsmail.com> <8467c97d-fba3-bd29-056e-de83a0277cbb@freebsd.org> <320e0627-4497-6f89-3d45-7470610da8b0@freebsd.org> From: Yuri Pankov Message-ID: <32563881-b1cb-1f52-d7d3-747b64dd6b48@xsmail.com> Date: Mon, 31 Aug 2020 15:47:58 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bg93P6QCPz4TRY X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=xsmail.com header.s=fm3 header.b=hMQY6JMt; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=feOhrdeJ; dmarc=pass (policy=none) header.from=xsmail.com; spf=pass (mx1.freebsd.org: domain of ypankov@xsmail.com designates 66.111.4.28 as permitted sender) smtp.mailfrom=ypankov@xsmail.com X-Spamd-Result: default: False [-4.21 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[xsmail.com:s=fm3,messagingengine.com:s=fm3]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[xsmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; NEURAL_HAM_LONG(-1.02)[-1.022]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; DKIM_TRACE(0.00)[xsmail.com:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[xsmail.com,none]; NEURAL_HAM_SHORT(-1.06)[-1.063]; NEURAL_HAM_MEDIUM(-1.03)[-1.030]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[xsmail.com]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[virtualization]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2020 12:48:03 -0000 Steve Wills wrote: > Hmm, I think I saw this when using the -W flag to bhyve and removing > that avoided it. Yes, I should have provided the flags I'm running bhyve with, no -W: bhyve -DHSuw -c 4 -m 4G ... > On 8/31/20 8:38 AM, Peter Grehan wrote: >> This appears to be an MP issue: if the number of vCPUs in the win10 >> guest is set to 1, I'm unable to trigger this. However, it happens >> almost immediately with vCPUs > 1. >> >> Even with a single vCPU there looks to be some false triggering of the >> transmit process: still debugging that. From owner-freebsd-virtualization@freebsd.org Mon Aug 31 20:42:37 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CA4003CDD1F for ; Mon, 31 Aug 2020 20:42:37 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BgMZz71F2z459b for ; Mon, 31 Aug 2020 20:42:35 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 4943 invoked by uid 89); 1 Sep 2020 05:42:23 +0900 X-ASJ-Track-ID: <20200831204223.4943.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 73.190.120.36 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1598906543.185273.4937@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@73.190.120.36) Received: from c-73-190-120-36.hsd1.or.comcast.net (HELO rnci003.ddns.net) (nishida@asusa.net@73.190.120.36) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 1 Sep 2020 05:42:23 +0900 To: freebsd-virtualization@freebsd.org From: Hiroshi Nishida Subject: IPv6 Problem with Bhyve Message-ID: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> Date: Mon, 31 Aug 2020 13:42:21 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 Content-Language: en-US X-Rspamd-Queue-Id: 4BgMZz71F2z459b X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [3.40 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.44)[0.439]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.86)[0.862]; NEURAL_SPAM_LONG(0.89)[0.894]; MIME_HTML_ONLY(0.20)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:~]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2020 20:42:37 -0000 From owner-freebsd-virtualization@freebsd.org Tue Sep 1 14:20:39 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C730B3C9E0A for ; Tue, 1 Sep 2020 14:20:39 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bgq3p4b7Dz4Zkx for ; Tue, 1 Sep 2020 14:20:38 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 59270 invoked by uid 89); 1 Sep 2020 23:20:35 +0900 X-ASJ-Track-ID: <20200901142035.59270.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 73.190.120.36 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1598970035.176551.59264@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@73.190.120.36) Received: from c-73-190-120-36.hsd1.or.comcast.net (HELO rnci003.ddns.net) (nishida@asusa.net@73.190.120.36) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 1 Sep 2020 23:20:35 +0900 Subject: Re: IPv6 Problem with Bhyve From: Hiroshi Nishida To: freebsd-virtualization@freebsd.org References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> Message-ID: <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> Date: Tue, 1 Sep 2020 07:20:33 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: 4Bgq3p4b7Dz4Zkx X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [2.91 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.21)[0.208]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.86)[0.862]; NEURAL_SPAM_LONG(0.94)[0.939]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 14:20:39 -0000 I'm sorry but I sent my first e-mail in an HTML format. Hi, I already asked the same question at https://forums.freebsd.org/threads/ipv6-tcp-connection-issue-with-bhyve.76771/ but haven't got any responses yet. I'd like to ask also here to figure out what causes this problem. I could install Windows Server 2019 on FreeBSD 12.1R + bhyve by mostly following https://wiki.freebsd.org/bhyve/Windows but have the following problem swith TCP/IPv6: * All firewalls are turned off on both host FreeBSD and guest Windows. * The guest Windows is assigned to a static IPv6 address and a DHCP'ed IPv4 address. * Accessing the guest Windows using IPv4 is all OK including RDP, telnet, etc and vice versa. * I can ping from the guest Windows to all IPv6 addresses, vice versa. * However, accessing the guest Windows and accessing from the guest Windows through TCP/IPv6 all fail. Please take a look at https://forums.freebsd.org/threads/ipv6-tcp-connection-issue-with-bhyve.76771 for a tcpdump log on a tcp connection trial from host FreeBSD to guest Windows. Briefly speaking, the 3-way connection does not establish because the host FreeBSD ignores (?) the SYN-ACK from the guest Windows. As for the guest Windows -> the host FreeBSD, the guest sends a SYN packet to the host but the host FreeBSD does not respond to it. The connection trial packet from the guest -> Internet goes through tap0, bridge0 and igb0 but does not seem to reach our IPv6 gateway. Interestingly, I have exactly the same problem also with CentOS 8 + KVM/QEMU. I would appreciate it if anybody could tell me how to fix this. Thank you. -- Hiroshi Nishida ASUSA Corporation From owner-freebsd-virtualization@freebsd.org Tue Sep 1 15:08:49 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4C08A3CB4DC for ; Tue, 1 Sep 2020 15:08:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bgr7P0jHMz4f9s for ; Tue, 1 Sep 2020 15:08:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 181BF3CB684; Tue, 1 Sep 2020 15:08:49 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 17DB83CB278 for ; Tue, 1 Sep 2020 15:08:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bgr7N6zwvz4dxd for ; Tue, 1 Sep 2020 15:08:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D34AC1AF3F for ; Tue, 1 Sep 2020 15:08:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 081F8m8O065297 for ; Tue, 1 Sep 2020 15:08:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 081F8m0q065296 for virtualization@FreeBSD.org; Tue, 1 Sep 2020 15:08:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 247208] mpt(4): VMWare virtualized LSI controller panics during hot-attach Date: Tue, 01 Sep 2020 15:08:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.3-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: jpaetzel@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 15:08:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D247208 --- Comment #5 from Josh Paetzel --- Ok, so I see the reason I couldn't reproduce the panic is this patch has already been committed to HEAD. So I think that's verification that the patch works. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Sep 1 15:39:50 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D820E3CCB1E for ; Tue, 1 Sep 2020 15:39:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BgrqB5RbWz3TYF for ; Tue, 1 Sep 2020 15:39:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BAD033CCA47; Tue, 1 Sep 2020 15:39:50 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BA97C3CCB96 for ; Tue, 1 Sep 2020 15:39:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BgrqB4YnPz3TYD for ; Tue, 1 Sep 2020 15:39:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7CB511B84B for ; Tue, 1 Sep 2020 15:39:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 081Fdofd096348 for ; Tue, 1 Sep 2020 15:39:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 081Fdo7Z096347 for virtualization@FreeBSD.org; Tue, 1 Sep 2020 15:39:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 247208] mpt(4): VMWare virtualized LSI controller panics during hot-attach Date: Tue, 01 Sep 2020 15:39:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.3-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 15:39:50 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D247208 --- Comment #6 from Mark Johnston --- (In reply to Josh Paetzel from comment #5) It was not committed as far as I know. The patch fixes bugs in the control= ler detach path. That is, the driver fails to attach for some reason (which you don't seem to hit), and panics when cleaning up. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Sep 1 16:07:10 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2A4FF3CD0B5 for ; Tue, 1 Sep 2020 16:07:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BgsQk0Lzqz3W7S for ; Tue, 1 Sep 2020 16:07:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 093E23CD3E0; Tue, 1 Sep 2020 16:07:10 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 090453CD0B4 for ; Tue, 1 Sep 2020 16:07:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BgsQj6Yszz3WJJ for ; Tue, 1 Sep 2020 16:07:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C645B1BEC3 for ; Tue, 1 Sep 2020 16:07:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 081G79bi085057 for ; Tue, 1 Sep 2020 16:07:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 081G799X085056 for virtualization@FreeBSD.org; Tue, 1 Sep 2020 16:07:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 247208] mpt(4): VMWare virtualized LSI controller panics during hot-attach Date: Tue, 01 Sep 2020 16:07:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.3-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: jpaetzel@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 16:07:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D247208 --- Comment #7 from Josh Paetzel --- I see said the blind man as he pissed into the wind, it's all coming back t= o me now. I had built the kernel with the patch, but tried to reproduce on the origin= al kernel. I couldn't reproduce the issue, then looked at your patch and my sources (which already had the patch applied) and came to he conclusion tha= t I couldn't reproduce the issue because I was testing the fix. To be clear, I was testing stock FreeBSD HEAD WITHOUT the patch and could n= ot reproduce the problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Sep 1 18:00:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D0A0A3D1F29 for ; Tue, 1 Sep 2020 18:00:04 +0000 (UTC) (envelope-from bch@online.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.133]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bgvwz4rf4z3ydy for ; Tue, 1 Sep 2020 18:00:03 +0000 (UTC) (envelope-from bch@online.de) Received: from x230a2 ([78.47.230.132]) by mrelayeu.kundenserver.de (mreue011 [212.227.15.167]) with ESMTPSA (Nemesis) id 1MsI8Y-1kRwbb2EqA-00tkDH for ; Tue, 01 Sep 2020 20:00:01 +0200 From: Christian Barthel To: freebsd-virtualization@freebsd.org Subject: bhyve entered ddb: Stopped at rdmsr Date: Tue, 01 Sep 2020 19:58:40 +0200 Message-ID: <877dtdidkf.fsf@barthel.ch> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K1:wUipl9GCxH/EleRa4gyyDq7/cnyzOfR4TkB3xU07BwiZeg9QQu5 lThrZG5UPq1bxwoRrRE5KWOk/RgtB3NXf2kIc2gbgWyHOnrvKcpJbB2NGgAg2WWmvKp8qNx dqM3k3EMsQ4wwjrjd7LpQU9xJ13PgFSarvONJ9Cv5LxyViuVlrWw6corSi6oDXtZnr/kWr9 YUsNCwP2V03o4t47fjvpg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:HU916EJ+nsY=:v5a4+PxFlBFQtRbpWF6Tzn WWDhiGRMnwjv0JEiNZ5p9jywx2h3oDw9O/ZDQUzBpx7L65XB06zu15DsVMgXZFpqMrCtxHc3L pG2J+RAeKWjIWkF+kfLE2X6V8kox7d1cNC6c+0vEB74gwZ1H9easLJOXcUh6ZnUI3lr5tNfdB XyntO16JlikK206wHrC7CmewJDSLkTUCSflM7wYxqtQEm9olyHA1Jeucdl+/hx4RxxYvPikjD HPvdRchyYECGk41C6RfrHsYut6MddiZ2hAbsjWrHCBhoIUwsumgUoI5gUVM/fZpvxy6iPFEJ7 5oyB4uRSWgiIRecniFbhLUA5k8WaPmNENJfsgbWXE/SipIpU+f4vH69HHbSCrdc84QGIEuE+K RRe7NzXk3eJ1y8qi7ivEGYPuH/GqwKUT+AIwj8uqhCOFxiRPJGb9iNczoKzlBxdZ46kz7Vuwx TJBLjuTNOTmOhKpnV2dLdVqQcHQGGbhWspMOxSz2IF3J5DjDULn8tUqzo3HCT+rMNlw59juaP ScuikqYhPO52vRyRQ7yEIwl3y8zX9AkxKPNGOrrz0wxmZ9TTv4fw3J4iFGKiLl5ViVKwE2BAA Xn3BnuDXeAEmgnIyDmO3bvdXG8B0XZQ41iWi6EcprwbPcLm5oFWnY10WINCoT1aDSkCa79Yvk JBTmAgi1lxDLIcrHKkjpYEBNeAFZJH5pFYlxlupbVLIGCYJYOvwQlf2upl7yMzWDfev8U4HsV EP+6Yi2HerylFnkGdh/HG3WeHZr5vRzTIdlUz2LrRY7RFetdthzGTqPuj6uLgR7PXCjOsqRfa WsAzYrh3Aws5AX6fS0GOFX9xmudGWQP4h+5tLyvq1dYzmakAS/bZT2+Uajtjpm4pTNvSh0fU4 3OTjur5Abg9fIsS1yDmQ== X-Rspamd-Queue-Id: 4Bgvwz4rf4z3ydy X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bch@online.de designates 212.227.126.133 as permitted sender) smtp.mailfrom=bch@online.de X-Spamd-Result: default: False [-1.74 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.126.128/25]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.001]; DMARC_NA(0.00)[online.de]; NEURAL_SPAM_SHORT(0.16)[0.158]; RCVD_IN_DNSWL_NONE(0.00)[212.227.126.133:from]; NEURAL_HAM_MEDIUM(-0.59)[-0.595]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.126.133:from] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 18:00:04 -0000 Hello, I switched my notebook from a ThinkPad X230 to ThinkPad T480 (each running 12.1). I noticed that one of my OpenBSD (6.3) bhyve VMs is not booting anymore. It stops with a debugger prompt: acpi0: sleep states S5 acpi0: tables DSDT FACP HPET APIC MCFG SPCR acpi0: wakeup devices acpitimer0 at acpi0: 3579545 Hz, 32 bits acpihpet0 at acpi0: 16777216 Hz acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz, 1992.07 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,PBE,SSE3,PCLMUL,DTES64,DS-CPL,SSSE3,SDBG,FMA3,CX16,xTPR,PCID,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,LONG,LAHF,ABM,3DNOWP,ITSC,FSGSBASE,BMI1,AVX2,BMI2,ERMS,INVPCID,RDSEED,ARAT,MELTDOWN cpu0: 256KB 64b/line 8-way L2 cache rdmsr to register 0xc80 on vcpu 0 kernel: protection fault trap, code=0 Stopped at identifycpu+0x75c: rdmsr ddb{0}> Does anyone know why / how to boot the VM? This VM runs fine on the X230 model but not on the T480. Other guests (FreeBSD, Ubuntu) run fine on the T480 model as well. Thanks! -- Christian Barthel From owner-freebsd-virtualization@freebsd.org Tue Sep 1 18:11:13 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 693D13D2489 for ; Tue, 1 Sep 2020 18:11:13 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bgw9r3hgHz40J6 for ; Tue, 1 Sep 2020 18:11:12 +0000 (UTC) (envelope-from ypankov@xsmail.com) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.west.internal (Postfix) with ESMTP id DCB2E93E; Tue, 1 Sep 2020 14:11:10 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Tue, 01 Sep 2020 14:11:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xsmail.com; h= subject:to:references:from:message-id:date:mime-version :in-reply-to:content-type:content-transfer-encoding; s=fm3; bh=1 ODabxZ64VgvNoc/9BL+1HZ7pVmqJTtGPZr4aIaDLLM=; b=DpNr631cV0shx5ZqB BivF8PwzanK6ga+sLJTMZ+80WDWsdageYJLmtBmb+/aSE0pAoD45jkKPoFfUG35I DZuGL4o7zoi8RsrExV8cHqne0HZp7FmlLT/PWkm7G/wR+qZZcG6+869uiB1OecNG RbxC0SAW/7M85eux0LpUwQxxU2fk9p/almsh95RqaLcZJG0q6Xc6ennyNB/HbFc3 urRulOr75dVyuXvAFCu719BvNTiwuLqnnv74Tmf6pR2x1GC92CENJ3VZfaGk/i6C 3izOmQepkIedDF1WYlshyAd9mnuCA/NXB0Q+94PDJADb7KQtTjNOl4I5i3HMzFLi oItKg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=1ODabxZ64VgvNoc/9BL+1HZ7pVmqJTtGPZr4aIaDL LM=; b=vIHR4h+iXlLQgt6ZoDNQaj37h3WBnjTfBcEjstNgSnETNDiuKHV3Rkzfk QGDJQxtqQRdOvIHUwjuDufRrHS0pGcrLt1GQWu6le/tVhVWc9Zv+1z/4IE6z7WLl rsZCb+S1nUFkB+2P5zysdpyuDjcsD5sCDvQZ24gmh2Bd1QYoT2V536OYN0+VnHKr fN4RvKeGvHGH+kvUXvOz/GF+7zvQVHwy780zRamnDcW+0obXSM3YxCEiwf11yX0t Q8QvXLiJPo8+/k8K17gcZ4ezAz7XAuX0oGguvNHXQkUhHjT1LXQwaCYkLFQvJe+h SnCCBiysQa//subKbfA+bJPf70XJg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudefjedguddvvdcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpefuvfhfhffkffgfgggjtgfgsehtjeertddtfeejnecuhfhrohhmpegjuhhr ihcurfgrnhhkohhvuceohihprghnkhhovhesgihsmhgrihhlrdgtohhmqeenucggtffrrg htthgvrhhnpefhvdevhfekkeekheeffeevjeevjeduhfejgfejfeeiudegheeuueetheei heduvdenucfkphepledurddvgedtrdduvdegrdduledtnecuufhprghmkfhppfgvthifoh hrkhepledurddvgedtrdduvdegrdduledtnecuvehluhhsthgvrhfuihiivgeptdenucfr rghrrghmpehmrghilhhfrhhomhephihprghnkhhovhesgihsmhgrihhlrdgtohhm X-ME-Proxy: Received: from [192.168.1.6] (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id 270513060067; Tue, 1 Sep 2020 14:11:09 -0400 (EDT) Subject: Re: bhyve entered ddb: Stopped at rdmsr To: Christian Barthel , freebsd-virtualization@freebsd.org References: <877dtdidkf.fsf@barthel.ch> From: Yuri Pankov Message-ID: Date: Tue, 1 Sep 2020 21:11:08 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.2.1 MIME-Version: 1.0 In-Reply-To: <877dtdidkf.fsf@barthel.ch> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bgw9r3hgHz40J6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=xsmail.com header.s=fm3 header.b=DpNr631c; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=vIHR4h+i; dmarc=pass (policy=none) header.from=xsmail.com; spf=pass (mx1.freebsd.org: domain of ypankov@xsmail.com designates 64.147.123.19 as permitted sender) smtp.mailfrom=ypankov@xsmail.com X-Spamd-Result: default: False [-3.83 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[xsmail.com:s=fm3,messagingengine.com:s=fm3]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[xsmail.com]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.01)[-1.012]; RWL_MAILSPIKE_GOOD(0.00)[64.147.123.19:from]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[xsmail.com:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[xsmail.com,none]; NEURAL_HAM_SHORT(-0.71)[-0.715]; NEURAL_HAM_MEDIUM(-1.01)[-1.006]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[xsmail.com]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 18:11:13 -0000 Christian Barthel wrote: > Hello, > > I switched my notebook from a ThinkPad X230 to ThinkPad T480 > (each running 12.1). I noticed that one of my OpenBSD (6.3) > bhyve VMs is not booting anymore. It stops with a debugger > prompt: > > acpi0: sleep states S5 > acpi0: tables DSDT FACP HPET APIC MCFG SPCR > acpi0: wakeup devices > acpitimer0 at acpi0: 3579545 Hz, 32 bits > acpihpet0 at acpi0: 16777216 Hz > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz, 1992.07 MHz > cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,PBE,SSE3,PCLMUL,DTES64,DS-CPL,SSSE3,SDBG,FMA3,CX16,xTPR,PCID,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,LONG,LAHF,ABM,3DNOWP,ITSC,FSGSBASE,BMI1,AVX2,BMI2,ERMS,INVPCID,RDSEED,ARAT,MELTDOWN > cpu0: 256KB 64b/line 8-way L2 cache > rdmsr to register 0xc80 on vcpu 0 > kernel: protection fault trap, code=0 > Stopped at identifycpu+0x75c: rdmsr > ddb{0}> > > > Does anyone know why / how to boot the VM? > This VM runs fine on the X230 model but not on the T480. > Other guests (FreeBSD, Ubuntu) run fine on the T480 model as > well. Are you using -w flag (Ignore accesses to unimplemented Model Specific Registers)? At least, it seems to be required to boot Windows guest. From owner-freebsd-virtualization@freebsd.org Tue Sep 1 22:11:18 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 72BE737EFD0 for ; Tue, 1 Sep 2020 22:11:18 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-wm1-f43.google.com (mail-wm1-f43.google.com [209.85.128.43]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh1Vn6GMBz3Srg for ; Tue, 1 Sep 2020 22:11:13 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-wm1-f43.google.com with SMTP id c19so1849237wmd.1 for ; Tue, 01 Sep 2020 15:11:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SIR+Z2mIHJ3Ix/ucFbuhcSO4fu850BdLiAqvSsFNHBQ=; b=JXjMwM6NRY7G6CIKg0pJQIwkoL2EGM0QymoS8BrHbzpsjW3z6oMolMgN4C0FtibHbi tY7tAsQNN4vogi5NLGVm+akRws7XrycKSXzBfN6agF4rH+0KqiY2hjZ7WcnWjX2gLBD/ hbjg2I40t4DKcb0jXhTisoQxM4ZSZ+qT6nNXH/KHbwqATuz9bnf2KBD2H2C8GY//b3SH 71qISIG4v8XzZvg4izeQyaiaNYUwsZA2HLpcl2+jSD0kiEJSHiinI6RIaaL9UztmLmQQ AGNfum0nm2TG0LDTanOc5dwPODwcAOZ+ysgaJjWYKULx5ZeoY6oIwFduhB7L+yvwf2El 122g== X-Gm-Message-State: AOAM533HXBHD3kf+gdvFMmNF52Ed2A80Bm8ZenSBQVb1eBYpzxTtJI+8 wga/Rwf4xbo9dknngUgMYk3/vE97A05lgzwFDuDx/nFd X-Google-Smtp-Source: ABdhPJzUBiPcyaVidpg3ltSQpfYiDh883dAbp49hogvXcFf6kohiLzvB7HeowQRldgRcIKzbJj8X9MqJBMaFWZqVhuM= X-Received: by 2002:a1c:1904:: with SMTP id 4mr3646586wmz.119.1598998271827; Tue, 01 Sep 2020 15:11:11 -0700 (PDT) MIME-Version: 1.0 References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> In-Reply-To: <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> From: Jason Tubnor Date: Wed, 2 Sep 2020 08:11:00 +1000 Message-ID: Subject: Re: IPv6 Problem with Bhyve To: Hiroshi Nishida Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 4Bh1Vn6GMBz3Srg X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.128.43 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-2.17 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.05)[-1.053]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; ARC_NA(0.00)[]; DMARC_NA(0.00)[tubnor.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.09)[-0.093]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.128.43:from]; NEURAL_HAM_MEDIUM(-1.03)[-1.029]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.128.43:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 22:11:20 -0000 On Wed, 2 Sep 2020 at 00:20, Hiroshi Nishida wrote: > > > I could install Windows Server 2019 on FreeBSD 12.1R + bhyve by mostly > following https://wiki.freebsd.org/bhyve/Windows but have the following > problem swith TCP/IPv6: > > * All firewalls are turned off on both host FreeBSD and guest Windows. > * The guest Windows is assigned to a static IPv6 address and a DHCP'ed > IPv4 address. > * Accessing the guest Windows using IPv4 is all OK including RDP, > telnet, etc and vice versa. > * I can ping from the guest Windows to all IPv6 addresses, vice versa. > * However, accessing the guest Windows and accessing from the guest > Windows through TCP/IPv6 all fail. > > I hit similar bugs in various ways around IPv6 guests in 12.0 with lingering problems in 12.1. All issues appeared to be fixed in 12-STABLE now, so 12.2 should be good to go. Can you test 12-STABLE snapshot if possible? The issue wasn't necessarily around bhyve, but more iflib. Interestingly, I have exactly the same problem also with CentOS 8 + > KVM/QEMU. > > ^^^ This is interesting, maybe it isn't bhyve or a FreeBSD issue at play here if you are also getting it under KVM. We have a high count of Windows 2019 Server bhyve guests in our environment, but they are running on 11.4 and no IPv6 so I'm not going to be much use in being able to reproduce this. I'll work on getting IPv6 working on my home connection and drag a W2k19 image home, but this will take a while as I have other pressing work commitments. Please keep the list updated. Thanks Jason. From owner-freebsd-virtualization@freebsd.org Tue Sep 1 23:00:26 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2E0863C110F for ; Tue, 1 Sep 2020 23:00:26 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: from mail-ej1-x62a.google.com (mail-ej1-x62a.google.com [IPv6:2a00:1450:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh2bX5CLkz3YKv for ; Tue, 1 Sep 2020 23:00:24 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: by mail-ej1-x62a.google.com with SMTP id a26so3985879ejc.2 for ; Tue, 01 Sep 2020 16:00:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=te+R9DsXqcjVWQIw5uQpuFkyEy4NEfgLDN6AL/NfVx8=; b=nwHiQ2x9aXzx4tiY250uaXcy3eOBUqPKLU/eGz1hIH+1J5w0Xia/MltHpR1PVE1Uu1 +jQA3lgBUAsmRYj5g6u8gvNj77U3xRsRJcbmqFY+qzvnCGnZ6Aia5QCsTamjIhq7BLnG XS57Yb0xhZJViTcaupJ1hfILxDlZYeYGS2dv7xo/n6n2vLPAwNUew1v7rGRtc0QiHzYi JR/nRjjjCfyfOvYVPfajpqeUSdXVvZEe+u9C9fYqwuhKhw6xemfsszP2F5kp0b4Nnl9y 63TnmIX8mg85sx/NcJ3vmY7oPG6s3XyCOBKDHpvk+6M/fe+GwRWyZJJPOtV7tAEuRqHP F6Vg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=te+R9DsXqcjVWQIw5uQpuFkyEy4NEfgLDN6AL/NfVx8=; b=USMHaHhWyJ5HQMS15Qn1zY4CQOnb92Bk1ug11P7gto63R0fbcHTbELbXii0ohEPVIE B/TYgKUGEND7QHhg6ULIDi83E6+GqJATLdr9Eptrzc9MH37l9IoNgaG+NPTxqa7+Wd8g aoq65/1HIsU6dz8LzQstJjQQULUNeMJgOoKl/vO4n8riXQ4ohJH8c2JI44/o23KyRjIR zIUXVNmKPCQbGIlpoY9ABeiLYSTMPvgChuRkAe23ojJEi73F+pWZMs0ZPSPvFteBPepK kxN2lZk6kYq6Udu6Ir/PtbGKFY3HZdBDfnrDIC3BcQRTXtey+F8e6TFxSP7MkTQOkDO2 bY9A== X-Gm-Message-State: AOAM531S6ACrnZwwo5sFq2jRI8zeKCKE5um1EViDJ47ogHZiKb4vv3qt YPU+N5NtA1+4rNnSC4hyc7wS6yea7U2/9m1caTpyCfXGSL0= X-Google-Smtp-Source: ABdhPJx0UaSpbfBDr7+S5rmgLzuV5eDLsKmYZKqZymSRpZzIJ3ngbF/ujHvDsvvIs3xaEPPUS5lH7xi/8cW9KWEvJO0= X-Received: by 2002:a17:906:82d1:: with SMTP id a17mr3550235ejy.385.1599001222369; Tue, 01 Sep 2020 16:00:22 -0700 (PDT) MIME-Version: 1.0 References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> In-Reply-To: From: Dustin Marquess Date: Tue, 1 Sep 2020 18:00:11 -0500 Message-ID: Subject: Re: IPv6 Problem with Bhyve To: Jason Tubnor Cc: Hiroshi Nishida , "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Bh2bX5CLkz3YKv X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=nwHiQ2x9; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dmarquess@gmail.com designates 2a00:1450:4864:20::62a as permitted sender) smtp.mailfrom=dmarquess@gmail.com X-Spamd-Result: default: False [-4.14 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.03)[-1.034]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62a:from]; NEURAL_HAM_SHORT(-1.08)[-1.084]; NEURAL_HAM_MEDIUM(-1.02)[-1.024]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 23:00:26 -0000 On Tue, Sep 1, 2020 at 5:11 PM Jason Tubnor wrote: > > On Wed, 2 Sep 2020 at 00:20, Hiroshi Nishida wrote: > I hit similar bugs in various ways around IPv6 guests in 12.0 with > lingering problems in 12.1. All issues appeared to be fixed in 12-STABLE > now, so 12.2 should be good to go. Can you test 12-STABLE snapshot if > possible? The issue wasn't necessarily around bhyve, but more iflib. > > Interestingly, I have exactly the same problem also with CentOS 8 + > > KVM/QEMU. > > > > > ^^^ This is interesting, maybe it isn't bhyve or a FreeBSD issue at play > here if you are also getting it under KVM. We have a high count of Windows > 2019 Server bhyve guests in our environment, but they are running on 11.4 > and no IPv6 so I'm not going to be much use in being able to reproduce > this. I'll work on getting IPv6 working on my home connection and drag a > W2k19 image home, but this will take a while as I have other pressing work > commitments. I have Server 2019 VMs under bhyve (FreeBSD-CURRENT) using both static IPv6 and SLAAC IPv6, and I have no problems at all connecting to them using RDP over IPv6. Are you absolutely sure the Windows firewall is set to wide open? -Dustin From owner-freebsd-virtualization@freebsd.org Tue Sep 1 23:10:05 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9B9903C114B for ; Tue, 1 Sep 2020 23:10:05 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh2ph3bqqz3YbS for ; Tue, 1 Sep 2020 23:10:03 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 88159 invoked by uid 89); 2 Sep 2020 08:09:53 +0900 X-ASJ-Track-ID: <20200901230953.88159.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 50.207.112.201 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1599001792.707020.88153@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@50.207.112.201) Received: from gw.asusa.net (HELO rd05.asusa-internal.net) (nishida@asusa.net@50.207.112.201) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 2 Sep 2020 08:09:52 +0900 Subject: Re: IPv6 Problem with Bhyve To: Jason Tubnor Cc: "freebsd-virtualization@freebsd.org" References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> From: Hiroshi Nishida Message-ID: <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> Date: Tue, 1 Sep 2020 16:09:50 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 In-Reply-To: Content-Language: en-US X-Rspamd-Queue-Id: 4Bh2ph3bqqz3YbS X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [-0.25 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.24)[-0.242]; MID_RHS_MATCH_FROM(0.00)[]; NEURAL_HAM_LONG(-0.98)[-0.981]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.23)[-0.227]; RCPT_COUNT_TWO(0.00)[2]; MIME_HTML_ONLY(0.20)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:~]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 23:10:05 -0000 From owner-freebsd-virtualization@freebsd.org Tue Sep 1 23:12:59 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F108B3C12E2 for ; Tue, 1 Sep 2020 23:12:59 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh2t25lC8z3Yvn for ; Tue, 1 Sep 2020 23:12:58 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 88397 invoked by uid 89); 2 Sep 2020 08:12:56 +0900 X-ASJ-Track-ID: <20200901231256.88397.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 50.207.112.201 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1599001976.141810.88390@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@50.207.112.201) Received: from gw.asusa.net (HELO rd05.asusa-internal.net) (nishida@asusa.net@50.207.112.201) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 2 Sep 2020 08:12:56 +0900 Subject: Re: IPv6 Problem with Bhyve From: Hiroshi Nishida To: "freebsd-virtualization@freebsd.org" References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> Message-ID: Date: Tue, 1 Sep 2020 16:12:54 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4Bh2t25lC8z3Yvn X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [3.37 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.57)[0.567]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.96)[0.960]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(0.94)[0.942]; TO_DN_EQ_ADDR_ALL(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 23:13:00 -0000 Oops, I made the same mistake again. I need to configure every Thunderbird on each machine. Thanks for your reply. Fortunately, I have a 12-STABLE box. I'll test tomorrow. By the way, do you think it's possible that there's something wrong with Linux's vertio? On 2020/09/01 13:11, Jason Tubnor wrote: > > > On Wed, 2 Sep 2020 at 00:20, Hiroshi Nishida > wrote: > > > > I could install Windows Server 2019 on FreeBSD 12.1R + bhyve by > mostly > following https://wiki.freebsd.org/bhyve/Windows but have the > following > problem swith TCP/IPv6: > > * All firewalls are turned off on both host FreeBSD and guest Windows. > * The guest Windows is assigned to a static IPv6 address and a > DHCP'ed > IPv4 address. > * Accessing the guest Windows using IPv4 is all OK including RDP, > telnet, etc and vice versa. > * I can ping from the guest Windows to all IPv6 addresses, vice versa. > * However, accessing the guest Windows and accessing from the guest > Windows through TCP/IPv6 all fail. > > > I hit similar bugs in various ways around IPv6 guests in 12.0 with > lingering problems in 12.1.  All issues appeared to be fixed in > 12-STABLE now, so 12.2 should be good to go. Can you test 12-STABLE > snapshot if possible?  The issue wasn't necessarily around bhyve, but > more iflib. > > Interestingly, I have exactly the same problem also with CentOS 8 + > KVM/QEMU. > > > ^^^ This is interesting, maybe it isn't bhyve or a FreeBSD issue at > play here if you are also getting it under KVM.  We have a high count > of Windows 2019 Server bhyve guests in our environment, but they are > running on 11.4 and no IPv6 so I'm not going to be much use in being > able to reproduce this. I'll work on getting IPv6 working on my home > connection and drag a W2k19 image home, but this will take a while as > I have other pressing work commitments. > > Please keep the list updated.  Thanks > > Jason. > -- Hiroshi Nishida, PhD President ASUSA Corporation From owner-freebsd-virtualization@freebsd.org Tue Sep 1 23:43:19 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1AA6F3C231D for ; Tue, 1 Sep 2020 23:43:19 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-wm1-f49.google.com (mail-wm1-f49.google.com [209.85.128.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh3Y20Bjbz3bgN for ; Tue, 1 Sep 2020 23:43:17 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-wm1-f49.google.com with SMTP id c19so1956344wmd.1 for ; Tue, 01 Sep 2020 16:43:17 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=iNUHf6TtKLUc0DPkPv++hjavW9mg1Gaipenf+5jqkpw=; b=W3Trm9Yirk7XSON3aRHolF+diD6ux6nLkXqXXEC+qYPaFzi/hdSk1h1T+6NvQ4jGtJ VURdUqX9LrOFNIhNEFLiW7VE5AwNyTFSct2h/+9ipZ485+n8bwCg0gssZeZx5dteFIhT 47VqnRzgJOuvi8E5Un0IOktOgeN0NiQ3SRi28/nwcEuN7G6yEBqbKJdixg/XONGoooJF 1x5t4uuynUG+LDE2F0jpyOyhRKC7zSx+DuOPyhWgXNfGVPyG2/gIgEONqz0h6RrKNc44 /unbg3ndtYqYHrZcAqtZ8y3mdfrbG6neddpX/fGpX9/v/u0X3YBVnSE4L5oZ+LlFswdS HQ2w== X-Gm-Message-State: AOAM533cESHJlXZtgnTC3dmtXa+lyXqhqIksknzP7tVEHF3v4YffcaHL QD31soDkNE2fXLZSY5yjsV6x9x278D1ZG+f/6+qxjp0osKM= X-Google-Smtp-Source: ABdhPJx5xm2SDNJCZF+W8yP/zxOwwCrvkMVKxMuQy7KoEkggQQmF04hOc6/jUMK++5zPuCa1RJ6R/9Q74qK+2pNMyMY= X-Received: by 2002:a7b:cd09:: with SMTP id f9mr3763700wmj.184.1599003796678; Tue, 01 Sep 2020 16:43:16 -0700 (PDT) MIME-Version: 1.0 References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> In-Reply-To: From: Jason Tubnor Date: Wed, 2 Sep 2020 09:43:05 +1000 Message-ID: Subject: Re: IPv6 Problem with Bhyve To: Hiroshi Nishida Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 4Bh3Y20Bjbz3bgN X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.128.49 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.05)[-1.053]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; ARC_NA(0.00)[]; DMARC_NA(0.00)[tubnor.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.92)[-0.915]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.128.49:from]; NEURAL_HAM_MEDIUM(-1.03)[-1.030]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.128.49:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2020 23:43:19 -0000 On Wed, 2 Sep 2020 at 09:12, Hiroshi Nishida wrote: > > > By the way, do you think it's possible that there's something wrong with > Linux's vertio? Maybe. We are currently using 0.1.185 in production without issue. Without going back through the release notes for each one, they may have been IPv6 issues with a version you are using. What are you using and have you tried the latest? : https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.189-1/ Cheers, Jason From owner-freebsd-virtualization@freebsd.org Wed Sep 2 01:22:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CF57D3C4B8A for ; Wed, 2 Sep 2020 01:22:04 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh5ky3VFMz3gdg for ; Wed, 2 Sep 2020 01:22:01 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 97496 invoked by uid 89); 2 Sep 2020 10:21:56 +0900 X-ASJ-Track-ID: <20200902012156.97496.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 73.190.120.36 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1599009715.770337.97487@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@73.190.120.36) Received: from c-73-190-120-36.hsd1.or.comcast.net (HELO rnci003.ddns.net) (nishida@asusa.net@73.190.120.36) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 2 Sep 2020 10:21:56 +0900 Subject: Re: IPv6 Problem with Bhyve To: Jason Tubnor Cc: "freebsd-virtualization@freebsd.org" References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> From: Hiroshi Nishida Message-ID: <52fb7c49-fd16-0978-6ccd-eb39fa0dafa1@asusa.net> Date: Tue, 1 Sep 2020 18:21:53 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 In-Reply-To: Content-Language: en-US X-Rspamd-Queue-Id: 4Bh5ky3VFMz3gdg X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [0.35 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.24)[-0.244]; MID_RHS_MATCH_FROM(0.00)[]; NEURAL_HAM_LONG(-0.98)[-0.983]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.38)[0.380]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_HTML_ONLY(0.20)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:~]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2020 01:22:04 -0000 From owner-freebsd-virtualization@freebsd.org Wed Sep 2 01:23:46 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 700243C485C for ; Wed, 2 Sep 2020 01:23:46 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bh5mx1Xrwz3xBh for ; Wed, 2 Sep 2020 01:23:44 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 97661 invoked by uid 89); 2 Sep 2020 10:23:43 +0900 X-ASJ-Track-ID: <20200902012343.97661.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 73.190.120.36 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1599009822.816299.97654@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@73.190.120.36) Received: from c-73-190-120-36.hsd1.or.comcast.net (HELO rnci003.ddns.net) (nishida@asusa.net@73.190.120.36) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 2 Sep 2020 10:23:42 +0900 Subject: Re: IPv6 Problem with Bhyve To: "freebsd-virtualization@freebsd.org" References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> From: Hiroshi Nishida Message-ID: Date: Tue, 1 Sep 2020 18:23:41 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4Bh5mx1Xrwz3xBh X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [3.59 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.79)[0.791]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.96)[0.960]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(0.94)[0.941]; TO_DN_EQ_ADDR_ALL(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2020 01:23:46 -0000 Well, I have noticed that I'm using a very old one 0.1.96 because it was at the bottom of the list under 0.1.189-1.... I thought it was the latest but will try the latest one first. Thank you. On 2020/09/01 16:43, Jason Tubnor wrote: > > > On Wed, 2 Sep 2020 at 09:12, Hiroshi Nishida > wrote: > > > > By the way, do you think it's possible that there's something > wrong with > Linux's vertio? > > > Maybe.  We are currently using 0.1.185 in production without issue.  > Without going back through the release notes for each one, they may > have been IPv6 issues with a version you are using.  What are you > using and have you tried the latest?  : > https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.189-1/ > > Cheers, > > Jason -- Hiroshi Nishida, PhD President ASUSA Corporation From owner-freebsd-virtualization@freebsd.org Wed Sep 2 15:56:21 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4CEF93DAD6E for ; Wed, 2 Sep 2020 15:56:21 +0000 (UTC) (envelope-from nishida@asusa.net) Received: from asusam.asj-hosting.net (asusa.asj-hosting.net [219.118.222.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.asj-hosting.net", Issuer "JPRS Domain Validation Authority - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BhT7l6t1Dz4v0H for ; Wed, 2 Sep 2020 15:56:19 +0000 (UTC) (envelope-from nishida@asusa.net) Received: (qmail 55570 invoked by uid 89); 3 Sep 2020 00:56:14 +0900 X-ASJ-Track-ID: <20200902155614.55570.qmail@asusam.asj-hosting.net> X-Spam-Checker-Version: ASJ KMsrv Spam Check Process Internal X-Spam-Status: No, hits=0.0 X-Spam-Flag: No X-Virus-Scanned: ASJ KMsrv Virus Check Process 08041001 X-ASJ-SMTP-Authentication: nishida@asusa.net X-ASJ-Arrival-IP: 73.190.120.36 X-ASJ-SPF-Info: auth X-ASJ-Scan-ID: <1599062174.98823.55564@asusam.asj-hosting.net> X-ASJ-Received-SPF: pass (send with smtp authentication by nishida@asusa.net@73.190.120.36) Received: from c-73-190-120-36.hsd1.or.comcast.net (HELO rnci003.ddns.net) (nishida@asusa.net@73.190.120.36) by asusams.asj-hosting.net with ESMTPS (AES128-SHA encrypted); 3 Sep 2020 00:56:14 +0900 Subject: Re: IPv6 Problem with Bhyve From: Hiroshi Nishida To: "freebsd-virtualization@freebsd.org" References: <53835548-cd6e-6859-c19d-8dd96d3993f3@asusa.net> <0b2304fd-4799-f56e-2271-169a5348d654@asusa.net> <55041e52-8784-8336-3c41-1d203d6d2f98@asusa.net> Message-ID: <9bee075a-3ad6-76f6-1eb5-d9772c101564@asusa.net> Date: Wed, 2 Sep 2020 08:56:11 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4BhT7l6t1Dz4v0H X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of nishida@asusa.net has no SPF policy when checking 219.118.222.245) smtp.mailfrom=nishida@asusa.net X-Spamd-Result: default: False [3.09 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.73)[0.734]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[asusa.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.52)[0.519]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(0.94)[0.942]; TO_DN_EQ_ADDR_ALL(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:55388, ipnet:219.118.192.0/19, country:JP]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2020 15:56:21 -0000 Problem solved. It was just vertio driver... Upgrading to 0.1.189 solved everything. I think https://wiki.freebsd.org/bhyve/Windows should be updated, or I can post how to run Win Server 2019 on bhyve to one of FreeBSD forums. By the way, how stable is Windows Server 2019 on bhyve? > On 2020/09/01 16:43, Jason Tubnor wrote: >> >> Maybe.  We are currently using 0.1.185 in production without issue.  >> Without going back through the release notes for each one, they may >> have been IPv6 issues with a version you are using.  What are you >> using and have you tried the latest?  : >> https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.189-1/ >> Is it reliable enough as production? -- Hiroshi Nishida, PhD President ASUSA Corporation