From owner-freebsd-virtualization@freebsd.org Thu Mar 1 17:02:10 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA3C1F3C241 for ; Thu, 1 Mar 2018 17:02:09 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 5F8CD7079D for ; Thu, 1 Mar 2018 17:02:09 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id C4101211B71A for ; Fri, 2 Mar 2018 03:02:05 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id BE8252808C8 for ; Fri, 2 Mar 2018 03:02:05 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 2h_2hFRLm-B7 for ; Fri, 2 Mar 2018 03:02:05 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 08DA9280504; Fri, 2 Mar 2018 03:02:04 +1000 (AEST) Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) To: Mike Tancsa Cc: "freebsd-virtualization@freebsd.org" References: <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> <36c062e4-352b-eebe-5f08-1af250d98eee@sentex.net> <7fa0b7a0-492e-6ded-3b5c-1edeff54d746@sentex.net> From: Peter Grehan Message-ID: Date: Thu, 1 Mar 2018 09:02:02 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <7fa0b7a0-492e-6ded-3b5c-1edeff54d746@sentex.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=v2DPQv5-lfwA:10 a=EmWB8mlrOu5xcvncD0EA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 17:02:10 -0000 >> On the Epyc it seemed to take a longer, but eventually the box locked >> up and the watchdog ended up rebooting the server. I started 3, vCPU >> guests all with separate CPU's pinned. It lasted 9hrs. > > The Ryzen board also locked up with just 2 VMs running, and all vCPUs > pinned to separate cores. Thanks for that Mike - it rules out any issues related to vCPUs moving around on physical cores. I'd like to now see if there's a way to get this to happen quicker - perhaps running the test with increasing numbers of guest vCPUs ? From what I've seen, the network test only really uses 2 vCPUs so it's probably ok to even go to oversubscribing. I'll get this going on my Ryzen. later, Peter.