From owner-freebsd-virtualization@freebsd.org Sat Jul 22 00:48:36 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 39ADBC31C69 for ; Sat, 22 Jul 2017 00:48:36 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-wm0-x236.google.com (mail-wm0-x236.google.com [IPv6:2a00:1450:400c:c09::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B912863BCD; Sat, 22 Jul 2017 00:48:35 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by mail-wm0-x236.google.com with SMTP id w126so23641516wme.0; Fri, 21 Jul 2017 17:48:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=Eel3XeLoh8Rykhh6HeXgnvWW+sZZzrt8LnMJQUzBjtc=; b=qSzcH9KlkWTpzkDW1H74DiI8CV00C0Lvss0NGCOfhRDMDsNV3QRlCPaWU2c08pAwE2 ElnBnGSlNMjSODOeBMouulcm5/JTXtBDhrARVel0MfXJFTxiFwSzIKPPziKcVt3iG4FF NXajWC2mv1wYnnJX7XNV8N+Q+X2I/Wkfk8ZjhTL5AtLYiWP0lsrjAHRksc1jHz3yoNKk /uEKwj8mHgVDVjMQi7fMxelZV7HC1ikV2u+T21nwnDC4Hk26JGxSnEwSvkXh32jzP7+j 1YiUJwKeaIVU3en3txJCESBKj3QfMO0cBaF0Be7CFKSCAPs0Sk0by3ZjnNG3c6rKk8A+ 6K8w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=Eel3XeLoh8Rykhh6HeXgnvWW+sZZzrt8LnMJQUzBjtc=; b=QS3n72JerarXFDFFFuNxc2WTysptqO8nshVoetU6KC3uWldTjy1ewo/Fkj8eYI7K4x aY06PPV+NFT0hFMpKjktNLLXuwGBuSU+unmS2mHyTxIc9T0spyWA/508kmBSUB7MLUUX qNH72rxue+s5we7kPJc573Q99B2D34smdpIrWD294wTvoHQBcYiicfPIbdriZySVu91F A8KJHNyT6SindG9VWbkKi3gNydcr3IEGPSszXl0964y7G8XxlwgxG5NedjqQc183rTnu +qXFqW53a5hnWpMjk1Tp/7cj8aHx+6uOTqmhGlzg8bAI9PAUOs3K3uPw02y85Lk9FOS5 HUnw== X-Gm-Message-State: AIVw111Dj+nkBacn/vEy+QOQVnf8qJucmQsRqVX9MEJ5+CbKAcksXjxi Rf2kFhbfwHPcoMkXthis2SZEf1DDPsPF X-Received: by 10.80.175.130 with SMTP id h2mr890327edd.193.1500684514087; Fri, 21 Jul 2017 17:48:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.220.8 with HTTP; Fri, 21 Jul 2017 17:48:33 -0700 (PDT) In-Reply-To: <490d70e2-ff8b-2a60-2eb7-669dadbcc2a9@freebsd.org> References: <490d70e2-ff8b-2a60-2eb7-669dadbcc2a9@freebsd.org> From: Zaphod Beeblebrox Date: Fri, 21 Jul 2017 20:48:33 -0400 Message-ID: Subject: Re: Bhyve Broken: whose fault (AMD, FreeBSD, ZFS ...?) To: Peter Grehan Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Jul 2017 00:48:36 -0000 I tried the -p 0:1 -p 1:2 -p 2:3 -p 3:4 bit. If I may say, it felt a little "chunky" ... but that could have just been a perception. Anyways... still hung the guest. On Fri, Jul 21, 2017 at 6:58 PM, Peter Grehan wrote: > Hi, > > What should be next steps here? This is repeatable. The host is stable >> (it can makeworld -j32 in about 25 minutes ... so it's hardware seems >> good). Is this an AMD bug? Is it bad to use ZFS ZVols? >> > > ZVols are fine. Is the guest panic a spinlock timeout ? > > I believe this is a bug in bhyve/SVM. It appears somewhat related to > processor speed (I can't repro on a 2.3GHz 8 CPU Opteron 6320, but can hit > it after 15 mins or so on a Ryzen 1700, with/without SMT). > > Anish and I are currently chasing this and have repros. An experiment you > could try is to run with the vCPUs pinned i.e. for a 4 vCPU guest, add the > options "-p 0:1 -p 1:2 -p 2:3 -p 3:4". > > later, > > Peter. >