From owner-freebsd-virtualization@freebsd.org  Sat Dec  2 09:23:10 2017
Return-Path: <owner-freebsd-virtualization@freebsd.org>
Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23547DF9006
 for <freebsd-virtualization@mailman.ysv.freebsd.org>;
 Sat,  2 Dec 2017 09:23:10 +0000 (UTC) (envelope-from k@free.de)
Received: from smtp.free.de (smtp.free.de [91.204.6.103])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id E155D6784E
 for <freebsd-virtualization@freebsd.org>; Sat,  2 Dec 2017 09:23:09 +0000 (UTC)
 (envelope-from k@free.de)
Received: from [91.204.5.154] (unknown [91.204.5.154])
 by smtp.free.de (Postfix) with ESMTPSA id A5755160D8;
 Sat,  2 Dec 2017 10:23:00 +0100 (CET)
Subject: Re: Linux lockups inside bhyve VM on FreeBSD 11.1
To: Jason Tubnor <jason@tubnor.net>
Cc: freebsd-virtualization@freebsd.org
References: <5b1166b2-0b8c-248c-9a3b-b5c9685e4f37@free.de>
 <CACLnyCKsLuGyEy_2ozXjNJ7CEG=wRopACDe4vnfxV-Tya4dVHg@mail.gmail.com>
From: Kai Gallasch <k@free.de>
Message-ID: <61029a6b-84fb-6eca-c5c6-73e517dd9bce@free.de>
Date: Sat, 2 Dec 2017 10:22:59 +0100
Mime-Version: 1.0
In-Reply-To: <CACLnyCKsLuGyEy_2ozXjNJ7CEG=wRopACDe4vnfxV-Tya4dVHg@mail.gmail.com>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 8bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.25
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 <freebsd-virtualization.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-virtualization/>
List-Post: <mailto:freebsd-virtualization@freebsd.org>
List-Help: <mailto:freebsd-virtualization-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 02 Dec 2017 09:23:10 -0000



Am 01.12.2017 um 03:41 schrieb Jason Tubnor:
> 
> On 1 December 2017 at 08:29, Kai Gallasch <k@free.de <mailto:k@free.de>>
> wrote:
> 
>     Hello.
> 
>     Last day an apache 2.4 running inside a Debian9 linux bhyve VM locked up
>     on one of my servers (FreeBSD 11.1-RELENG, GENERIC kernel) overloading
>     the VM.
> 
>     The VM uses a ZFS zvol blockdevice on top of a zpool, consisting of two
>     mirrored SSDs.
> 
>     I was able to enter the VM through the bhyve console, kill and restart
>     the stuck apache process and regain stability inside the VM.
> 
>     I found below output in the Linux dmesg and suspect the ext4 journaling
>     to be the culprit.
> 
>     Has anyone experienced similar lockups running Linux inside a bhyve VM?
>     At the time when this happened there was no high I/O on the VM zpool.
> 
> 
> Have you set vfs.zfs.arc_max to a lower value to allow for bhyve head
> room?  How was the host system swap, did the host start to eat into it?
> 
> I run a few guests with Ubuntu 16.04 but mainly use XFS for areas that
> aren't system related and haven't come across this issue.

Hello Jason.

My bhyve host server has 96GB RAM and all Linux VMs together are
allocated 20GB. I now have set vfs.zfs.arc_max to 64G to see if other
lockups occur.

K.