From owner-freebsd-virtualization@freebsd.org Fri Dec 1 02:41:46 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0D514DF13FD for ; Fri, 1 Dec 2017 02:41:46 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-it0-x231.google.com (mail-it0-x231.google.com [IPv6:2607:f8b0:4001:c0b::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C5FF7804BA for ; Fri, 1 Dec 2017 02:41:45 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-it0-x231.google.com with SMTP id x28so915146ita.0 for ; Thu, 30 Nov 2017 18:41:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=dJ1vNPcMWjDKuZa505uDckNwZjnY3dR1XQUvMeoow0w=; b=gTnapkK49jBrif0mvG+5GcctvcBWAaESQX3u2FtTSZwRzH8OWTa0tTQFKYk2bg/YyC vQhb3HxMF60T5vsfS29tkFpcgFemn0mYpPwhYZwsTts62z1JHfACy8iLT98WXs98GWHK jj09xxi/uXa/gLXz+Q5/eoh7FMLytNr17hptBsLrghxhSA/Jz893t0/Oy0jJ8Fzxe2bY pk5jLfB2f1AQzvhN3fy9QE1C3w3IzlYaXUHpE4LNlDCzqSRy1xE+5lqwAJCQQU6Jw0JD kN0jRWEay2D/aZWFJ+6T7kmGCuJsuRy6eB3K2K5orREF76S7fHT4oIMc4uXnHu84gvid 5ZrA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=dJ1vNPcMWjDKuZa505uDckNwZjnY3dR1XQUvMeoow0w=; b=NTAlzCBiMu0GWQIBNe39ge2YJjTps4EC1leDl+IOvU26JTtHu/HmmrIv9Xfu9GxCbq abumIK/Yed6DUYO9igFYgYj5AVGYi1DYoH5eqC0NhLZPWNwI22W7WfCJhQxeuL6mtmvy lOjg3P02ELYdix8rddi/ti/Q/CCKxn96exNxq3L4wxM0xgA/ZSURJNK4GEVasgJzE4sr HV/MxvEhsf3T12Jc2hVmFtV8RDJ1u+79zt8dU66daXo3mt14MGpRs3vWuVPTdXrcj0RV zA5jZ7SeTqdfuqYUXELL02yuYN7f1R2vZlFrJu9GB25cRBL9szTU1jlAroP85H23EdGB 3DoA== X-Gm-Message-State: AKGB3mKXpZ4E+Z0neImQu3A8c6NFhwhIR8Udwaow1wTD1Jv9elvsal6U 3J6ggEqId/WwyIhV9pT85tjrLj22a++GJzs/kH4= X-Google-Smtp-Source: AGs4zMaWU1pX7P3SsL2yybx5r/H2mspWm4HY1sQEo2fRK65Y21FfLW1sy97LHCHUK38tu88jtiuBcLfOHnSy4iCRtxU= X-Received: by 10.36.122.17 with SMTP id a17mr36851itc.30.1512096105120; Thu, 30 Nov 2017 18:41:45 -0800 (PST) MIME-Version: 1.0 Sender: jtubnor@gmail.com Received: by 10.2.69.213 with HTTP; Thu, 30 Nov 2017 18:41:24 -0800 (PST) In-Reply-To: <5b1166b2-0b8c-248c-9a3b-b5c9685e4f37@free.de> References: <5b1166b2-0b8c-248c-9a3b-b5c9685e4f37@free.de> From: Jason Tubnor Date: Fri, 1 Dec 2017 13:41:24 +1100 X-Google-Sender-Auth: RDC_Ihk1EBI9Com-qlQXdVl_hCY Message-ID: Subject: Re: Linux lockups inside bhyve VM on FreeBSD 11.1 To: Kai Gallasch Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Dec 2017 02:41:46 -0000 On 1 December 2017 at 08:29, Kai Gallasch wrote: > Hello. > > Last day an apache 2.4 running inside a Debian9 linux bhyve VM locked up > on one of my servers (FreeBSD 11.1-RELENG, GENERIC kernel) overloading > the VM. > > The VM uses a ZFS zvol blockdevice on top of a zpool, consisting of two > mirrored SSDs. > > I was able to enter the VM through the bhyve console, kill and restart > the stuck apache process and regain stability inside the VM. > > I found below output in the Linux dmesg and suspect the ext4 journaling > to be the culprit. > > Has anyone experienced similar lockups running Linux inside a bhyve VM? > At the time when this happened there was no high I/O on the VM zpool. Have you set vfs.zfs.arc_max to a lower value to allow for bhyve head room? How was the host system swap, did the host start to eat into it? I run a few guests with Ubuntu 16.04 but mainly use XFS for areas that aren't system related and haven't come across this issue. Cheers, Jason.