From owner-freebsd-virtualization@FreeBSD.ORG Tue Dec 23 02:21:50 2014 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4487CBE4; Tue, 23 Dec 2014 02:21:50 +0000 (UTC) Received: from mail-wg0-x230.google.com (mail-wg0-x230.google.com [IPv6:2a00:1450:400c:c00::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CB71664097; Tue, 23 Dec 2014 02:21:49 +0000 (UTC) Received: by mail-wg0-f48.google.com with SMTP id y19so8025683wgg.35; Mon, 22 Dec 2014 18:21:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=7THP3RhMp4vUXyT+5efkzqQc3niG0Qf7N2VxYniAgWQ=; b=fU8KnBtH98ulZiD+aiQKxd4bRI2G29c+w4w6HPRRwP3Py4DDdpAsSe8Pk+T5dPkv8g aWUGXOl/e2LBokdxkSRFHmaEeB/vCWzVuTf21L2j2r/h/w+1Bm2elD1uebLjde4zRDSR WRaxcm33vErsAuEB511rwxIUwhfoU2EH0nLcDYNw8xedTng4xA9CGXnv/AIxhH7SF99w 3+M1MdAAnxlsuf7kEdSynZok0CK2whZVVsr83wo9AJexlLBb/Vnj3VrQwl/I7NzdHddc KVEyTIJWIn5soGinYF8pkoTnU0IVfn5kqycunEKzCZD9htsU6oUvNZ7qzdLf7gTxFYms lp8g== MIME-Version: 1.0 X-Received: by 10.180.109.46 with SMTP id hp14mr37036371wib.54.1419301307719; Mon, 22 Dec 2014 18:21:47 -0800 (PST) Received: by 10.27.5.207 with HTTP; Mon, 22 Dec 2014 18:21:47 -0800 (PST) In-Reply-To: References: <54773CF8.2020306@freebsd.org> <54789699.7030507@freebsd.org> Date: Mon, 22 Dec 2014 18:21:47 -0800 Message-ID: Subject: Re: bhyve failure From: Neel Natu To: Julian Elischer Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Dec 2014 02:21:50 -0000 Hi Julian, On Sat, Nov 29, 2014 at 6:31 PM, Neel Natu wrote: > Hi Julian, > > On Fri, Nov 28, 2014 at 7:36 AM, Julian Elischer wrote: >> On 11/28/14, 3:12 AM, Neel Natu wrote: >>> >>> Hi Julian, >>> >>> On Thu, Nov 27, 2014 at 7:02 AM, Julian Elischer >>> wrote: >>>> >>>> I added WITNESS to a kernel I've been running and during boot I got this >>>> result: >>>> >>>> vm exit[0] >>>> reason VMX >>>> rip 0xffffffff8078c1a7 >>>> inst_length 7 >>>> status 0 >>>> exit_reason 2 >>> >>> That's a triple fault (from sys/amd64/vmm/intel/vmcs.h) >>> >>> #define EXIT_REASON_TRIPLE_FAULT 2 >>> >>> >>>> qualification 0x0000000000000000 >>>> inst_type 0 >>>> inst_error 0 >>>> Abort trap (core dumped) >>>> >>>> anyone have a decoder ring? >>>> >>> A few questions to narrow this down: >>> >>> Did you add WITNESS to the guest kernel or the host kernel when this >>> happened? >> >> yes I added it to the guest kernel.. I suspect it ay be related to this, >> especially since there was a kernel module loaded that was not recompiled. >> I'm trying to ascertain now whether a withness kernel requires special >> handling for its modules. >> >> >>> >>> Is this readily reproducible? >> >> don't know yet. >> > > Its interesting that the guest went all the way to a triple fault > instead of stopping at the double fault handler. > > I'll be happy to track this down if there is a reliably repro case > (guest binaries would be sufficient). > I just committed a change that should let you trace every exception seen by the guest: https://svnweb.freebsd.org/changeset/base/276098 It will let you trace all the exceptions leading up to the triple fault via ktr(4). best Neel > best > Neel > >>> >>> Can you share the host and guest revision numbers? >> >> >> guest is custom sources based on stable-10 on the same day as 10.0 was >> released.basically whatever svn revision# was on 10.0 but on the stable >> branch. >> host is >> FreeBSD 10.1-BETA1 #0 r271671: Tue Sep 16 09:31:23 PDT 2014 >> >> >> >> >>> >>> best >>> Neel >>> >>>> julian >>>> _______________________________________________ >>>> freebsd-virtualization@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>>> To unsubscribe, send any mail to >>>> "freebsd-virtualization-unsubscribe@freebsd.org" >> >>