From owner-freebsd-stable@FreeBSD.ORG Mon May 11 08:08:28 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 97675DAF for ; Mon, 11 May 2015 08:08:28 +0000 (UTC) Received: from mail-wi0-x22a.google.com (mail-wi0-x22a.google.com [IPv6:2a00:1450:400c:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 25F931CF4 for ; Mon, 11 May 2015 08:08:27 +0000 (UTC) Received: by wiun10 with SMTP id n10so86580844wiu.1 for ; Mon, 11 May 2015 01:08:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=300.nl; s=tip; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=SR6YCZ5TTNKTzLmkMM2N9DlDa+mKvFnQAMSmjBthKxk=; b=GSH/OoWMWlzdo3lsdk4XPy6Uoo11Hn6UWSvec8JGj381rM5P11ttHRj75yLCRbYf9c 2Bv/ReopL3W+s1U1sf6TVFR0MyqYavPIITDorkKmy/pIgtFl3Wqvp2bLfcEhvWWJSSKy aTL/QIaING9+pjKdyoZ3SeEEy614N8ZSkSdlI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:message-id:references:to; bh=SR6YCZ5TTNKTzLmkMM2N9DlDa+mKvFnQAMSmjBthKxk=; b=B/ATXs9ufzA7mEq6xmi4pwhxl1FHloeVEheEI1RpFjaEEEhHi/QkbKrs8gN1Iip/rZ lDoXa0lWgxspZxL+tsTwfU/BR2TP8nreFxzXKDmsyf2sCE0hf7gKtg0T7weALXis+yUD TIOlYmxwc2d22w6jffk+mG1whyH8jG+PFB1CT2fAo7Cscigd/+OpQotOl7GFimGy125O LoL8xoRcx5/zlp+lKXT8Lke0N35vo0J5jWk/4X4IR0HvpBrgMAHjW8/g3EC2n0udOj+Z 6FI/lRhSBMKo4TzTzVomOQ2esYKIscBARCySOdaAqlcAwdCqI2sbdcHN9VGx64rdUsxk gvyA== X-Gm-Message-State: ALoCoQlGxVcfXy+itVeVs/2CssPnV0PvhKZXG3Vt9dZN5aDb980Rol9NP4lD72r1HQroAjsqLpgO X-Received: by 10.194.71.168 with SMTP id w8mr17398351wju.80.1431331706390; Mon, 11 May 2015 01:08:26 -0700 (PDT) Received: from [10.2.7.215] (kantoor.transip.nl. [80.69.69.100]) by mx.google.com with ESMTPSA id l6sm21551426wjz.4.2015.05.11.01.08.23 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 11 May 2015 01:08:24 -0700 (PDT) Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2098\)) Subject: Re: panic: pmap active 0xfffff8001b7154b8 From: Johan Schuijt-Li In-Reply-To: <554B7F5D.3050805@FreeBSD.org> Date: Mon, 11 May 2015 10:08:22 +0200 Cc: freebsd-stable@freebsd.org Message-Id: <1DEF14DA-341D-4C96-A166-5E187565CECE@300.nl> References: <554B7F5D.3050805@FreeBSD.org> To: Bryan Drewery X-Mailer: Apple Mail (2.2098) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 May 2015 08:08:28 -0000 Small update for archiving purposes: I=E2=80=99ve been in contact with bdrewery and kib outside of the = mailing list which resulted in the following patch: https://svnweb.freebsd.org/base?view=3Drevision&revision=3D282679 = We=E2=80=99re currently in the process of testing this patch and we=E2=80=99= re cautiously positive on the results thus far. We=E2=80=99ll be rolling = out this patch further and in roughly one week we should be confident = enough that this problem is fully resolved. - Johan > On 07 May 2015, at 17:06, Bryan Drewery wrote: >=20 > On 5/7/2015 7:08 AM, Johan Schuijt-Li wrote: >> Hi, >>=20 >> We=E2=80=99ve been seeing (seemingly) random reboots on 10.1-RELEASE = virtual machines (KVM virtualisation) on our production servers. In an = attempt to determine what was causing this we=E2=80=99ve switched to = running a kernel with INVARIANTS enabled. This resulted for us in the = following panic: >>=20 >> Unread portion of the kernel message buffer: >> panic: pmap active 0xfffff8001b7154b8 >> cpuid =3D 3 >> KDB: stack backtrace: >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe03dd1493a0 >> kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe03dd149450 >> vpanic() at vpanic+0x126/frame 0xfffffe03dd149490 >> kassert_panic() at kassert_panic+0x139/frame 0xfffffe03dd149500 >> pmap_remove_pages() at pmap_remove_pages+0x8c/frame = 0xfffffe03dd1495f0 >> exec_new_vmspace() at exec_new_vmspace+0x16a/frame 0xfffffe03dd149650 >> exec_elf64_imgact() at exec_elf64_imgact+0x658/frame = 0xfffffe03dd149720 >> kern_execve() at kern_execve+0x5e4/frame 0xfffffe03dd149a80 >> sys_execve() at sys_execve+0x37/frame 0xfffffe03dd149ae0 >> amd64_syscall() at amd64_syscall+0x25a/frame 0xfffffe03dd149bf0 >> Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe03dd149bf0 >> --- syscall (59, FreeBSD ELF64, sys_execve), rip =3D 0x80158af1a, rsp = =3D 0x7fffffffac38, rbp =3D 0x7fffffffad40 --- >>=20 >>=20 >> I=E2=80=99ve only come across one other report here (without result = unfortunate): >> = https://lists.freebsd.org/pipermail/freebsd-current/2014-June/050827.html = = > >>=20 >=20 > I looked around for the conclusion of that thread but could not find = it. > I was reproducing so often I'm sure this case was fixed. I may have > privately contacted one of the VM maintainers to fix it. However = lacking > evidence I think it just stopped happening for me and I never reported > anything useful. >=20 >> Are other people aware of this issue or working on this? >>=20 >> I can provide access to a VM with a kernel dump and the kernel build = for extra information if needed. >>=20 >=20 > What we really need is a full core dump (minidump) and backtrace. This > will let us inspect the pmap state. >=20 > = https://www.freebsd.org/doc/en/books/developers-handbook/kerneldebug.html = > = https://www.freebsd.org/doc/en/books/developers-handbook/kerneldebug-gdb.h= tml = >=20 >=20 > --=20 > Regards, > Bryan Drewery