From owner-freebsd-stable@FreeBSD.ORG Sat Sep 28 02:31:00 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 5F678C45 for ; Sat, 28 Sep 2013 02:31:00 +0000 (UTC) (envelope-from john.marshall@riverwillow.com.au) Received: from mail1.riverwillow.net.au (mail1.riverwillow.net.au [IPv6:2001:8000:1000:1801::36]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B30A628C6 for ; Sat, 28 Sep 2013 02:30:59 +0000 (UTC) Received: from rwpc15.gfn.riverwillow.net.au (rwpc15.gfn.riverwillow.net.au [IPv6:2001:8000:1000:18e1:20c:76ff:fe0a:2117]) (authenticated bits=56) by mail1.riverwillow.net.au (8.14.7/8.14.7) with ESMTP id r8S2Uk3a020325 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sat, 28 Sep 2013 12:30:48 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=riverwillow.com.au; s=m1001; t=1380335449; bh=FCKuAp/7wrK7h/Xx6Th4Zw6R16Ue06S/EXhY+5qrkvg=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=ONltKVfu4SPwI6m87w0PQRt1WSeIgPWKPvdiILI8dVGDt4HP/dOJ1C1M3ScKVuvl4 cX6YnlIAawKGtRatM1qYHvWvBNwphBfyX/k31LA+AJGiQETC52A7sgsJT9n8UTsGRP NGyan9YHL2KN2GwDRPVY9eVwWtqfZ6J3J/EYbc2c= Date: Sat, 28 Sep 2013 12:30:46 +1000 From: John Marshall To: Konstantin Belousov Subject: Re: 9.2-RC4 amd64 panic: vm_page_unwire Message-ID: <20130928023046.GA1428@rwpc15.gfn.riverwillow.net.au> References: <20130927000728.GB19167@rwpc15.gfn.riverwillow.net.au> <20130927081221.GK41229@kib.kiev.ua> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Kj7319i9nmIyA2yE" Content-Disposition: inline In-Reply-To: <20130927081221.GK41229@kib.kiev.ua> OpenPGP: id=A29A84A2; url=http://pki.riverwillow.com.au/pgp/johnmarshall.asc User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Sep 2013 02:31:00 -0000 --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, 27 Sep 2013, 11:12 +0300, Konstantin Belousov wrote: > On Fri, Sep 27, 2013 at 10:07:28AM +1000, John Marshall wrote: > > I'm running 9.2-RC4 on a handful of desktop and server machines (both > > i386 and amd64). I have seen three panics (all vm_page_unwire) on one > > of those systems only (amd64 server) during the past week. > > The first two panics were triggered when shutting down the ntpd daemon > > (a recent development snapshot version of ntpd: 4.2.7p387). Exiting a > > later release (p388) has not triggered the panic. The system panicked > > again overnight, this time while acting as an sftp server receiving > > large (GB) files from another system. > > I have made the core.txt.[0-2] files available in the following > > directory. The directory is not browsable. > >=20 > > http://www.riverwillow.net.au/~john/92rc4/ >=20 > This might be fixed by r254087-r254090 on stable/9. Thank you. Those patches applied cleanly to releng/9.2 so I rebuilt a patched 9.2. I double-checked and verified that the following patched files in my releng/9.2@255904 working copy were identical to the same files in stable/9@254090, then I removed /usr/obj/* and built a fresh system. M /usr/src/sys/vm/vm_fault.c M /usr/src/sys/vm/vm_map.c M /usr/src/sys/vm/vm_map.h M /usr/src/sys/vm/vm_object.c M /usr/src/sys/vm/vm_object.h M /usr/src/sys/vm/vm_page.c The system panicked as follows during shutdown after its first boot. The corresponding core.txt.3 file is available at the same location previously posted. Fri Sep 27 22:32:18 2013 +1000 ozsrv04# kgdb kernel.debug /var/crash/vmcore.3 ... Unread portion of the kernel message buffer: . <118>Stopping watchdogd. <118>Waiting for PIDS: 1297 panic: vm_page_unwire: page 0xfffffe023743eb50's wire count is zero cpuid =3D 1 KDB: stack backtrace: #0 0xffffffff80490278 at kdb_backtrace+0x68 #1 0xffffffff8045630a at panic+0x21a #2 0xffffffff8068bac2 at vm_page_unwire+0x102 #3 0xffffffff80678732 at vm_fault_unwire+0xd2 #4 0xffffffff80680851 at vm_map_delete+0x171 #5 0xffffffff80680acf at vm_map_remove+0x5f #6 0xffffffff80683ea9 at vmspace_exit+0xc9 #7 0xffffffff8041f3ad at exit1+0x72d #8 0xffffffff804203ae at sys_sys_exit+0xe #9 0xffffffff806afc6f at amd64_syscall+0x3bf #10 0xffffffff8069a717 at Xfast_syscall+0xf7 Uptime: 7m24s I have now seen this panic on a second server as well (also amd64 but different hardware vendor). This second (unpatched) system also panicked during shutdown as follows. Corresponding file named core.txt.0.system2 is available at the same location as above. Sat Sep 28 06:19:59 2013 +1000 panic: vm_page_unwire: page 0xfffffe0429aa5d18's wire count is zero cpuid =3D 1 KDB: stack backtrace: #0 0xffffffff804e7398 at kdb_backtrace+0x68 #1 0xffffffff804ad43a at panic+0x21a #2 0xffffffff80717d42 at vm_page_unwire+0x102 #3 0xffffffff80704882 at vm_fault_unwire+0xd2 #4 0xffffffff8070c9c1 at vm_map_delete+0x171 #5 0xffffffff8070cc3f at vm_map_remove+0x5f #6 0xffffffff80710069 at vmspace_exit+0xc9 #7 0xffffffff804764dd at exit1+0x72d #8 0xffffffff804774de at sys_sys_exit+0xe #9 0xffffffff8073d7cf at amd64_syscall+0x3bf #10 0xffffffff80728277 at Xfast_syscall+0xf7 Uptime: 5m31s --=20 John Marshall --Kj7319i9nmIyA2yE Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.21 (FreeBSD) iEYEARECAAYFAlJGP1YACgkQw/tAaKKahKILMgCfdivuO5qbJ1KY74rnn5J1TJZA WC8AnirV5eQcvlQ5rWIQgX1FXOQ9FdRc =jP5j -----END PGP SIGNATURE----- --Kj7319i9nmIyA2yE--