From owner-freebsd-current@FreeBSD.ORG Thu May 21 18:31:40 2009 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2C9F106564A for ; Thu, 21 May 2009 18:31:40 +0000 (UTC) (envelope-from mat.macy@gmail.com) Received: from an-out-0708.google.com (an-out-0708.google.com [209.85.132.240]) by mx1.freebsd.org (Postfix) with ESMTP id 743948FC14 for ; Thu, 21 May 2009 18:31:40 +0000 (UTC) (envelope-from mat.macy@gmail.com) Received: by an-out-0708.google.com with SMTP id c3so755370ana.13 for ; Thu, 21 May 2009 11:31:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=f7o6xqKHNg0vzvHX6URNS/F2Dx2gQbYw4+nWi8BKpMQ=; b=sgQwwVCFFbuMLDh2csply0X8guoCPii+zGWmgn5tOl9kLTQKnHGY6T3X1TKpCWPVDJ GKE7u9mezW+5g+usn+41/ZlWeu9r+2iQmI2jGE9QdzBT7HIt/Ba6EzE85LFqImXsFKjg E8Syx+91Zgvhk1K3hsz8zZxQ3/d5LXPjVQZWA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=GQa4NUQRg0M75upM1MHDkfdiEKO94ezkyljFRE77d7LPAxLSo8ogA05lpKH0WcuZ4z 6MrB7+eyiT1DfOCpR9qzP7xZZBMJ/Uly9SdJmMKMS82tIJY2RYxG/G96pUdd46fgV0Xa R1MGDdA8/uECWaYJMXA+1oHP930w1xDtCPe1c= MIME-Version: 1.0 Sender: mat.macy@gmail.com Received: by 10.100.47.10 with SMTP id u10mr5620052anu.17.1242930699150; Thu, 21 May 2009 11:31:39 -0700 (PDT) In-Reply-To: References: <20090518145614.GF82547@egr.msu.edu> <3c1674c90905181659g1d20f0f1w3f623966ae4440ec@mail.gmail.com> <3c1674c90905181800x469d3cabx5df959d3585b4b5a@mail.gmail.com> <040ce5cee10b3b92fd127bbce83f4c77.squirrel@webmail.lerctr.org> <3c1674c90905181815r49a5bbe2u5d4a73e4f91f89a6@mail.gmail.com> Date: Thu, 21 May 2009 11:31:38 -0700 X-Google-Sender-Auth: daa477fd119c91fd Message-ID: <3c1674c90905211131q607e05a9m68e906f2d3620414@mail.gmail.com> From: Kip Macy To: Thomas Backman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: current@freebsd.org Subject: Re: Fatal trap 12: page fault panic with recent kernel with ZFS X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2009 18:31:41 -0000 > Hey, I (not the OP) am still having trouble with this. The panics appear = to > be gone since I set arc_min to 30M and arc_max to 100M, though (2GB RAM). > I get/got them during a full zfs send -R | zfs recv -Fvd of a ~3.3GB pool= . > The only modification I've done to the source tree is the libzfs_sendrecv > patch here: > http://lists.freebsd.org/pipermail/freebsd-current/2009-May/006814.html I'll apply the patch this weekend. If I get time I'll also try to reproduce your panic. Thanks, Kip > > FreeBSD chaos.exscape.org 8.0-CURRENT FreeBSD 8.0-CURRENT #1: Wed May 20 > 21:19:29 CEST 2009 =A0 =A0 root@chaos.exscape.org:/usr/obj/usr/src/sys/DT= RACE > =A0amd64 > (GENERIC + the 3 DTrace lines added) > > Fatal trap 12: page fault while in kernel mode > cpuid =3D 0; apic id =3D 00 > fault virtual address =A0 =3D 0x0 > fault code =A0 =A0 =A0 =A0 =A0 =A0 =A0=3D supervisor write data, page not= present > instruction pointer =A0 =A0 =3D 0x20:0xffffffff8085e89a > stack pointer =A0 =A0 =A0 =A0 =A0 =3D 0x28:0xffffff803ea4e4d0 > frame pointer =A0 =A0 =A0 =A0 =A0 =3D 0x28:0xffffff803ea4e590 > code segment =A0 =A0 =A0 =A0 =A0 =A0=3D base 0x0, limit 0xfffff, type 0x1= b > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=3D DPL 0, pres 1, long 1,= def32 0, gran 1 > processor eflags =A0 =A0 =A0 =A0=3D interrupt enabled, resume, IOPL =3D 0 > current process =A0 =A0 =A0 =A0 =3D 1281 (zfs) > > vmstat -s from core.txt shows 388955 pages wired down - I take it that's > 388955*4 kiB or almost 1.5GB out of 2GB. 110685 pages are still free, if > that's relevant (I'm not sure why the crash occurs, but I guess it might > be). > > Backtrace: > #0 =A0doadump () at pcpu.h:223 > 223 =A0 =A0 pcpu.h: No such file or directory. > =A0 =A0 =A0 =A0in pcpu.h > (kgdb) #0 =A0doadump () at pcpu.h:223 > #1 =A00xffffffff80576089 in boot (howto=3D260) > =A0 =A0at /usr/src/sys/kern/kern_shutdown.c:420 > #2 =A00xffffffff805764dc in panic (fmt=3DVariable "fmt" is not available. > ) > =A0 =A0at /usr/src/sys/kern/kern_shutdown.c:576 > #3 =A00xffffffff801d5a97 in db_panic (addr=3DVariable "addr" is not avail= able. > ) > =A0 =A0at /usr/src/sys/ddb/db_command.c:478 > #4 =A00xffffffff801d5ea1 in db_command (last_cmdp=3D0xffffffff80bd7c20, > cmd_table=3DVariable "cmd_table" is not available. > > ) at /usr/src/sys/ddb/db_command.c:445 > #5 =A00xffffffff801d60f0 in db_command_loop () > =A0 =A0at /usr/src/sys/ddb/db_command.c:498 > #6 =A00xffffffff801d8089 in db_trap (type=3DVariable "type" is not availa= ble. > ) at /usr/src/sys/ddb/db_main.c:229 > #7 =A00xffffffff805a6bb5 in kdb_trap (type=3D12, code=3D0, tf=3D0xffffff8= 03ea4e420) > =A0 =A0at /usr/src/sys/kern/subr_kdb.c:534 > #8 =A00xffffffff808603bd in trap_fatal (frame=3D0xffffff803ea4e420, eva= =3DVariable > "eva" is not available. > ) > =A0 =A0at /usr/src/sys/amd64/amd64/trap.c:847 > #9 =A00xffffffff80860794 in trap_pfault (frame=3D0xffffff803ea4e420, user= mode=3D0) > =A0 =A0at /usr/src/sys/amd64/amd64/trap.c:768 > #10 0xffffffff80861283 in trap (frame=3D0xffffff803ea4e420) > =A0 =A0at /usr/src/sys/amd64/amd64/trap.c:494 > #11 0xffffffff8083ae57 in calltrap () > =A0 =A0at /usr/src/sys/amd64/amd64/exception.S:223 > #12 0xffffffff8085e89a in bzero () at /usr/src/sys/amd64/amd64/support.S:= 64 > #13 0xffffffff80e8aab1 in dbuf_read () from /boot/kernel/zfs.ko > #14 0xffffffff80e8a12e in dmu_buf_rele () from /boot/kernel/zfs.ko > #15 0xffffff0002e34460 in ?? () > #16 0x0000000000000000 in ?? () > #17 0x0000000000000000 in ?? () > #18 0x000000003ea4e570 in ?? () > #19 0xffffff003533c2d0 in ?? () > #20 0xffffff803ea4e588 in ?? () > #21 0xffffff8004619240 in ?? () > #22 0xffffff00415591c0 in ?? () > #23 0x0000000000000000 in ?? () > #24 0x0000000000000000 in ?? () > #25 0x000000044153f300 in ?? () > #26 0x0000000000000000 in ?? () > #27 0xffffff0002e34460 in ?? () > #28 0x0000000000000005 in ?? () > #29 0xffffff004153f300 in ?? () > #30 0x0000000000000000 in ?? () > #31 0x000000000000da01 in ?? () > #32 0xffffff803ea4e5c0 in ?? () > #33 0xffffffff80e963ea in dmu_tx_check_ioerr () from /boot/kernel/zfs.ko > > Regards, > Thomas > > PS. I have the full core.txt if it'd help. DS. > --=20 When bad men combine, the good must associate; else they will fall one by one, an unpitied sacrifice in a contemptible struggle. Edmund Burke