From owner-freebsd-current@FreeBSD.ORG Fri Sep 21 15:47:42 2007 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EA06F16A419 for ; Fri, 21 Sep 2007 15:47:42 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [192.147.25.65]) by mx1.freebsd.org (Postfix) with ESMTP id C840713C44B for ; Fri, 21 Sep 2007 15:47:42 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from adsl-69-149-117-186.dsl.austtx.swbell.net ([69.149.117.186]:62817 helo=borg) by thebighonker.lerctr.org with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.68 (FreeBSD)) (envelope-from ) id 1IYkUU-000MiG-0u for freebsd-current@freebsd.org; Fri, 21 Sep 2007 10:32:37 -0500 Date: Fri, 21 Sep 2007 10:32:23 -0500 (CDT) From: Larry Rosenman Sender: ler@borg To: freebsd-current@freebsd.org Message-ID: <20070921102946.T11189@borg> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Spam-Score: -3.3 (---) X-LERCTR-Spam-Score: -3.3 (---) X-Spam-Report: SpamScore (-3.3/5.0) ALL_TRUSTED=-1.8, BAYES_00=-2.599, FM_MULTI_ODD2=1.1 X-LERCTR-Spam-Report: SpamScore (-3.3/5.0) ALL_TRUSTED=-1.8, BAYES_00=-2.599, FM_MULTI_ODD2=1.1 DomainKey-Status: no signature Subject: panic: kmem_malloc(131072): kmem_map too small (AMD64) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 15:47:43 -0000 I'm a heavy ZFS user, and got the following panic on 2007-09-18 source/world: # kgdb -c vmcore.1 /usr/obj/usr/src/sys/BORG/kernel.debug [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd". Unread portion of the kernel message buffer: panic: kmem_malloc(131072): kmem_map too small: 333647872 total allocated cpuid = 2 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a panic() at panic+0x17a kmem_malloc() at kmem_malloc+0x49a uma_large_malloc() at uma_large_malloc+0x4a malloc() at malloc+0x12d arc_get_data_buf() at arc_get_data_buf+0x36e arc_buf_alloc() at arc_buf_alloc+0xe4 arc_read() at arc_read+0xfa dbuf_prefetch() at dbuf_prefetch+0x137 dmu_zfetch_dofetch() at dmu_zfetch_dofetch+0xd4 dmu_zfetch() at dmu_zfetch+0x616 dbuf_read() at dbuf_read+0x31f dmu_buf_hold_array_by_dnode() at dmu_buf_hold_array_by_dnode+0xe9 dmu_buf_hold_array() at dmu_buf_hold_array+0x62 dmu_read_uio() at dmu_read_uio+0x3f zfs_freebsd_read() at zfs_freebsd_read+0x576 vn_read() at vn_read+0x17a dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x4c read() at read+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (3, FreeBSD ELF64, read), rip = 0x80158835c, rsp = 0x7fffff9fd058, rbp = 0 --- Uptime: 2d6h22m6s Physical memory: 4085 MB Dumping 1305 MB: 1290 1274 1258 1242 1226 1210 1194 1178 1162 1146 1130 1114 1098 1082 1066 1050 1034 1018 1002 986 970 954 938 922 906 890 874 858 842 826 810 794 778 762 746 730 714 698 682 666 650 634 618 602 586 570 554 538 522 506 490 474 458 442 426 410 394 378 362 346 330 314 298 282 266 250 234 218 202 186 170 154 138 122 106 90 74 58 42 26 10 #0 doadump () at pcpu.h:194 194 pcpu.h: No such file or directory. in pcpu.h (kgdb) bt #0 doadump () at pcpu.h:194 #1 0xffffffff802e3c65 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409 #2 0xffffffff802e40d7 in panic (fmt=Variable "fmt" is not available. ) at /usr/src/sys/kern/kern_shutdown.c:563 #3 0xffffffff804d138a in kmem_malloc (map=0xffffff00010000f8, size=131072, flags=2) at /usr/src/sys/vm/vm_kern.c:305 #4 0xffffffff804ca53a in uma_large_malloc (size=131072, wait=2) at /usr/src/sys/vm/uma_core.c:2709 #5 0xffffffff802d65ed in malloc (size=131072, mtp=0xffffffff8095f5c0, flags=2) at /usr/src/sys/kern/kern_malloc.c:364 #6 0xffffffff80900a8e in ?? () #7 0x000000000000a125 in ?? () #8 0xffffff00180f90f0 in ?? () #9 0xffffff00046fa000 in ?? () #10 0xffffff006cc14898 in ?? () #11 0x0000000000020000 in ?? () #12 0xffffff00046fa000 in ?? () #13 0xffffffffb243c4f0 in ?? () #14 0xffffffff80900ca4 in ?? () #15 0x0000000000000000 in ?? () #16 0xffffffff94cd1d00 in ?? () #17 0x0000000000000070 in ?? () #18 0x0000000000000000 in ?? () #19 0xffffffffb243c580 in ?? () #20 0xffffffff80901bda in ?? () #21 0xffffffffb243c5e0 in ?? () #22 0xffffffff802eb070 in _sx_xunlock (sx=0xffffffff809633c0, file=0x20000
, line=403673328) ---Type to continue, or q to quit--- at /usr/src/sys/kern/kern_sx.c:309 Previous frame inner to this frame (corrupt stack?) (kgdb) I have the core available, and am more than willing to give access to the box. I'm not sure exactly what may have triggered it, but this is the first ZFS panic I've seen. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 512-248-2683 E-Mail: ler@lerctr.org US Mail: 430 Valona Loop, Round Rock, TX 78681-3893