Date: Tue, 4 Mar 2008 09:41:26 GMT From: tadokoro <tadokoro@csg.is.titech.ac.jp> To: freebsd-gnats-submit@FreeBSD.org Subject: kern/121350: panic: initiate_write_inodeblock_ufs2: already started Message-ID: <200803040941.m249fQVJ073145@www.freebsd.org> Resent-Message-ID: <200803040950.m249o3jh038987@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 121350 >Category: kern >Synopsis: panic: initiate_write_inodeblock_ufs2: already started >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue Mar 04 09:50:03 UTC 2008 >Closed-Date: >Last-Modified: >Originator: tadokoro >Release: 6.2-RELEASE-p11 >Organization: tokyo institute of technology >Environment: FreeBSD yeti.local 6.2-RELEASE-p11 FreeBSD 6.2-RELEASE-p11 #17: Fri Feb 15 21:29:36 JST 2008 root@yeti.local:/usr/obj/usr/src/sys/YETI amd64 I'm running software RAID-1 with atacontrol. % grep ata /var/run/dmesg.boot atapci0: <nVidia nForce CK804 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe800-0xe80f at device 6.0 on pci0 ata0: <ATA channel 0> on atapci0 ata1: <ATA channel 1> on atapci0 atapci1: <nVidia nForce CK804 SATA300 controller> port 0x9f0-0x9f7,0xbf0-0xbf3,0x970-0x977,0xb70-0xb73,0xd400-0xd40f mem 0xfebfc000-0xfebfcfff irq 23 at device 7.0 on pci0 ata2: <ATA channel 0> on atapci1 ata3: <ATA channel 1> on atapci1 atapci2: <nVidia nForce CK804 SATA300 controller> port 0x9e0-0x9e7,0xbe0-0xbe3,0x960-0x967,0xb60-0xb63,0xc000-0xc00f mem 0xfebfb000-0xfebfbfff irq 21 at device 8.0 on pci0 ata4: <ATA channel 0> on atapci2 ata5: <ATA channel 1> on atapci2 acd0: DVDR <PIONEER DVD-RW DVR-111/1.06> at ata0-master UDMA66 ad4: 238475MB <HDT722525DLA380 V44OA96A> at ata2-master SATA150 ad6: 238475MB <HDT722525DLA380 V44OA96A> at ata3-master SATA150 ar0: disk0 READY (master) using ad4 at ata2-master ar0: disk1 READY (mirror) using ad6 at ata3-master >Description: The machine got panic during "portupgrade -rf gnutls". The machine was maybe under heavy I/O because of portupgrade. But I did nothing other. /var/log/messages before and after the panic is below. Mar 4 10:50:39 yeti nmbd[11859]: ***** Mar 4 15:06:08 yeti kernel: DOH! ata_alloc_request failed! Mar 4 15:06:08 yeti kernel: FAILURE - out of memory in ata_raid_init_request Mar 4 15:06:08 yeti last message repeated 8 times Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632301056, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632317440, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632333824, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632350208, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632366592, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632382976, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632415744, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632432128, length=16384)]error = 5 Mar 4 15:06:08 yeti kernel: g_vfs_done():ar0s1f[WRITE(offset=9632448512, length=16384)]error = 5 Mar 4 15:09:02 yeti syslogd: kernel boot file is /boot/kernel/kernel Mar 4 15:09:02 yeti kernel: Copyright (c) 1992-2007 The FreeBSD Project. Mar 4 15:09:02 yeti kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Mar 4 15:09:02 yeti kernel: The Regents of the University of California. All rights reserved. Mar 4 15:09:02 yeti kernel: FreeBSD is a registered trademark of The FreeBSD Foundation. Mar 4 15:09:02 yeti kernel: FreeBSD 6.2-RELEASE-p11 #17: Fri Feb 15 21:29:36 JST 2008 Mar 4 15:09:02 yeti kernel: root@yeti.local:/usr/obj/usr/src/sys/YETI A kernel crash dump with kgdb is below. yeti# cd /usr/obj/usr/src/sys/YETI yeti# kgdb kernel.debug /var/crash/vmcore.1 [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd". Unread portion of the kernel message buffer: panic: initiate_write_inodeblock_ufs2: already started cpuid = 0 Uptime: 16d18h58m18s Dumping 2046 MB (2 chunks) chunk 0: 1MB (148 pages) ... ok chunk 1: 2046MB (523744 pages) 2030 2014 1998 1982 1966 1950 1934 1918 1902 1886 1870 1854 1838 1822 1806 1790 1774 1758 1742 1726 1710 1694 1678 1662 1646 1630 1614 1598 1582 1566 1550 1534 1518 1502 1486 1470 1454 1438 1422 1406 1390 1374 1358 1342 1326 1310 1294 1278 1262 1246 1230 1214 1198 1182 1166 1150 1134 1118 1102 1086 1070 1054 1038 1022 1006 990 974 958 942 926 910 894 878 862 846 830 814 798 782 766 750 734 718 702 686 670 654 638 622 606 590 574 558 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 158 142 126 110 94 78 62 46 30 14 #0 doadump () at pcpu.h:172 172 __asm __volatile("movq %%gs:0,%0" : "=r" (td)); (kgdb) bt full #0 doadump () at pcpu.h:172 No locals. #1 0x0000000000000004 in ?? () No symbol table info available. #2 0xffffffff803f90b7 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409 first_buf_printf = 1 #3 0xffffffff803f9751 in panic (fmt=0xffffff007b838980 "°\026Üy") at /usr/src/sys/kern/kern_shutdown.c:565 bootopt = 260 newpanic = 0 ap = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0xffffffffb1d4ea20, reg_save_area = 0xffffffffb1d4e950}} buf = "initiate_write_inodeblock_ufs2: already started", '\0' <repeats 208 times> #4 0xffffffff80577bf9 in softdep_disk_io_initiation (bp=0xffffffff9fd77fe0) at /usr/src/sys/ufs/ffs/ffs_softdep.c:3763 wk = (struct worklist *) 0xffffff000b5f5400 marker = {wk_mp = 0xffffff007fec2238, wk_list = {le_next = 0xffffff000f7b9600, le_prev = 0xffffff000b5f5408}, wk_type = 14, wk_state = 0} #5 0xffffffff80584256 in ffs_geom_strategy (bo=0xffffff0061c4bb00, bp=0xffffffff9fd77fe0) at buf.h:433 vp = (struct vnode *) 0xffffff0061c4b9b0 error = 0 tbp = (struct buf *) 0xa0020024 #6 0xffffffff804546b0 in bufwrite (bp=0xffffffff9fd77fe0) at buf.h:426 No locals. #7 0xffffffff8044f6cd in vfs_bio_awrite (bp=0xffffffff9fd77fe0) at buf.h:410 i = -1 j = -2138334496 lblkno = -1097871344896 vp = (struct vnode *) 0x4000 ncl = 1640282544 size = 0 #8 0xffffffff80458d58 in vop_stdfsync (ap=0xffffffffb1d4ebc0) at /usr/src/sys/kern/vfs_default.c:428 vp = (struct vnode *) 0xffffff0061c4b9b0 bp = (struct buf *) 0xffffffff9fd77fe0 bo = (struct bufobj *) 0xffffffff9fd77fe0 nbp = (struct buf *) 0xffffffffa0133688 error = 0 maxretry = 1000 #9 0xffffffff806702cd in VOP_FSYNC_APV (vop=0x0, a=0x0) at vnode_if.c:1020 rc = 0 #10 0xffffffff80463651 in sched_sync () at vnode_if.h:537 next = (struct synclist *) 0xffffff00796bf5a0 slp = (struct synclist *) 0xffffff00796bf598 bo = (struct bufobj *) 0xffffff0061c4bb00 starttime = 1204610797 td = (struct thread *) 0xffffff007b838980 dummychan = 0 last_work_seen = 20 net_worklist_len = 1640282880 syncer_final_iter = 0 first_printf = 1 #11 0xffffffff803de087 in fork_exit (callout=0xffffffff80463250 <sched_sync>, arg=0x0, frame=0xffffffffb1d4ec50) at /usr/src/sys/kern/kern_fork.c:821 p = (struct proc *) 0xffffff0079dc16b0 #12 0xffffffff8060530e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:394 No locals. >How-To-Repeat: Sorry, I don't know. >Fix: >Release-Note: >Audit-Trail: >Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200803040941.m249fQVJ073145>