From owner-freebsd-stable@FreeBSD.ORG Sat Sep 16 20:55:10 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DE3D416A494; Sat, 16 Sep 2006 20:55:09 +0000 (UTC) (envelope-from frode@nordahl.net) Received: from smtp1.powertech.no (smtp1.powertech.no [195.159.0.145]) by mx1.FreeBSD.org (Postfix) with ESMTP id CAA1643D55; Sat, 16 Sep 2006 20:55:08 +0000 (GMT) (envelope-from frode@nordahl.net) Received: from [195.159.148.126] (dhcp7.xu.nordahl.net [195.159.148.126]) by smtp1.powertech.no (Postfix) with ESMTP id 8E14A828B; Sat, 16 Sep 2006 22:55:07 +0200 (CEST) In-Reply-To: References: <200609161609.28528.jhb@freebsd.org> Mime-Version: 1.0 (Apple Message framework v752.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <5D255995-5E67-4D21-88A5-54A8385C4935@nordahl.net> Content-Transfer-Encoding: 7bit From: Frode Nordahl Date: Sat, 16 Sep 2006 22:55:06 +0200 To: John Baldwin X-Mailer: Apple Mail (2.752.2) Cc: freebsd-stable@freebsd.org Subject: Re: RELENG_6 Livelock X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Sep 2006 20:55:10 -0000 On 16. sep. 2006, at 22.22, Frode Nordahl wrote: > On 16. sep. 2006, at 22.09, John Baldwin wrote: > >> On Saturday 16 September 2006 07:02, Frode Nordahl wrote: >>> Hello, >>> >>> FreeBSD localhost.localdomain 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE >>> #1: Wed Sep 13 00:10:04 CEST 2006 frode@localhost.localdomain:/ >>> usr/obj/usr/src/sys/PT i386 >>> >>> After running some stress tests for 3 days, I wanted to remove some >>> large directories. >> >> Do you have a coredump? I assume you do from your debug output. Can >> you download http://www.FreeBSD.org/~jhb/gdb/gdb6, fire up kgdb, and >> once in kgdb, do 'source /path/to/gdb6' and then run 'ps' and reply >> with the output from that? > > I am sorry, I have not. I tried to call doadump, but there was no > dumpdevice configured :-( > > Somehow I have convinced myself that this was turned on by default > now, so I have not enabled it explicitly in rc.conf. Is there any > way to tell DDB what dumpdevice to use directly? > > I will configure a dumpdevice and try really hard to make it happen > again. I was able to reproduce the livelock again, and this time I had the system armed with dumpon :-) Here is the output you requested: (kgdb) ps pid ppid pgrp uid state wmesg wchan cmd 2535 2499 2535 0 R+ CPU 0 rm 2534 2499 2534 0 L+ *Giant 0xc6704580 rm 2533 2499 2533 0 L+ *Giant 0xc6704580 rm 2532 2499 2532 0 R+ rm 2531 2499 2531 0 L+ *Giant 0xc6704580 rm 2499 2496 2499 0 Ss+ ttyin 0xc655d810 bash 2496 784 2496 0 Rs sshd 852 1 852 0 Rs+ getty 851 1 851 0 Ss+ ttyin 0xc6569010 getty 850 1 850 0 Ss+ ttyin 0xc6568c10 getty 849 1 849 0 Ss+ ttyin 0xc6569c10 getty 848 1 848 0 Ss+ ttyin 0xc6569810 getty 847 1 847 0 Ss+ ttyin 0xc6568410 getty 846 1 846 0 Ss+ ttyin 0xc6568010 getty 845 1 845 0 Ss+ ttyin 0xc6567810 getty 844 1 844 0 Ss+ ttyin 0xc6567c10 getty 802 1 802 0 Rs cron 796 1 796 25 Ss pause 0xc673524c sendmail 790 1 790 0 Rs sendmail 784 1 784 0 Ss select 0xc09ebb64 sshd 763 1 763 0 Rs ntpd 731 725 725 0 S nfslockd 0xc09f4128 rpc.lockd ---Type to continue, or q to quit--- 725 1 725 0 Rs rpc.lockd 720 1 720 0 Rs rpc.statd 715 710 710 0 S - 0xc6715800 nfsd 714 710 710 0 S - 0xc671f000 nfsd 713 710 710 0 S - 0xc651b600 nfsd 712 710 710 0 S - 0xc6715e00 nfsd 710 1 710 0 Ss select 0xc09ebb64 nfsd 708 1 708 0 Ss select 0xc09ebb64 mountd 639 1 639 0 Rs rpcbind 604 1 604 0 Rs syslogd 530 1 530 0 Ss select 0xc09ebb64 devd 43 0 0 0 RL [schedcpu] 42 0 0 0 DL sdflush 0xc09f9554 [softdepflush] 41 0 0 0 RL [syncer] 40 0 0 0 RL [vnlru] 39 0 0 0 DL psleep 0xc09ec0cc [bufdaemon] 38 0 0 0 RL [pagezero] 37 0 0 0 DL psleep 0xc09fa014 [vmdaemon] 36 0 0 0 DL psleep 0xc09f9fd0 [pagedaemon] 35 0 0 0 WL [irq1: atkbd0] 34 0 0 0 DL - 0xc6560a3c [fdc0] 33 0 0 0 WL [irq7: ppc0] 32 0 0 0 WL [swi0: sio] ---Type to continue, or q to quit--- 31 0 0 0 RL [acpi_thermal] 30 0 0 0 DL - 0xc651dd00 [em0 taskq] 29 0 0 0 WL [irq20: amr0] 28 0 0 0 DL idle 0xc651b000 [aic_recovery1] 27 0 0 0 WL [irq17: ahc1] 26 0 0 0 DL idle 0xc651b000 [aic_recovery1] 25 0 0 0 DL idle 0xc648a600 [aic_recovery0] 24 0 0 0 WL [irq16: ahc0] 23 0 0 0 DL idle 0xc648a600 [aic_recovery0] 22 0 0 0 WL [irq15: ata2] 21 0 0 0 WL [irq14: ata0] 20 0 0 0 WL [irq18: fxp0] 19 0 0 0 WL [irq31: acpi0] 18 0 0 0 WL [swi6: Giant taskq] 17 0 0 0 WL [swi6: task queue] 9 0 0 0 DL - 0xc63dfb00 [acpi_task_2] 8 0 0 0 DL - 0xc63dfb00 [acpi_task_1] 7 0 0 0 DL - 0xc63dfb00 [acpi_task_0] 6 0 0 0 DL - 0xc63dfb80 [kqueue taskq] 16 0 0 0 WL [swi2: cambio] 15 0 0 0 WL [swi5: +] 5 0 0 0 DL - 0xc63dfe00 [thread taskq] 14 0 0 0 DL - 0xc09e1aa0 [yarrow] ---Type to continue, or q to quit--- 4 0 0 0 DL - 0xc09e45c8 [g_down] 3 0 0 0 DL - 0xc09e45c4 [g_up] 2 0 0 0 DL - 0xc09e45bc [g_event] 13 0 0 0 WL [swi3: vm] 12 0 0 0 LL *Giant 0xc6704580 [swi4: clock sio] 11 0 0 0 WL [swi1: net] 10 0 0 0 RL [idle] 1 0 1 0 SLs wait 0xc638f000 [init] 0 0 0 0 WLs [swapper] (kgdb) -- Frode Nordahl