Date: Tue, 24 Jan 2012 16:32:45 +0400 From: Gleb Smirnoff <glebius@FreeBSD.org> To: Andriy Gapon <avg@FreeBSD.org> Cc: current@FreeBSD.org Subject: Re: new panic in cpu_reset() with WITNESS Message-ID: <20120124123245.GZ16676@glebius.int.ru> In-Reply-To: <4F1E9F5F.8080209@FreeBSD.org> References: <4F1D18A5.8010006@FreeBSD.org> <20120123130743.GI16676@glebius.int.ru> <4F1D6830.60602@FreeBSD.org> <20120123162410.GN16676@glebius.int.ru> <20120123162606.GO16676@FreeBSD.org> <4F1D8E2B.30800@FreeBSD.org> <20120123164659.GQ16676@glebius.int.ru> <4F1D9128.3030501@FreeBSD.org> <20120124115424.GX16676@glebius.int.ru> <4F1E9F5F.8080209@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Jan 24, 2012 at 02:09:03PM +0200, Andriy Gapon wrote:
A> on 24/01/2012 13:54 Gleb Smirnoff said the following:
A> > On Mon, Jan 23, 2012 at 06:56:08PM +0200, Andriy Gapon wrote:
A> > A> on 23/01/2012 18:46 Gleb Smirnoff said the following:
A> > A> > On Mon, Jan 23, 2012 at 06:43:23PM +0200, Andriy Gapon wrote:
A> > A> > A> > db> bt
A> > A> > A> > Tracing pid 1 tid 100001 td 0xfffffe0001d5e000
A> > A> > A> > kdb_enter() at kdb_enter+0x3b
A> > A> > A> > panic() at panic+0x1c7
A> > A> > A> > _mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x10f
A> > A> > A> > cnputs() at cnputs+0x7a
A> > A> > A> > vprintf() at vprintf+0xcb
A> > A> > A> > printf() at printf+0x67
A> > A> > A> > db_putc() at db_putc+0x81
A> > A> > A>
A> > A> > A> Ah, db_putc does something different from what I expected.
A> > A> > A> Can you hack it to never use printf?
A> > A> >
A> > A> > Just cut printfs from db_putc()?
A> > A>
A> > A> Make the following condition be always false:
A> > A>
A> > A> if (!kdb_active || ddb_use_printf) {
A> > A>
A> > A> E.g.:
A> > A>
A> > A> if (0) {
A> >
A> > With this change + s/printf/db_printf/ in subr_witness.c I've
A> > got the following during reboot:
A> >
A> > Rebooting...
A> > lllock order reversal:
A> > 1st 0xffffffff80937140 smp rendezvous (smp rendezvous) @ /usr/src/head/sys/kern/kern_shutdown.c:542
A> > 2nd 0xffffffff80b13280 syscons video lock (syscons video lock) @ /usr/src/head/sys/dev/syscons/syscons.c:1921
A> > panic: mtx_lock_spin: recursed on non-recursive mutex cnputs_mtx @ /usr/src/head/sys/kern/kern_cons.c:500
A>
A> Can you disable video console?
Yes, now:
Rebooting...
lock order reversal:
1st 0xffffffff80937140 smp rendezvous (smp rendezvous) @ /usr/src/head/sys/kern/kern_shutdown.c:542
2nd 0xfffffe0001f5d838 uart_hwmtx (uart_hwmtx) @ /usr/src/head/sys/dev/uart/uart_cpu.h:92
panic: mtx_lock_spin: recursed on non-recursive mutex cnputs_mtx @ /usr/src/head/sys/kern/kern_cons.c:500
cpuid = 0
KDB: enter: panic
[ thread pid 1 tid 100001 ]
Stopped at kdb_enter+0x3b: movq $0,0x5159f2(%rip)
db> bt
Tracing pid 1 tid 100001 td 0xfffffe0001d5e000
kdb_enter() at kdb_enter+0x3b
panic() at panic+0x1c7
_mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x10f
cnputs() at cnputs+0x7a
putchar() at putchar+0x11f
kvprintf() at kvprintf+0x83
vprintf() at vprintf+0x85
printf() at printf+0x67
kdb_backtrace() at kdb_backtrace+0x2d
_witness_debugger() at _witness_debugger+0x2c
witness_checkorder() at witness_checkorder+0x854
_mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x99
uart_cnputc() at uart_cnputc+0x3e
cnputc() at cnputc+0x4c
cnputs() at cnputs+0x26
putchar() at putchar+0x11f
kvprintf() at kvprintf+0x83
vprintf() at vprintf+0x85
printf() at printf+0x67
cpu_reset() at cpu_reset+0x81
kern_reboot() at kern_reboot+0x3a5
sys_reboot() at sys_reboot+0x42
amd64_syscall() at amd64_syscall+0x39e
Xfast_syscall() at Xfast_syscall+0xf7
--- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x40ea3c, rsp = 0x7fffffffd6d8, rbp = 0x49 ---
--
Totus tuus, Glebius.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20120124123245.GZ16676>