From owner-freebsd-current@FreeBSD.ORG Sun Feb 17 17:23:58 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 82E8616A418 for ; Sun, 17 Feb 2008 17:23:58 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.189]) by mx1.freebsd.org (Postfix) with ESMTP id 1E27D13C4DD for ; Sun, 17 Feb 2008 17:23:57 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: by rv-out-0910.google.com with SMTP id g13so1131205rvb.43 for ; Sun, 17 Feb 2008 09:23:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=ZAhsQICxaj6KyE/ylLBb+CqC5EmxR+96PQMh8XmNfzk=; b=kD0QQbl4ke9bqk/dsgAjqdPjiu/viTT/e9XHAiUiyHTRX3uvxVnnqBczuD0dZLhPT4pv8vfqBShtEwVecTbBJu/hz7W1m21EpaOGJcWgksrVMOZ55w3BvPO/aTvZApwwrJPQH3MdiLp6k8n9t+sqTy7B0spMLx9nn+ClLuTjNm0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=kD+1Ht0dGd+LfDjppiTMFVfwjjufMlKj5Vw631Eb0J2oN0MyhrIvoEeQKcjoincJnExvAwmaRHdvhusNjaHhV/tVPZUT2/Swupc+8zpCZO5NKsOil23mPsj3un17ODe92CbSK1Nx/sU3Fpj0Uz27rfrmMtJySC4OdPTj8rZNlpI= Received: by 10.141.79.12 with SMTP id g12mr3255914rvl.182.1203269036519; Sun, 17 Feb 2008 09:23:56 -0800 (PST) Received: by 10.141.170.18 with HTTP; Sun, 17 Feb 2008 09:23:55 -0800 (PST) Message-ID: <2e77fc10802170923v565dfc0pa07f10f4666ab088@mail.gmail.com> Date: Sun, 17 Feb 2008 17:23:55 +0000 From: "Niki Denev" Sender: ndenev@gmail.com To: "John Birrell" In-Reply-To: <20080216234246.GA27115@what-creek.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080210224247.GA70317@what-creek.com> <47B764D5.8040305@portaone.com> <20080216234246.GA27115@what-creek.com> X-Google-Sender-Auth: 82ead5b4d4fa1aad X-Mailman-Approved-At: Sun, 17 Feb 2008 17:42:55 +0000 Cc: freebsd-current@freebsd.org Subject: Re: New DTrace source snapshot X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Feb 2008 17:23:58 -0000 On Feb 16, 2008 11:42 PM, John Birrell wrote: > On Sun, Feb 17, 2008 at 12:33:57AM +0200, Andrew Pogrebennyk wrote: > > Snapshot dtrace-20080211.tar.bz compiled well for me on i386. However > > during boot with DTrace I am getting the following tracebacks: > > > > GEOM_LABEL: Label for provider acd0 is iso9660/FreeBSD_Install. > > WARNING: WITNESS option enabled, expect reduced performance. > > lock order reversal: > > The lock order reversal warnings are a fault with current at the > moment. If I had my way the cause would be backed out until there > is a solution. I understand that it is a witness improvment that > has caused the warnings to start appearing.... meaning that the > change has exposed an existing problem that wasn't warned obut > before. > > They certainly aren't DTrace change specific. > > > sh*:::line > > { > > @lines[pid, uid, copyinstr(arg0)] = count(); > > } > > There is no sh provider yet. > > -- > John Birrell > I've had several panics while running Bonnie64 benchmars on ZFS on the Dtrace snapshot. I'm not entirely sure if this is Dtrace or ZFS related (the backtrace shows dtrace functions), but here is what textdump shows anyways : vertsion : FreeBSD 8.0-CURRENT #3: Sun Feb 17 16:38:29 EET 2008 root@tester69:/usr/obj/usr/src/sys/GENERIC*** *** This is GENERIC from the DTrace snapshot with INVARIANTS and WITNESS turned off panic message : spin lock held too long msgbuf : spin lock 0xffffffff80aad760 (smp rendezvous) held by 0xffffff000b02d6e0 (tid 100080) too long panic: spin lock held too long cpuid = 1 KDB: enter: panic db:0:kdb.enter.panic> show allpcpu Current CPU: 1 cpuid = 0 curthread = 0xffffff000b486370: pid 141 "spa_zio_intr_2" curpcb = 0xffffffffd83e6d40 fpcurthread = none idlethread = 0xffffff0002234370: pid 11 "idle: cpu0" cpuid = 1 curthread = 0xffffff0002dde6e0: pid 34 "arc_reclaim_thread" curpcb = 0xffffffffd5f99d40 fpcurthread = none idlethread = 0xffffff00022346e0: pid 11 "idle: cpu1" db:0:kdb.enter.panic> bt Tracing pid 34 tid 100051 td 0xffffff0002dde6e0 kdb_enter() at kdb_enter+0x3d panic() at panic+0x176 _mtx_lock_spin_failed() at _mtx_lock_spin_failed+0x39 _mtx_lock_spin() at _mtx_lock_spin+0x9e smp_rendezvous_cpus() at smp_rendezvous_cpus+0xe1 dtrace_xcall() at dtrace_xcall+0x6a dtrace_dynvar_clean() at dtrace_dynvar_clean+0xbe dtrace_state_clean() at dtrace_state_clean+0x29 cyclic_clock() at cyclic_clock+0x12b lapic_handle_timer() at lapic_handle_timer+0x8b Xtimerint() at Xtimerint+0x67 --- interrupt, rip = 0xffffffff80c444e5, rsp = 0xffffffffd5f99b60, rbp = 0xffffffffd5f99b80 --- arc_do_user_evicts() at arc_do_user_evicts+0x85 arc_reclaim_thread() at arc_reclaim_thread+0x1db fork_exit() at fork_exit+0x11f fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffd5f99d30, rbp = 0 --- Full textdump (debug.ddb.scripting.scripts="textdump set; capture on; show pcpu; bt; show locks; ps; alltrace; show lockedvnods; show alllocks; capture off; call doadump; reset") here : http://bg.freebsd.org/~ndenev/crashdumps/textdump_of_dtrace_or_zfs_panic.tar --Niki