From owner-freebsd-current@FreeBSD.ORG Wed Oct 22 05:14:35 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F1AA81065672 for ; Wed, 22 Oct 2008 05:14:34 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.155]) by mx1.freebsd.org (Postfix) with ESMTP id 7D3DC8FC1D for ; Wed, 22 Oct 2008 05:14:34 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so187311fgb.35 for ; Tue, 21 Oct 2008 22:14:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=YRKwEL90adLs++PpjBx3CVLbriDXq7Xu3wB5kI+wlkQ=; b=Njh1eHfh7Vgzj0s8rspnIAL7HR/Hi2QmIuFC8pglSpEDQnH0EgsaYFItsRjeN3lwzX vW3gtQT2aCX6D31BAMhz1k6pld32RRle5EwmqX1/kuHtl+dMOU+R59Fp1c0KwZAQPpqI UUVNj0aRmRohwlKa/LZ+3ah4eN8hOtw0FS4A4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=oyZgOBGq6E43HtCip1CPnVMOQEF3LSP4K3PldCzMJ3PjmIy+jbVp8++SwcBI3Jn3Fa gRgDD5GAUm2P0yCKmjfJG2NCmuGquH2FQw9MZH96uaWolgFpGKVEKLHoYoL9qID9tOtB 1yyGy+nvDmPshrQRhXF6Z9Y16pCFBDej1S9Mk= Received: by 10.103.238.4 with SMTP id p4mr4896803mur.66.1224652473363; Tue, 21 Oct 2008 22:14:33 -0700 (PDT) Received: from MYTAHT.totalterror.net ([87.121.19.243]) by mx.google.com with ESMTPS id i5sm35398433mue.11.2008.10.21.22.14.30 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 21 Oct 2008 22:14:31 -0700 (PDT) Message-Id: <26E8FF01-F092-449F-95D1-1B4F9B212918@gmail.com> From: Nikolay Denev To: Artem Belevich In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 22 Oct 2008 08:14:29 +0300 References: X-Mailer: Apple Mail (2.929.2) X-Mailman-Approved-At: Wed, 22 Oct 2008 11:14:12 +0000 Cc: freebsd-current@freebsd.org, jb@what-creek.com Subject: Re: Dtrace: hotkernel+buildworld -> crash X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2008 05:14:35 -0000 On 22 Oct, 2008, at 24:41 , Artem Belevich wrote: > Hi, > > I'm not sure if it's a known issue or not, but running hotkernel > script from DTraceToolkit-0.99 > during "make buildworld -j8" easily crashes -current (cvsup'ed on Oct > 20th) on amd64 (Quad core Q9450) > when I press ^C to stop the script. > > Kernel is GENERIC with WITNESS/INVARIANTS disabled and some > SCSI/wireless/NIC drivers removed. > > I was unable to dump kernel core - debugger always gets another trap > and returns > to the prompt. The box does not have serial ports, so I've typed in > portions of stack > traces below from the screen. > > One common thing across all crashes I've seen so far is that crashed > process always > dies in the same place with the following backtrace. Apparently it > attempts to > dereference $rip which is 0. > > cyclic_disable_xcall+0x7 > smp_rendezvous_action > Xrendezvous > ----interrupt > > Dtrace process itself always has the same stack trace: > > smp_tlb_shootdown > pmap_invalidate_page > pmap_remove_pte > pmap_remove > vm_map_delete > vm_map_remove > uma_large_free > free > dtrace_buffer_free > dtrace_state_destroy > dtrace_close > ... > > I'll try to reproduce the issue with WITNESS/INVARIANTS turned ON. > Perhaps that > would provide more hints on what's wrong. Meanwhile, if someone can > suggest > anything I can do to help troubleshoot this, that would be great as > I'm a bit out of > my depth here. > > -- > --Artem > Yesterday I was able to crash a machine several times with hotkernel. This was shile the machine was under heavy network load. While it was idle hotkernel seems to run normal, but when it's loaded as soon as I press Ctrl-C it crashes. The machine runs latest -STABLE, but I guess the Dtrace code is the same in both current and stable? -- Regards, Nikolay Denev