From owner-freebsd-current@FreeBSD.ORG Thu Jun 24 08:47:45 2010 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 72D6D1065674 for ; Thu, 24 Jun 2010 08:47:45 +0000 (UTC) (envelope-from tevans.uk@googlemail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 02A5D8FC1E for ; Thu, 24 Jun 2010 08:47:44 +0000 (UTC) Received: by fxm7 with SMTP id 7so4231674fxm.13 for ; Thu, 24 Jun 2010 01:47:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=4IwKq2NMxIr7d7STX/3YPM0KnxGd/KNA6gBBzXi0J/4=; b=o1ng0B95Qbr9Y52v9MihEcEGm/mrXhlMpYSAGNBVgDyc/oxuboiSSwUY7BUYKadUzv An2raRnGpKNZ2D+Ang7LiJzkXCXHMQzreswV86NoJ1X07OotUQfjjcUiK893pcmYRkrp JTXM93CHed+PooyEfJs/oiQJXfeurqUC/BvEk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=JNBVHcqV4k6HNlio9TVg0Sig0WaoGFXF/Uz+taRDwH4eeihjwdcvQV6t0uBgqGl2LP +fSpt5t+uuNE6eM8dPWVAETOTHj6S/WHux1yh6FZsLdQZp2z41C1hEv1J/91AG5qB+sY 0I1/bRmt9cRvRb6vJoePFZ8WiDaaOUE72hwqM= MIME-Version: 1.0 Received: by 10.239.133.6 with SMTP id 6mr701044hbt.130.1277369263681; Thu, 24 Jun 2010 01:47:43 -0700 (PDT) Received: by 10.239.185.1 with HTTP; Thu, 24 Jun 2010 01:47:43 -0700 (PDT) In-Reply-To: <20100623210133.GA10694@exodus.desync.com> References: <20100623164401.GA7914@exodus.desync.com> <4C2272E5.2090901@delphij.net> <20100623210133.GA10694@exodus.desync.com> Date: Thu, 24 Jun 2010 09:47:43 +0100 Message-ID: From: Tom Evans To: ben wilber Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-current , d@delphij.net Subject: Re: zfs panic X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Jun 2010 08:47:45 -0000 On Wed, Jun 23, 2010 at 10:01 PM, ben wilber wrote: > On Wed, Jun 23, 2010 at 01:47:33PM -0700, Xin LI wrote: >> > >> > panic: _sx_xlock_hard: recursed on non-recursive sx buf_hash_table.ht_= locks[i].ht_lock @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/= uts/c >> > ommon/fs/zfs/arc.c:1626 >> >> Any chance to obtain a backtrace for the panic? > > >From r209229: > > db:0:kdb.enter.default> =C2=A0bt > Tracing pid 3233 tid 100396 td 0xffffff013600f000 > kdb_enter() at kdb_enter+0x3d > panic() at panic+0x1c8 > _sx_xlock_hard() at _sx_xlock_hard+0x93 > _sx_xlock() at _sx_xlock+0xaa > arc_buf_remove_ref() at arc_buf_remove_ref+0x7b > dbuf_rele() at dbuf_rele+0x15d > zfs_freebsd_reclaim() at zfs_freebsd_reclaim+0xe1 > VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xe8 > vgonel() at vgonel+0x186 > vnlru_free() at vnlru_free+0x2f4 > vfs_lowmem() at vfs_lowmem+0x31 > kmem_malloc() at kmem_malloc+0x12c > page_alloc() at page_alloc+0x18 > keg_alloc_slab() at keg_alloc_slab+0xe6 > keg_fetch_slab() at keg_fetch_slab+0x18e > zone_fetch_slab() at zone_fetch_slab+0x4f > uma_zalloc_arg() at uma_zalloc_arg+0x56b > arc_get_data_buf() at arc_get_data_buf+0xaa > arc_read_nolock() at arc_read_nolock+0x1cb > arc_read() at arc_read+0x71 > dbuf_read() at dbuf_read+0x4ea > dmu_buf_hold_array_by_dnode() at dmu_buf_hold_array_by_dnode+0x119 > dmu_buf_hold_array() at dmu_buf_hold_array+0x57 > dmu_read_uio() at dmu_read_uio+0x3f > zfs_freebsd_read() at zfs_freebsd_read+0x558 > VOP_READ_APV() at VOP_READ_APV+0xe2 > vn_read() at vn_read+0x1d0 > dofileread() at dofileread+0x97 > kern_preadv() at kern_preadv+0x6a > pread() at pread+0x52 > syscallenter() at syscallenter+0x217 > syscall() at syscall+0x39 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (475, FreeBSD ELF64, pread), rip =3D 0x80100c14c, rsp =3D 0x7= fffffbfeb48, rbp =3D 0x2 --- > > Thanks. I notice the traceback is in the UMA zone allocaor. Did it used to be stabl= e? ZFS recently changed to using the UMA allocator, and I found this made my system less reliable. Does disabling this help? Add this to /boot/loader.conf: vfs.zfs.zio.use_uma=3D0 Cheers Tom