From owner-freebsd-current@FreeBSD.ORG Wed Jun 20 22:16:12 2007 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D520D16A469 for ; Wed, 20 Jun 2007 22:16:12 +0000 (UTC) (envelope-from joao.barros@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.169]) by mx1.freebsd.org (Postfix) with ESMTP id 3F34013C48C for ; Wed, 20 Jun 2007 22:16:11 +0000 (UTC) (envelope-from joao.barros@gmail.com) Received: by ug-out-1314.google.com with SMTP id u2so502289uge for ; Wed, 20 Jun 2007 15:16:10 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=fE/mMU/XTR6umRqpyOqCkhMf3jPAxnZ3W4ZoKDKTHZRKIAu6gY0boik7nKEuCHxog9p1tQ5jB3LcP7JwfXj2UsalfKczUIiwflSMRV/IVS6/APeNt1a1k5AueLQhEtvYMF9KPvGP+tRy6zwu/eV9EVLkdPuuKnHjyP7r6MaURJQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=UqIyDPdWU/2x6GXuERa6MSS0vxUZi3CQHwyYw+3RsFYrEYYKMwa3MWcXfKSJWaO5GyzMYXsrf1/K+X0p4IJA3D4q9RLlLPT5Lfkdh/GlPnRn8Gv3yUzPTd+PcjfzWCo/coaVQTht9Q5d1RpxHHRoB+fxR7g8CYFEXhvPWnBnXqo= Received: by 10.78.166.7 with SMTP id o7mr617531hue.1182377770179; Wed, 20 Jun 2007 15:16:10 -0700 (PDT) Received: by 10.78.163.2 with HTTP; Wed, 20 Jun 2007 15:16:10 -0700 (PDT) Message-ID: <70e8236f0706201516q3cc4fc23ue5837b0bc9d0308c@mail.gmail.com> Date: Wed, 20 Jun 2007 23:16:10 +0100 From: "Joao Barros" To: "John Nielsen" In-Reply-To: <200706201616.56547.lists@jnielsen.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <1182354823.6504.23.camel@shumai.marcuscom.com> <200706201528.31349.lists@jnielsen.net> <20070620145130.K71819@coco.macktronics.com> <200706201616.56547.lists@jnielsen.net> Cc: Dan Mack , freebsd-current@freebsd.org Subject: Re: ZFS and deadlock with {nullfs,NFS} X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2007 22:16:13 -0000 On 6/20/07, John Nielsen wrote: > On Wednesday 20 June 2007 03:56:13 pm Dan Mack wrote: > > On Wed, 20 Jun 2007, John Nielsen wrote: > > > On Wednesday 20 June 2007 12:30:23 pm Dan Mack wrote: > > >> On Wed, 20 Jun 2007, Kris Kennaway wrote: > > >> > > >> > > >> > > >>> 404 at the moment, but look for processes involving zil* in the > > >>> backtrace. I had to disable zil (vfs.zfs.zil_disable=1 tunable) to > > >>> prevent low-memory deadlocks on my machines. Since then it's been > > >>> fine. > > >>> > > >>> You may also wish to use my patches (see the archives) to improve > > >>> performance and low-memory behaviour. > > >>> > > >>> Kris > > >> > > >> Does someone have these recommended sysctls embodied in an example > > >> /boot/loader.conf yet? Here is mine, does it look reasonable to keep > > >> ZFS from running into the kmem_ memory panics? I have no idea if I > > >> found all of your recommendations so it would be nice if they were > > >> summarized in one place. > > >> > > >> | # /boot/loader.conf i386 / 1GB memory / SMP > > >> | kern.maxvnodes="50000" > > > > > > Note that kern.maxvnodes has to be set in /etc/sysctl.conf to have any > > > effect. > > > > > > JN > > > > FWIW ... I'm still experiencing panics; this time with when running cvsup > > to update /usr/ports: > > > > borg# grep -i Panic /var/crash/info* > > /var/crash/info.0: Panic String: kmem_malloc(16384): kmem_map too small: > > 268419072 total allocated /var/crash/info.1: Panic String: > > kmem_malloc(131072): kmem_map too small: 266354688 total allocated > > /var/crash/info.2: Panic String: kmem_malloc(4096): kmem_map too small: > > 268435456 total allocated /var/crash/info.3: Panic String: > > kmem_malloc(28672): kmem_map too small: 268435456 total allocated > > > > > > Anyone ideas on other tunables that might keep the system running? I'm > > not too concerned about performance. Otherwise I'll have to go spend > > some money on an AMD64 mainboard, memory, and cpu :-( > > The only tunable I had that you didn't was this one: > > vfs.zfs.arc_max="83886080" > > FWIW, my i386 system has 1.5GB RAM. More RAM might help, and/or you probably > still need to do some balancing (read: fiddling) with the tunables you're > already adjusting. > > JN > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > With a 4 drive raidz, i386 and 1GB ram I only changed one setting: kern.maxvnodes="50000" Without it a simple recursive chmod or chown would crash the kernel. A 'make world' would fail too. FYI my vfs.zfs look like this: # sysctl vfs.zfs. vfs.zfs.arc_min: 16777216 vfs.zfs.arc_max: 167772160 vfs.zfs.mdcomp_disable: 0 vfs.zfs.prefetch_disable: 0 vfs.zfs.zio.taskq_threads: 0 vfs.zfs.recover: 0 vfs.zfs.vdev.cache.size: 10485760 vfs.zfs.vdev.cache.max: 16384 vfs.zfs.cache_flush_disable: 0 vfs.zfs.zil_disable: 0 vfs.zfs.debug: 0 -- Joao Barros