From owner-freebsd-performance@FreeBSD.ORG Sat Dec 29 15:50:30 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C07916A418 for ; Sat, 29 Dec 2007 15:50:30 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.176]) by mx1.freebsd.org (Postfix) with ESMTP id F061C13C448 for ; Sat, 29 Dec 2007 15:50:29 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: by py-out-1112.google.com with SMTP id u52so8235699pyb.10 for ; Sat, 29 Dec 2007 07:50:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=OgUldBwYAcfMrUwqmClBXJaWocgM8DRkk0XRNVtEsPM=; b=fbvPbOdhWZZpx2nlLd+7vyvmWUQn+Bn0R/LCGiHpPCk2YBjpTFZgEifzS/Y3nSyp6RD0SN7xoN2sjUuVFtSRdiSN0eUm2gIYsHvHabrAerrGtUjTLjVNrH1DoCPvI0L2a2v+dR25nDX6wS41eYWsZiNZB1wKci6kHMCAFuExAVg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=TGeEGDi1gTOewY4cV+z0LqSxkKZMI2H8BT6bIHtkSwSN61VpDf1ITLzCpiD695tkw6ff0TQ+atFbLTwDLI9+u47w9udm74wrCYl+DxwnBZUFbfFgx2eg+GChhoIoc5MRtMjgDg9aZMN1PcMPfKmLULkuZKo9CIyIuQIRjrngRLs= Received: by 10.64.241.3 with SMTP id o3mr9613180qbh.16.1198943429060; Sat, 29 Dec 2007 07:50:29 -0800 (PST) Received: by 10.64.184.9 with HTTP; Sat, 29 Dec 2007 07:50:29 -0800 (PST) Message-ID: <8e10486b0712290750i41ca2354q7baba9217a1fd9aa@mail.gmail.com> Date: Sat, 29 Dec 2007 13:50:29 -0200 From: "Alexandre Biancalana" To: "Alfred Perlstein" In-Reply-To: <20071228213851.GE76698@elvis.mu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8e10486b0712191109n3d21b02cyf5183ee0cd01d8ce@mail.gmail.com> <20071221201625.GZ16982@elvis.mu.org> <8e10486b0712211249v4c5571ddud21b277f686992b2@mail.gmail.com> <20071221212808.GE16982@elvis.mu.org> <8e10486b0712211555n3efe8729qff14387be128cf10@mail.gmail.com> <20071222002535.GL16982@elvis.mu.org> <8e10486b0712251647uddf80f9sa6cacb42dfa94ff5@mail.gmail.com> <20071228213851.GE76698@elvis.mu.org> Cc: freebsd-performance@freebsd.org Subject: Re: Bad performance when accessing a lot of small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2007 15:50:30 -0000 On Dec 28, 2007 7:38 PM, Alfred Perlstein wrote: > > * Alexandre Biancalana [071225 16:45] wrote: > > On 12/21/07, Alfred Perlstein wrote: > > > > > Have you tried the 'noatime' mount option? That should help. > > > > Yeah, the zfs set atime=off was already done.... > > > > > > > > Can you provide a histogram of the count of files per directory? > > > > Excuse-me, but I don't understand.... > > Distribution of files per directory, example: > > 1000 files in 9 dirs > 1001 files in 12 dirs > > find /path_to_root/ -type f | sed 's/\/[^/]*$//' | uniq -c | \ > awk '{print $1}' | sort -n | uniq -c > > That will print out the number of files per dir. > > 2 98 > 3 102 > 1 103 > 2 105 Ohh yes !! Now I understand.... The problem is that last night the server stop responding and now is panicing with the message: ZFS(panic): zfs: allocating allocated segment(offset=2781261201408 size=131072)