From owner-svn-src-all@FreeBSD.ORG Tue Jun 18 21:29:07 2013 Return-Path: Delivered-To: svn-src-all@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 6B1B6427 for ; Tue, 18 Jun 2013 21:29:07 +0000 (UTC) (envelope-from jroberson@jroberson.net) Received: from mail-pa0-x22f.google.com (mail-pa0-x22f.google.com [IPv6:2607:f8b0:400e:c03::22f]) by mx1.freebsd.org (Postfix) with ESMTP id 2D6D21605 for ; Tue, 18 Jun 2013 21:29:07 +0000 (UTC) Received: by mail-pa0-f47.google.com with SMTP id kl14so4391358pab.6 for ; Tue, 18 Jun 2013 14:29:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:x-x-sender:to:cc:subject:in-reply-to:message-id :references:user-agent:mime-version:content-type:x-gm-message-state; bh=k3iDFc0wZJ+EaNtFRc3LDz7ilqThRPbHK+Qt0oChQ1M=; b=OeZqbnV19xbn9yKdk0NFU2FBFBXXlhFeU3kxjsQmLU3lH4I3xyNQ9Vr66uIMF4f+7a fgLekxduWx0biA0Q4qEQ8/TWHjeHzvwRbaoetd+D1F83OE8pfKwJtHRNe/mRh8oGDHiY p3FySCKxQwoM7f+5EIbpHqySqWMoK1+ZmFyfVjThpFEn5r35NU0LtD1bfBppyJ7GwAFe tkeYI118OMqxo0zId0QLC+Z63pFIhGRda1zHa0Y4Ajm8Bx3w3eICF15+ADzbEYNV+s0a 4QLjayAm1Yc1jiIVtzQPamJhI0aUowaQsmo8cyrE0Ajpp7+Iv3EO6WAwh64MQIvwwYOr UyZQ== X-Received: by 10.68.4.9 with SMTP id g9mr19018490pbg.217.1371590946902; Tue, 18 Jun 2013 14:29:06 -0700 (PDT) Received: from rrcs-66-91-135-210.west.biz.rr.com (rrcs-66-91-135-210.west.biz.rr.com. [66.91.135.210]) by mx.google.com with ESMTPSA id xj9sm19869773pbc.16.2013.06.18.14.29.04 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Tue, 18 Jun 2013 14:29:06 -0700 (PDT) Date: Tue, 18 Jun 2013 11:21:51 -1000 (HST) From: Jeff Roberson X-X-Sender: jroberson@desktop To: Alfred Perlstein Subject: Re: svn commit: r251894 - in head: lib/libmemstat sys/vm In-Reply-To: <51C04C77.7010907@mu.org> Message-ID: References: <201306180450.r5I4oKoY091256@svn.freebsd.org> <51C01964.1000006@freebsd.org> <20130618083733.GQ1400@FreeBSD.org> <51C04C77.7010907@mu.org> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Gm-Message-State: ALoCoQmv05eieITVUKcbizyAXryMb/TwmQcX7kp0Ed2NYMGkNMl6HL3TGa2qeYa+5V0NyKXp/6Mf Cc: src-committers@freebsd.org, Andre Oppermann , svn-src-all@freebsd.org, Gleb Smirnoff , svn-src-head@freebsd.org, Jeff Roberson X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jun 2013 21:29:07 -0000 On Tue, 18 Jun 2013, Alfred Perlstein wrote: > On 6/18/13 4:37 AM, Gleb Smirnoff wrote: >> On Tue, Jun 18, 2013 at 10:25:08AM +0200, Andre Oppermann wrote: >> A> There used to be a problem with per CPU caches accumulating large >> amounts >> A> of items without freeing back to the global (or socket) pool. >> A> >> A> Do these updates to UMA change this situation and/or do you have further >> A> improvements coming up? >> >> This is especially a problem with ZFS, which utilizes UMA extensively. >> >> IMHO, we need a flag for uma_zcreate() that would disable per CPU caches, >> so >> that certain zones (ZFS at least) would have them off. >> >> It might be a good idea to force this flag on every zone that has >> allocation >= >> then the page size. >> > What about people running with 256GB+ ram? Do they also want the per cpu > caches off? If you look at the new system there is a static threshold for the initial item size required for different sized per-cpu buckets. What might make sense is to tune this size based on available memory. For what it's worth I looked at solaris settings and they cache roughly 4x as much on a per-cpu basis. The new system should tend to cache less of large and infrequent allocations vs the old system. I can't say yet whether it is still a problem. I have an implementation of vmem to replace using vm_maps for kmem_map, buffer_map, etc. which may resolve the zfs allocation problems. I hope to get this in over the next few weeks. Thanks, Jeff > > -- > Alfred Perlstein > VP Software Engineering, iXsystems >