From owner-freebsd-stable@FreeBSD.ORG Sat Jan 19 20:21:20 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 051AB16A41A; Sat, 19 Jan 2008 20:21:20 +0000 (UTC) (envelope-from tom.hurst@clara.net) Received: from spork.qfe3.net (spork.qfe3.net [212.13.207.101]) by mx1.freebsd.org (Postfix) with ESMTP id C8E4613C457; Sat, 19 Jan 2008 20:21:19 +0000 (UTC) (envelope-from tom.hurst@clara.net) Received: from [81.104.123.28] (helo=voi.aagh.net) by spork.qfe3.net with esmtp (Exim 4.66 (FreeBSD)) (envelope-from ) id 1JGKBq-000H7j-DJ; Sat, 19 Jan 2008 20:21:18 +0000 Received: from freaky by voi.aagh.net with local (Exim 4.68 (FreeBSD)) (envelope-from ) id 1JGKBq-000CSE-0v; Sat, 19 Jan 2008 20:21:18 +0000 Date: Sat, 19 Jan 2008 20:21:17 +0000 From: Thomas Hurst To: Kris Kennaway Message-ID: <20080119202117.GA44697@voi.aagh.net> Mail-Followup-To: Kris Kennaway , John Baldwin , freebsd-stable@freebsd.org, Peter Jeremy References: <20071203054207.GA1153@aleph.niw.com.au> <4787AAF4.1020905@FreeBSD.org> <20080112033147.GX60060@server.vk2pj.dyndns.org> <200801120005.38972.jhb@freebsd.org> <20080115020316.GA47831@voi.aagh.net> <478C7B04.9080102@FreeBSD.org> <20080116182621.GA4260@voi.aagh.net> <20080119175151.GA22860@voi.aagh.net> <47925058.4020406@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <47925058.4020406@FreeBSD.org> Organization: Not much. User-Agent: Mutt/1.5.17 (2007-11-01) Sender: Thomas Hurst Cc: Peter Jeremy , freebsd-stable@freebsd.org, John Baldwin Subject: Re: Swapping caused by very large (regular) file size X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Jan 2008 20:21:20 -0000 * Kris Kennaway (kris@FreeBSD.org) wrote: > I don't understand your test procedure, can you elaborate? The spikes from last night are from: (/sbin/dump -$level -LuaC128 -f - $fs | /usr/bin/tee ${target} | /sbin/sha1 > ${target}.sha1) Followed by: nice -n 19 /home/freaky/bin/par2 c -t+ -r5 -m256 ${target} Graphs from this run clearly slow a modest amount of paging activity while it occurs; you can see the other graphs here: http://voi.aagh.net/backupmunin/ More simply, it can be reproduced by doing this: -# swapoff -a # clear swap -# swapon -a -# top |grep -A1 Mem Mem: 1371M Active, 5727M Inact, 416M Wired, 271M Cache, 214M Buf, 124M Free Swap: 10G Total, 10G Free -# ls -l voi_20080119_#usr.dmp.0 -rw-r--r-- 1 root wheel 106527672320 Jan 19 05:27 voi_20080119_#usr.dmp.0 -# cat voi_20080119_#usr.dmp.0 >/dev/null & -% sleep 20 && top |grep -A1 Mem Mem: 1407M Active, 5789M Inact, 431M Wired, 272M Cache, 214M Buf, 8580K Free Swap: 10G Total, 400K Used, 10G Free The system's occasionally deciding to swap pages out rather than recycle something from the huge pool of inactive/cache memory (which atm will be mostly cached pages from this file, since this is my second test run; the first took longer to ramp up). -% uname -a FreeBSD voi.nightsdawn.sf 7.0-RC1 FreeBSD 7.0-RC1 #0: Wed Jan 16 14:56:50 GMT 2008 -- Thomas 'Freaky' Hurst http://hur.st/