From owner-freebsd-fs@FreeBSD.ORG Wed Jan 25 16:24:39 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E30C61065672 for ; Wed, 25 Jan 2012 16:24:38 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from proxypop04.sare.net (proxypop04.sare.net [194.30.0.65]) by mx1.freebsd.org (Postfix) with ESMTP id 67A678FC16 for ; Wed, 25 Jan 2012 16:24:37 +0000 (UTC) Received: from [172.16.2.2] (izaro.sarenet.es [192.148.167.11]) by proxypop04.sare.net (Postfix) with ESMTPSA id 7C0949DC4D9 for ; Wed, 25 Jan 2012 17:24:36 +0100 (CET) From: Borja Marcos Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Date: Wed, 25 Jan 2012 17:24:35 +0100 Message-Id: <8E5FB8BA-DB11-459A-8DD8-6A5FA5275177@sarenet.es> To: freebsd-fs@freebsd.org Mime-Version: 1.0 (Apple Message framework v1084) X-Mailer: Apple Mail (2.1084) Subject: Is swap over ZFS safe on FreeBSD 9? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jan 2012 16:24:39 -0000 Hi I decided to give another try to swap over ZFS. I've created a volume, = added it as swap, and I've tried something crazy: make -j 128 buildworld The system is hung, it still responds to ping and establishes TCP = connections, but nothing else.=20 last pid: 70437; load averages: 16.19, 12.86, 8.27 up 0+04:57:12 = 16:54:32 203 processes: 1 running, 202 sleeping CPU: 0.0% user, 0.0% nice, 0.1% system, 0.1% interrupt, 99.9% idle Mem: 6409M Active, 83M Inact, 1421M Wired Swap: 32G Total, 45M Used, 32G Free Timeout, server not responding. HR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1790 borjam 1 47 0 16700K 1448K CPU2 2 1:44 9.81% top 1729 borjam 1 48 0 35604K 1064K pfault 10 1:25 8.59% zpool 70436 root 1 63 0 178M 168M pfault 1 0:06 4.78% = cc1plus 70316 root 1 63 0 195M 186M pfault 0 0:06 4.45% = cc1plus 70370 root 1 63 0 173M 162M pfault 7 0:05 4.28% = cc1plus 70300 root 1 63 0 207M 196M pfault 7 0:05 4.17% = cc1plus 70389 root 1 63 0 179M 168M pfault 2 0:05 4.12% = cc1plus 70390 root 1 63 0 185M 174M pfault 11 0:05 4.01% = cc1plus 70297 root 1 62 0 194M 184M pfault 2 0:05 4.01% = cc1plus 70421 root 1 62 0 168M 159M pfault 9 0:05 3.84% = cc1plus 70379 root 1 62 0 195M 184M pfault 9 0:04 3.84% = cc1plus 70372 root 1 62 0 189M 175M pfault 4 0:04 3.79% = cc1plus 70384 root 1 62 0 155M 146M pfault 2 0:04 3.62% = cc1plus 70288 root 1 62 0 179M 162M pfault 3 0:04 3.51% = cc1plus 70382 root 1 62 0 160M 149M pfault 11 0:04 3.40% = cc1plus 70430 root 1 62 0 158M 148M pfault 8 0:04 3.35% = cc1plus 70313 root 1 62 0 193M 183M pfault 10 0:04 3.29% = cc1plus Lots of processes are in "pfault" state. I tried to disable "sync", = primarycache and secondarycache for the swap volume, but without = success. Testing again, last pid: 88772; load averages: 0.00, 0.79, 2.73 up 0+00:28:14 = 17:34:15 186 processes: 1 running, 184 sleeping, 1 waiting CPU: 0.0% user, 0.0% nice, 0.1% system, 0.0% interrupt, 99.9% idle Mem: 6711M Active, 683M Inact, 519M Wired Swap: 32G Total, 116M Used, 32G Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU = COMMAND 3839 root 1 40 0 16700K 1412K CPU0 0 0:10 0.00% top 88692 root 1 53 0 259M 247M pfault 2 0:07 0.00% = cc1plus 88729 root 1 -20 0 199M 182M swread 2 0:07 0.00% = cc1plus 88750 root 1 52 0 166M 154M pfault 2 0:06 0.00% = cc1plus 88763 root 1 52 0 226M 211M pfault 8 0:06 0.00% = cc1plus 88768 root 1 -20 0 206M 191M swread 6 0:06 0.00% = cc1plus 88637 root 1 -20 0 218M 202M swread 11 0:06 0.00% = cc1plus 88643 root 1 52 0 219M 204M pfault 7 0:06 0.00% = cc1plus 88657 root 1 -20 0 225M 210M swread 4 0:06 0.00% = cc1plus 88748 root 1 -20 0 232M 217M swread 3 0:06 0.00% = cc1plus 88771 root 1 -20 0 235M 220M swread 6 0:06 0.00% = cc1plus 88701 root 1 52 0 218M 203M pfault 3 0:06 0.00% = cc1plus 88749 root 1 52 0 219M 205M pfault 1 0:05 0.00% = cc1plus 88682 root 1 -20 0 201M 189M swread 0 0:05 0.00% = cc1plus 88711 root 1 -20 0 240M 227M swread 2 0:05 0.00% = cc1plus 88696 root 1 52 0 232M 218M pfault 5 0:05 0.00% = cc1plus 88664 root 1 -20 0 222M 207M swread 5 0:05 0.00% = cc1plus Any ideas? I guess I better stay away from swap on ZFS for now. Borja.=