From owner-freebsd-stable@FreeBSD.ORG Tue Dec 12 20:13:52 2006 Return-Path: X-Original-To: freebsd-stable@FreeBSD.org Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A4FBD16A509 for ; Tue, 12 Dec 2006 20:13:52 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from mx1.sitevalley.com (sitevalley.com [209.67.60.43]) by mx1.FreeBSD.org (Postfix) with SMTP id 898B344A2C for ; Tue, 12 Dec 2006 19:46:31 +0000 (GMT) (envelope-from quetzal@zone3000.net) Received: from unknown (HELO localhost) (217.144.69.37) by 209.67.61.254 with SMTP; 12 Dec 2006 19:47:37 -0000 Date: Tue, 12 Dec 2006 21:47:10 +0200 From: Nikolay Pavlov To: LI Xin Message-ID: <20061212194710.GA7822@zone3000.net> Mail-Followup-To: Nikolay Pavlov , LI Xin , freebsd-stable@FreeBSD.org, Robert Watson References: <456662F4.6000306@delphij.net> <20061125103755.GA78288@zone3000.net> <456887CD.50606@delphij.net> <20061125212004.GA22786@zone3000.net> <457D0FC7.6010808@delphij.net> <20061211180817.GA4557@zone3000.net> <457DAA99.60605@delphij.net> <20061211205238.GA5733@zone3000.net> <20061212185233.GA7377@zone3000.net> <457EFCD0.6060007@delphij.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <457EFCD0.6060007@delphij.net> User-Agent: Mutt/1.4.2.1i X-Operating-System: FreeBSD 6.1-RELEASE-p10 Cc: Robert Watson , freebsd-stable@FreeBSD.org Subject: Re: deadlock in "zoneli" state on 6.2-PRERELEASE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Dec 2006 20:13:52 -0000 On Wednesday, 13 December 2006 at 3:02:40 +0800, LI Xin wrote: > Nikolay Pavlov wrote: > > No luck at all. > > patch-zonelim-drain-20061212 works for me as a previos one. > > no panics, but still zoneli. > > All this is very odd, because other two squid servers works > > perfectly in the same loadbalancer with out any patches and > > kernel panics. I think that the case with this server > > is realy rare. > > Would you please give a vmstat -z output when the server stuck in the > zonelim livelock? Thanks! 130947/775/131722 mbufs in use (current/cache/total) 130859/213/131072/131072 mbuf clusters in use (current/cache/total/max) 130859/213 mbuf+clusters out of packet secondary zone in use (current/cache) 0/0/0/0 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/0 9k jumbo clusters in use (current/cache/total/max) 0/0/0/0 16k jumbo clusters in use (current/cache/total/max) 294454K/619K/295074K bytes allocated to network (current/cache/total) 0/493001/246499 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/4/6656 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 83 calls to protocol drain routines ITEM SIZE LIMIT USED FREE REQUESTS UMA Kegs: 140, 0, 84, 12, 84 UMA Zones: 120, 0, 84, 6, 84 UMA Slabs: 64, 0, 941, 3, 2709 UMA RCntSlabs: 104, 0, 65536, 28, 65536 UMA Hash: 128, 0, 4, 26, 6 16 Bucket: 76, 0, 27, 23, 35 32 Bucket: 140, 0, 21, 7, 29 64 Bucket: 268, 0, 30, 26, 67 128 Bucket: 524, 0, 215, 457, 827387 VM OBJECT: 132, 0, 41860, 16, 72475 MAP: 192, 0, 7, 33, 7 KMAP ENTRY: 68, 57456, 121, 47, 97518 MAP ENTRY: 68, 0, 702, 362, 94390 PV ENTRY: 24, 2228360, 124664, 2646, 984278 DP fakepg: 72, 0, 0, 0, 0 mt_zone: 64, 0, 182, 54, 182 16: 16, 0, 3754, 306, 432518 32: 32, 0, 1794, 353, 116429 64: 64, 0, 3205, 3580, 206314 128: 128, 0, 1616, 1384, 371069 256: 256, 0, 368, 427, 22536 512: 512, 0, 1266, 30, 486094 1024: 1024, 0, 48, 84, 434408 2048: 2048, 0, 147, 61, 43326 4096: 4096, 0, 129, 22, 4942 Files: 72, 0, 2672, 2734, 481720 MAC labels: 20, 0, 59586, 1085, 622560 PROC: 536, 0, 71, 27, 1564 THREAD: 376, 0, 98, 22, 98 KSEGRP: 88, 0, 98, 62, 98 UPCALL: 44, 0, 0, 0, 0 VMSPACE: 296, 0, 28, 24, 1518 mbuf_packet: 256, 0, 131052, 20, 9510911 mbuf: 256, 0, 91, 559, 12694062 mbuf_cluster: 2048, 131072, 131072, 0, 136594 mbuf_jumbo_pagesize: 4096, 0, 0, 0, 0 mbuf_jumbo_9k: 9216, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 0, 0, 0, 0 ACL UMA zone: 388, 0, 0, 0, 0 g_bio: 132, 0, 0, 1160, 522435 ata_request: 204, 0, 0, 0, 0 ata_composite: 196, 0, 0, 0, 0 VNODE: 348, 0, 47312, 10, 52436 VNODEPOLL: 76, 0, 0, 0, 0 S VFS Cache: 68, 0, 39770, 46, 44847 L VFS Cache: 291, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 12, 205701 DIRHASH: 1024, 0, 1595, 229, 7023 NFSMOUNT: 480, 0, 1, 15, 1 NFSNODE: 536, 0, 16, 5, 16 PIPE: 408, 0, 6, 21, 664 KNOTE: 68, 0, 0, 112, 76 socket: 356, 131076, 3930, 1229, 186491 unpcb: 140, 131096, 12, 44, 170 ipq: 32, 4181, 0, 0, 0 udpcb: 180, 131076, 12, 32, 188 inpcb: 180, 131076, 3859, 1509, 186132 tcpcb: 464, 131072, 3859, 1237, 186132 tcptw: 48, 8268, 0, 546, 140117 syncache: 100, 15366, 2, 271, 165792 hostcache: 76, 15400, 3717, 33, 6425 tcpreass: 20, 8281, 0, 169, 1493 sackhole: 20, 0, 4, 334, 372356 ripcb: 180, 131076, 0, 0, 0 rtentry: 132, 0, 22, 36, 31 pfsrctrpl: 100, 15015, 0, 0, 0 pfrulepl: 604, 0, 9, 9, 9 pfstatepl: 260, 15000, 4626, 7134, 165422 pfaltqpl: 128, 0, 0, 0, 0 pfpooladdrpl: 68, 0, 2, 110, 2 pfrktable: 1240, 0, 4, 5, 8 pfrkentry: 156, 0, 5, 45, 5 pfrkentry2: 156, 0, 0, 0, 0 pffrent: 16, 203, 0, 203, 61 pffrag: 48, 0, 0, 156, 12 pffrcache: 48, 10062, 0, 0, 0 pffrcent: 12, 50141, 0, 0, 0 pfstatescrub: 28, 0, 0, 0, 0 pfiaddrpl: 92, 0, 0, 0, 0 pfospfen: 108, 0, 345, 51, 345 pfosfp: 28, 0, 188, 193, 188 SWAPMETA: 276, 121576, 0, 0, 0 Mountpoints: 740, 0, 7, 8, 7 FFS inode: 132, 0, 47253, 17, 52376 FFS1 dinode: 128, 0, 0, 0, 0 FFS2 dinode: 256, 0, 47253, 12, 52376 > > Cheers, > -- > Xin LI http://www.delphij.net/ > FreeBSD - The Power to Serve! > -- ====================================================================== - Best regards, Nikolay Pavlov. <<<----------------------------------- ======================================================================