From owner-freebsd-net@FreeBSD.ORG Sun Aug 22 08:34:22 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 857ED106566B for ; Sun, 22 Aug 2010 08:34:22 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 51C878FC12 for ; Sun, 22 Aug 2010 08:34:21 +0000 (UTC) Received: by iwn36 with SMTP id 36so5291960iwn.13 for ; Sun, 22 Aug 2010 01:34:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=ow3J0rSJsGpQhjriAVOcVj88G0pdfRPNmHKyO7w13Dw=; b=ejBCBrErWAw7n/QKCxSfOBjw/2pEK+XDihS53c3TG9/rgm7z9e0KLeQrR9lnSbZRAu sGFXJC53+alV3iEB3nWxZ0baoTnAK662i2Su+ENZj5MA0tM1R22r+D+5497KobOxr2AB CyqSlISB672l9fJyQ24rRvXtNYImXNxNGvasQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=iRp0m7bAnvKj1P1TeMlU0iloeonRYdQLrcD6Yyqm1hdhcoosIQb9qm6lIpCBwDRPM1 HiEK/r4Yl2Mt5j35gmT79qYkJHZT0/7Ei70icqIER6VCMxuUmtox7ft0Ttsh72tRKwyd EuJF6Lv3NIQnCT2TGY126VWP14pT6lAtOjgVs= MIME-Version: 1.0 Received: by 10.231.30.130 with SMTP id u2mr4620429ibc.111.1282464665306; Sun, 22 Aug 2010 01:11:05 -0700 (PDT) Received: by 10.231.168.14 with HTTP; Sun, 22 Aug 2010 01:11:05 -0700 (PDT) Date: Sun, 22 Aug 2010 16:11:05 +0800 Message-ID: From: Adrian Chadd To: freebsd-net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Subject: 8.0-RELEASE-p3: 4k jumbo mbuf cluster exhaustion X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Aug 2010 08:34:22 -0000 Hi, I've got a Squid/Lusca server on 8.0-RELEASE-p3 which is exhibiting some very strange behaviour. After a few minutes uptime, the 4k mbuf cluster zone fills up and Squid/Lusca spends almost all of it's time sleeping in "keglimit". I've bumped kern.ipc.nmbclusters to 262144 and kern.ipc.jumbop to 32768 but the system will slowly crawl towards filling that zone. The box has a bce on-board NIC and is using ipfw to handle redirecting traffic to/from the box for transparent TCP interception. It's handling around ~30,000 concurrent connections at the moment. I have other very busy proxies on FreeBSD-7.x pushing a few hundred megabits without any issues. This box falls over after ~ 20 mbit. If I bypass redirection and/or kill squid, the 4k cluster count drops back down to < 500 and stays there. Does anyone have any ideas on where to begin debugging this? Thanks, Adrian