From owner-svn-src-stable@FreeBSD.ORG Wed Nov 17 13:59:26 2010 Return-Path: Delivered-To: svn-src-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 268B81065695; Wed, 17 Nov 2010 13:59:26 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mail.sippysoft.com (gk1.360sip.com [72.236.70.240]) by mx1.freebsd.org (Postfix) with ESMTP id D55418FC17; Wed, 17 Nov 2010 13:59:25 +0000 (UTC) Received: from s0106005004e13421.vs.shawcable.net ([70.71.175.212] helo=[192.168.1.79]) by mail.sippysoft.com with esmtpsa (TLSv1:CAMELLIA256-SHA:256) (Exim 4.72 (FreeBSD)) (envelope-from ) id 1PIiXi-0005K3-1B; Wed, 17 Nov 2010 05:59:24 -0800 Message-ID: <4CE3DFB3.4060809@sippysoft.com> Date: Wed, 17 Nov 2010 05:59:15 -0800 From: Maxim Sobolev Organization: Sippy Software, Inc. User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6 MIME-Version: 1.0 To: Bruce Evans References: <201011160440.oAG4e3YU039413@svn.freebsd.org> <20101117030118.X1203@besplex.bde.org> In-Reply-To: <20101117030118.X1203@besplex.bde.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam_score: -2.9 X-Spam_score_int: -28 X-Spam_bar: -- X-Spam_report: Spam detection software, running on the system "mail.sippysoft.com", has identified this incoming email as possible spam. The original message has been attached to this so you can view it (if it isn't spam) or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: On 11/16/2010 8:12 AM, Bruce Evans wrote: > This was quite low for yestdeay's uses (starting in about 1995), but today > it is little missed since only yesterday's low-end hardware uses it. Most > of today's interfaces are 1Gbps, and for this it is almost essential for > the hardware to have a ring buffer with > 50 entries, so most of today's > drivers ignore ifqmaxlen and set the queue length to the almost equally > bogus value of the ring buffer size (-1). I set it to about 10000 instead > in bge and em (10000 is too large, but fixes streaming under certain loads > when hz is small). [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] Cc: svn-src-stable@FreeBSD.org, svn-src-all@FreeBSD.org, src-committers@FreeBSD.org, svn-src-stable-7@FreeBSD.org Subject: Re: svn commit: r215368 - in stable/7/sys: arm/at91 arm/xscale/ixp425 contrib/dev/oltr dev/ae dev/an dev/ar dev/arl dev/ath dev/awi dev/ce dev/cm dev/cnw dev/cp dev/cs dev/ctau dev/cx dev/cxgb dev/ed d... X-BeenThere: svn-src-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SVN commit messages for all the -stable branches of the src tree List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Nov 2010 13:59:26 -0000 On 11/16/2010 8:12 AM, Bruce Evans wrote: > This was quite low for yestdeay's uses (starting in about 1995), but today > it is little missed since only yesterday's low-end hardware uses it. Most > of today's interfaces are 1Gbps, and for this it is almost essential for > the hardware to have a ring buffer with > 50 entries, so most of today's > drivers ignore ifqmaxlen and set the queue length to the almost equally > bogus value of the ring buffer size (-1). I set it to about 10000 instead > in bge and em (10000 is too large, but fixes streaming under certain loads > when hz is small). One of those interfaces is if_rl, which is still quite popular these days and supports speeds up to 1gbps (which I believe triggered this change). But in general I agree, unfortunately FreeBSD network subsystem is tuned for yesteday's speeds. We are seeing lot of lookups and other issues under high PPS. I wish somebody could stand and pick up the task of cleaning it up and re-tuning eventually for 2010. We could probably even sponsor in part such a work (anyone). Apart from interface tuning for Gbps speeds, another area that needs more work is splitting up memory pool for the IPC from the memory pool for the other networking. Today's software is highly distributed and rock-solid IPC is a must for the FreeBSD being a solid server application platform. That's OK when under the load we drop some packets, but it's not OK when extreme network activity can bring down communications between application and database system within the host itself. And that's exactly what can happen in FreeBSD. Regards, -- Maksym Sobolyev Sippy Software, Inc. Internet Telephony (VoIP) Experts T/F: +1-646-651-1110 Web: http://www.sippysoft.com MSN: sales@sippysoft.com Skype: SippySoft