From owner-freebsd-net@FreeBSD.ORG Mon Aug 11 23:52:15 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 72DFA415 for ; Mon, 11 Aug 2014 23:52:15 +0000 (UTC) Received: from mail-lb0-x236.google.com (mail-lb0-x236.google.com [IPv6:2a00:1450:4010:c04::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E62262661 for ; Mon, 11 Aug 2014 23:52:14 +0000 (UTC) Received: by mail-lb0-f182.google.com with SMTP id z11so6534455lbi.27 for ; Mon, 11 Aug 2014 16:52:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=E0M23eE8Xe+1rdedMUsqr48v1Zl80FBhqrBp/XMI/NE=; b=ogjcjB1mVBh7W8XJqL7Qa3U7HOT7364CxUVvEzHY4zscSjX8SIe0+hxx1QxFz0sCX/ SahFTB1JfqxSg+BwzjcVqS7f6EZy8RaLzpoNHRd8D3nzbrawG9nfkXND5PQFcf850cYZ reOVD/+p5nA4rytaKjJvdhvPPcfIQRlBZmH7U+OhVz9/n7bMNmR3gpKD3hO6AMD5Bnou jhVaySRruuxQIO2ELzVU0SEPl5MncEVWgBbIxywdmvYe+96yx5BSjE0I8+njjBdPLzf7 zKCYiKuyFsFKzMsW9Qq5lO1OS9pZ+pbI8RcDSlzc15Y2dhoRWmPJnrPJ+pG6+Bu7njIE PRDA== MIME-Version: 1.0 X-Received: by 10.112.91.196 with SMTP id cg4mr720494lbb.42.1407801132270; Mon, 11 Aug 2014 16:52:12 -0700 (PDT) Received: by 10.114.81.73 with HTTP; Mon, 11 Aug 2014 16:52:12 -0700 (PDT) In-Reply-To: <5D3CBFDC-362E-4DB6-A132-BA842EF5B1B2@lurchi.franken.de> References: <20140809184232.GF83475@funkthat.com> <8AE1AC56-D52F-4F13-AAA3-BB96042B37DD@lurchi.franken.de> <20140809204500.GG83475@funkthat.com> <3F6BC212-4223-4AAC-8668-A27075DC55C2@lurchi.franken.de> <20140810022350.GI83475@funkthat.com> <20140810033212.GL83475@funkthat.com> <17A804F3-BEA6-46F4-887F-B68750618FD9@netapp.com> <0CF85443-26AC-4931-9D00-3396C18C7690@lurchi.franken.de> <7A4120EE-60F3-4D32-89C4-C694B8DFEAE4@netapp.com> <5E8A6382-7096-495A-907C-86CE26A163A2@lurchi.franken.de> <5D3CBFDC-362E-4DB6-A132-BA842EF5B1B2@lurchi.franken.de> Date: Mon, 11 Aug 2014 16:52:12 -0700 Message-ID: Subject: Re: A problem on TCP in High RTT Environment. From: hiren panchasara To: Michael Tuexen Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-net@freebsd.org" , John-Mark Gurney , "Eggert, Lars" , Niu Zhixiong , Bill Yuan X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Aug 2014 23:52:15 -0000 On Mon, Aug 11, 2014 at 12:59 PM, Michael Tuexen wrote: > On 11 Aug 2014, at 21:40, Eggert, Lars wrote: > >> Hi, >> >> On 2014-8-11, at 21:27, Michael Tuexen wrote: >>> On 11 Aug 2014, at 14:12, Eggert, Lars wrote: >>>> 544/57/8194 requests for mbufs denied (mbufs/clusters/mbuf+clusters) >>> I guess the above is the problem. The card wants a lot of mbufs... >>> So the problem should go away if you increase the number of mbufs/clusters, >>> which means no requests are denied and you don't experience any performance >>> issue. >> >> And I have six of those ports in that box... >> >> So I bump kern.ipc.nmbclusters? Any additional sysctls I should bump? > If I remember correctly, I increased > kern.ipc.nmbufs and kern.ipc.nmbclusters in /boot/loader.conf I believe, you just need to set kern.ipc.nmbclusters (max mbuf clusters allowed) and kern.ipc.nmbufs (max mbufs allowed) should be adjusted based on that. cheers, Hiren