From owner-freebsd-net@FreeBSD.ORG Thu Jul 5 17:00:54 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 15BED106564A for ; Thu, 5 Jul 2012 17:00:54 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-gg0-f182.google.com (mail-gg0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id AC0748FC08 for ; Thu, 5 Jul 2012 17:00:53 +0000 (UTC) Received: by ggnm2 with SMTP id m2so8949521ggn.13 for ; Thu, 05 Jul 2012 10:00:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; bh=yMSll1CkVNMEQKi/koS7zbz7GwaEJYP2/3bmo1UTDdc=; b=CvKUYwBVYHqJ0RmKGfGy2opDMD7sqsAzGm37jjGigo7exbLc0cexd2IXqGeElrYsGl 7EjjWbJUai63ux/p8KyWj9affg+SglrKo+zZ1BAxHIss3TrbUJRhJr6p0WJsZ5Oml3EI 6enZ2aJYesGlwXgv5gqLtQdLw/PXLIl0H483g= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:x-gm-message-state; bh=yMSll1CkVNMEQKi/koS7zbz7GwaEJYP2/3bmo1UTDdc=; b=e1LcVrdV0RMpw7jrsjtklTXqBspLTMLen8NqCMUwgq8IVWVR/aLQsyRYzd+WpOLXlF jdiNTFLVgwYdAPVfsLQU8y0QDPyrbFHJ99ZePwsWpCGyyHUZVpQIgw93KOqGZF3TRSKD nE4Ew8qiLxY8BCXwxcdEmj3NvhbhxgeF+j7InnirF6wdMiNPPMB3Cx45OQ58XZ3eh/QN HQ+LXpUOAO82AvQWwiHtGPxRh53jEzT8y07fP6i2cZm1Tx4a49pptEJVK+O+olJPEspi jXl2TYKLeGv50XzWCWDq3p9MsSoLljd8O9qoKofXY/TSIHKjJjJhmkgvpeIo50uGxTJf IzBA== Received: by 10.50.40.193 with SMTP id z1mr458668igk.0.1341507652893; Thu, 05 Jul 2012 10:00:52 -0700 (PDT) Received: from DataIX.net (adsl-108-73-115-46.dsl.klmzmi.sbcglobal.net. [108.73.115.46]) by mx.google.com with ESMTPS id pp4sm781901igb.5.2012.07.05.10.00.51 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 05 Jul 2012 10:00:52 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q65H0nEx043533 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 5 Jul 2012 13:00:49 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jh@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q65H0mJp043532; Thu, 5 Jul 2012 13:00:48 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Thu, 5 Jul 2012 13:00:48 -0400 From: Jason Hellenthal To: Vyacheslav Kulikovskyy Message-ID: <20120705170048.GC35340@DataIX.net> References: <4FF5329E.1000007@rdtc.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wRRV7LY7NUeQGEoC" Content-Disposition: inline In-Reply-To: X-Gm-Message-State: ALoCoQnSo/sqvbzint6fX1eqPyvz65n5jUtQ5jAYXk1AEBL3ivv11DTHkqH3A632wzQO8QRRsWmJ Cc: freebsd-net@freebsd.org, Eugene Grosbein Subject: Re: lagg speed trouble X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2012 17:00:54 -0000 --wRRV7LY7NUeQGEoC Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jul 05, 2012 at 12:00:07PM +0300, Vyacheslav Kulikovskyy wrote: > 2012/7/5 Eugene Grosbein >=20 > > 04.07.2012 18:30, Vyacheslav Kulikovskyy =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > > i have sever with two 1G links (em) aggregated by lagg0 > > > > > > after 1700Megabits i have collisions/errors on lagg0 port, but not on= em0 > > > or em1 > > > > > > I'm using nginx in own CDN. and server don't limited my mbufs, irq, or > > > anything else.. only lagg0 errors ( > > > > lagg0 by default uses way too small output FIFO queue, 50 slots. > > You definitely want to increase this to sum of your em intefaces > > txd buffers at least. So, if you use hw.em.txd=3D4096, you should > > use 8192 for lagg or more. I prefer 10K, in /boot/loader.conf: > > > > net.link.ifqmaxlen=3D10240 > > > > Reboot is required. > > > > Eugene Grosbein > > >=20 > This is solution don't help me > hw.em.txd: 4096 > net.link.ifqmaxlen: 10240 >=20 > # netstat -w 1 -I lagg0 > input (lagg0) output > packets errs idrops bytes packets errs bytes colls > 77600 0 0 4771508 71175 70 208916199 0 > 79747 0 0 4885070 73101 242 218847447 0 > 84956 0 0 5262540 74504 455 213752515 0 > 81333 0 0 4998499 73836 229 215808086 0 >=20 > and no errors on em0,em1 >=20 > more info: FreeBSD 9.0-STABLE #0: AMD64 >=20 > ps after small test i'll try patch from Andrew Thompson Would you be able to produce a tcpdump capture of the traffic causing this on all three interfaces ? tcpdump -s 112 -w em0.pcap -p -c 5000 -i em0 tcpdump -s 112 -w em1.pcap -p -c 5000 -i em1 tcpdump -s 112 -w lagg0.pcap -p -c 5000 -i lagg0 Tar em up and put them somewhere in a http or ftp you know about but noone else does and email appropriate person with the link. --=20 - (2^(N-1)) --wRRV7LY7NUeQGEoC Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJP9cg/AAoJEBSh2Dr1DU7WnusH/3hnDnAPKryEJNPwSi8NFm13 GV8lHwSHi7PrLQrdcmeOCUf8Wyt32W2t3f8+fizHvojKDqa8oqbUcaW3DQTRlkod julIZOc7xAZG02/PiVoErNRS8bBABSrO9HukA+MLkwWFcZ8PxoVqlEexuBak+tsF MOs8QTLuBr4WqicJx0yTgz7pFYpHX9fuuxegX9mbifLJdBDacwaITcjoIz0IL7um O/GluBlHJKjF9bD6dwvHY2DyyHUXLhJunsP3lnuJ1Ibbh92WBLF1NRcw/Ank7Wzu mnuExqq+y6gzfabCaiN2F/zETQlEuPv6HQAmvzXMMORsH89QkuRrl1TZ1NpH5Kw= =4bdk -----END PGP SIGNATURE----- --wRRV7LY7NUeQGEoC--