From owner-freebsd-net@FreeBSD.ORG Thu Apr 8 18:07:53 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AE21B106566C for ; Thu, 8 Apr 2010 18:07:53 +0000 (UTC) (envelope-from kmatthew.macy@gmail.com) Received: from mail-qy0-f181.google.com (mail-qy0-f181.google.com [209.85.221.181]) by mx1.freebsd.org (Postfix) with ESMTP id 62D2E8FC13 for ; Thu, 8 Apr 2010 18:07:53 +0000 (UTC) Received: by qyk11 with SMTP id 11so1795979qyk.13 for ; Thu, 08 Apr 2010 11:07:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:reply-to:received :in-reply-to:references:date:x-google-sender-auth:received :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=QzmAAtmLm0o/qyzwvOvBtJ0t5V0D2/q8tK+FTY0H6u4=; b=gcvoOQhpmWhZBvaygniqjcVI4SszAhpzRgteoLOsbZF1KkAVIpAMtBCtBz3JBTUznx LH/fV/YusdS1B/6RrJdmoOdw7xhu2Jvj4BO3zhp8jdCwf4XcgrE0WJgCezdxupnGbWdk xQZP7jk6YNIhLGzXQPYNCeoyIoogjTgGRwGfc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:reply-to:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=WFOxwx0nrbzMEMULT8jOdseNudxbgFZI+mKh/Q9D0qaxAvxhSV5tDOtVrj5RdBi0m4 KSXCR8A57U8x77vY+1aeCIpUBiaw1YXNU+4/AcPbnD29Q0Ayuw8ycDDvA/Ol8LmtDXN+ qWvyccp/1opCKIJnSjlg0m7e55Oq3MN07kfCk= MIME-Version: 1.0 Sender: kmatthew.macy@gmail.com Received: by 10.229.214.136 with HTTP; Thu, 8 Apr 2010 11:07:52 -0700 (PDT) In-Reply-To: <4BBDD49E.4010805@unsane.co.uk> References: <31285.63437.qm@web63906.mail.re1.yahoo.com> <4BBDD49E.4010805@unsane.co.uk> Date: Thu, 8 Apr 2010 11:07:52 -0700 X-Google-Sender-Auth: 2d53addfff78a73b Received: by 10.229.212.146 with SMTP id gs18mr710879qcb.90.1270750072628; Thu, 08 Apr 2010 11:07:52 -0700 (PDT) Message-ID: From: "K. Macy" To: Vincent Hoffman Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org Subject: Re: kern/144917: Flowtable crashes system X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kmacy@freebsd.org List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Apr 2010 18:07:53 -0000 Hi Vincent, Thanks for your response. However, the answers to both his questions have been given many times before and he knows them already. This person has not made material contributions to discussions and has in fact made active efforts to reduce the signal to noise ratio. Cheers, Kip On Thu, Apr 8, 2010 at 6:05 AM, Vincent Hoffman wrote: > On 08/04/2010 13:07, Barney Cordoba wrote: >> >> --- On Fri, 4/2/10, K. Macy wrote: >> >> >>> From: K. Macy >>> Subject: Re: kern/144917: Flowtable crashes system >>> To: "Ilya Zhuravlev" >>> Cc: freebsd-net@freebsd.org, "Evgenii Davidov" >>> Date: Friday, April 2, 2010, 11:07 PM >>> Please try with the latest 8-STABLE >>> and tell me if recent changes fix it. >>> >>> Thanks, >>> Kip >>> >>> On Thu, Mar 25, 2010 at 8:32 AM, Ilya Zhuravlev >>> wrote: >>> >>>> On 21.03.2010 17:04, Evgenii Davidov wrote: >>>> >>>>> =FA=C4=D2=C1=D7=D3=D4=D7=D5=CA=D4=C5, >>>>> >>>>> On Sat, Mar 20, 2010 at 11:06:35PM +0000, Doychin >>>>> >>> Dokov =D0=C9=DB=C5=D4: >>> >>>>> >>>>>>> Description: >>>>>>> >>>>>> It seems like flowtable has been merged and >>>>>> >>> enabled by default in 8.0.... >>> >>>>>> which is a really really bad idea. >>>>>> On a system which handles two full BGP tables >>>>>> >>> it makes one of the CPU >>> >>>>>> cores run at 100% right after most of the >>>>>> >>> prefixes get installed in the >>> >>>>>> routing table. >>>>>> >>>>> i saw the same effect with ospf >>>>> >>>>> >>>> 8.0-p2, 2 full-view with openbgpd >>>> "tuning": >>>> net.inet.tcp.blackhole=3D2 >>>> net.inet.udp.blackhole=3D1 >>>> net.inet.icmp.icmplim_output=3D0 >>>> net.inet.icmp.drop_redirect=3D1 >>>> net.inet.flowtable.nmbflows=3D32768 >>>> >>>> 1 week uptime.Now I think only about increasing tx/rx >>>> >>> descriptors to reduce >>> >>>> interrupts (default values was not changed) >>>> >>>> >>>> netstat -w1 -Iigb0 >>>> =9A =9A =9A =9A =9A =9Ainput =9A =9A =9A =9A (igb0) >>>> >>> =9A output >>> >>>> =9A packets =9Aerrs =9A =9A =9Abytes =9A =9Apackets =9Aerrs >>>> >>> =9A =9Abytes colls >>> >>>> =9A =9A 49100 =9A =9A 0 =9A 12290513 =9A =9A =9A23693 =9A =9A 0 >>>> >>> =9A 27268884 =9A =9A 0 >>> >>>> =9A =9A 48322 =9A =9A 0 =9A 12688283 =9A =9A =9A24332 =9A =9A 0 >>>> >>> =9A 28099404 =9A =9A 0 >>> >>>> =9A =9A 50602 =9A =9A 0 =9A 12759620 =9A =9A =9A24437 =9A =9A 0 >>>> >>> =9A 27698341 =9A =9A 0 >>> >>>> =9A =9A 47857 =9A =9A 0 =9A 11354124 =9A =9A =9A21410 =9A =9A 0 >>>> >>> =9A 23845155 =9A =9A 0 >>> >>>> netstat -w1 -Iigb1 >>>> =9A =9A =9A =9A =9A =9Ainput =9A =9A =9A =9A (igb1) >>>> >>> =9A output >>> >>>> =9A packets =9Aerrs =9A =9A =9Abytes =9A =9Apackets =9Aerrs >>>> >>> =9A =9Abytes colls >>> >>>> =9A =9A 32428 =9A =9A 0 =9A 35027019 =9A =9A =9A24562 =9A =9A 0 >>>> >>> =9A =9A5624934 =9A =9A 0 >>> >>>> =9A =9A 30621 =9A =9A 0 =9A 33384339 =9A =9A =9A23569 =9A =9A 0 >>>> >>> =9A =9A4456944 =9A =9A 0 >>> >>>> =9A =9A 28419 =9A =9A 0 =9A 31014269 =9A =9A =9A21571 =9A =9A 0 >>>> >>> =9A =9A3638083 =9A =9A 0 >>> >>>> =9A =9A 29409 =9A =9A 0 =9A 32524760 =9A =9A =9A22137 =9A =9A 0 >>>> >>> =9A =9A3503600 =9A =9A 0 >>> >>>> =9A =9A 30965 =9A =9A 0 =9A 33532742 =9A =9A =9A23973 =9A =9A 0 >>>> >>> =9A =9A5089231 =9A =9A 0 >>> >>>> netstat -w1 -Iem0 >>>> =9A =9A =9A =9A =9A =9Ainput =9A =9A =9A =9A =9A(em0) >>>> >>> =9A output >>> >>>> =9A packets =9Aerrs =9A =9A =9Abytes =9A =9Apackets =9Aerrs >>>> >>> =9A =9Abytes colls >>> >>>> =9A =9A 17217 =9A =9A 0 =9A =9A3929366 =9A =9A =9A72741 =9A =9A 0 >>>> >>> =9A 46377762 =9A =9A 0 >>> >>>> =9A =9A 17412 =9A =9A 0 =9A =9A3745112 =9A =9A =9A75522 =9A =9A 0 >>>> >>> =9A 49338883 =9A =9A 0 >>> >>>> =9A =9A 18385 =9A =9A 0 =9A =9A4014568 =9A =9A =9A77444 =9A =9A 0 >>>> >>> =9A 50532101 =9A =9A 0 >>> >>>> =9A =9A 17142 =9A =9A 0 =9A =9A3875518 =9A =9A =9A77125 =9A =9A 0 >>>> >>> =9A 47646681 =9A =9A 0 >>> >>>> =9A =9A 16870 =9A =9A 0 =9A =9A3528316 =9A =9A =9A73188 =9A =9A 0 >>>> >>> =9A 47940959 =9A =9A 0 >>> >>>> =9A =9A 17069 =9A =9A 0 =9A =9A3682891 =9A =9A =9A80268 =9A =9A 0 >>>> >>> =9A 52904747 =9A =9A 0 >>> >>>> =9A =9A 17313 =9A =9A 0 =9A =9A4101576 =9A =9A =9A75586 =9A =9A 0 >>>> >>> =9A 51933330 =9A =9A 0 >>> >>>> _______________________________________________ >>>> freebsd-net@freebsd.org >>>> >> >> How about telling us how to turn it off; or better yet how to not >> compile it into the kernel at all. Thats the best solution. >> >> As my Dad used to say on a regular basis, we need this like we >> need a hole in our head. Is 8.0 the Kip Macy personal test bed? >> >> Why is something that virtually no-one needs enabled by default? >> >> Barney >> >> > I havent followed the whole thread so if this doesnt actally work for > some reason then sorry for noise. > > [root@prawn ~]# sysctl -a | grep flowtable > net.inet.ip.output_flowtable_size: 2048 > net.inet.flowtable.nmbflows: 4096 > net.inet.flowtable.tcp_expire: 86400 > net.inet.flowtable.fin_wait_expire: 600 > net.inet.flowtable.udp_expire: 300 > net.inet.flowtable.syn_expire: 300 > net.inet.flowtable.collisions: 0 > net.inet.flowtable.max_depth: 0 > net.inet.flowtable.free_checks: 8845 > net.inet.flowtable.frees: 2181 > net.inet.flowtable.misses: 2403 > net.inet.flowtable.lookups: 11633 > net.inet.flowtable.hits: 9231 > net.inet.flowtable.enable: 1 > net.inet.flowtable.debug: 0 > > > [root@prawn ~]# sysctl -d net.inet.flowtable.enable > net.inet.flowtable.enable: enable flowtable caching. > > [root@prawn ~]# sysctl net.inet.flowtable.enable=3D0 > net.inet.flowtable.enable: 1 -> 0 > > > Vince >> >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >