Date: Mon, 28 Jul 2014 10:51:11 -0400 From: John Jasen <jjasen@gmail.com> To: Adrian Chadd <adrian@freebsd.org> Cc: FreeBSD Net <freebsd-net@freebsd.org> Subject: Re: fastforward/routing: a 3 million packet-per-second system? Message-ID: <CAACLuR09etiyujR7-qOGSUQpQFH1o6S38_96_uSd9Cy57OnYYQ@mail.gmail.com> In-Reply-To: <CAJ-VmonMYi-7ZCw-PqiuOp5euAdxbyiHXW-ZW96MWQ8%2B-RV8MA@mail.gmail.com> References: <53CE80DD.9090109@gmail.com> <CAACLuR1r0axCYWXeLDSa-m07eAVgTMBVW5sNbt%2By_Lt2ss1r7Q@mail.gmail.com> <CAJ-Vmonsc79ULDOT9trtOotq7mRh1XJkhL2JfDNxXP16OFWMFg@mail.gmail.com> <CAJ-Vmok6vyrD-2%2BswCBPP_VeMqH6t7CXuVBPUaDfwyRrb6aiTg@mail.gmail.com> <53D4600A.1010505@gmail.com> <CAJ-Vmonf_krdxrkrKbjkC-a=4x0M7y9mXeTGMvs1qOSGNbqdGA@mail.gmail.com> <53D4F77B.9020009@gmail.com> <CAJ-VmonMYi-7ZCw-PqiuOp5euAdxbyiHXW-ZW96MWQ8%2B-RV8MA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
in_input crept up into the top 5, versus fastforward. Would PMC counters help? cat debug.lock.pref.stats.out-20140728-1 | sort -nk 4 | tail -5 5 4 413 115 160 2 0 0 63 /usr/src/sys/kern/kern_condvar.c:145 (sleep mutex:Giant) 1 1 148858 4095 650072 0 0 0 11184 /usr/src/sys/kern/subr_turnstile.c:552 (spin mutex:turnstile chain) 8 14 13747639 561636 72520256 0 0 0 689603 /usr/src/sys/net/route.c:439 (sleep mutex:rtentry) 3 20 3907071 2322975 72520256 0 0 0 2529589 /usr/src/sys/netinet/ip_input.c:1315 (sleep mutex:rtentry) 3 17 3665247 3715117 72520256 0 0 0 8425384 /usr/src/sys/netinet/in_rmx.c:114 (sleep mutex:rtentry) On Sun, Jul 27, 2014 at 1:50 PM, Adrian Chadd <adrian@freebsd.org> wrote: > Yeah, there's something odd going on. You shouldn't see any of that > lock contention if flowtable is enabled. Thus I think there's > > Oh wait, the fastfwd code doesn't know about flowtables. I just looked > at it (sys/netinet/ip_fastfwd.c.) > > Try disabling fastfwd for a test and see if the lock profile improves. > (Set debug.lock.prof.reset=1 to clear the profiling data before you do it.) > > > -a > > > On 27 July 2014 05:58, John Jasen <jjasen@gmail.com> wrote: > > I shouldn't even be coming close to maxflows in this test scenario. > > > > net.flowtable.enable: 1 > > net.flowtable.maxflows: 1042468 > > > > On 07/26/2014 10:20 PM, Adrian Chadd wrote: > >> Flowtable is enabled? That's odd, it shouldn't be showing up like that. > >> > >> > >> > >> -a > >> > >> > >> > > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAACLuR09etiyujR7-qOGSUQpQFH1o6S38_96_uSd9Cy57OnYYQ>