From owner-freebsd-stable@freebsd.org Tue Feb 9 06:59:50 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 520C7533457 for ; Tue, 9 Feb 2021 06:59:50 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from plan-b.pwste.edu.pl (plan-b.pwste.edu.pl [IPv6:2001:678:618::40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "plan-b.pwste.edu.pl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DZYfs1hpnz4ZP4 for ; Tue, 9 Feb 2021 06:59:48 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from fomalhaut.potoki.eu ([IPv6:2001:470:71:d47:c74:fc44:68db:64b9]) (authenticated bits=0) by plan-b.pwste.edu.pl (8.16.1/8.16.1) with ESMTPSA id 1196xhDJ049922 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 9 Feb 2021 07:59:44 +0100 (CET) (envelope-from zarychtam@plan-b.pwste.edu.pl) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=plan-b.pwste.edu.pl; s=plan-b-mailer; t=1612853985; bh=1gjhZKKF3B8v1PtBLKrcT0pVk95Z1BrPnyE4WIXW6rw=; h=To:References:From:Subject:Date:In-Reply-To; b=aaDAfBVQlXzjosgqFw3KJKqeJSaOL/PU+a8eZj1N7eSU3uJpT2+w8UUOt7lYKjBPg KkHBGrNooi8k5Z3iuXcGUjKN2lRzwOtZGZ9uQ+NTcTb9qPriAJl2XIcv0sO7SPd8hT sqfGme9ICsCJ0msxACkpIT0OEBKjaBK9x8DD/mBeNnrJaLj7ZhJNGVIhNhdFROTGYV bl68pDr/QujVEQgfUdX2Cvwz/d3rf1C8DROzcfU9OfcTmwje1SNHTCilPN0tUxbHmT xPZrh0pPwpfzTSeGH7bLJ4aNrVXgKubEWXXOnblcl5xAnquNDT8mixjsguQvHWLN46 YYeq/h+SkG3+w== X-Authentication-Warning: plan-b.pwste.edu.pl: Host [IPv6:2001:470:71:d47:c74:fc44:68db:64b9] claimed to be fomalhaut.potoki.eu To: "Alexander V. Chernikov" , mike tancsa , FreeBSD-STABLE Mailing List References: <5670cd9a-cd10-2b89-1347-97a6c817c50f@sentex.net> <8696072a-dc25-8eff-04fa-4d1db13bf5cc@plan-b.pwste.edu.pl> <3588111612809020@mail.yandex.ru> <53ef5715-42ce-aad0-9a8b-11d91a9891e3@plan-b.pwste.edu.pl> <301391612827263@mail.yandex.ru> From: Marek Zarychta Subject: Re: option FIB_ALGO and dpdk_lpm4 Message-ID: Date: Tue, 9 Feb 2021 07:59:43 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.7.0 MIME-Version: 1.0 In-Reply-To: <301391612827263@mail.yandex.ru> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Rspamd-Queue-Id: 4DZYfs1hpnz4ZP4 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=plan-b.pwste.edu.pl header.s=plan-b-mailer header.b=aaDAfBVQ; dmarc=pass (policy=none) header.from=plan-b.pwste.edu.pl; spf=none (mx1.freebsd.org: domain of zarychtam@plan-b.pwste.edu.pl has no SPF policy when checking 2001:678:618::40) smtp.mailfrom=zarychtam@plan-b.pwste.edu.pl X-Spamd-Result: default: False [-5.80 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[plan-b.pwste.edu.pl:s=plan-b-mailer]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DWL_DNSWL_MED(-2.00)[pwste.edu.pl:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[2001:678:618::40:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[plan-b.pwste.edu.pl:+]; DMARC_POLICY_ALLOW(-0.50)[plan-b.pwste.edu.pl,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:678:618::40:from]; ASN(0.00)[asn:206006, ipnet:2001:678:618::/48, country:PL]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2021 06:59:50 -0000 W dniu 09.02.2021 o=C2=A000:35, Alexander V. Chernikov pisze: > 08.02.2021, 20:10, "Marek Zarychta" : >> W dniu 08.02.2021 o=C2=A019:32, Alexander V. Chernikov pisze: >>> =C2=A008.02.2021, 14:33, "Marek Zarychta" : >>>> =C2=A0W dniu 08.02.2021 o=C2=A013:10, mike tancsa pisze: >>>>> =C2=A0=C2=A0I have been setting up some tests to see if >>>>> >>>>> =C2=A0=C2=A0option FIB_ALGO and dpdk_lpm4.ko >>>>> >>>>> =C2=A0=C2=A0will help with my pkt forwarding needs and large routi= ng tables. So far so good. But one thing I noticed, is that its very chat= ty to dmesg. >>>>> =C2=A0=C2=A0eg >>>>> =C2=A0=C2=A0alloc_nhgrp: new mpath group: num_nhops: 2 >>>>> =C2=A0=C2=A0compile_nhgrp: O: 2/2 >>>>> =C2=A0=C2=A0compile_nhgrp: OO[0]: 1/1 curr=3D1 slot_idx=3D0 >>>>> =C2=A0=C2=A0compile_nhgrp: OO[1]: 0/0 curr=3D1 slot_idx=3D1 >>>>> =C2=A0=C2=A0alloc_nhgrp: new mpath group: num_nhops: 2 >>>>> =C2=A0=C2=A0compile_nhgrp: O: 2/2 >>>>> =C2=A0=C2=A0compile_nhgrp: OO[0]: 1/1 curr=3D1 slot_idx=3D0 >>>>> =C2=A0=C2=A0compile_nhgrp: OO[1]: 0/0 curr=3D1 slot_idx=3D1 >>>>> =C2=A0=C2=A0alloc_nhgrp: new mpath group: num_nhops: 2 >>>>> =C2=A0=C2=A0compile_nhgrp: O: 2/2 >>>>> =C2=A0=C2=A0compile_nhgrp: OO[0]: 1/1 curr=3D1 slot_idx=3D0 >>>>> =C2=A0=C2=A0compile_nhgrp: OO[1]: 0/0 curr=3D1 slot_idx=3D1 >>>>> >>>>> =C2=A0=C2=A0are these debugging messages that forgot to be turned = off ? What do they mean ? >>>>> =C2=A0=C2=A0Thanks for this work! >>>>> >>>>> =C2=A0=C2=A013.0-STABLE #11 stable/13-cc1352c1f-dirty >>>> =C2=A0Thank you for sharing this Mike. Could you please reveal us h= ow do you >>>> =C2=A0feed your routing tables? Is net/bird{,2} or net/frr7 involve= d? Any >>>> =C2=A0problems or hints to make the routing daemon working with new= routing stack? >>> =C2=A0Non-multipath should work as before, multipath works for quagg= a/frr but needs some patches for bird. >> Thank you for the clarification, so is with anything but quagga or frr= >> the sysctl setting net.route.multipath=3D0 obligatory now? >>>> =C2=A0The new routing stack looks very promising, please let me als= o give this >>>> =C2=A0way some appreciations to melifaro@ and other people who work= ed on it. >>>> >>>> =C2=A0I was also trying to test it with legacy net/bird and multipl= e fib >>>> =C2=A0tables, but I was early hit by: "KRT: Error sending route x.x= =2Ex.x/y to >>>> =C2=A0kernel: Operation not supported" >>> =C2=A0Any chance you could clarify what are these routes? "Operation= not supported" looks a bit weird, it shouln't happen. >>>> =C2=A0Setting net.add_net.add_addr_allfibs=3D1addr_allfibs=3D1 chan= ged it a bit, >>>> =C2=A0but still some blackhole /32 routes seem to get rejected. >>> =C2=A0Just "blackhole" route in the bird config? /32 or all? >> I used for tests the feed from Peter Hessler's OpenBSD spam trapping >> project[1]. On FreeBSD 11.4 I see these routes in net/bird as >> blackholed, for example: >> x.x.x.x/32 blackhole [bgp_spamd 20:20:43 from y.y.y.y] * (100) [ASzzzz= ] >> They work the same was as routes added by route(8) with option "-black= hole" >> >> With new routing stack, these routes are rejected with the message >> above. Now in net/bird, they appear like the example below and import = to >> the fib (fib number is not equal to 0 in this case) is blocked: >> x.x.x.x/32 unreachable [SPAM 19:58:18 from y.y.y.y] ! (100/-) [ASzzzz]= > Does the change in https://reviews.freebsd.org/D28549 fix bird? Thank you for the fix. It solves the issue for net/bird. So it's probably time to push it a bit further and test in a production=20 environment. >> Probably it all should be tested in normal peering, but my initial tes= t >> was performed on the old lab setup where multiple fibs and policy >> routing[2] were involved. The config was loosely based on the example = by >> Ondrej Filip from the[2]. >> >> Once again thank you for implementing all these improvements into >> FreeBSD routing stack and please don't get me wrong, I am just testing= >> it a bit before migration from 11.4-STABLE, but not complaining about >> anything. > No problem! Thank you for the report. It's really nice it's been caught= before the release. >> [1] http://rs.bgp-spamd.net/client/index.html >> [2] https://gitlab.nic.cz/labs/bird/-/wikis/Policy_routing >> --=20 Marek Zarychta