Date: Fri, 22 May 2020 14:11:53 +0000 From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 246660] Sporadic LACP Lagg Flap Message-ID: <bug-246660-227@https.bugs.freebsd.org/bugzilla/>
next in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246660 Bug ID: 246660 Summary: Sporadic LACP Lagg Flap Product: Base System Version: 12.1-STABLE Hardware: Any OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: nonesuch@longcount.org On FreeBSD 12-STABLE r354698 amd64 with LACP laggs on top of Solarflare SFX= GE nics (7k and 8k series cards) attached to arista mlaggs ( 7050's or 7150's running eos 4.0.19 and newer ). The FreeBSD side sporadically stops setting the lacp distribution flag. Causing the switch to detect a link flap.=20 The setup is as follows . Dell R630 and R640's, Supermicro X9DRT Ivy Bridge boards setup with one Solarflare SFN7122F or SFN8522 runnging Solarflare Firmware = 7.1 and 7.4.4 . Each server is setup as a router with pf being used to nat and filter traffic. There is on LACP lagg made of up the two ports going to two upstream Arista 7050 or 7150 switches in a MLAGG setup. The LAGG carries anywhere from 5 to 50 vlans at a time.=20 Now the complicated part. This issues happens as what appear to be random times, on routers we have setup and left to "burn in" over a weekend with little or no traffic, and on some routers where they are preforming moderate amounts work. This issue also did not happen on 10.3-STABLE amd64 .=20 Sysctls =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D #security.bsd.see_other_uids=3D0 net.inet.tcp.mssdflt=3D1460 net.inet.tcp.minmss=3D536 net.inet.tcp.rfc6675_pipe=3D1 net.inet.tcp.syncache.rexmtlimit=3D0 # (default 3) net.inet.tcp.per_cpu_timers=3D1 net.inet.ip.fastforwarding=3D1 #kern.random.harvest.mask=3D65887 kern.random.harvest.mask=3D65537 kern.random.sys.harvest.ethernet=3D0 kern.random.sys.harvest.point_to_point=3D0 kern.random.sys.harvest.interrupt=3D0 hw.intr_storm_threshold=3D10000 kern.ipc.maxsockbuf=3D16777216 # socket buffers net.inet.tcp.recvspace=3D4194304 net.inet.tcp.sendspace=3D2097152 net.inet.tcp.sendbuf_max=3D16777216 net.inet.tcp.recvbuf_max=3D16777216 net.inet.tcp.sendbuf_auto=3D1 net.inet.tcp.recvbuf_auto=3D1 net.inet.tcp.sendbuf_inc=3D16384 net.inet.tcp.recvbuf_inc=3D524288 net.inet.tcp.cc.algorithm=3Dhtcp net.inet.ip.intr_queue_maxlen=3D2048 net.route.netisr_maxqlen=3D2048 # Do not send IP redirects (enable fastforwarding path) net.inet.ip.redirect=3D0 net.inet6.ip6.redirect=3D0 =3D=3D=3Dloader.conf=3D=3D=3D ipmi_load=3D"YES" boot_multicons=3D"YES" boot_serial=3D"YES" console=3D"comconsole,vidconsole" net.inet.tcp.tso=3D"0" autoboot_delay=3D"5" hw.mfi.mrsas_enable=3D"1" hw.usb.no_pf=3D"1" # Disable USB packet filtering hw.usb.no_shutdown_wait=3D"1" hw.vga.textmode=3D"1" # Text mode machdep.hyperthreading_allowed=3D"0" geom_mirror_load=3D"YES" kern.ipc.nmbclusters=3D"1000000" net.isr.maxqlimit=3D"1000000" kern.ipc.nmbjumbop=3D524288 net.isr.bindthreads=3D"0" net.isr.maxthreads=3D"-1" net.link.ifqmaxlen=3D"2048" net.pf.source_nodes_hashsize=3D"1048576" net.isr.defaultqlimit=3D"2048" net.inet.tcp.syncache.hashsize=3D"1024" net.inet.tcp.syncache.bucketlimit=3D"100" net.inet.tcp.tcbhashsize=3D"65536" vm.pmap.pti=3D0 hw.ibrs_disable=3D1 =3D=3D=3DLAGG Config=3D=3D=3D ifconfig lagg0 laggproto lacp lagghash l2,l3 laggport sfxge0 laggport sfxge1 =3D=3D=3Dsfxge tunings=3D=3D=3D kenv hw.sfxge.${NIC0_ID}.max_rss_channels=3D7 kenv hw.sfxge.${NIC1_ID}.max_rss_channels=3D7 kenv hw.sfxge.tx_ring=3D2048 kenv hw.sfxge.rx_ring=3D4096 kenv hw.sfxge.tx_dpl_get_non_tcp_max=3D4096 kenv hw.sfxge.tx_dpl_put_max=3D2048 # This turns of AIM sysctl dev.sfxge.${NIC0_ID}.int_mod=3D0 sysctl dev.sfxge.${NIC1_ID}.int_mod=3D0 PCAPs available on request. --=20 You are receiving this mail because: You are the assignee for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-246660-227>