Date: Thu, 2 Apr 2015 13:01:42 +0200 From: Mark Schouten <mark@tuxis.nl> To: freebsd-net@freebsd.org Subject: Re: Urgent matter: LACP trunk stops distributing Message-ID: <2042783266-15365@kerio.tuxis.nl> In-Reply-To: <1953214074-10699@kerio.tuxis.nl>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] Hi, So I've changed the configuration last night, eliminating the possibility that the issue was LACP. All traffic was handled by the single igb interface. It didn't help, at all. This morning the interface stopped working, without any form of messages and started working again after a few minutes. Then, some minutes later it stopped again, to resume after a few minutes. So now I plugged the switch into an em-port and I tried to move the vlan interfaces to the em-interface. That worked, partially. The server kept the old mac-address in the arp-table. Even after I deleted the vlan interface. I rebooted the box, and so far so good. But still, any help is appreciated. Met vriendelijke groeten, -- Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK: 61527076 | http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl Van: Mark Schouten <mark@tuxis.nl> Aan: <freebsd-net@freebsd.org> Verzonden: 1-4-2015 12:07 Onderwerp: Urgent matter: LACP trunk stops distributing Hi, I've got an urgent matter on my hands, my FreeBSD iScsibox has dropped it's LACP trunk twice in the last 24 hours, which causes a whole lot of issues on my VPS cluster, using that storage. It's a FreeBSD box with two igb-interfaces in an LACP trunk with jumboframes and vlans. If the connection drops, the only thing I see is: Apr 1 10:37:18 zstore02 kernel: igb0: Interface stopped DISTRIBUTING, possible flapping Apr 1 10:37:28 zstore02 kernel: igb1: Interface stopped DISTRIBUTING, possible flapping The switch has nothing to say, so it doesn't seem that there are acual linkflaps. I have a feeling that it's this LACP trunk that goes haywire somewhere on the FreeBSD side. If anyone can help me with this, I'd be grateful. If someone (preferably EU-based) wants to help out professionally as a consultant, that would be fine too. Or if anyone knows someone in .nl that offers this level of expertise on consultingbase, let me know. I'm running 10.1-RELEASE on the box, see the (AFAICS) relevant config below. The switch is a Brocade ICX6430. [root@zstore02 ~]# ifconfig lagg0 lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000 options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO> ether 0c:c4:7a:12:13:dc nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: active laggproto lacp lagghash l2,l3,l4 laggport: em1 flags=0<> laggport: em0 flags=0<> laggport: igb1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> laggport: igb0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> [root@zstore02 ~]# sysctl -a | grep lacp net.link.lagg.lacp.debug: 0 net.link.lagg.0.lacp.lacp_strict_mode: 1 net.link.lagg.0.lacp.debug.rx_test: 0 net.link.lagg.0.lacp.debug.tx_test: 0 Met vriendelijke groeten, -- Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK: 61527076 | http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl [-- Attachment #2 --] 0 *H 01 0 + 0 *H 00,]~!dn=0 *H 01 0 UGB10UGreater Manchester10USalford10U COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA0 140701000000Z 150701235959Z0 1 0 *H mark@tuxis.nl0"0 *H 0 ,e1`4jEtuBeE")>ԁY 7ՀI&]KͨqkRnZÚC$jw4[ߞ? f)Sm6,M%#R 2U\?blOZǣۍq }(/nKNoovtڪmrw4Ԣ -H2R 0!0PnB_n?uW+RoqCڇvx|1B/ Lan / )` 00 U #0zN t[xcd'/[y{0 U ~tDeHO3 1M]0U 0 U 0 0 U %0+ +10 `HB 0FU ?0=0; +10+0)+ https://secure.comodo.net/CPS0WU P0N0LJHFhttp://crl.comodoca.com/COMODOClientAuthenticationandSecureEmailCA.crl0+|0z0R+0Fhttp://crt.comodoca.com/COMODOClientAuthenticationandSecureEmailCA.crt0$+0http://ocsp.comodoca.com0U 0 mark@tuxis.nl0 *H |0D7 -Ѐ1Ν {(pSiW;@Fλ2I)l`ϥ#<v.|Y;oa95z.dJ5 _[/>1I/ QSby@o@=T<cW4$?^KXkO=Uw NCdFC ӡLWk?@\˯K OdAWL{yC0zb%|{&1ӷ >g ʋlg !&600mOj3""2zq0 *H 01 0 UUS1 0 UUT10USalt Lake City1 0 U The USERTRUST Network1!0 U http://www.usertrust.com1604U-UTN-USERFirst-Client Authentication and Email0 110428000000Z 200530104838Z01 0 UGB10UGreater Manchester10USalford10U COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA0"0 *H 0 [KW^/@ȣSX_fe2N2}UxLUB'qi2@'Vbqi c^`ʢAj HmeC*.+c8w߱ڂ2jgo \5Tq 7 PSl Y1 LR@[HhJ$ :q_㬿;%qh=XF<hmz!W42~JRrd&N`ohQcB}"cөΞD\[5 K0G0 U #0g}ĝ&p KPH|=n}0 U zN t[xcd'/[y{0U 0U 0 0U 00U 0XU Q0O0MKIGhttp://crl.usertrust.com/UTN-USERFirst-ClientAuthenticationandEmail.crl0t+h0f0=+01http://crt.usertrust.com/UTNAddTrustClient_CA.crt0%+0http://ocsp.usertrust.com0 *H ־xWUm3DRB JAIZҭsn>&|L0(B<%> u=9fѡMo(l tZڱuz/y VtCr`9 G:eH<=%`I?C 3_н`j;:< I3B)93i.EMiڀ =]|Gm]W0KID~y83:]&XaU!ՙC@B0Ұun004=+'44pT0 *H 0o1 0 USE10U AddTrust AB1&0$U AddTrust External TTP Network1"0 UAddTrust External CA Root0 050607080910Z 200530104838Z01 0 UUS1 0 UUT10USalt Lake City1 0 U The USERTRUST Network1!0 U http://www.usertrust.com1604U-UTN-USERFirst-Client Authentication and Email0"0 *H 0 9}A;bF7`u9eJGHjM5BI/ |1Nd.)բdąQ5yNh{ zɤ2 O0 nFxoY^/m/묡j.g5y iF͠ v:z'[=s "HaLi.1 ,CZ qYں gT: we tbh ~GeMW(t40b0, 00 U #0z4&&T$T0 U g}ĝ&p KPH|=n}0U 0U 00U 00U 0DU =0;09753http://crl.usertrust.com/AddTrustExternalCARoot.crl05+)0'0%+0http://ocsp.usertrust.com0 *H c(1{b#1sSQ L֟/g~x3t&dp bP#4Vp4nx7 _j̉_|>Q5|`k:+߳}[| P-sxt1^˚ƹ7urDg% R%G<N 6wH\-?`q`q 6 lKuI;ٟMx&-n_ 10001 0 UGB10UGreater Manchester10USalford10U COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA,]~!dn=0 + 0 *H 1 *H 0 *H 1 150402110142Z0# *H 13#Qnv$'`Wc 0y *H 1l0j0 `He*0 `He0 `He0 *H 0*H 0 *H @0+0 *H (0 *H It8^)1zgӟZh{l?c) !%QvDKnFtKFVV[jJ$h"=0(P VU#JJkczg9f\:t> } $<ʇФrr{^B纊l>jR{@zqKN|2de丐<@oOfL_mCVo@dHXQ d3dgygq<(GY:Hjٮhome | help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2042783266-15365>