Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 1 Apr 2015 12:07:19 +0200
From:      Mark Schouten <mark@tuxis.nl>
To:        freebsd-net@freebsd.org
Subject:   Urgent matter: LACP trunk stops distributing
Message-ID:  <1953214074-10699@kerio.tuxis.nl>

next in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]
Hi,

I've got an urgent matter on my hands, my FreeBSD iScsibox has dropped it's LACP trunk twice in the last 24 hours, which causes a whole lot of issues on my VPS cluster, using that storage. 

It's a FreeBSD box with two igb-interfaces in an LACP trunk with jumboframes and vlans. If the connection drops, the only thing I see is:

Apr  1 10:37:18 zstore02 kernel: igb0: Interface stopped DISTRIBUTING, possible flapping
Apr  1 10:37:28 zstore02 kernel: igb1: Interface stopped DISTRIBUTING, possible flapping

The switch has nothing to say, so it doesn't seem that there are acual linkflaps. I have a feeling that it's this LACP trunk that goes haywire somewhere on the FreeBSD side. If anyone can help me with this, I'd be grateful. If someone (preferably EU-based) wants to help out professionally as a consultant, that would be fine too. Or if anyone knows someone in .nl that offers this level of expertise on consultingbase, let me know.

I'm running 10.1-RELEASE on the box, see the (AFAICS) relevant config below. The switch is a Brocade ICX6430.

[root@zstore02 ~]# ifconfig lagg0
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
    options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
    ether 0c:c4:7a:12:13:dc
    nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
    media: Ethernet autoselect
    status: active
    laggproto lacp lagghash l2,l3,l4
    laggport: em1 flags=0<>
    laggport: em0 flags=0<>
    laggport: igb1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
    laggport: igb0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>

[root@zstore02 ~]# sysctl -a | grep lacp
net.link.lagg.lacp.debug: 0
net.link.lagg.0.lacp.lacp_strict_mode: 1
net.link.lagg.0.lacp.debug.rx_test: 0
net.link.lagg.0.lacp.debug.tx_test: 0



Met vriendelijke groeten,

-- 
Kerio Operator in de Cloud? https://www.kerioindecloud.nl/
Mark Schouten  | Tuxis Internet Engineering
KvK: 61527076 | http://www.tuxis.nl/
T: 0318 200208 | info@tuxis.nl
[-- Attachment #2 --]
0	*H
010	+0	*H
00,]~!dn=0
	*H
010	UGB10UGreater Manchester10USalford10U
COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA0
140701000000Z
150701235959Z010	*H
	
mark@tuxis.nl0"0
	*H
0
,e1`4jEtuBeE")>ԁY 7ՀI&]KͨqkRnZÚC$jw4[ߞ?f)Sm6,M%#R2U\?blOZǣۍq}(/nKNoovtڪmrw4Ԣ-H2R0!0PnB_n?uW+RoqCڇvx|1B/Lan	/)`00U#0zNt[xcd'/[y{0U~tDeHO3 1M]0U0U00 U%0++10	`HB 0FU ?0=0;+10+0)+https://secure.comodo.net/CPS0WUP0N0LJHFhttp://crl.comodoca.com/COMODOClientAuthenticationandSecureEmailCA.crl0+|0z0R+0Fhttp://crt.comodoca.com/COMODOClientAuthenticationandSecureEmailCA.crt0$+0http://ocsp.comodoca.com0U0
mark@tuxis.nl0
	*H
|0D7-Ѐ1Ν{(pSiW;@Fλ2I)l`ϥ#<v.|Y;oa95z.dJ5_[/>1I/ QSby@o@=T<cW4$?^KXkO=Uw NCdFCӡLWk?@\˯KOdAWL{yC0zb%|{&1ӷ>gʋlg!&600mOj3""2zq0
	*H
010	UUS10	UUT10USalt Lake City10U
The USERTRUST Network1!0Uhttp://www.usertrust.com1604U-UTN-USERFirst-Client Authentication and Email0
110428000000Z
200530104838Z010	UGB10UGreater Manchester10USalford10U
COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA0"0
	*H
0
[KW^/@ȣSX_fe2N2}UxLUB'qi2@'Vbqi c^`ʢAjHmeC*.+c8w߱ڂ2jgo \5Tq
7
PSlY1	LR@[HhJ$:q_㬿;%qh=XF<hmz!W42~JRrd&N`ohQcB}"cөΞD\[5K0G0U#0g}ĝ&pKPH|=n}0UzNt[xcd'/[y{0U0U00U 
00U 0XUQ0O0MKIGhttp://crl.usertrust.com/UTN-USERFirst-ClientAuthenticationandEmail.crl0t+h0f0=+01http://crt.usertrust.com/UTNAddTrustClient_CA.crt0%+0http://ocsp.usertrust.com0
	*H
־xWUm3DRB
JAIZҭsn>&|L0(B<%>
u=9fѡMo(ltZڱuz/yVtCr`9 G:eH<=%`I?C
3_н`j;:<I3B)93i.EMiڀ=]|Gm]W0KID~y83:]&XaU!ՙC@B0Ұun004=+'44pT0
	*H
0o10	USE10U
AddTrust AB1&0$UAddTrust External TTP Network1"0 UAddTrust External CA Root0
050607080910Z
200530104838Z010	UUS10	UUT10USalt Lake City10U
The USERTRUST Network1!0Uhttp://www.usertrust.com1604U-UTN-USERFirst-Client Authentication and Email0"0
	*H
0
9}A;bF7`u9eJGHjM5BI/|1Nd.)բdąQ5yNh{zɤ2O0nFxoY^/m/묡j.g5yiF͠v:z'[=s"HaLi.1 ,׉CZqYں
gT:
wetbh~GeMW(t40b0,00U#0z4&&T$T0Ug}ĝ&pKPH|=n}0U0U00U 
00U 0DU=0;09753http://crl.usertrust.com/AddTrustExternalCARoot.crl05+)0'0%+0http://ocsp.usertrust.com0
	*H
c(1{b#1sSQL֟/g~x3t&dpbP#4Vp4nx7_j̉_|>Q5|`k:+߳}[|P-sxt1^˚ƹ7urDg%R%G<N
6wH\-?`q`q6 lKuI;ٟMx&-n_100010	UGB10UGreater Manchester10USalford10U
COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA,]~!dn=0	+0	*H
	1	*H
0	*H
	1
150401100719Z0#	*H
	13%ڙ{ksxK{0y	*H
	1l0j0	`He*0	`He0	`He0
*H
0*H
0
*H
@0+0
*H
(0
	*H
Pʿau^ipqgLkT-
j+|A@t/C+KNVςntvZRW>A|[qq/3*4T)N.jͤ}CpQYλ-&B'oXfUM_+G*l\1N0BO|.`ﭫ}%dT.O,c#5P,$T让c[8w=iSЯ
jJ}hj[ný~^P#f"ɓ*%

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1953214074-10699>