Date: Tue, 26 May 2015 10:30:08 +0200 From: Mark Schouten <mark@tuxis.nl> To: Cs <bimmer@field.hu> Cc: freebsd-net@freebsd.org Subject: Re: FreeBSD 10.1-REL - network unaccessible after high traffic Message-ID: <2404899099-25362@alcyone.saas.tuxis.net> In-Reply-To: <440563e0-ec18-4853-8952-866006d06141@typeapp.com>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] Oh, didn't see your lowest remark. Then, the next thing that comes past here a few times per week is 'Try disabling TSO'. Met vriendelijke groeten, -- Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK: 61527076 | http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl Van: Cs <bimmer@field.hu> Aan: Mark Schouten <mark@tuxis.nl> Cc: <freebsd-net@freebsd.org> Verzonden: 25-5-2015 11:12 Onderwerp: Re: FreeBSD 10.1-REL - network unaccessible after high traffic It was on 1500 for ~3 years :) Regards, Csaba On May 25, 2015, 10:30, at 10:30, Mark Schouten <mark@tuxis.nl> wrote: > >Try lowering your mtu to 1500, that worked miracles for me.. > >-- >Mark Schouten >Tuxis Internet Engineering >mark@tuxis.nl / 0318 200208 > >> On 25 May 2015, at 09:36, "Cs" <bimmer@field.hu> wrote: >> >> Hi all, >> >> I have two FreeBSd 10.1-RELEASE servers connected to each other. They >were connected via cross link, but they are connected to a cisco switch >now (the problem was the same with cross link too). When transferring >huge files (50-500GB backup files) via Gigabit (it is important!) the >network randomly dies. The backup runs every day/week and sometimes the >connection is ok for months sometimes it happens twice a week. When the >network dies I can log in to the server via IPMI and use the console >everything is OK, but can't send anything out on the network. ifconfig >em0 down/up doesn't help nor netif restart. The problem never occured >when I used 100Mbit connection between them, but it was 3com NIC (xl), >gigabit adapter is Intel (em0). When I limit the transfer rate (rsync >bandwith limit or ipfw pipe) the problem is much more rare. >> >> I tried to set these tuning parameters on both servers with different >buffer size but nothing helped: >> >> # cat /etc/sysctl.conf >> security.bsd.see_other_uids=0 >> net.inet.tcp.recvspace=512000 >> net.route.netisr_maxqlen=2048 >> kern.ipc.nmbclusters=1310720 >> net.inet.tcp.sendbuf_max=16777216 >> net.inet.tcp.recvbuf_max=16777216 >> kern.ipc.soacceptqueue=32768 >> >> # cat /boot/loader.conf >> geom_mirror_load="YES" # RAID1 disk driver (see gmirror(8)) >> ipfw_load="YES" >> net.inet.ip.fw.default_to_accept=1 >> kern.maxusers=4096 >> accf_data_load="YES" >> >> The duplex settings are identical on both servers. >> >> Server A: >> em1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu >9000 >> >options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO> > >> ether 00:25:90:24:52:66 >> inet x.x.x.x netmask 0xfffffe00 broadcast x.x.x.x >> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> >> media: Ethernet autoselect (1000baseT <full-duplex>) >> status: active >> >> Server B: >> em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu >9000 >> >options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO> > >> ether 00:30:48:dd:fe:3e >> inet x.x.x.x netmask 0xfffffe00 broadcast x.x.x.x >> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> >> media: Ethernet autoselect (1000baseT <full-duplex>) >> status: active >> >> Today I tried to set mtu to 9000 but in tcpdump I see that during scp >it is still 1500: >> x.x.x.x.222 > x.x.x.x.37612: Flags [.], cksum 0xb6ee (incorrect -> >0xda6f), seq 35749, ack 113701596, win 7986, options [nop,nop,TS val >3103966325 ecr 853712893], length 0 >> 09:27:33.912354 IP (tos 0x8, ttl 64, id 1028, offset 0, flags [DF], >proto TCP (6), length 1500) >> 09:27:33.912358 IP (tos 0x8, ttl 64, id 1029, offset 0, flags [DF], >proto TCP (6), length 1500) >> >> >> Any ideas? Thanks guys! >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to >"freebsd-net-unsubscribe@freebsd.org" _______________________________________________ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" [-- Attachment #2 --] 0 *H 01 0 + 0 *H 00,]~!dn=0 *H 01 0 UGB10UGreater Manchester10USalford10U COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA0 140701000000Z 150701235959Z0 1 0 *H mark@tuxis.nl0"0 *H 0 ,e1`4jEtuBeE")>ԁY 7ՀI&]KͨqkRnZÚC$jw4[ߞ? f)Sm6,M%#R 2U\?blOZǣۍq }(/nKNoovtڪmrw4Ԣ -H2R 0!0PnB_n?uW+RoqCڇvx|1B/ Lan / )` 00 U #0zN t[xcd'/[y{0 U ~tDeHO3 1M]0U 0 U 0 0 U %0+ +10 `HB 0FU ?0=0; +10+0)+ https://secure.comodo.net/CPS0WU P0N0LJHFhttp://crl.comodoca.com/COMODOClientAuthenticationandSecureEmailCA.crl0+|0z0R+0Fhttp://crt.comodoca.com/COMODOClientAuthenticationandSecureEmailCA.crt0$+0http://ocsp.comodoca.com0U 0 mark@tuxis.nl0 *H |0D7 -Ѐ1Ν {(pSiW;@Fλ2I)l`ϥ#<v.|Y;oa95z.dJ5 _[/>1I/ QSby@o@=T<cW4$?^KXkO=Uw NCdFC ӡLWk?@\˯K OdAWL{yC0zb%|{&1ӷ >g ʋlg !&600mOj3""2zq0 *H 01 0 UUS1 0 UUT10USalt Lake City1 0 U The USERTRUST Network1!0 U http://www.usertrust.com1604U-UTN-USERFirst-Client Authentication and Email0 110428000000Z 200530104838Z01 0 UGB10UGreater Manchester10USalford10U COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA0"0 *H 0 [KW^/@ȣSX_fe2N2}UxLUB'qi2@'Vbqi c^`ʢAj HmeC*.+c8w߱ڂ2jgo \5Tq 7 PSl Y1 LR@[HhJ$ :q_㬿;%qh=XF<hmz!W42~JRrd&N`ohQcB}"cөΞD\[5 K0G0 U #0g}ĝ&p KPH|=n}0 U zN t[xcd'/[y{0U 0U 0 0U 00U 0XU Q0O0MKIGhttp://crl.usertrust.com/UTN-USERFirst-ClientAuthenticationandEmail.crl0t+h0f0=+01http://crt.usertrust.com/UTNAddTrustClient_CA.crt0%+0http://ocsp.usertrust.com0 *H ־xWUm3DRB JAIZҭsn>&|L0(B<%> u=9fѡMo(l tZڱuz/y VtCr`9 G:eH<=%`I?C 3_н`j;:< I3B)93i.EMiڀ =]|Gm]W0KID~y83:]&XaU!ՙC@B0Ұun004=+'44pT0 *H 0o1 0 USE10U AddTrust AB1&0$U AddTrust External TTP Network1"0 UAddTrust External CA Root0 050607080910Z 200530104838Z01 0 UUS1 0 UUT10USalt Lake City1 0 U The USERTRUST Network1!0 U http://www.usertrust.com1604U-UTN-USERFirst-Client Authentication and Email0"0 *H 0 9}A;bF7`u9eJGHjM5BI/ |1Nd.)բdąQ5yNh{ zɤ2 O0 nFxoY^/m/묡j.g5y iF͠ v:z'[=s "HaLi.1 ,CZ qYں gT: we tbh ~GeMW(t40b0, 00 U #0z4&&T$T0 U g}ĝ&p KPH|=n}0U 0U 00U 00U 0DU =0;09753http://crl.usertrust.com/AddTrustExternalCARoot.crl05+)0'0%+0http://ocsp.usertrust.com0 *H c(1{b#1sSQ L֟/g~x3t&dp bP#4Vp4nx7 _j̉_|>Q5|`k:+߳}[| P-sxt1^˚ƹ7urDg% R%G<N 6wH\-?`q`q 6 lKuI;ٟMx&-n_ 10001 0 UGB10UGreater Manchester10USalford10U COMODO CA Limited1907U0COMODO Client Authentication and Secure Email CA,]~!dn=0 + 0 *H 1 *H 0 *H 1 150526083008Z0# *H 1[Cg< <Xjy3<30y *H 1l0j0 `He*0 `He0 `He0 *H 0*H 0 *H @0+0 *H (0 *H bHkf tk7q(]yDSp'cC}HBiaa W U9p| t7 yDB135~nF/pd@AV; z_T;x 4 6}_Dy< >) - Duu!!6Z mW8\K ܷoU֔ nR0=rk raIz0Vk}Vjc%'Y@z'&
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2404899099-25362>