Date: Tue, 26 May 2015 10:30:08 +0200 From: Mark Schouten <mark@tuxis.nl> To: Cs <bimmer@field.hu> Cc: freebsd-net@freebsd.org Subject: Re: FreeBSD 10.1-REL - network unaccessible after high traffic Message-ID: <2404899099-25362@alcyone.saas.tuxis.net> In-Reply-To: <440563e0-ec18-4853-8952-866006d06141@typeapp.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--=-3OH9LaMKEL0YtYwD6ebT Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Oh, didn't see your lowest remark. Then, the next thing that comes past her= e a few times per week is 'Try disabling TSO'. Met vriendelijke groeten, --=C2=A0 Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK:=C2=A061527076=C2=A0| http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl Van: Cs <bimmer@field.hu>=20 Aan: Mark Schouten <mark@tuxis.nl>=20 Cc: <freebsd-net@freebsd.org>=20 Verzonden: 25-5-2015 11:12=20 Onderwerp: Re: FreeBSD 10.1-REL - network unaccessible after high traffi= c=20 It was on 1500 for ~3 years :)=20 =20 Regards,=20 Csaba=20 =20 =20 =20 On May 25, 2015, 10:30, at 10:30, Mark Schouten <mark@tuxis.nl> wrote:=20 >=20 >Try lowering your mtu to 1500, that worked miracles for me..=20 >=20 >-- =20 >Mark Schouten=20 >Tuxis Internet Engineering=20 >mark@tuxis.nl / 0318 200208=20 >=20 >> On 25 May 2015, at 09:36, "Cs" <bimmer@field.hu> wrote:=20 >> =20 >> Hi all,=20 >> =20 >> I have two FreeBSd 10.1-RELEASE servers connected to each other. They=20 >were connected via cross link, but they are connected to a cisco switch=20 >now (the problem was the same with cross link too). When transferring=20 >huge files (50-500GB backup files) via Gigabit (it is important!) the=20 >network randomly dies. The backup runs every day/week and sometimes the=20 >connection is ok for months sometimes it happens twice a week. When the=20 >network dies I can log in to the server via IPMI and use the console=20 >everything is OK, but can't send anything out on the network. ifconfig=20 >em0 down/up doesn't help nor netif restart. The problem never occured=20 >when I used 100Mbit connection between them, but it was 3com NIC (xl),=20 >gigabit adapter is Intel (em0). When I limit the transfer rate (rsync=20 >bandwith limit or ipfw pipe) the problem is much more rare.=20 >> =20 >> I tried to set these tuning parameters on both servers with different=20 >buffer size but nothing helped:=20 >> =20 >> # cat /etc/sysctl.conf=20 >> security.bsd.see_other_uids=3D0=20 >> net.inet.tcp.recvspace=3D512000=20 >> net.route.netisr_maxqlen=3D2048=20 >> kern.ipc.nmbclusters=3D1310720=20 >> net.inet.tcp.sendbuf_max=3D16777216=20 >> net.inet.tcp.recvbuf_max=3D16777216=20 >> kern.ipc.soacceptqueue=3D32768=20 >> =20 >> # cat /boot/loader.conf=20 >> geom_mirror_load=3D"YES" # RAID1 disk driver (see gmirror(8))=20 >> ipfw_load=3D"YES"=20 >> net.inet.ip.fw.default_to_accept=3D1=20 >> kern.maxusers=3D4096=20 >> accf_data_load=3D"YES"=20 >> =20 >> The duplex settings are identical on both servers.=20 >> =20 >> Server A:=20 >> em1: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu=20 >9000=20 >>=20 >options=3D4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL= _MAGIC,VLAN_HWTSO>=20 >=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0ether 00:25:90:24:52:66=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0inet x.x.x.x netmask 0xfffffe00 broadcast x.x= .x.x=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_L= INKLOCAL>=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0media: Ethernet autoselect (1000baseT <full-d= uplex>)=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0status: active=20 >> =20 >> Server B:=20 >> em0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu=20 >9000=20 >>=20 >options=3D4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL= _MAGIC,VLAN_HWTSO>=20 >=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0ether 00:30:48:dd:fe:3e=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0inet x.x.x.x netmask 0xfffffe00 broadcast x.x= .x.x=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_L= INKLOCAL>=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0media: Ethernet autoselect (1000baseT <full-d= uplex>)=20 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0status: active=20 >> =20 >> Today I tried to set mtu to 9000 but in tcpdump I see that during scp=20 >it is still 1500:=20 >> =C2=A0 =C2=A0x.x.x.x.222 > x.x.x.x.37612: Flags [.], cksum 0xb6ee (incor= rect ->=20 >0xda6f), seq 35749, ack 113701596, win 7986, options [nop,nop,TS val=20 >3103966325 ecr 853712893], length 0=20 >> 09:27:33.912354 IP (tos 0x8, ttl 64, id 1028, offset 0, flags [DF],=20 >proto TCP (6), length 1500)=20 >> 09:27:33.912358 IP (tos 0x8, ttl 64, id 1029, offset 0, flags [DF],=20 >proto TCP (6), length 1500)=20 >> =20 >> =20 >> Any ideas? Thanks guys!=20 >> _______________________________________________=20 >> freebsd-net@freebsd.org mailing list=20 >> http://lists.freebsd.org/mailman/listinfo/freebsd-net=20 >> To unsubscribe, send any mail to=20 >"freebsd-net-unsubscribe@freebsd.org"=20 _______________________________________________=20 freebsd-net@freebsd.org mailing list=20 http://lists.freebsd.org/mailman/listinfo/freebsd-net=20 To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=20 = --=-3OH9LaMKEL0YtYwD6ebT Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Description: Electronic Signature S/MIME Content-Transfer-Encoding: base64 MIIRwQYJKoZIhvcNAQcCoIIRsjCCEa4CAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCCDt4w ggUbMIIEA6ADAgECAhAsv+VdGX6YsSHI/WRu2j2JMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQG EwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYD VQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNh dGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBMB4XDTE0MDcwMTAwMDAwMFoXDTE1MDcwMTIzNTk1OVow HjEcMBoGCSqGSIb3DQEJARYNbWFya0B0dXhpcy5ubDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCC AQoCggEBANHu3SxlMZOG5GA0/mqtRXR1QmWwhUXzmCIprI0IPtSBWSA31YBJ5qcmXRhLzaiTB3Fr UpIGkW5aAZnDms9DD64kasF3oZE00Fvfnj/BDGbw098px1PukKfg4hasbTaELAjQTSUj8xRSHzKk VVynvLA/YmyRT/+u3ueK4wdaxcej241xH6mNfZeiKMAvbkv6Tm9vdup0BtqqbRSKcnc01KKrspun Eh73jLIUhP21uJv8vuOTxS1I9zJSlhIcMCEapjBQ+26cQl+s+qBuAs/LP3UPVytSbxvicdhDxtqH npN2h3jJ/+J86zGfQi8bG7EamsULTGHkbgIJL9AdKZRgAKECAwEAAaOCAd0wggHZMB8GA1UdIwQY MBaAFHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBR+dMZE22X/SMCyTxYzIP+NMZBNXTAO BgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggrBgEFBQcDBAYLKwYBBAGy MQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYBBAGyMQECAQEBMCswKQYI KwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcGA1UdHwRQME4wTKBKoEiG Rmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhlbnRpY2F0aW9uYW5kU2Vj dXJlRW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcwAoZGaHR0cDovL2NydC5j b21vZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRTZWN1cmVFbWFpbENBLmNy dDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMBgGA1UdEQQRMA+BDW1hcmtA dHV4aXMubmwwDQYJKoZIhvcNAQEFBQADggEBAIB8FhqaML1EzfvgNwwHDC3k0ICeMerOncgee6uJ KLxwU2mstttX5jtAmgK9RuDOu+TrMkkpF2yxYMTPpSM8nL7r+N/kdogu5Bustol8WTsW1e5vs+Nh hJYFORk113ouur1kSjXuHF8TWy+/PjFJBS/xm/H+/fkghppRU+4Dj2IReUBvlexAPYr4VDxjV7AD xPOXqTQkP15LWGvhTz2YVbJ3IAVOyUNkRhr9QwzToUxXa9k/QAOpXMuvS74AT2RBV/YCEEx7ebRD MAR6lZcbYiV8sXv1ASbnMdO3Fh2F98g+5rJn5PfFH8qLpapsZx0I2/axtSG09QMDJqXd3Ab6NpEw ggUaMIIEAqADAgECAhBtGeqnGU9qMyLmIjJ6qnHeMA0GCSqGSIb3DQEBBQUAMIGuMQswCQYDVQQG EwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUg VVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQG A1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMB4XDTEx MDQyODAwMDAwMFoXDTIwMDUzMDEwNDgzOFowgZMxCzAJBgNVBAYTAkdCMRswGQYDVQQIExJHcmVh dGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcTB1NhbGZvcmQxGjAYBgNVBAoTEUNPTU9ETyBDQSBMaW1p dGVkMTkwNwYDVQQDEzBDT01PRE8gQ2xpZW50IEF1dGhlbnRpY2F0aW9uIGFuZCBTZWN1cmUgRW1h aWwgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCShIRbS1eY1F4vi6ThQMijU1hf ZmXxMk73nzJ9VdB4TFW3QpTg+SdxB8XGaaS5MsTxQBqQzCdWYn8XtXFpruUgG+TLY15gyqJB9mrh o/+43x9IbWVDjCouK2M4d9+xF6zC2oIC1tQyatRnbyATj1w1+uVUgK/YcQodNwoCUFNslR2pEBS0 mZVZEjH/CaLSTNxS297iQAFbSGjdxUq04O0kHzqvcV8H46y/FDuwJXFoPfQP1hdYRhWBPGiLi4MP bXohV+Y0sNsyfuNK4aVScmQmkU6lkg//4LFg/RpvaFGZY40ai6XMQpubfSJj06mg/M6ekN9EGfRc WzW6FvOnm//BAgMBAAGjggFLMIIBRzAfBgNVHSMEGDAWgBSJgmd9xJ0mcABLtFBIfN49rgRufTAd BgNVHQ4EFgQUehNOAHRbxnhjZCfBL+KgW7x5xXswDgYDVR0PAQH/BAQDAgEGMBIGA1UdEwEB/wQI MAYBAf8CAQAwEQYDVR0gBAowCDAGBgRVHSAAMFgGA1UdHwRRME8wTaBLoEmGR2h0dHA6Ly9jcmwu dXNlcnRydXN0LmNvbS9VVE4tVVNFUkZpcnN0LUNsaWVudEF1dGhlbnRpY2F0aW9uYW5kRW1haWwu Y3JsMHQGCCsGAQUFBwEBBGgwZjA9BggrBgEFBQcwAoYxaHR0cDovL2NydC51c2VydHJ1c3QuY29t L1VUTkFkZFRydXN0Q2xpZW50X0NBLmNydDAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRy dXN0LmNvbTANBgkqhkiG9w0BAQUFAAOCAQEAhda+eFdVbTN/RFL+QtUGqAEDgIr7DbL9Sr/2r0FJ 9RtaxdKtG3NuPukmfOZMmMEwKN/L+0I8oSU+CnXW0D05hmbRoZu1TZtvryhsHa/l6nRaqNqxwPF1 ei+eupN5yv7ikR5WdLL4jdPgQ3Ib7Y/9YDkgR/uLrzplSDyYPaUlv73vYOBJ5RbI6z9Dg/Dg7g3B 080zX5vQvWBqszv++tTJOjwf7Zv/m0kzvkIpOYPuM2kugp1FTahp2oAbHj3SGl18R5mlmwhtEpmG 1l1XBxunML5LSUS4kH7K0Xk467Qz+qA6XSZYnmFVGLQh1ZnV4ENAQjC+6qXnlNKw/vN1+X9u5zCC BJ0wggOFoAMCAQICEDQ96SusJzT/j8s0lPvMcFQwDQYJKoZIhvcNAQEFBQAwbzELMAkGA1UEBhMC U0UxFDASBgNVBAoTC0FkZFRydXN0IEFCMSYwJAYDVQQLEx1BZGRUcnVzdCBFeHRlcm5hbCBUVFAg TmV0d29yazEiMCAGA1UEAxMZQWRkVHJ1c3QgRXh0ZXJuYWwgQ0EgUm9vdDAeFw0wNTA2MDcwODA5 MTBaFw0yMDA1MzAxMDQ4MzhaMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcT DlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsT GGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQg QXV0aGVudGljYXRpb24gYW5kIEVtYWlsMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA sjmFpPJ9q0E7YkY3rs3BYHW8OWX5ShpHornMSMxqmNVNNRm5pELlzkniii8efNIxB8dOtINknS4p 1aJkxIW9hVE1eaROaJB7HHqkkqgX8pgV8pPMyaQylbsMTzC9mKALi+VuG6JG+ni8om+rWV6lL8/K 2m2qL+usobNqqrcuZzWLeeEeaYji5kbNoKXqvgvOdjp6Dpvq/NonWz1zHyLmSGHGTPNpsaguG7bU MSAsvIKKjqQOpdeJQ/wWWq8dcdcRWdq6hw2v+vPhwvCkxWeM1tZUOt4KpLoDd7NlyP0e03RiqhjK aJMeoYV+9Udly/hNVyh00jT/MLbu9mIwFIws6wIDAQABo4H0MIHxMB8GA1UdIwQYMBaAFK29mHo0 tCb3+sQmVO8DveAky1QaMB0GA1UdDgQWBBSJgmd9xJ0mcABLtFBIfN49rgRufTAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zARBgNVHSAECjAIMAYGBFUdIAAwRAYDVR0fBD0wOzA5oDeg NYYzaHR0cDovL2NybC51c2VydHJ1c3QuY29tL0FkZFRydXN0RXh0ZXJuYWxDQVJvb3QuY3JsMDUG CCsGAQUFBwEBBCkwJzAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRydXN0LmNvbTANBgkq hkiG9w0BAQUFAAOCAQEAAbyc42MosPMxAcLfe91ioAGdIzEPnJJzU1HqH0z61p/Eyi9nfngzD3QW uZGHkfWKJvpkcADYHvkLBGJQh5OB1Nr1I9s0u4VWtHA0bniDNx6FHMURFZJfhxe9rGr98cLRzIlf sXzwPlHyNfN87GCYazor4O/fs32G67Ub9VvsonyYE9cAULnRLXPeA3h04QWFMV7LmrmdlMa5lDd1 ctxE+2fo8PolHlKn2iXpR+CgxzygTrEKNvt3SJ/vl4r7tP7jlBSog7xcLT/SYHFg7sJxggzpiDbj 2iC0o6BsqpZLuICOdcpJB/Y7FLrf3AXZn9vgsuZNoHgm5+ctbn9fxh6IFTGCAqswggKnAgEBMIGo MIGTMQswCQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdT YWxmb3JkMRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVu dCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBAhAsv+VdGX6YsSHI/WRu2j2JMAkG BSsOAwIaBQCggdgwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTUw NTI2MDgzMDA4WjAjBgkqhkiG9w0BCQQxFgQUW4wDsENnszz1HoA8WPBqeTP9PDMweQYJKoZIhvcN AQkPMWwwajALBglghkgBZQMEASowCwYJYIZIAWUDBAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0D BzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw DQYJKoZIhvcNAQEBBQAEggEAYtZI8I1rZhzywuB0azdxKJVdeRNEU3C4wCet7GNDfawbSEKjaa5h vLqU65lh1snsHt0Kx1cTIFXxOelwfAl0N/uY9dYA+HlE+7XUQhL1gfoxs7KjnYszNb1+CKJu9YxG 4y9wZKJAQVY7pqEQ85qv3gEK5qLbel/fVIw7qnggmTT4GO0Jud020n3hAV+IRHk8H4ja4/A+s+0p ExwtDPTsRA/gs8t1+efC4d11ISGGvzYUG1rdC21XON1clrJLvQzF3LdvVeMO8pmn1pQc725SMPg9 0nJrC3KKYa+Uh8JJeoSHteUw0sVWawi1fVZql2P+FyUnullA53rcJ/6PJn8Z1Q== --=-3OH9LaMKEL0YtYwD6ebT--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2404899099-25362>