From owner-freebsd-net@FreeBSD.ORG Mon May 25 09:12:44 2015 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8EBFC196 for ; Mon, 25 May 2015 09:12:44 +0000 (UTC) (envelope-from bimmer@field.hu) Received: from green.field.hu (green.field.hu [217.20.130.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 443368A5 for ; Mon, 25 May 2015 09:12:43 +0000 (UTC) (envelope-from bimmer@field.hu) Received: from green.field.hu (localhost [127.0.0.1]) by green.field.hu (Postfix) with ESMTP id BCB07250A6D; Mon, 25 May 2015 11:12:40 +0200 (CEST) X-Virus-Scanned: by Amavisd-new at field.hu Received: from green.field.hu ([127.0.0.1]) by green.field.hu (green.field.hu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dZ-drsMhZ_-S; Mon, 25 May 2015 11:12:38 +0200 (CEST) Received: from [192.168.3.114] (catv-80-98-134-30.catv.broadband.hu [80.98.134.30]) by green.field.hu (Postfix) with ESMTPA id C9655250A64; Mon, 25 May 2015 11:12:37 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=field.hu; s=mail; t=1432545157; bh=Si2TB1nIVAqF7Z3UDfqPr74Ra7SwMuEyuYBnsP7K7lA=; h=In-Reply-To:References:Subject:From:Date:To:CC; b=j5OwcWKbENTicDdysZc36JJugcruh/5f5ailieKCr/9xS8GDpu82ZErNnUpB+ZYUW oeA8evhWnEooOLzL/GrnSyrtTUq8A7eD03lVIJCmYywUoZ9/dAcUArfv5Bl6tZSAM+ KYk49Mr+1UBoREejnXSYQgGU6Wig4sx5wjdvWSUg= In-Reply-To: <13CD4CDB-1744-4E2F-8FD7-BFE2365121F3@tuxis.nl> References: <5562D0F3.4070408@field.hu> <13CD4CDB-1744-4E2F-8FD7-BFE2365121F3@tuxis.nl> X-Referenced-Uid: 90 Thread-Topic: Re: FreeBSD 10.1-REL - network unaccessible after high traffic User-Agent: Type for Android MIME-Version: 1.0 Subject: Re: FreeBSD 10.1-REL - network unaccessible after high traffic From: Cs Date: Mon, 25 May 2015 11:12:35 +0200 To: Mark Schouten CC: freebsd-net@freebsd.org Message-ID: <440563e0-ec18-4853-8952-866006d06141@typeapp.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 May 2015 09:12:44 -0000 It was on 1500 for ~3 years :) Regards, Csaba On May 25, 2015, 10:30, at 10:30, Mark Schouten wrote: > >Try lowering your mtu to 1500, that worked miracles for me.. > >-- >Mark Schouten >Tuxis Internet Engineering >mark@tuxis.nl / 0318 200208 > >> On 25 May 2015, at 09:36, "Cs" wrote: >> >> Hi all, >> >> I have two FreeBSd 10.1-RELEASE servers connected to each other. They >were connected via cross link, but they are connected to a cisco switch >now (the problem was the same with cross link too). When transferring >huge files (50-500GB backup files) via Gigabit (it is important!) the >network randomly dies. The backup runs every day/week and sometimes the >connection is ok for months sometimes it happens twice a week. When the >network dies I can log in to the server via IPMI and use the console >everything is OK, but can't send anything out on the network. ifconfig >em0 down/up doesn't help nor netif restart. The problem never occured >when I used 100Mbit connection between them, but it was 3com NIC (xl), >gigabit adapter is Intel (em0). When I limit the transfer rate (rsync >bandwith limit or ipfw pipe) the problem is much more rare. >> >> I tried to set these tuning parameters on both servers with different >buffer size but nothing helped: >> >> # cat /etc/sysctl.conf >> security.bsd.see_other_uids=0 >> net.inet.tcp.recvspace=512000 >> net.route.netisr_maxqlen=2048 >> kern.ipc.nmbclusters=1310720 >> net.inet.tcp.sendbuf_max=16777216 >> net.inet.tcp.recvbuf_max=16777216 >> kern.ipc.soacceptqueue=32768 >> >> # cat /boot/loader.conf >> geom_mirror_load="YES" # RAID1 disk driver (see gmirror(8)) >> ipfw_load="YES" >> net.inet.ip.fw.default_to_accept=1 >> kern.maxusers=4096 >> accf_data_load="YES" >> >> The duplex settings are identical on both servers. >> >> Server A: >> em1: flags=8843 metric 0 mtu >9000 >> >options=4219b > >> ether 00:25:90:24:52:66 >> inet x.x.x.x netmask 0xfffffe00 broadcast x.x.x.x >> nd6 options=29 >> media: Ethernet autoselect (1000baseT ) >> status: active >> >> Server B: >> em0: flags=8843 metric 0 mtu >9000 >> >options=4219b > >> ether 00:30:48:dd:fe:3e >> inet x.x.x.x netmask 0xfffffe00 broadcast x.x.x.x >> nd6 options=29 >> media: Ethernet autoselect (1000baseT ) >> status: active >> >> Today I tried to set mtu to 9000 but in tcpdump I see that during scp >it is still 1500: >> x.x.x.x.222 > x.x.x.x.37612: Flags [.], cksum 0xb6ee (incorrect -> >0xda6f), seq 35749, ack 113701596, win 7986, options [nop,nop,TS val >3103966325 ecr 853712893], length 0 >> 09:27:33.912354 IP (tos 0x8, ttl 64, id 1028, offset 0, flags [DF], >proto TCP (6), length 1500) >> 09:27:33.912358 IP (tos 0x8, ttl 64, id 1029, offset 0, flags [DF], >proto TCP (6), length 1500) >> >> >> Any ideas? Thanks guys! >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to >"freebsd-net-unsubscribe@freebsd.org"