From owner-freebsd-performance@FreeBSD.ORG Sun May 24 15:21:02 2015 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5CBCEF71 for ; Sun, 24 May 2015 15:21:02 +0000 (UTC) Received: from green.field.hu (green.field.hu [217.20.130.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 196531BE4 for ; Sun, 24 May 2015 15:21:01 +0000 (UTC) Received: from green.field.hu (localhost [127.0.0.1]) by green.field.hu (Postfix) with ESMTP id 5E3EF250A64 for ; Sun, 24 May 2015 17:12:58 +0200 (CEST) X-Virus-Scanned: by Amavisd-new at field.hu Received: from green.field.hu ([127.0.0.1]) by green.field.hu (green.field.hu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id W4NxqI909vcv for ; Sun, 24 May 2015 17:12:55 +0200 (CEST) Received: from [192.168.52.11] (1F2EC6DD.catv.pool.telekom.hu [31.46.198.221]) by green.field.hu (Postfix) with ESMTPA id 6488F250A4F for ; Sun, 24 May 2015 17:12:55 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=field.hu; s=mail; t=1432480375; bh=QwT3LKZLzmNAtV21B+g2BuMW/gA489DDMSzpff17lbY=; h=Date:From:To:Subject; b=G0DCAMttxMImPl6XhAXRIbXO2G/IBGskUwJ4SGC5BRFNWcg7hXvz04bZP8rzgSmEX KPm9iYdFNzFn/xy7wBAw/JM9BBIG/PubN6IV8ZIWONr0bo1UgODq9IFadcHIeC+qWG 4UCESt59uQo+98/L9Rr88xmE7nGySXOok/BU7nqE= Message-ID: <5561EA73.20005@field.hu> Date: Sun, 24 May 2015 17:12:51 +0200 From: Cs User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-performance@freebsd.org Subject: FreeBSD 10.1-REL - network unaccessible after high traffic Content-Type: text/plain; charset=iso-8859-2; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 May 2015 15:21:02 -0000 Hi all, I have two FreeBSd 10.1-RELEASE servers connected to each other. They were connected via cross link, but they are connected to a cisco switch now. When transferring huge files (50-500GB backup files) via Gigabit (it is important!) the network randomly dies. The backup runs every day/week and sometimes the connection is ok for months sometimes it happens twice a week. When the network dies I can log in to the server via IPMI and use the console everything is OK, but can't send anything out on the network. ifconfig em0 down/up doesn't help nor netif restart. The problem never occured when I used 100Mbit connection between them, but it was 3com NIC (xl), gigabit adapter is Intel (em0). When I limit the transfer rate (rsync bandwith limit or ipfw pipe) the problem is much more rare. I tried to set these tuning parameters on both servers with different buffer size but nothing helped: # cat /etc/sysctl.conf security.bsd.see_other_uids=0 net.inet.tcp.recvspace=512000 net.route.netisr_maxqlen=2048 kern.ipc.nmbclusters=1310720 net.inet.tcp.sendbuf_max=16777216 net.inet.tcp.recvbuf_max=16777216 kern.ipc.soacceptqueue=32768 # cat /boot/loader.conf geom_mirror_load="YES" # RAID1 disk driver (see gmirror(8)) ipfw_load="YES" net.inet.ip.fw.default_to_accept=1 kern.maxusers=4096 accf_data_load="YES" Any ideas? Thanks guys!