From owner-freebsd-net@FreeBSD.ORG Mon Feb 25 18:16:05 2013 Return-Path: Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 1DC0E220 for ; Mon, 25 Feb 2013 18:16:05 +0000 (UTC) (envelope-from harrison@biostat.wisc.edu) Received: from agogare.doit.wisc.edu (agogare.doit.wisc.edu [144.92.197.211]) by mx1.freebsd.org (Postfix) with ESMTP id EEF1BCFE for ; Mon, 25 Feb 2013 18:16:04 +0000 (UTC) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII; format=flowed Received: from avs-daemon.smtpauth2.wiscmail.wisc.edu by smtpauth2.wiscmail.wisc.edu (Sun Java(tm) System Messaging Server 7u2-7.05 32bit (built Jul 30 2009)) id <0MIS00D00F8LTV00@smtpauth2.wiscmail.wisc.edu> for freebsd-net@FreeBSD.org; Mon, 25 Feb 2013 12:16:03 -0600 (CST) X-Spam-PmxInfo: Server=avs-2, Version=5.6.1.2065439, Antispam-Engine: 2.7.2.376379, Antispam-Data: 2013.2.25.175717, SenderIP=0.0.0.0 X-Spam-Report: AuthenticatedSender=yes, SenderIP=0.0.0.0 Received: from seal.biostat.wisc.edu (seal.biostat.wisc.edu [144.92.73.36]) by smtpauth2.wiscmail.wisc.edu (Sun Java(tm) System Messaging Server 7u2-7.05 32bit (built Jul 30 2009)) with ESMTPSA id <0MIS000ADG2OQG50@smtpauth2.wiscmail.wisc.edu> for freebsd-net@FreeBSD.org; Mon, 25 Feb 2013 12:16:01 -0600 (CST) X-Wisc-Sender: harrison@biostat.wisc.edu Message-id: <512BAA60.3060703@biostat.wisc.edu> Date: Mon, 25 Feb 2013 12:16:00 -0600 From: "Christopher D. Harrison" User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.11) Gecko/20121116 Thunderbird/10.0.11 To: freebsd-net@FreeBSD.org Subject: igb network lockups X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Feb 2013 18:16:05 -0000 I recently have been experiencing network "freezes" and network "lockups" on our Freebsd 9.1 systems which are running zfs and nfs file servers. I upgraded from 9.0 to 9.1 about 2 months ago and we have been having issues with almost bi-monthly. The issue manifests in the system becomes unresponsive to any/all nfs clients. The system is not resource bound as our I/O is low to disk and our network is usually in the 20mbit/40mbit range. We do notice a correlation between temporary i/o spikes and network freezes but not enough to send our system in to "lockup" mode for the next 5min. Currently we have 4 igb nics in 2 aggr's with 8 queue's per nic and our dev.igb reports: dev.igb.3.%desc: Intel(R) PRO/1000 Network Connection version - 2.3.4 I am almost certain the problem is with the ibg driver as a friend is also experiencing the same problem with the same intel igb nic. He has addressed the issue by restarting the network using netif on his systems. According to my friend, once the network interfaces get cleared, everything comes back and starts working as expected. I have noticed an issue with the igb driver and I was looking for thoughts on how to help address this problem. http://freebsd.1045724.n5.nabble.com/em-igb-if-transmit-drbr-and-ALTQ-td5760338.html Thoughts/Ideas are greatly appreciated!!! -C