From owner-freebsd-current@FreeBSD.ORG Fri Sep 11 17:38:51 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7E3D71065670 for ; Fri, 11 Sep 2009 17:38:51 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-qy0-f195.google.com (mail-qy0-f195.google.com [209.85.221.195]) by mx1.freebsd.org (Postfix) with ESMTP id 332018FC15 for ; Fri, 11 Sep 2009 17:38:50 +0000 (UTC) Received: by qyk33 with SMTP id 33so30294qyk.14 for ; Fri, 11 Sep 2009 10:38:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:from:date:to:cc :subject:message-id:reply-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=fQjxKchYWyIpFUed+Fg2In71q3Th+HD2jvud0+MgQps=; b=ozTK2/8SHYW/hBvClCX/36xS3U78xcDuzHXMMVG9xPtvjwG5x9hJPRepwstX6bffh1 cuNujpCsXAEQDm+KFJkAxbNwIkan9ewoNd2Fke9OTsQwe2eE+SGiC6PIrCCJyQtTP5X7 00TVD0qooUYjfT16SIG/lV0kqsXBELKinydRM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=dQMOSOTvuld62DfjWGHDiTGjGW3cnY7g3+bGSBgHIr2OVc58H5FVuOSR03szSm66MF zdOn0P83t3ETieSmncezPvGIseDDzT6XWeOFISa9PUtxNqthLGjmZlegp4tdjsZX5DKl BPR51oGwURN1qDyZjUkaTZl/++jLsH1y3vSMk= Received: by 10.224.112.10 with SMTP id u10mr2753745qap.169.1252690730308; Fri, 11 Sep 2009 10:38:50 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id 8sm128474qwj.18.2009.09.11.10.38.48 (version=TLSv1/SSLv3 cipher=RC4-MD5); Fri, 11 Sep 2009 10:38:49 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Fri, 11 Sep 2009 10:37:56 -0700 From: Pyun YongHyeon Date: Fri, 11 Sep 2009 10:37:56 -0700 To: Pieter de Goeje Message-ID: <20090911173756.GA1100@michelle.cdnetworks.com> References: <200909111924.10927.pieter@degoeje.nl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200909111924.10927.pieter@degoeje.nl> User-Agent: Mutt/1.4.2.3i Cc: freebsd-current@freebsd.org Subject: Re: BETA3: network processes hang in keglimit (unkillable) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2009 17:38:51 -0000 On Fri, Sep 11, 2009 at 07:24:10PM +0200, Pieter de Goeje wrote: > I just experienced a complete loss of network, where every network related > process would sleep on "keglimit". I was unable to recover from this > situation. I tried killing the processes with SIGKILL, but it didn't work, > and I tried to bring the network interface (em) down and up again, which also > didn't work. A reboot "solved" the problem. The machine was handling some > major traffic, both TCP and UDP. > > Apparently the system was waiting on some resource to free up, but what could > it be? How can this situation be avoided in the future? > > uname: 8.0-BETA3 FreeBSD 8.0-BETA3 #1: Sun Aug 30 01:23:36 CEST 2009 amd64 > Both em(4) and igb(4) had mbuf leak bug which was recently fixed by Jack. Check mbuf statistics with "netstat -m" and see whether you've reached mbuf resource limit(see 4K jumbo cluster counter). The leak can be easily seen on UDP traffic, especially NFS over UDP.