From owner-freebsd-net@FreeBSD.ORG Tue Dec 6 22:18:59 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5F492106564A for ; Tue, 6 Dec 2011 22:18:59 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 27F818FC0C for ; Tue, 6 Dec 2011 22:18:58 +0000 (UTC) Received: by iafi7 with SMTP id i7so7982455iaf.13 for ; Tue, 06 Dec 2011 14:18:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=g2ACbZGLF5Cr4LQjOIZvFcbyjGVCwUIRv1NYxIMvIKU=; b=JgUwoWBJn9Khcbrq29PfGTgLvFfcdntXO3NsSA5u37s3F6X0Yyedz3tUFyVoQISPCR 7cEFsXA8Cm/M7Yj+P1WsObr5A5iI+8s5SxBP3x1HIwai/Wef9PgmxuU2ir/EVhQ9/C+N vB4rOXo6ZlPCEoY1lg/RfrjhvcaWKK8JWwBfA= Received: by 10.42.29.6 with SMTP id p6mr15825883icc.44.1323209938409; Tue, 06 Dec 2011 14:18:58 -0800 (PST) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id wo4sm52032131igc.5.2011.12.06.14.18.55 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 06 Dec 2011 14:18:57 -0800 (PST) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Tue, 06 Dec 2011 14:18:44 -0800 From: YongHyeon PYUN Date: Tue, 6 Dec 2011 14:18:44 -0800 To: Arnaud Lacombe Message-ID: <20111206221844.GD5825@michelle.cdnetworks.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: "Jukka A. Ukkonen" , freebsd-net@freebsd.org Subject: Re: msk0: initialization failed: no memory for Rx buffers X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Dec 2011 22:18:59 -0000 On Mon, Dec 05, 2011 at 05:02:45PM -0500, Arnaud Lacombe wrote: > Hi folks, > > FWIW, if any developers cares, I'm getting the same problem as Jukka > A. Ukkonen in [0], that is, an msk(4) interface stuck in: > > msk0: prefetch unit stuck? > msk0: initialization failed: no memory for Rx buffers > If you upgraded from pre-r223396, try cold-boot. Note, you may have to completely remove power cord for a while before boot. The prefetch unit stuck message will show when RX checksum offloading initialization failed. If cold boot has no effect, try disabling RX checksum offloading. > hardware involved here is: > > # dmesg > [...] > mskc0: port 0xbe00-0xbeff mem > 0xfdefc000-0xfdefffff irq 16 at device 0.0 on pci1 > msk0: on mskc0 > msk0: Ethernet address: 00:03:2d:09:94:3a > miibus0: on msk0 > > # pciconf -l > [...] > mskc0@pci0:1:0:0: class=0x020000 card=0x43401148 chip=0x436211ab > rev=0x19 hdr=0x00 > mskc1@pci0:2:0:0: class=0x020000 card=0x43401148 chip=0x436211ab > rev=0x19 hdr=0x00 > mskc2@pci0:3:0:0: class=0x020000 card=0x43401148 chip=0x436211ab > rev=0x19 hdr=0x00 > mskc3@pci0:4:0:0: class=0x020000 card=0x43401148 chip=0x436211ab > rev=0x19 hdr=0x00 > > Memory on the system is fine: > > # vmstat > procs memory page disk faults cpu > r b w avm fre flt re pi po fr sr ad0 in sy cs us sy id > 0 0 0 52844K 1957M 0 0 0 0 0 0 0 51 34 4044 0 0 100 > > # netstat -m > 719/946/1665 mbufs in use (current/cache/total) > 717/825/1542/262144 mbuf clusters in use (current/cache/total/max) > 717/819 mbuf+clusters out of packet secondary zone in use (current/cache) > 0/5/5/131072 4k (page size) jumbo clusters in use (current/cache/total/max) > 0/0/0/65536 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/32768 16k jumbo clusters in use (current/cache/total/max) > 1613K/1906K/3520K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters denied (4k/9k/16k) > 0/3/6656 sfbufs in use (current/peak/max) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > 0 calls to protocol drain routines > > Faulty code is from 8-STABLE, i386, locally built with FLOWTABLES and > ROUTETABLES=8. Jukka's report seems to point out that -current is no > better. > > Problem happened after a few minutes of not-so-heavy transfer. > > - Arnaud > > [0]: http://lists.freebsd.org/pipermail/freebsd-questions/2011-November/235646.html