From owner-freebsd-net@FreeBSD.ORG Fri Mar 8 20:16:55 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id B1509A25 for ; Fri, 8 Mar 2013 20:16:55 +0000 (UTC) (envelope-from mxb@alumni.chalmers.se) Received: from mail-la0-x230.google.com (mail-la0-x230.google.com [IPv6:2a00:1450:4010:c03::230]) by mx1.freebsd.org (Postfix) with ESMTP id 1073B865 for ; Fri, 8 Mar 2013 20:16:54 +0000 (UTC) Received: by mail-la0-f48.google.com with SMTP id fq13so2107035lab.35 for ; Fri, 08 Mar 2013 12:16:54 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:content-type:mime-version:subject:from:in-reply-to:date :cc:content-transfer-encoding:message-id:references:to:x-mailer :x-gm-message-state; bh=ngCr5DDSFRRX6s9lrYxa2hy/4HXmTC0ze58H1zEkJUg=; b=ZAMkI5l1Gg6aKrJV+X7DdiyaXn9sblK/W73zpGyArr4az/tkMUXIOFcztO26n1Sljb r4BAXo4bgkUdAOBoYK6OCLWWp3sIGFRbACDI7KBoe45z/QqzvroHylm293rHAmEd2A6p kLXNSwRSE3NadcteipSIX8Y5BEtvLPH8Xgxj9+ehU+aHcx31WEjjTI4fKHJmUn4gpOqS z7MODRq3W3VolEUbUrP2iq/eHKfPDqFuPYJxOPqJIyOn1DcK5vhVmu75+njSCIMRRmC9 dZwZ5m8ZYGTDaPEmttHAIcGuPLzFADN0T04ZWtKXkJIQnhgdbalPFnuEG71N5ubBjDv8 g8Qg== X-Received: by 10.112.104.103 with SMTP id gd7mr1538285lbb.54.1362773813868; Fri, 08 Mar 2013 12:16:53 -0800 (PST) Received: from grey.home.unixconn.com (h-75-17.a183.priv.bahnhof.se. [46.59.75.17]) by mx.google.com with ESMTPS id q9sm2011142lbz.3.2013.03.08.12.16.51 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 08 Mar 2013 12:16:52 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: 9.1-RELEASE-p1: em0: Could not setup receive structures From: mxb In-Reply-To: Date: Fri, 8 Mar 2013 21:16:50 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <2E6BC0C8-D435-433A-ABF7-D0E4F649F262@alumni.chalmers.se> References: <5587F8D1-2242-4579-B992-357C75425A37@alumni.chalmers.se> To: Jack Vogel X-Mailer: Apple Mail (2.1499) X-Gm-Message-State: ALoCoQnQs7wPieT+/P0jO+kHHaSP6N62Obz/c4+bNoOxC15/ncOI4u0wxGzsF83kTrR6HrZZ3Eeg Cc: freebsd-net@freebsd.org, mxb X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Mar 2013 20:16:55 -0000 Any sysctl I'd should look out for? //maxim On 8 mar 2013, at 21:03, Jack Vogel wrote: > The message occurs because you don't have enough mbufs to setup the RX > ring, so you > need to look at nmbclusters. It may be that em is just the victim, = since > you have igb interfaces > as well from what I see. >=20 > Jack >=20 >=20 > On Fri, Mar 8, 2013 at 11:19 AM, mxb wrote: >=20 >>=20 >> Hello list@, >>=20 >> I'm mostly active on OpenBSD-side, however I have several machines = running >> fbsd with ZFS. >>=20 >> I'v recently upgraded(today) from 8.2-stable to 9.1-rel because of = em(4) >> with the problem on 8.2-stable. >> However, my problem has not disappeared after mentioned upgrade. >>=20 >> I serve VMWare images from this machine. >>=20 >> Configuration: >>=20 >> lagg0: flags=3D8843 metric 0 = mtu 9000 >>=20 >> = options=3D4019b >> ether 00:25:90:24:70:e8 >> inet 172.16.0.243 netmask 0xfffff800 broadcast 172.16.7.255 >> nd6 options=3D1 >> media: Ethernet autoselect >> status: active >> laggproto lacp lagghash l2,l3,l4 >> laggport: igb0 flags=3D1c >> laggport: em0 flags=3D18 >> lagg1: flags=3D8843 metric 0 = mtu 9000 >>=20 >> = options=3D4019b >> ether 00:25:90:24:70:e9 >> inet 10.11.11.1 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.11 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.12 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.13 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.14 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.15 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.16 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.17 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.18 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.19 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.20 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.21 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.22 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.23 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.24 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.25 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.26 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.27 netmask 0xffffff00 broadcast 10.11.11.255 >> inet 10.11.11.28 netmask 0xffffff00 broadcast 10.11.11.255 >> nd6 options=3D1 >> media: Ethernet autoselect >> status: active >> laggproto lacp lagghash l2,l3,l4 >> laggport: igb1 flags=3D1c >> laggport: em1 flags=3D1c >>=20 >> current sysctl.conf (not fixed after upgrade): >> # Every socket is a file, so increase them >> kern.maxfiles=3D204800 >> kern.maxfilesperproc=3D200000 >> kern.ipc.maxsockets=3D204800 >>=20 >> # Increase max command-line length showed in `ps` (e.g for = Tomcat/Java) >> # Default is PAGE_SIZE / 16 or 256 on x86 >> # For more info see: = http://www.freebsd.org/cgi/query-pr.cgi?pr=3D120749 >> kern.ps_arg_cache_limit=3D4096 >>=20 >> # Security >> #net.inet.udp.blackhole=3D1 >> #net.inet.tcp.blackhole=3D2 >>=20 >> kern.ipc.maxsockbuf=3D16777216 >> kern.ipc.nmbclusters=3D65535 >> kern.ipc.somaxconn=3D32768 >> #kern.maxfiles=3D65535 >> kern.maxvnodes=3D800000 >>=20 >> vfs.zfs.l2arc_noprefetch=3D0 >> vfs.zfs.l2arc_write_max=3D16777216 >> vfs.zfs.l2arc_write_boost=3D16777216 >>=20 >> net.inet.tcp.sendspace=3D65535 >> net.inet.tcp.recvspace=3D131072 >> net.inet.tcp.mssdflt=3D1452 >> net.inet.tcp.sendbuf_max=3D16777216 >> net.inet.tcp.sendbuf_inc=3D524288 >> net.inet.tcp.recvbuf_max=3D16777216 >> net.inet.tcp.recvbuf_inc=3D524288 >> net.inet.udp.recvspace=3D65535 >> net.inet.udp.maxdgram=3D65535 >> net.local.stream.recvspace=3D65535 >> net.local.stream.sendspace=3D65535 >> net.inet.tcp.delayed_ack=3D0 >>=20 >>=20 >> Any clues? >>=20 >> Please mail directly to me or cc to sysop@prisjakt.nu >>=20 >> Regards >> Maxim >>=20 >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"