Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 8 Mar 2013 12:03:20 -0800
From:      Jack Vogel <jfvogel@gmail.com>
To:        mxb <mxb@alumni.chalmers.se>
Cc:        freebsd-net@freebsd.org
Subject:   Re: 9.1-RELEASE-p1: em0: Could not setup receive structures
Message-ID:  <CAFOYbcmr8LzhUt6VndDgvX%2BW-0r17X3W0xqt7JYgFJSUVUJF-A@mail.gmail.com>
In-Reply-To: <5587F8D1-2242-4579-B992-357C75425A37@alumni.chalmers.se>
References:  <5587F8D1-2242-4579-B992-357C75425A37@alumni.chalmers.se>

next in thread | previous in thread | raw e-mail | index | archive | help
The message occurs because you don't have enough mbufs to setup the RX
ring, so you
need to look at nmbclusters. It may be that em is just the victim, since
you have igb interfaces
as well from what I see.

Jack


On Fri, Mar 8, 2013 at 11:19 AM, mxb <mxb@alumni.chalmers.se> wrote:

>
> Hello list@,
>
> I'm mostly active on OpenBSD-side, however I have several machines running
> fbsd with ZFS.
>
> I'v recently upgraded(today) from 8.2-stable to 9.1-rel because of em(4)
> with the problem  <subject> on 8.2-stable.
> However, my problem has not disappeared after mentioned upgrade.
>
> I serve VMWare images from this machine.
>
> Configuration:
>
> lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
>
> options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
>         ether 00:25:90:24:70:e8
>         inet 172.16.0.243 netmask 0xfffff800 broadcast 172.16.7.255
>         nd6 options=1<PERFORMNUD>
>         media: Ethernet autoselect
>         status: active
>         laggproto lacp lagghash l2,l3,l4
>         laggport: igb0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>         laggport: em0 flags=18<COLLECTING,DISTRIBUTING>
> lagg1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
>
> options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
>         ether 00:25:90:24:70:e9
>         inet 10.11.11.1 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.11 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.12 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.13 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.14 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.15 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.16 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.17 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.18 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.19 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.20 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.21 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.22 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.23 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.24 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.25 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.26 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.27 netmask 0xffffff00 broadcast 10.11.11.255
>         inet 10.11.11.28 netmask 0xffffff00 broadcast 10.11.11.255
>         nd6 options=1<PERFORMNUD>
>         media: Ethernet autoselect
>         status: active
>         laggproto lacp lagghash l2,l3,l4
>         laggport: igb1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>         laggport: em1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>
> current sysctl.conf (not fixed after upgrade):
> # Every socket is a file, so increase them
> kern.maxfiles=204800
> kern.maxfilesperproc=200000
> kern.ipc.maxsockets=204800
>
> # Increase max command-line length showed in `ps` (e.g for Tomcat/Java)
> # Default is PAGE_SIZE / 16 or 256 on x86
> # For more info see: http://www.freebsd.org/cgi/query-pr.cgi?pr=120749
> kern.ps_arg_cache_limit=4096
>
> # Security
> #net.inet.udp.blackhole=1
> #net.inet.tcp.blackhole=2
>
> kern.ipc.maxsockbuf=16777216
> kern.ipc.nmbclusters=65535
> kern.ipc.somaxconn=32768
> #kern.maxfiles=65535
> kern.maxvnodes=800000
>
> vfs.zfs.l2arc_noprefetch=0
> vfs.zfs.l2arc_write_max=16777216
> vfs.zfs.l2arc_write_boost=16777216
>
> net.inet.tcp.sendspace=65535
> net.inet.tcp.recvspace=131072
> net.inet.tcp.mssdflt=1452
> net.inet.tcp.sendbuf_max=16777216
> net.inet.tcp.sendbuf_inc=524288
> net.inet.tcp.recvbuf_max=16777216
> net.inet.tcp.recvbuf_inc=524288
> net.inet.udp.recvspace=65535
> net.inet.udp.maxdgram=65535
> net.local.stream.recvspace=65535
> net.local.stream.sendspace=65535
> net.inet.tcp.delayed_ack=0
>
>
> Any clues?
>
> Please mail directly to me or cc to sysop@prisjakt.nu
>
> Regards
> Maxim
>
>
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFOYbcmr8LzhUt6VndDgvX%2BW-0r17X3W0xqt7JYgFJSUVUJF-A>