From owner-freebsd-ipfw@FreeBSD.ORG Thu Oct 18 06:23:23 2012 Return-Path: Delivered-To: freebsd-ipfw@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DB6135E8 for ; Thu, 18 Oct 2012 06:23:23 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: from mail-vb0-f54.google.com (mail-vb0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id 7C8CB8FC08 for ; Thu, 18 Oct 2012 06:23:23 +0000 (UTC) Received: by mail-vb0-f54.google.com with SMTP id v11so10533133vbm.13 for ; Wed, 17 Oct 2012 23:23:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=BEl+ad9u4BmXJ+PSo2CRa1Yi/iRk2T19MHwd6TW93UY=; b=t45OuFfAiSY7OS2FeIagjZhkpRbNW/WCx+Lu0oYxw5zM68RB2cuJirlzVmgNKJu4Fk R8+qWXJM8kh1KWZWLsLv9p15mPPkWZHlwSfBfoUsT/MPCbfcBs7F1cbt9ZieJpvgq3za ftAwfzOKaU1BaKloe39pnBbPRWGFYPGu+5C+YqRx9c6lYW6Hm+041xrHKpN9DIrdIPIZ 7+JP8fZ1M0Q69UCfd72mVw7lLJkpjg3P/RRqWvRGF7+/DAlbAwZfWc9brDoBRcHziGZZ pHs6zVLrNrhiXjJ3W0FNObZyDb8ZN+0wpGuNohYPnGjY6HZSq92M0V3x7lse805kdq+C wCOg== MIME-Version: 1.0 Received: by 10.220.150.14 with SMTP id w14mr3728104vcv.13.1350541402706; Wed, 17 Oct 2012 23:23:22 -0700 (PDT) Received: by 10.58.56.135 with HTTP; Wed, 17 Oct 2012 23:23:22 -0700 (PDT) In-Reply-To: References: Date: Thu, 18 Oct 2012 09:23:22 +0300 Message-ID: Subject: Re: ipfw: Opcode 10 size 49 wrong From: =?ISO-8859-1?Q?=D6zkan_KIRIK?= To: freebsd-ipfw@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-ipfw@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: IPFW Technical Discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Oct 2012 06:23:24 -0000 Some information below : # netstat -m 133399/12146/145545 mbufs in use (current/cache/total) 132837/5409/138246/524288 mbuf clusters in use (current/cache/total/max) 132837/4891 mbuf+clusters out of packet secondary zone in use (current/cach= e) 291/634/925/262144 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/131072 9k jumbo clusters in use (current/cache/total/max) 0/0/0/65536 16k jumbo clusters in use (current/cache/total/max) 300241K/16390K/316632K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 41 requests for I/O initiated by sendfile 0 calls to protocol drain routines # sysctl dev.igb.0 dev.igb.0.%desc: Intel(R) PRO/1000 Network Connection version - 2.3.1 dev.igb.0.%driver: igb dev.igb.0.%location: slot=3D0 function=3D0 dev.igb.0.%pnpinfo: vendor=3D0x8086 device=3D0x1521 subvendor=3D0x8086 subdevice=3D0x0001 class=3D0x020000 dev.igb.0.%parent: pci6 dev.igb.0.nvm: -1 dev.igb.0.enable_aim: 1 dev.igb.0.fc: 3 dev.igb.0.rx_processing_limit: -1 dev.igb.0.dmac: 0 dev.igb.0.eee_disabled: 1 dev.igb.0.link_irq: 2 dev.igb.0.dropped: 0 dev.igb.0.tx_dma_fail: 0 dev.igb.0.rx_overruns: 0 dev.igb.0.watchdog_timeouts: 0 dev.igb.0.device_control: 1209795137 dev.igb.0.rx_control: 67141658 dev.igb.0.interrupt_mask: 4 dev.igb.0.extended_int_mask: 2147484151 dev.igb.0.tx_buf_alloc: 0 dev.igb.0.rx_buf_alloc: 0 dev.igb.0.fc_high_water: 33168 dev.igb.0.fc_low_water: 33152 dev.igb.0.queue0.interrupt_rate: 5208 dev.igb.0.queue0.txd_head: 1557 dev.igb.0.queue0.txd_tail: 1557 dev.igb.0.queue0.no_desc_avail: 0 dev.igb.0.queue0.tx_packets: 424156 dev.igb.0.queue0.rxd_head: 681 dev.igb.0.queue0.rxd_tail: 680 dev.igb.0.queue0.rx_packets: 397993 dev.igb.0.queue0.rx_bytes: 90331828 dev.igb.0.queue0.lro_queued: 0 dev.igb.0.queue0.lro_flushed: 0 dev.igb.0.queue1.interrupt_rate: 100000 dev.igb.0.queue1.txd_head: 250 dev.igb.0.queue1.txd_tail: 250 dev.igb.0.queue1.no_desc_avail: 0 dev.igb.0.queue1.tx_packets: 424717 dev.igb.0.queue1.rxd_head: 917 dev.igb.0.queue1.rxd_tail: 916 dev.igb.0.queue1.rx_packets: 435093 dev.igb.0.queue1.rx_bytes: 215966796 dev.igb.0.queue1.lro_queued: 0 dev.igb.0.queue1.lro_flushed: 0 dev.igb.0.queue2.interrupt_rate: 30303 dev.igb.0.queue2.txd_head: 2127 dev.igb.0.queue2.txd_tail: 2127 dev.igb.0.queue2.no_desc_avail: 0 dev.igb.0.queue2.tx_packets: 818615 dev.igb.0.queue2.rxd_head: 3994 dev.igb.0.queue2.rxd_tail: 3993 dev.igb.0.queue2.rx_packets: 434074 dev.igb.0.queue2.rx_bytes: 166773634 dev.igb.0.queue2.lro_queued: 0 dev.igb.0.queue2.lro_flushed: 0 dev.igb.0.queue3.interrupt_rate: 2673 dev.igb.0.queue3.txd_head: 3055 dev.igb.0.queue3.txd_tail: 3055 dev.igb.0.queue3.no_desc_avail: 0 dev.igb.0.queue3.tx_packets: 481533 dev.igb.0.queue3.rxd_head: 2037 dev.igb.0.queue3.rxd_tail: 2035 dev.igb.0.queue3.rx_packets: 681973 dev.igb.0.queue3.rx_bytes: 105467978 dev.igb.0.queue3.lro_queued: 0 dev.igb.0.queue3.lro_flushed: 0 dev.igb.0.queue4.interrupt_rate: 13888 dev.igb.0.queue4.txd_head: 1496 dev.igb.0.queue4.txd_tail: 1496 dev.igb.0.queue4.no_desc_avail: 0 dev.igb.0.queue4.tx_packets: 344471 dev.igb.0.queue4.rxd_head: 3804 dev.igb.0.queue4.rxd_tail: 3803 dev.igb.0.queue4.rx_packets: 392924 dev.igb.0.queue4.rx_bytes: 132467841 dev.igb.0.queue4.lro_queued: 0 dev.igb.0.queue4.lro_flushed: 0 dev.igb.0.queue5.interrupt_rate: 100000 dev.igb.0.queue5.txd_head: 3221 dev.igb.0.queue5.txd_tail: 3221 dev.igb.0.queue5.no_desc_avail: 0 dev.igb.0.queue5.tx_packets: 496837 dev.igb.0.queue5.rxd_head: 418 dev.igb.0.queue5.rxd_tail: 417 dev.igb.0.queue5.rx_packets: 483746 dev.igb.0.queue5.rx_bytes: 114443400 dev.igb.0.queue5.lro_queued: 0 dev.igb.0.queue5.lro_flushed: 0 dev.igb.0.queue6.interrupt_rate: 2673 dev.igb.0.queue6.txd_head: 1625 dev.igb.0.queue6.txd_tail: 1625 dev.igb.0.queue6.no_desc_avail: 0 dev.igb.0.queue6.tx_packets: 308415 dev.igb.0.queue6.rxd_head: 2065 dev.igb.0.queue6.rxd_tail: 2064 dev.igb.0.queue6.rx_packets: 321553 dev.igb.0.queue6.rx_bytes: 78662967 dev.igb.0.queue6.lro_queued: 0 dev.igb.0.queue6.lro_flushed: 0 dev.igb.0.queue7.interrupt_rate: 21276 dev.igb.0.queue7.txd_head: 1472 dev.igb.0.queue7.txd_tail: 1472 dev.igb.0.queue7.no_desc_avail: 0 dev.igb.0.queue7.tx_packets: 514688 dev.igb.0.queue7.rxd_head: 1961 dev.igb.0.queue7.rxd_tail: 1960 dev.igb.0.queue7.rx_packets: 321449 dev.igb.0.queue7.rx_bytes: 104156914 dev.igb.0.queue7.lro_queued: 0 dev.igb.0.queue7.lro_flushed: 0 dev.igb.0.mac_stats.excess_coll: 0 dev.igb.0.mac_stats.single_coll: 0 dev.igb.0.mac_stats.multiple_coll: 0 dev.igb.0.mac_stats.late_coll: 0 dev.igb.0.mac_stats.collision_count: 0 dev.igb.0.mac_stats.symbol_errors: 0 dev.igb.0.mac_stats.sequence_errors: 0 dev.igb.0.mac_stats.defer_count: 0 dev.igb.0.mac_stats.missed_packets: 0 dev.igb.0.mac_stats.recv_no_buff: 0 dev.igb.0.mac_stats.recv_undersize: 0 dev.igb.0.mac_stats.recv_fragmented: 0 dev.igb.0.mac_stats.recv_oversize: 0 dev.igb.0.mac_stats.recv_jabber: 0 dev.igb.0.mac_stats.recv_errs: 0 dev.igb.0.mac_stats.crc_errs: 0 dev.igb.0.mac_stats.alignment_errs: 0 dev.igb.0.mac_stats.coll_ext_errs: 0 dev.igb.0.mac_stats.xon_recvd: 0 dev.igb.0.mac_stats.xon_txd: 0 dev.igb.0.mac_stats.xoff_recvd: 0 dev.igb.0.mac_stats.xoff_txd: 0 dev.igb.0.mac_stats.total_pkts_recvd: 3466618 dev.igb.0.mac_stats.good_pkts_recvd: 3466613 dev.igb.0.mac_stats.bcast_pkts_recvd: 80019 dev.igb.0.mac_stats.mcast_pkts_recvd: 86214 dev.igb.0.mac_stats.rx_frames_64: 1768575 dev.igb.0.mac_stats.rx_frames_65_127: 923733 dev.igb.0.mac_stats.rx_frames_128_255: 90372 dev.igb.0.mac_stats.rx_frames_256_511: 80393 dev.igb.0.mac_stats.rx_frames_512_1023: 123063 dev.igb.0.mac_stats.rx_frames_1024_1522: 480477 dev.igb.0.mac_stats.good_octets_recvd: 1022903617 dev.igb.0.mac_stats.good_octets_txd: 5378183340 dev.igb.0.mac_stats.total_pkts_txd: 4740612 dev.igb.0.mac_stats.good_pkts_txd: 4740612 dev.igb.0.mac_stats.bcast_pkts_txd: 1698 dev.igb.0.mac_stats.mcast_pkts_txd: 3516 dev.igb.0.mac_stats.tx_frames_64: 419889 dev.igb.0.mac_stats.tx_frames_65_127: 365584 dev.igb.0.mac_stats.tx_frames_128_255: 149310 dev.igb.0.mac_stats.tx_frames_256_511: 199405 dev.igb.0.mac_stats.tx_frames_512_1023: 190421 dev.igb.0.mac_stats.tx_frames_1024_1522: 3416003 dev.igb.0.mac_stats.tso_txd: 588491 dev.igb.0.mac_stats.tso_ctx_fail: 0 dev.igb.0.interrupts.asserts: 6979137 dev.igb.0.interrupts.rx_pkt_timer: 3466552 dev.igb.0.interrupts.rx_abs_timer: 0 dev.igb.0.interrupts.tx_pkt_timer: 0 dev.igb.0.interrupts.tx_abs_timer: 0 dev.igb.0.interrupts.tx_queue_empty: 4740550 dev.igb.0.interrupts.tx_queue_min_thresh: 9485162 dev.igb.0.interrupts.rx_desc_min_thresh: 0 dev.igb.0.interrupts.rx_overrun: 0 dev.igb.0.host.breaker_tx_pkt: 0 dev.igb.0.host.host_tx_pkt_discard: 0 dev.igb.0.host.rx_pkt: 61 dev.igb.0.host.breaker_rx_pkts: 0 dev.igb.0.host.breaker_rx_pkt_drop: 0 dev.igb.0.host.tx_good_pkt: 62 dev.igb.0.host.breaker_tx_pkt_drop: 0 dev.igb.0.host.rx_good_bytes: 1022903617 dev.igb.0.host.tx_good_bytes: 5378183340 dev.igb.0.host.length_errors: 5 dev.igb.0.host.serdes_violation_pkt: 0 dev.igb.0.host.header_redir_missed: 0 I show that interrupt rates of queues are different. On Thu, Oct 18, 2012 at 8:49 AM, =D6zkan KIRIK wrot= e: > Hi, > > I am using FreeBSD 8.3 - RELEASE with ipfw + dummynet + inkernel_nat > compiled kernel. > > This message appears on my console about 20 times per hour : > > ipfw: opcode 10 size 49 wrong" > ipfw: opcode 10 size 49 wrong" > ipfw: opcode 10 size 49 wrong" > ipfw: opcode 10 size 49 wrong" > ipfw: opcode 10 size 49 wrong" > ... > > > System works as expectedly but, it hangs after about 2-3 hours. > > Both IPv4 and IPv6 addresses configured, > System has 3 interfaces ( 1 LAN, 1 WAN, 1 DMZ ) > All of cards are Intel I350T ( igbX ). > kern.ipc.nmbclusters is set to 262144. > > What does it mean "ipfw: opcode 10 size 49 wrong" ? > How can we debug / solve this problem? > > Best regards, > Ozkan.