From owner-freebsd-net@FreeBSD.ORG Fri Jul 4 08:10:28 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 604D3EDD for ; Fri, 4 Jul 2014 08:10:28 +0000 (UTC) Received: from mail.bsdinfo.com.br (mail.bsdinfo.com.br [67.212.89.78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2836A2C86 for ; Fri, 4 Jul 2014 08:10:27 +0000 (UTC) Received: from mail.bsdinfo.com.br (mail.bsdinfo.com.br [127.0.0.1]) by mail.bsdinfo.com.br (Postfix) with ESMTP id 5F2FD139D0 for ; Fri, 4 Jul 2014 05:10:50 -0300 (BRT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=bsdinfo.com.br; h=content-transfer-encoding:content-type:content-type :in-reply-to:references:subject:subject:to:mime-version :user-agent:from:from:date:date:message-id; s=dkim; t= 1404461449; x=1405325450; bh=uqLifdCfjD+/aUHeu0RK7XMTEdH66ACnUeD vJXQnxQs=; b=jTHxzzvNghh+DnoU4Qm8OtGrXeEWZliS848G+N2ErKKPiwpk5k8 Rrg8dGSYRFc3stDx9OL9/2cRIN3z1tbatqaaEh2mdqnmHQse7vCcwwDZh0mvNnTR KORHNp/NwkUQrOnr10Lowp1ZVfUYAIOzGE/2gbbzbI0E+XXBG5o4ht1M= X-Virus-Scanned: amavisd-new at mail.bsdinfo.com.br Received: from mail.bsdinfo.com.br ([127.0.0.1]) by mail.bsdinfo.com.br (mail.bsdinfo.com.br [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kxCpk8Fl0t4k for ; Fri, 4 Jul 2014 05:10:49 -0300 (BRT) Received: from [192.168.10.208] (unknown [186.193.54.69]) by mail.bsdinfo.com.br (Postfix) with ESMTPSA id 2D6F9139CB; Fri, 4 Jul 2014 05:10:48 -0300 (BRT) Message-ID: <53B6616B.2080108@bsdinfo.com.br> Date: Fri, 04 Jul 2014 05:10:19 -0300 From: Marcelo Gondim User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Jack Vogel Subject: Re: Network Intel X520-SR2 stopping References: <53B3F1B6.9010606@bsdinfo.com.br> <2A35EA60C3C77D438915767F458D65687E8F859E@ORSMSX111.amr.corp.intel.com> <20140702.190739.74686622.sthaug@nethelp.no> <53B45C33.1010501@bsdinfo.com.br> <53B659EA.20200@bsdinfo.com.br> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "Pieper, Jeffrey E" , FreeBSD Net , sthaug@nethelp.no X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 08:10:28 -0000 Hi Jack, # netstat -m 65493/19272/84765 mbufs in use (current/cache/total) 65491/13867/79358/1014370 mbuf clusters in use (current/cache/total/max) 65491/13698 mbuf+clusters out of packet secondary zone in use (current/cache) 0/15/15/507184 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/150276 9k jumbo clusters in use (current/cache/total/max) 0/0/0/84530 16k jumbo clusters in use (current/cache/total/max) 147355K/32612K/179967K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile Thanks for your help. Em 04/07/2014 04:59, Jack Vogel escreveu: > What does a netstat -m show, I noticed you show no_desc counts on > all your queues, perhaps you don't have enough mbufs/clusters available? > Does your message log show any events or messages of significance? > > I'm not sure about the module compatibility, Jeff would be better positioned > to answer that. > > Jack > > > > On Fri, Jul 4, 2014 at 12:38 AM, Marcelo Gondim > wrote: > >> Hi all, >> >> Both modules are 850nm. Could there be some incompatibility between the >> Datacom XFP optical module and the SFP + Intel X520-SR2 optical module? >> I ask this because I replaced all the hardware and optical cords and >> nothing worked. Datacom is a DM4100. >> >> dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - >> 2.5.15 >> dev.ix.0.%driver: ix >> dev.ix.0.%location: slot=0 function=0 handle=\_SB_.PCI1.BR48.S3F0 >> dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 >> subdevice=0x7a11 class=0x020000 >> dev.ix.0.%parent: pci131 >> dev.ix.0.fc: 3 >> dev.ix.0.enable_aim: 1 >> dev.ix.0.advertise_speed: 0 >> dev.ix.0.dropped: 0 >> dev.ix.0.mbuf_defrag_failed: 0 >> dev.ix.0.watchdog_events: 0 >> dev.ix.0.link_irq: 61846 >> dev.ix.0.queue0.interrupt_rate: 83333 >> dev.ix.0.queue0.irqs: 2240081588 >> dev.ix.0.queue0.txd_head: 1687 >> dev.ix.0.queue0.txd_tail: 1687 >> dev.ix.0.queue0.tso_tx: 5 >> dev.ix.0.queue0.no_tx_dma_setup: 0 >> dev.ix.0.queue0.no_desc_avail: 2171 >> dev.ix.0.queue0.tx_packets: 4721544662 >> dev.ix.0.queue0.rxd_head: 223 >> dev.ix.0.queue0.rxd_tail: 222 >> dev.ix.0.queue0.rx_packets: 3939926170 >> dev.ix.0.queue0.rx_bytes: 708714319872 >> dev.ix.0.queue0.rx_copies: 1428958853 >> dev.ix.0.queue0.lro_queued: 0 >> dev.ix.0.queue0.lro_flushed: 0 >> dev.ix.0.queue1.interrupt_rate: 100000 >> dev.ix.0.queue1.irqs: 2164304165 >> dev.ix.0.queue1.txd_head: 24 >> dev.ix.0.queue1.txd_tail: 24 >> dev.ix.0.queue1.tso_tx: 0 >> dev.ix.0.queue1.no_tx_dma_setup: 0 >> dev.ix.0.queue1.no_desc_avail: 241832 >> dev.ix.0.queue1.tx_packets: 4995476933 >> dev.ix.0.queue1.rxd_head: 1161 >> dev.ix.0.queue1.rxd_tail: 1160 >> dev.ix.0.queue1.rx_packets: 3901327164 >> dev.ix.0.queue1.rx_bytes: 691440627148 >> dev.ix.0.queue1.rx_copies: 1408409383 >> dev.ix.0.queue1.lro_queued: 0 >> dev.ix.0.queue1.lro_flushed: 0 >> dev.ix.0.queue2.interrupt_rate: 83333 >> dev.ix.0.queue2.irqs: 2167993136 >> dev.ix.0.queue2.txd_head: 1329 >> dev.ix.0.queue2.txd_tail: 1329 >> dev.ix.0.queue2.tso_tx: 0 >> dev.ix.0.queue2.no_tx_dma_setup: 0 >> dev.ix.0.queue2.no_desc_avail: 190120 >> dev.ix.0.queue2.tx_packets: 5013202508 >> dev.ix.0.queue2.rxd_head: 2039 >> dev.ix.0.queue2.rxd_tail: 2038 >> dev.ix.0.queue2.rx_packets: 3955460159 >> dev.ix.0.queue2.rx_bytes: 743382421188 >> dev.ix.0.queue2.rx_copies: 1422295822 >> dev.ix.0.queue2.lro_queued: 0 >> dev.ix.0.queue2.lro_flushed: 0 >> dev.ix.0.queue3.interrupt_rate: 71428 >> dev.ix.0.queue3.irqs: 2139498119 >> dev.ix.0.queue3.txd_head: 673 >> dev.ix.0.queue3.txd_tail: 673 >> dev.ix.0.queue3.tso_tx: 0 >> dev.ix.0.queue3.no_tx_dma_setup: 0 >> dev.ix.0.queue3.no_desc_avail: 94226 >> dev.ix.0.queue3.tx_packets: 5301360114 >> dev.ix.0.queue3.rxd_head: 416 >> dev.ix.0.queue3.rxd_tail: 415 >> dev.ix.0.queue3.rx_packets: 3951345010 >> dev.ix.0.queue3.rx_bytes: 723655881546 >> dev.ix.0.queue3.rx_copies: 1424750061 >> dev.ix.0.queue3.lro_queued: 0 >> dev.ix.0.queue3.lro_flushed: 0 >> dev.ix.0.queue4.interrupt_rate: 100000 >> dev.ix.0.queue4.irqs: 2027199532 >> dev.ix.0.queue4.txd_head: 764 >> dev.ix.0.queue4.txd_tail: 764 >> dev.ix.0.queue4.tso_tx: 0 >> dev.ix.0.queue4.no_tx_dma_setup: 0 >> dev.ix.0.queue4.no_desc_avail: 174621 >> dev.ix.0.queue4.tx_packets: 5250099331 >> dev.ix.0.queue4.rxd_head: 780 >> dev.ix.0.queue4.rxd_tail: 779 >> dev.ix.0.queue4.rx_packets: 3898505370 >> dev.ix.0.queue4.rx_bytes: 680413268286 >> dev.ix.0.queue4.rx_copies: 1415917068 >> dev.ix.0.queue4.lro_queued: 0 >> dev.ix.0.queue4.lro_flushed: 0 >> dev.ix.0.queue5.interrupt_rate: 62500 >> dev.ix.0.queue5.irqs: 2076140170 >> dev.ix.0.queue5.txd_head: 553 >> dev.ix.0.queue5.txd_tail: 553 >> dev.ix.0.queue5.tso_tx: 23 >> dev.ix.0.queue5.no_tx_dma_setup: 0 >> dev.ix.0.queue5.no_desc_avail: 178058 >> dev.ix.0.queue5.tx_packets: 5266432651 >> dev.ix.0.queue5.rxd_head: 1870 >> dev.ix.0.queue5.rxd_tail: 1869 >> dev.ix.0.queue5.rx_packets: 3876348699 >> dev.ix.0.queue5.rx_bytes: 684015705094 >> dev.ix.0.queue5.rx_copies: 1433886240 >> dev.ix.0.queue5.lro_queued: 0 >> dev.ix.0.queue5.lro_flushed: 0 >> dev.ix.0.queue6.interrupt_rate: 100000 >> dev.ix.0.queue6.irqs: 2106459361 >> dev.ix.0.queue6.txd_head: 181 >> dev.ix.0.queue6.txd_tail: 181 >> dev.ix.0.queue6.tso_tx: 0 >> dev.ix.0.queue6.no_tx_dma_setup: 0 >> dev.ix.0.queue6.no_desc_avail: 2112 >> dev.ix.0.queue6.tx_packets: 4786334585 >> dev.ix.0.queue6.rxd_head: 1165 >> dev.ix.0.queue6.rxd_tail: 1164 >> dev.ix.0.queue6.rx_packets: 3963283094 >> dev.ix.0.queue6.rx_bytes: 707926383609 >> dev.ix.0.queue6.rx_copies: 1443393267 >> dev.ix.0.queue6.lro_queued: 0 >> dev.ix.0.queue6.lro_flushed: 0 >> dev.ix.0.queue7.interrupt_rate: 62500 >> dev.ix.0.queue7.irqs: 2046097590 >> dev.ix.0.queue7.txd_head: 1928 >> dev.ix.0.queue7.txd_tail: 1928 >> dev.ix.0.queue7.tso_tx: 0 >> dev.ix.0.queue7.no_tx_dma_setup: 0 >> dev.ix.0.queue7.no_desc_avail: 151682 >> dev.ix.0.queue7.tx_packets: 4753275982 >> dev.ix.0.queue7.rxd_head: 971 >> dev.ix.0.queue7.rxd_tail: 970 >> dev.ix.0.queue7.rx_packets: 3941412326 >> dev.ix.0.queue7.rx_bytes: 707141933261 >> dev.ix.0.queue7.rx_copies: 1438797770 >> dev.ix.0.queue7.lro_queued: 0 >> dev.ix.0.queue7.lro_flushed: 0 >> dev.ix.0.mac_stats.crc_errs: 119 >> dev.ix.0.mac_stats.ill_errs: 4 >> dev.ix.0.mac_stats.byte_errs: 20 >> dev.ix.0.mac_stats.short_discards: 0 >> dev.ix.0.mac_stats.local_faults: 14 >> dev.ix.0.mac_stats.remote_faults: 69 >> dev.ix.0.mac_stats.rec_len_errs: 0 >> dev.ix.0.mac_stats.xon_txd: 201740142300 >> dev.ix.0.mac_stats.xon_recvd: 0 >> dev.ix.0.mac_stats.xoff_txd: 3736066605 >> dev.ix.0.mac_stats.xoff_recvd: 0 >> dev.ix.0.mac_stats.total_octets_rcvd: 11577768204079 >> dev.ix.0.mac_stats.good_octets_rcvd: 11577747489371 >> dev.ix.0.mac_stats.total_pkts_rcvd: 31435679394 >> dev.ix.0.mac_stats.good_pkts_rcvd: 18446741966445774380 >> dev.ix.0.mac_stats.mcast_pkts_rcvd: 1678 >> dev.ix.0.mac_stats.bcast_pkts_rcvd: 60437 >> dev.ix.0.mac_stats.rx_frames_64: 488 >> dev.ix.0.mac_stats.rx_frames_65_127: 22152221688 >> dev.ix.0.mac_stats.rx_frames_128_255: 1593120232 >> dev.ix.0.mac_stats.rx_frames_256_511: 689654943 >> dev.ix.0.mac_stats.rx_frames_512_1023: 1050762441 >> dev.ix.0.mac_stats.rx_frames_1024_1522: 5949659560 >> dev.ix.0.mac_stats.recv_undersized: 0 >> dev.ix.0.mac_stats.recv_fragmented: 0 >> dev.ix.0.mac_stats.recv_oversized: 0 >> dev.ix.0.mac_stats.recv_jabberd: 1 >> dev.ix.0.mac_stats.management_pkts_rcvd: 0 >> dev.ix.0.mac_stats.management_pkts_drpd: 0 >> dev.ix.0.mac_stats.checksum_errs: 189336386 >> dev.ix.0.mac_stats.good_octets_txd: 39184317469340 >> dev.ix.0.mac_stats.total_pkts_txd: 40087600379 >> dev.ix.0.mac_stats.good_pkts_txd: 18446743912615910349 >> dev.ix.0.mac_stats.bcast_pkts_txd: 73107 >> dev.ix.0.mac_stats.mcast_pkts_txd: 18446743872528672584 >> dev.ix.0.mac_stats.management_pkts_txd: 0 >> dev.ix.0.mac_stats.tx_frames_64: 18446743875376966599 >> dev.ix.0.mac_stats.tx_frames_65_127: 7716639581 >> dev.ix.0.mac_stats.tx_frames_128_255: 2192043837 >> dev.ix.0.mac_stats.tx_frames_256_511: 1138023553 >> dev.ix.0.mac_stats.tx_frames_512_1023: 1236626066 >> dev.ix.0.mac_stats.tx_frames_1024_1522: 24955610750 >> >> >> Em 02/07/2014 16:23, Marcelo Gondim escreveu: >> >> Em 02/07/2014 14:07, sthaug@nethelp.no escreveu: >>>> Is there any way that you can try a reproduce this using a B2B >>>>> configuration, or something that doesn't use XFP as a link partner? I'm >>>>> thinking that you are correct regarding an incompatibility issue between >>>>> SFP+ and XFP. >>>>> >>>> Why do you believe that? The optical signals are the same for SFP+ >>>> and XFP. >>>> >>>> We have lots of 10G SFP+ / XFP links in production. It just works... >>>> >>>> Steinar Haug, Nethelp consulting, sthaug@nethelp.no >>>> >>>> I think I found the problem. Our SFP+ optical module is 850nm MMF and >>> our transport operator is using an XFP 1310nmMMF. >>> I am waiting for them to exchange the module and see the result. Once the >>> module is changed, I post here. >>> >>> Thanks and best regards, >>> Gondim