From owner-freebsd-net@FreeBSD.ORG Fri Oct 7 19:24:46 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 085AE106566B for ; Fri, 7 Oct 2011 19:24:46 +0000 (UTC) (envelope-from lacombar@gmail.com) Received: from mail-wy0-f182.google.com (mail-wy0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 3B8548FC19 for ; Fri, 7 Oct 2011 19:24:44 +0000 (UTC) Received: by wyj26 with SMTP id 26so5807642wyj.13 for ; Fri, 07 Oct 2011 12:24:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=Uq+N+o4+6nks+ZjmPsljCdf99jRHQCV4m5LbZGZ5H4o=; b=Izu1nRixVmkENUm6g5WKoG8sPu2k4Scvkbk5SUDPznr6N2LGLbL/bODSVTWgkRVzd6 V+53rhWO9GfSUSdGBLf3wQbfhwgUY7bB+PyaoRrYiBN6DtvT5mBnZVLDovTuD7csQGp9 eXJr3K9CGQSsU2qA1TGN2gTJ8RTW9AzB05SJU= MIME-Version: 1.0 Received: by 10.227.195.13 with SMTP id ea13mr2822370wbb.36.1318015483601; Fri, 07 Oct 2011 12:24:43 -0700 (PDT) Received: by 10.180.103.33 with HTTP; Fri, 7 Oct 2011 12:24:43 -0700 (PDT) In-Reply-To: References: Date: Fri, 7 Oct 2011 15:24:43 -0400 Message-ID: From: Arnaud Lacombe To: Jason Wolfe Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org Subject: Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Oct 2011 19:24:46 -0000 Hi, On Fri, Oct 7, 2011 at 2:57 PM, Jason Wolfe wrote: > Jack, > > Entirely possible there are multiple moving pieces here, the only bit I k= now > for certain is it's related to the different operation when running with = MSI > vs MSI-X. Here is also my loader.conf for reference. I'm currently runnin= g > the modular congestion control stuff with cubic in use, but these issues > predate those changes also. Just to give you a scope of it though, it was > somewhat 'rare' for them to wedge. Out of a pool of ~2000 servers running > with the 82574L doing ~800Mb/s average, there were ~220 reports in a week= . > So with some fuzzy math to put it in the same terms you were talking in, = a > server in particular would hang about once every 9 weeks. > Just a two questions out of my mind: Are the failing server evenly distributed, or always the same are failing ? Did you collect the uptime and the kernel msgbuf of the server when the issue triggered ? Thanks, - Arnaud > net.inet.tcp.cc.available: cubic, newreno > net.inet.tcp.cc.algorithm: cubic > > loader.conf: > hw.pci.do_power_nodriver=3D"3" > net.link.ifqmaxlen=3D"1024" > net.inet.tcp.tcbhashsize=3D"4096" > net.inet.tcp.syncache.hashsize=3D"1024" > net.inet.tcp.syncache.bucketlimit=3D"512" > net.inet.tcp.syncache.cachelimit=3D"65536" > net.inet.tcp.hostcache.hashsize=3D"1024" > net.inet.tcp.hostcache.bucketlimit=3D"512" > net.inet.tcp.hostcache.cachelimit=3D"65536" > hw.em.enable_msix=3D"0" > hw.em.rxd=3D"2048" > hw.em.txd=3D"2048" > cc_cubic_load=3D"YES" > > Thanks again for looking into it. > > Jason > > On Thu, Oct 6, 2011 at 5:02 PM, Jack Vogel wrote: > >> There are plenty other users using the 574 with MSI-X without issue, so = its >> likely >> more complicated than just that 1 variable. The issue discussed was like >> last year, >> it has to do with getting stuck in low power state, and my driver has co= de >> that addresses >> that. There was rigorous testing done at the performance center in Canad= a, >> got to >> the point of having a hang once in maybe 3 weeks, and then that was fixe= d. >> I have >> not heard of a problem from Mike since. >> >> So, I'd say something else must be coming into play here, I'll stare at = the >> data >> a bit when I get a chance and see if anything jumps out at me. >> >> Jack >> >> >> On Thu, Oct 6, 2011 at 4:15 PM, Jason Wolfe wrote= : >> >>> I'm seeing the interface wedge on a good number of systems with Intel >>> 82574L >>> chips under FBSD8.2 _only when MSI-X is enabled_, running either 7.1.9 >>> from >>> 8.2-RELEASE or 7.2.3 from 8.2-STABLE. =A0I have em0 and em1 in a lagg, = but >>> only one side would fail, and a few systems that didn't have a lagg als= o >>> saw >>> the issue. =A0Higher traffic did seem to increase the likely hood of it >>> cropping up, but lower traffic server also showed the same issues >>> (anywhere >>> from 200Mb/s -> 1.8Gb/s). =A0This wedging on the Intel chips has been >>> discussed in many threads over the past year, though some have turned o= ut >>> to >>> be various other issues. =A0I haven't seen reports of it being fixed by >>> disabling MSI-X via loader.conf, hw.em.enable_msix=3D0, so I figured I'= d >>> start >>> a fresh one. >>> >>> The band aid for me was throwing a quick script into cron that watched = for >>> incrementing drops and static outgoing packet counts from netstat, then >>> just >>> bounced the interface with ifconfig down/up. =A0Prior to the bounce I h= ad it >>> emailing me the output of the following commands: >>> >>> vmstat -i >>> netstat -m >>> netstat -ndi >>> sysctl dev.em.X.debug=3D1 >>> sysctl net.inet.ip.intr_queue_maxlen net.inet.ip.intr_queue_drops dev.e= m >>> >>> I have ~300 reports from over the course of a week or so while I played >>> with >>> various bits before finding MSI-X to be the culprit. =A0These were all >>> collected about a month ago, but as I'm seeing now the increased latenc= y >>> with MSI-X disabled (as discussed in another thread) I'm more intereste= d >>> in >>> seeing we can tackle this. =A0I can bounce them over to anyone interest= ed. >>> Random one, follow by pciconf output: >>> >>> I bounced em1 because dropped packets incremented 3175498 to 3175688 an= d >>> the >>> interface is not incrementing packets out. >>> >>> interrupt total rate >>> irq3: uart1 94210 0 >>> cpu0: timer 8536176695 2000 >>> irq256: em0:rx 0 24657925778 5777 >>> irq257: em0:tx 0 18016438387 4221 >>> irq258: em0:link 1096 0 >>> irq259: em1:rx 0 49440830 11 >>> irq260: em1:tx 0 17831558454 4177 >>> irq261: em1:link 3 0 >>> irq262: mps0 971428418 227 >>> cpu1: timer 8536168686 2000 >>> cpu2: timer 8536168739 2000 >>> cpu3: timer 8536168715 2000 >>> Total 95671570011 22415 >>> >>> 43620/31830/75450 mbufs in use (current/cache/total) >>> 8457/1825/10282/6192924 mbuf clusters in use (current/cache/total/max) >>> 8457/1490 mbuf+clusters out of packet secondary zone in use >>> (current/cache) >>> 32620/3569/36189/3096461 4k (page size) jumbo clusters in use >>> (current/cache/total/max) >>> 0/0/0/6400 9k jumbo clusters in use (current/cache/total/max) >>> 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) >>> 158299K/25883K/184182K bytes allocated to network (current/cache/total) >>> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) >>> 0/0/0 requests for jumbo clusters denied (4k/9k/16k) >>> 0/0/0 sfbufs in use (current/peak/max) >>> 0 requests for sfbufs denied >>> 0 requests for sfbufs delayed >>> 0 requests for I/O initiated by sendfile >>> 0 calls to protocol drain routines >>> >>> Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop >>> em0 1500 00:25:90:2c:a8:c8 70347342717 2290 0 53256848932 0 0 >>> 1209615 >>> em0 1500 fe80:1::225:9 fe80:1::225:90ff: 0 - - 5 - - - >>> em1 1500 00:25:90:2c:a8:c8 49440879 0 0 50500079972 0 0 317605= 7 >>> em1 1500 fe80:2::225:9 fe80:2::225:90ff: 0 - - 2 - - - >>> lagg0 1500 00:25:90:2c:a8:c8 70396711726 0 0 103748441456 4385= 672 >>> 0 >>> 0 >>> lagg0 1500 117.121.249.0 117.121.249.76 46351366311 - - 103757765366 - = - - >>> lagg0 1500 fe80:5::225:9 fe80:5::225:90ff: 607 - - 674 - - - >>> lagg0 1500 2402:6800:730 2402:6800:730:12: 136847 - - 142450 - - - >>> >>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE >>> Aug 30 23:05:04 cds56 kernel: em0: hw tdh =3D 371, hw tdt =3D 376 >>> Aug 30 23:05:04 cds56 kernel: em0: hw rdh =3D 923, hw rdt =3D 922 >>> Aug 30 23:05:04 cds56 kernel: em0: Tx Queue Status =3D 0 >>> Aug 30 23:05:04 cds56 kernel: em0: TX descriptors avail =3D 1014 >>> Aug 30 23:05:04 cds56 kernel: em0: Tx Descriptors avail failure =3D 0 >>> Aug 30 23:05:04 cds56 kernel: em0: RX discarded packets =3D 0 >>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Check =3D 986 >>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Refresh =3D 994 >>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE >>> Aug 30 23:05:04 cds56 kernel: em1: hw tdh =3D 78, hw tdt =3D 78 >>> Aug 30 23:05:04 cds56 kernel: em1: hw rdh =3D 88, hw rdt =3D 87 >>> Aug 30 23:05:04 cds56 kernel: em1: Tx Queue Status =3D 0 >>> Aug 30 23:05:04 cds56 kernel: em1: TX descriptors avail =3D 1024 >>> Aug 30 23:05:04 cds56 kernel: em1: Tx Descriptors avail failure =3D 0 >>> Aug 30 23:05:04 cds56 kernel: em1: RX discarded packets =3D 0 >>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Check =3D 88 >>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Refresh =3D 88 >>> >>> net.inet.ip.intr_queue_maxlen: 512 >>> net.inet.ip.intr_queue_drops: 0 >>> dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9 >>> dev.em.0.%driver: em >>> dev.em.0.%location: slot=3D0 function=3D0 >>> dev.em.0.%pnpinfo: vendor=3D0x8086 device=3D0x10d3 subvendor=3D0x15d9 >>> subdevice=3D0x10d3 class=3D0x020000 >>> dev.em.0.%parent: pci1 >>> dev.em.0.nvm: -1 >>> dev.em.0.debug: -1 >>> dev.em.0.rx_int_delay: 0 >>> dev.em.0.tx_int_delay: 66 >>> dev.em.0.rx_abs_int_delay: 66 >>> dev.em.0.tx_abs_int_delay: 66 >>> dev.em.0.rx_processing_limit: 100 >>> dev.em.0.flow_control: 3 >>> dev.em.0.link_irq: 1096 >>> dev.em.0.mbuf_alloc_fail: 0 >>> dev.em.0.cluster_alloc_fail: 0 >>> dev.em.0.dropped: 0 >>> dev.em.0.tx_dma_fail: 0 >>> dev.em.0.rx_overruns: 0 >>> dev.em.0.watchdog_timeouts: 0 >>> dev.em.0.device_control: 1477444168 >>> dev.em.0.rx_control: 67141634 >>> dev.em.0.fc_high_water: 18432 >>> dev.em.0.fc_low_water: 16932 >>> dev.em.0.queue0.txd_head: 923 >>> dev.em.0.queue0.txd_tail: 923 >>> dev.em.0.queue0.tx_irq: 18016443069 >>> dev.em.0.queue0.no_desc_avail: 0 >>> dev.em.0.queue0.rxd_head: 620 >>> dev.em.0.queue0.rxd_tail: 619 >>> dev.em.0.queue0.rx_irq: 24617484192 >>> dev.em.0.mac_stats.excess_coll: 0 >>> dev.em.0.mac_stats.single_coll: 0 >>> dev.em.0.mac_stats.multiple_coll: 0 >>> dev.em.0.mac_stats.late_coll: 0 >>> dev.em.0.mac_stats.collision_count: 0 >>> dev.em.0.mac_stats.symbol_errors: 0 >>> dev.em.0.mac_stats.sequence_errors: 0 >>> dev.em.0.mac_stats.defer_count: 0 >>> dev.em.0.mac_stats.missed_packets: 2290 >>> dev.em.0.mac_stats.recv_no_buff: 2063 >>> dev.em.0.mac_stats.recv_undersize: 0 >>> dev.em.0.mac_stats.recv_fragmented: 0 >>> dev.em.0.mac_stats.recv_oversize: 0 >>> dev.em.0.mac_stats.recv_jabber: 0 >>> dev.em.0.mac_stats.recv_errs: 0 >>> dev.em.0.mac_stats.crc_errs: 0 >>> dev.em.0.mac_stats.alignment_errs: 0 >>> dev.em.0.mac_stats.coll_ext_errs: 0 >>> dev.em.0.mac_stats.xon_recvd: 0 >>> dev.em.0.mac_stats.xon_txd: 34 >>> dev.em.0.mac_stats.xoff_recvd: 0 >>> dev.em.0.mac_stats.xoff_txd: 2281 >>> dev.em.0.mac_stats.total_pkts_recvd: 70347571042 >>> dev.em.0.mac_stats.good_pkts_recvd: 70347568752 >>> dev.em.0.mac_stats.bcast_pkts_recvd: 49354826 >>> dev.em.0.mac_stats.mcast_pkts_recvd: 21430 >>> dev.em.0.mac_stats.rx_frames_64: 24097227332 >>> dev.em.0.mac_stats.rx_frames_65_127: 26282000524 >>> dev.em.0.mac_stats.rx_frames_128_255: 117491895 >>> dev.em.0.mac_stats.rx_frames_256_511: 397131263 >>> dev.em.0.mac_stats.rx_frames_512_1023: 1048868288 >>> dev.em.0.mac_stats.rx_frames_1024_1522: 18404849450 >>> dev.em.0.mac_stats.good_octets_recvd: 32288605684532 >>> dev.em.0.mac_stats.good_octets_txd: 59508100377248 >>> dev.em.0.mac_stats.total_pkts_txd: 53257111032 >>> dev.em.0.mac_stats.good_pkts_txd: 53257108716 >>> dev.em.0.mac_stats.bcast_pkts_txd: 21098 >>> dev.em.0.mac_stats.mcast_pkts_txd: 28465 >>> dev.em.0.mac_stats.tx_frames_64: 1243827849 >>> dev.em.0.mac_stats.tx_frames_65_127: 12126816593 >>> dev.em.0.mac_stats.tx_frames_128_255: 260192405 >>> dev.em.0.mac_stats.tx_frames_256_511: 196901153 >>> dev.em.0.mac_stats.tx_frames_512_1023: 565384449 >>> dev.em.0.mac_stats.tx_frames_1024_1522: 38863986268 >>> dev.em.0.mac_stats.tso_txd: 0 >>> dev.em.0.mac_stats.tso_ctx_fail: 0 >>> dev.em.0.interrupts.asserts: 571 >>> dev.em.0.interrupts.rx_pkt_timer: 0 >>> dev.em.0.interrupts.rx_abs_timer: 0 >>> dev.em.0.interrupts.tx_pkt_timer: 0 >>> dev.em.0.interrupts.tx_abs_timer: 0 >>> dev.em.0.interrupts.tx_queue_empty: 0 >>> dev.em.0.interrupts.tx_queue_min_thresh: 0 >>> dev.em.0.interrupts.rx_desc_min_thresh: 0 >>> dev.em.0.interrupts.rx_overrun: 0 >>> dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.1.9 >>> dev.em.1.%driver: em >>> dev.em.1.%location: slot=3D0 function=3D0 >>> dev.em.1.%pnpinfo: vendor=3D0x8086 device=3D0x10d3 subvendor=3D0x15d9 >>> subdevice=3D0x10d3 class=3D0x020000 >>> dev.em.1.%parent: pci2 >>> dev.em.1.nvm: -1 >>> dev.em.1.debug: -1 >>> dev.em.1.rx_int_delay: 0 >>> dev.em.1.tx_int_delay: 66 >>> dev.em.1.rx_abs_int_delay: 66 >>> dev.em.1.tx_abs_int_delay: 66 >>> dev.em.1.rx_processing_limit: 100 >>> dev.em.1.flow_control: 3 >>> dev.em.1.link_irq: 3 >>> dev.em.1.mbuf_alloc_fail: 0 >>> dev.em.1.cluster_alloc_fail: 0 >>> dev.em.1.dropped: 0 >>> dev.em.1.tx_dma_fail: 0 >>> dev.em.1.rx_overruns: 0 >>> dev.em.1.watchdog_timeouts: 0 >>> dev.em.1.device_control: 1477444168 >>> dev.em.1.rx_control: 67141634 >>> dev.em.1.fc_high_water: 18432 >>> dev.em.1.fc_low_water: 16932 >>> dev.em.1.queue0.txd_head: 78 >>> dev.em.1.queue0.txd_tail: 78 >>> dev.em.1.queue0.tx_irq: 17831483878 >>> dev.em.1.queue0.no_desc_avail: 0 >>> dev.em.1.queue0.rxd_head: 104 >>> dev.em.1.queue0.rxd_tail: 103 >>> dev.em.1.queue0.rx_irq: 49440805 >>> dev.em.1.mac_stats.excess_coll: 0 >>> dev.em.1.mac_stats.single_coll: 0 >>> dev.em.1.mac_stats.multiple_coll: 0 >>> dev.em.1.mac_stats.late_coll: 0 >>> dev.em.1.mac_stats.collision_count: 0 >>> dev.em.1.mac_stats.symbol_errors: 0 >>> dev.em.1.mac_stats.sequence_errors: 0 >>> dev.em.1.mac_stats.defer_count: 0 >>> dev.em.1.mac_stats.missed_packets: 0 >>> dev.em.1.mac_stats.recv_no_buff: 0 >>> dev.em.1.mac_stats.recv_undersize: 0 >>> dev.em.1.mac_stats.recv_fragmented: 0 >>> dev.em.1.mac_stats.recv_oversize: 0 >>> dev.em.1.mac_stats.recv_jabber: 0 >>> dev.em.1.mac_stats.recv_errs: 0 >>> dev.em.1.mac_stats.crc_errs: 0 >>> dev.em.1.mac_stats.alignment_errs: 0 >>> dev.em.1.mac_stats.coll_ext_errs: 0 >>> dev.em.1.mac_stats.xon_recvd: 0 >>> dev.em.1.mac_stats.xon_txd: 0 >>> dev.em.1.mac_stats.xoff_recvd: 0 >>> dev.em.1.mac_stats.xoff_txd: 0 >>> dev.em.1.mac_stats.total_pkts_recvd: 49440891 >>> dev.em.1.mac_stats.good_pkts_recvd: 49440891 >>> dev.em.1.mac_stats.bcast_pkts_recvd: 49419308 >>> dev.em.1.mac_stats.mcast_pkts_recvd: 21444 >>> dev.em.1.mac_stats.rx_frames_64: 49419319 >>> dev.em.1.mac_stats.rx_frames_65_127: 21536 >>> dev.em.1.mac_stats.rx_frames_128_255: 1 >>> dev.em.1.mac_stats.rx_frames_256_511: 11 >>> dev.em.1.mac_stats.rx_frames_512_1023: 13 >>> dev.em.1.mac_stats.rx_frames_1024_1522: 11 >>> dev.em.1.mac_stats.good_octets_recvd: 3165480294 >>> dev.em.1.mac_stats.good_octets_txd: 58735098276348 >>> dev.em.1.mac_stats.total_pkts_txd: 50500079972 >>> dev.em.1.mac_stats.good_pkts_txd: 50500079972 >>> dev.em.1.mac_stats.bcast_pkts_txd: 0 >>> dev.em.1.mac_stats.mcast_pkts_txd: 5 >>> dev.em.1.mac_stats.tx_frames_64: 1267032327 >>> dev.em.1.mac_stats.tx_frames_65_127: 9722353368 >>> dev.em.1.mac_stats.tx_frames_128_255: 265847363 >>> dev.em.1.mac_stats.tx_frames_256_511: 198177596 >>> dev.em.1.mac_stats.tx_frames_512_1023: 568826323 >>> dev.em.1.mac_stats.tx_frames_1024_1522: 38477842995 >>> dev.em.1.mac_stats.tso_txd: 0 >>> dev.em.1.mac_stats.tso_ctx_fail: 0 >>> dev.em.1.interrupts.asserts: 4 >>> dev.em.1.interrupts.rx_pkt_timer: 0 >>> dev.em.1.interrupts.rx_abs_timer: 0 >>> dev.em.1.interrupts.tx_pkt_timer: 0 >>> dev.em.1.interrupts.tx_abs_timer: 0 >>> dev.em.1.interrupts.tx_queue_empty: 0 >>> dev.em.1.interrupts.tx_queue_min_thresh: 0 >>> dev.em.1.interrupts.rx_desc_min_thresh: 0 >>> dev.em.1.interrupts.rx_overrun: 0 >>> >>> hostb0@pci0:0:0:0: class=3D0x060000 card=3D0x00008086 chip=3D0x34068086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub to ESI Port' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> pcib1@pci0:0:1:0: class=3D0x060400 card=3D0x00008086 chip=3D0x34088086 = rev=3D0x22 >>> hdr=3D0x01 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 1' >>> class =3D bridge >>> subclass =3D PCI-PCI >>> pcib2@pci0:0:2:0: class=3D0x060400 card=3D0x00008086 chip=3D0x34098086 = rev=3D0x22 >>> hdr=3D0x01 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 2' >>> class =3D bridge >>> subclass =3D PCI-PCI >>> pcib3@pci0:0:3:0: class=3D0x060400 card=3D0x00008086 chip=3D0x340a8086 = rev=3D0x22 >>> hdr=3D0x01 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 3' >>> class =3D bridge >>> subclass =3D PCI-PCI >>> pcib4@pci0:0:5:0: class=3D0x060400 card=3D0x00008086 chip=3D0x340c8086 = rev=3D0x22 >>> hdr=3D0x01 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 5' >>> class =3D bridge >>> subclass =3D PCI-PCI >>> pcib5@pci0:0:7:0: class=3D0x060400 card=3D0x00008086 chip=3D0x340e8086 = rev=3D0x22 >>> hdr=3D0x01 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 7' >>> class =3D bridge >>> subclass =3D PCI-PCI >>> ioapic0@pci0:0:19:0: class=3D0x080020 card=3D0x00000000 chip=3D0x342d80= 86 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub I/OxAPIC Interrupt Controlle= r' >>> class =3D base peripheral >>> subclass =3D interrupt controller >>> bar [10] =3D type Memory, range 32, base 0xfec8a000, size 4096, enabled >>> none0@pci0:0:20:0: class=3D0x080000 card=3D0x00000000 chip=3D0x342e8086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub System Management Registers' >>> class =3D base peripheral >>> subclass =3D interrupt controller >>> none1@pci0:0:20:1: class=3D0x080000 card=3D0x00000000 chip=3D0x34228086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub GPIO and Scratch Pad Registe= rs' >>> class =3D base peripheral >>> subclass =3D interrupt controller >>> none2@pci0:0:20:2: class=3D0x080000 card=3D0x00000000 chip=3D0x34238086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub Control Status and RAS Regis= ters' >>> class =3D base peripheral >>> subclass =3D interrupt controller >>> none3@pci0:0:20:3: class=3D0x080000 card=3D0x00000000 chip=3D0x34388086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'QuickPath Architecture I/O Hub Throttle Registers' >>> class =3D base peripheral >>> subclass =3D interrupt controller >>> none4@pci0:0:22:0: class=3D0x088000 card=3D0x000715d9 chip=3D0x34308086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbed8000, size 16384, enable= d >>> none5@pci0:0:22:1: class=3D0x088000 card=3D0x000715d9 chip=3D0x34318086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbedc000, size 16384, enable= d >>> none6@pci0:0:22:2: class=3D0x088000 card=3D0x000715d9 chip=3D0x34328086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbee0000, size 16384, enable= d >>> none7@pci0:0:22:3: class=3D0x088000 card=3D0x000715d9 chip=3D0x34338086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbee4000, size 16384, enable= d >>> none8@pci0:0:22:4: class=3D0x088000 card=3D0x000715d9 chip=3D0x34298086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbee8000, size 16384, enable= d >>> none9@pci0:0:22:5: class=3D0x088000 card=3D0x000715d9 chip=3D0x342a8086 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbeec000, size 16384, enable= d >>> none10@pci0:0:22:6: class=3D0x088000 card=3D0x000715d9 chip=3D0x342b808= 6 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbef0000, size 16384, enable= d >>> none11@pci0:0:22:7: class=3D0x088000 card=3D0x000715d9 chip=3D0x342c808= 6 >>> rev=3D0x22 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'DMA Engine' >>> class =3D base peripheral >>> bar [10] =3D type Memory, range 64, base 0xfbef4000, size 16384, enable= d >>> none12@pci0:0:26:0: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a37808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB UHCI Controller *4' >>> class =3D serial bus >>> subclass =3D USB >>> none13@pci0:0:26:1: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a38808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB UHCI Controller *5' >>> class =3D serial bus >>> subclass =3D USB >>> none14@pci0:0:26:2: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a39808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB UHCI Controller *6' >>> class =3D serial bus >>> subclass =3D USB >>> none15@pci0:0:26:7: class=3D0x0c0320 card=3D0x000715d9 chip=3D0x3a3c808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB EHCI Controller *2' >>> class =3D serial bus >>> subclass =3D USB >>> none16@pci0:0:29:0: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a34808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB UHCI Controller *1' >>> class =3D serial bus >>> subclass =3D USB >>> none17@pci0:0:29:1: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a35808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB UHCI Controller *2' >>> class =3D serial bus >>> subclass =3D USB >>> none18@pci0:0:29:2: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a36808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB UHCI Controller *3' >>> class =3D serial bus >>> subclass =3D USB >>> none19@pci0:0:29:7: class=3D0x0c0320 card=3D0x000715d9 chip=3D0x3a3a808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'USB EHCI Controller *1' >>> class =3D serial bus >>> subclass =3D USB >>> pcib6@pci0:0:30:0: class=3D0x060401 card=3D0x000715d9 chip=3D0x244e8086 >>> rev=3D0x90 >>> hdr=3D0x01 >>> vendor =3D 'Intel Corporation' >>> device =3D '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface to = PCI >>> Bridge' >>> class =3D bridge >>> subclass =3D PCI-PCI >>> isab0@pci0:0:31:0: class=3D0x060100 card=3D0x000715d9 chip=3D0x3a188086 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'LPC Interface Controller' >>> class =3D bridge >>> subclass =3D PCI-ISA >>> atapci0@pci0:0:31:2: class=3D0x01018f card=3D0x000715d9 chip=3D0x3a2080= 86 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'SATA2(4Port2) (ICH10 Family)' >>> class =3D mass storage >>> subclass =3D ATA >>> bar [10] =3D type I/O Port, range 32, base 0xbc00, size 8, enabled >>> bar [14] =3D type I/O Port, range 32, base 0xb880, size 4, enabled >>> bar [18] =3D type I/O Port, range 32, base 0xb800, size 8, enabled >>> bar [1c] =3D type I/O Port, range 32, base 0xb480, size 4, enabled >>> bar [20] =3D type I/O Port, range 32, base 0xb400, size 16, enabled >>> bar [24] =3D type I/O Port, range 32, base 0xb080, size 16, enabled >>> none20@pci0:0:31:3: class=3D0x0c0500 card=3D0x000715d9 chip=3D0x3a30808= 6 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'SMB controller (50011458)' >>> class =3D serial bus >>> subclass =3D SMBus >>> bar [10] =3D type Memory, range 64, base 0xfbefa000, size 256, enabled >>> bar [20] =3D type I/O Port, range 32, base 0x400, size 32, enabled >>> atapci1@pci0:0:31:5: class=3D0x010185 card=3D0x000715d9 chip=3D0x3a2680= 86 >>> rev=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'SATA2(2Port2) (ICH10 Family)' >>> class =3D mass storage >>> subclass =3D ATA >>> bar [10] =3D type I/O Port, range 32, base 0xac00, size 8, enabled >>> bar [14] =3D type I/O Port, range 32, base 0xa880, size 4, enabled >>> bar [18] =3D type I/O Port, range 32, base 0xa800, size 8, enabled >>> bar [1c] =3D type I/O Port, range 32, base 0xa480, size 4, enabled >>> bar [20] =3D type I/O Port, range 32, base 0xa400, size 16, enabled >>> bar [24] =3D type I/O Port, range 32, base 0xa080, size 16, enabled >>> em0@pci0:1:0:0: class=3D0x020000 card=3D0x10d315d9 chip=3D0x10d38086 re= v=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'Intel 82574L Gigabit Ethernet Controller (82574L)' >>> class =3D network >>> subclass =3D ethernet >>> bar [10] =3D type Memory, range 32, base 0xfbbe0000, size 131072, enabl= ed >>> bar [18] =3D type I/O Port, range 32, base 0xcc00, size 32, enabled >>> bar [1c] =3D type Memory, range 32, base 0xfbbdc000, size 16384, enable= d >>> em1@pci0:2:0:0: class=3D0x020000 card=3D0x10d315d9 chip=3D0x10d38086 re= v=3D0x00 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> device =3D 'Intel 82574L Gigabit Ethernet Controller (82574L)' >>> class =3D network >>> subclass =3D ethernet >>> bar [10] =3D type Memory, range 32, base 0xfbce0000, size 131072, enabl= ed >>> bar [18] =3D type I/O Port, range 32, base 0xdc00, size 32, enabled >>> bar [1c] =3D type Memory, range 32, base 0xfbcdc000, size 16384, enable= d >>> mps0@pci0:4:0:0: class=3D0x010700 card=3D0x040015d9 chip=3D0x00721000 r= ev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'LSI Logic (Was: Symbios Logic, NCR)' >>> class =3D mass storage >>> subclass =3D SAS >>> bar [10] =3D type I/O Port, range 32, base 0xe000, size 256, enabled >>> bar [14] =3D type Memory, range 64, base 0xfbd3c000, size 16384, enable= d >>> bar [1c] =3D type Memory, range 64, base 0xfbd40000, size 262144, enabl= ed >>> vgapci0@pci0:6:1:0: class=3D0x030000 card=3D0x000715d9 chip=3D0x0532102= b >>> rev=3D0x0a >>> hdr=3D0x00 >>> vendor =3D 'Matrox Electronic Systems Ltd.' >>> class =3D display >>> subclass =3D VGA >>> bar [10] =3D type Prefetchable Memory, range 32, base 0xf9000000, size >>> 16777216, enabled >>> bar [14] =3D type Memory, range 32, base 0xfaffc000, size 16384, enable= d >>> bar [18] =3D type Memory, range 32, base 0xfb000000, size 8388608, enab= led >>> hostb1@pci0:255:0:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2c7080= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb2@pci0:255:0:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2d8180= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb3@pci0:255:2:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9080= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb4@pci0:255:2:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9180= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb5@pci0:255:2:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9280= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb6@pci0:255:2:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9380= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb7@pci0:255:2:4: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9480= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb8@pci0:255:2:5: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9580= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb9@pci0:255:3:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9880= 86 >>> rev=3D0x02 >>> hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb10@pci0:255:3:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2d998= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb11@pci0:255:3:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9a8= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb12@pci0:255:3:4: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9c8= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb13@pci0:255:4:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2da08= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb14@pci0:255:4:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2da18= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb15@pci0:255:4:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2da28= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb16@pci0:255:4:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2da38= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb17@pci0:255:5:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2da88= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb18@pci0:255:5:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2da98= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb19@pci0:255:5:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2daa8= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb20@pci0:255:5:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2dab8= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb21@pci0:255:6:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2db08= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb22@pci0:255:6:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2db18= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb23@pci0:255:6:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2db28= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> hostb24@pci0:255:6:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2db38= 086 >>> rev=3D0x02 hdr=3D0x00 >>> vendor =3D 'Intel Corporation' >>> class =3D bridge >>> subclass =3D HOST-PCI >>> >>> Thank you in advance sirs! >>> Jason Wolfe >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >>> >> >> > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >