From owner-freebsd-net@FreeBSD.ORG Fri Oct 7 18:57:34 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E99691065676 for ; Fri, 7 Oct 2011 18:57:34 +0000 (UTC) (envelope-from nitroboost@gmail.com) Received: from mail-bw0-f54.google.com (mail-bw0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id 1A2238FC13 for ; Fri, 7 Oct 2011 18:57:33 +0000 (UTC) Received: by bkbzs8 with SMTP id zs8so6063633bkb.13 for ; Fri, 07 Oct 2011 11:57:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=bBQTVpyAWQiMsXB6KvAsRrJ2ZLpFFqv8JGta9wTk1G4=; b=j4klhWE8id+cgvzAvVj+FNYXkO29XMELWXo4qlo/Oj8RxnxnlcGCEAg5pP3abpkjve tWHptXnQfqeWzpjOZGDdOWjOMyDYy3x8oLJTi3LMl5a8owidpQTreaIdWxbxP/eW/APn aSOmIqNcRUSOMbV8u8l0ZeSEWhPzUogS/ALLc= MIME-Version: 1.0 Received: by 10.223.58.83 with SMTP id f19mr12479986fah.36.1318013852152; Fri, 07 Oct 2011 11:57:32 -0700 (PDT) Received: by 10.152.36.102 with HTTP; Fri, 7 Oct 2011 11:57:32 -0700 (PDT) In-Reply-To: References: Date: Fri, 7 Oct 2011 11:57:32 -0700 Message-ID: From: Jason Wolfe To: freebsd-net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Oct 2011 18:57:35 -0000 Jack, Entirely possible there are multiple moving pieces here, the only bit I know for certain is it's related to the different operation when running with MSI vs MSI-X. Here is also my loader.conf for reference. I'm currently running the modular congestion control stuff with cubic in use, but these issues predate those changes also. Just to give you a scope of it though, it was somewhat 'rare' for them to wedge. Out of a pool of ~2000 servers running with the 82574L doing ~800Mb/s average, there were ~220 reports in a week. So with some fuzzy math to put it in the same terms you were talking in, a server in particular would hang about once every 9 weeks. net.inet.tcp.cc.available: cubic, newreno net.inet.tcp.cc.algorithm: cubic loader.conf: hw.pci.do_power_nodriver="3" net.link.ifqmaxlen="1024" net.inet.tcp.tcbhashsize="4096" net.inet.tcp.syncache.hashsize="1024" net.inet.tcp.syncache.bucketlimit="512" net.inet.tcp.syncache.cachelimit="65536" net.inet.tcp.hostcache.hashsize="1024" net.inet.tcp.hostcache.bucketlimit="512" net.inet.tcp.hostcache.cachelimit="65536" hw.em.enable_msix="0" hw.em.rxd="2048" hw.em.txd="2048" cc_cubic_load="YES" Thanks again for looking into it. Jason On Thu, Oct 6, 2011 at 5:02 PM, Jack Vogel wrote: > There are plenty other users using the 574 with MSI-X without issue, so its > likely > more complicated than just that 1 variable. The issue discussed was like > last year, > it has to do with getting stuck in low power state, and my driver has code > that addresses > that. There was rigorous testing done at the performance center in Canada, > got to > the point of having a hang once in maybe 3 weeks, and then that was fixed. > I have > not heard of a problem from Mike since. > > So, I'd say something else must be coming into play here, I'll stare at the > data > a bit when I get a chance and see if anything jumps out at me. > > Jack > > > On Thu, Oct 6, 2011 at 4:15 PM, Jason Wolfe wrote: > >> I'm seeing the interface wedge on a good number of systems with Intel >> 82574L >> chips under FBSD8.2 _only when MSI-X is enabled_, running either 7.1.9 >> from >> 8.2-RELEASE or 7.2.3 from 8.2-STABLE. I have em0 and em1 in a lagg, but >> only one side would fail, and a few systems that didn't have a lagg also >> saw >> the issue. Higher traffic did seem to increase the likely hood of it >> cropping up, but lower traffic server also showed the same issues >> (anywhere >> from 200Mb/s -> 1.8Gb/s). This wedging on the Intel chips has been >> discussed in many threads over the past year, though some have turned out >> to >> be various other issues. I haven't seen reports of it being fixed by >> disabling MSI-X via loader.conf, hw.em.enable_msix=0, so I figured I'd >> start >> a fresh one. >> >> The band aid for me was throwing a quick script into cron that watched for >> incrementing drops and static outgoing packet counts from netstat, then >> just >> bounced the interface with ifconfig down/up. Prior to the bounce I had it >> emailing me the output of the following commands: >> >> vmstat -i >> netstat -m >> netstat -ndi >> sysctl dev.em.X.debug=1 >> sysctl net.inet.ip.intr_queue_maxlen net.inet.ip.intr_queue_drops dev.em >> >> I have ~300 reports from over the course of a week or so while I played >> with >> various bits before finding MSI-X to be the culprit. These were all >> collected about a month ago, but as I'm seeing now the increased latency >> with MSI-X disabled (as discussed in another thread) I'm more interested >> in >> seeing we can tackle this. I can bounce them over to anyone interested. >> Random one, follow by pciconf output: >> >> I bounced em1 because dropped packets incremented 3175498 to 3175688 and >> the >> interface is not incrementing packets out. >> >> interrupt total rate >> irq3: uart1 94210 0 >> cpu0: timer 8536176695 2000 >> irq256: em0:rx 0 24657925778 5777 >> irq257: em0:tx 0 18016438387 4221 >> irq258: em0:link 1096 0 >> irq259: em1:rx 0 49440830 11 >> irq260: em1:tx 0 17831558454 4177 >> irq261: em1:link 3 0 >> irq262: mps0 971428418 227 >> cpu1: timer 8536168686 2000 >> cpu2: timer 8536168739 2000 >> cpu3: timer 8536168715 2000 >> Total 95671570011 22415 >> >> 43620/31830/75450 mbufs in use (current/cache/total) >> 8457/1825/10282/6192924 mbuf clusters in use (current/cache/total/max) >> 8457/1490 mbuf+clusters out of packet secondary zone in use >> (current/cache) >> 32620/3569/36189/3096461 4k (page size) jumbo clusters in use >> (current/cache/total/max) >> 0/0/0/6400 9k jumbo clusters in use (current/cache/total/max) >> 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) >> 158299K/25883K/184182K bytes allocated to network (current/cache/total) >> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) >> 0/0/0 requests for jumbo clusters denied (4k/9k/16k) >> 0/0/0 sfbufs in use (current/peak/max) >> 0 requests for sfbufs denied >> 0 requests for sfbufs delayed >> 0 requests for I/O initiated by sendfile >> 0 calls to protocol drain routines >> >> Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop >> em0 1500 00:25:90:2c:a8:c8 70347342717 2290 0 53256848932 0 0 >> 1209615 >> em0 1500 fe80:1::225:9 fe80:1::225:90ff: 0 - - 5 - - - >> em1 1500 00:25:90:2c:a8:c8 49440879 0 0 50500079972 0 0 3176057 >> em1 1500 fe80:2::225:9 fe80:2::225:90ff: 0 - - 2 - - - >> lagg0 1500 00:25:90:2c:a8:c8 70396711726 0 0 103748441456 4385672 >> 0 >> 0 >> lagg0 1500 117.121.249.0 117.121.249.76 46351366311 - - 103757765366 - - - >> lagg0 1500 fe80:5::225:9 fe80:5::225:90ff: 607 - - 674 - - - >> lagg0 1500 2402:6800:730 2402:6800:730:12: 136847 - - 142450 - - - >> >> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE >> Aug 30 23:05:04 cds56 kernel: em0: hw tdh = 371, hw tdt = 376 >> Aug 30 23:05:04 cds56 kernel: em0: hw rdh = 923, hw rdt = 922 >> Aug 30 23:05:04 cds56 kernel: em0: Tx Queue Status = 0 >> Aug 30 23:05:04 cds56 kernel: em0: TX descriptors avail = 1014 >> Aug 30 23:05:04 cds56 kernel: em0: Tx Descriptors avail failure = 0 >> Aug 30 23:05:04 cds56 kernel: em0: RX discarded packets = 0 >> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Check = 986 >> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Refresh = 994 >> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE >> Aug 30 23:05:04 cds56 kernel: em1: hw tdh = 78, hw tdt = 78 >> Aug 30 23:05:04 cds56 kernel: em1: hw rdh = 88, hw rdt = 87 >> Aug 30 23:05:04 cds56 kernel: em1: Tx Queue Status = 0 >> Aug 30 23:05:04 cds56 kernel: em1: TX descriptors avail = 1024 >> Aug 30 23:05:04 cds56 kernel: em1: Tx Descriptors avail failure = 0 >> Aug 30 23:05:04 cds56 kernel: em1: RX discarded packets = 0 >> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Check = 88 >> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Refresh = 88 >> >> net.inet.ip.intr_queue_maxlen: 512 >> net.inet.ip.intr_queue_drops: 0 >> dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9 >> dev.em.0.%driver: em >> dev.em.0.%location: slot=0 function=0 >> dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x15d9 >> subdevice=0x10d3 class=0x020000 >> dev.em.0.%parent: pci1 >> dev.em.0.nvm: -1 >> dev.em.0.debug: -1 >> dev.em.0.rx_int_delay: 0 >> dev.em.0.tx_int_delay: 66 >> dev.em.0.rx_abs_int_delay: 66 >> dev.em.0.tx_abs_int_delay: 66 >> dev.em.0.rx_processing_limit: 100 >> dev.em.0.flow_control: 3 >> dev.em.0.link_irq: 1096 >> dev.em.0.mbuf_alloc_fail: 0 >> dev.em.0.cluster_alloc_fail: 0 >> dev.em.0.dropped: 0 >> dev.em.0.tx_dma_fail: 0 >> dev.em.0.rx_overruns: 0 >> dev.em.0.watchdog_timeouts: 0 >> dev.em.0.device_control: 1477444168 >> dev.em.0.rx_control: 67141634 >> dev.em.0.fc_high_water: 18432 >> dev.em.0.fc_low_water: 16932 >> dev.em.0.queue0.txd_head: 923 >> dev.em.0.queue0.txd_tail: 923 >> dev.em.0.queue0.tx_irq: 18016443069 >> dev.em.0.queue0.no_desc_avail: 0 >> dev.em.0.queue0.rxd_head: 620 >> dev.em.0.queue0.rxd_tail: 619 >> dev.em.0.queue0.rx_irq: 24617484192 >> dev.em.0.mac_stats.excess_coll: 0 >> dev.em.0.mac_stats.single_coll: 0 >> dev.em.0.mac_stats.multiple_coll: 0 >> dev.em.0.mac_stats.late_coll: 0 >> dev.em.0.mac_stats.collision_count: 0 >> dev.em.0.mac_stats.symbol_errors: 0 >> dev.em.0.mac_stats.sequence_errors: 0 >> dev.em.0.mac_stats.defer_count: 0 >> dev.em.0.mac_stats.missed_packets: 2290 >> dev.em.0.mac_stats.recv_no_buff: 2063 >> dev.em.0.mac_stats.recv_undersize: 0 >> dev.em.0.mac_stats.recv_fragmented: 0 >> dev.em.0.mac_stats.recv_oversize: 0 >> dev.em.0.mac_stats.recv_jabber: 0 >> dev.em.0.mac_stats.recv_errs: 0 >> dev.em.0.mac_stats.crc_errs: 0 >> dev.em.0.mac_stats.alignment_errs: 0 >> dev.em.0.mac_stats.coll_ext_errs: 0 >> dev.em.0.mac_stats.xon_recvd: 0 >> dev.em.0.mac_stats.xon_txd: 34 >> dev.em.0.mac_stats.xoff_recvd: 0 >> dev.em.0.mac_stats.xoff_txd: 2281 >> dev.em.0.mac_stats.total_pkts_recvd: 70347571042 >> dev.em.0.mac_stats.good_pkts_recvd: 70347568752 >> dev.em.0.mac_stats.bcast_pkts_recvd: 49354826 >> dev.em.0.mac_stats.mcast_pkts_recvd: 21430 >> dev.em.0.mac_stats.rx_frames_64: 24097227332 >> dev.em.0.mac_stats.rx_frames_65_127: 26282000524 >> dev.em.0.mac_stats.rx_frames_128_255: 117491895 >> dev.em.0.mac_stats.rx_frames_256_511: 397131263 >> dev.em.0.mac_stats.rx_frames_512_1023: 1048868288 >> dev.em.0.mac_stats.rx_frames_1024_1522: 18404849450 >> dev.em.0.mac_stats.good_octets_recvd: 32288605684532 >> dev.em.0.mac_stats.good_octets_txd: 59508100377248 >> dev.em.0.mac_stats.total_pkts_txd: 53257111032 >> dev.em.0.mac_stats.good_pkts_txd: 53257108716 >> dev.em.0.mac_stats.bcast_pkts_txd: 21098 >> dev.em.0.mac_stats.mcast_pkts_txd: 28465 >> dev.em.0.mac_stats.tx_frames_64: 1243827849 >> dev.em.0.mac_stats.tx_frames_65_127: 12126816593 >> dev.em.0.mac_stats.tx_frames_128_255: 260192405 >> dev.em.0.mac_stats.tx_frames_256_511: 196901153 >> dev.em.0.mac_stats.tx_frames_512_1023: 565384449 >> dev.em.0.mac_stats.tx_frames_1024_1522: 38863986268 >> dev.em.0.mac_stats.tso_txd: 0 >> dev.em.0.mac_stats.tso_ctx_fail: 0 >> dev.em.0.interrupts.asserts: 571 >> dev.em.0.interrupts.rx_pkt_timer: 0 >> dev.em.0.interrupts.rx_abs_timer: 0 >> dev.em.0.interrupts.tx_pkt_timer: 0 >> dev.em.0.interrupts.tx_abs_timer: 0 >> dev.em.0.interrupts.tx_queue_empty: 0 >> dev.em.0.interrupts.tx_queue_min_thresh: 0 >> dev.em.0.interrupts.rx_desc_min_thresh: 0 >> dev.em.0.interrupts.rx_overrun: 0 >> dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.1.9 >> dev.em.1.%driver: em >> dev.em.1.%location: slot=0 function=0 >> dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x15d9 >> subdevice=0x10d3 class=0x020000 >> dev.em.1.%parent: pci2 >> dev.em.1.nvm: -1 >> dev.em.1.debug: -1 >> dev.em.1.rx_int_delay: 0 >> dev.em.1.tx_int_delay: 66 >> dev.em.1.rx_abs_int_delay: 66 >> dev.em.1.tx_abs_int_delay: 66 >> dev.em.1.rx_processing_limit: 100 >> dev.em.1.flow_control: 3 >> dev.em.1.link_irq: 3 >> dev.em.1.mbuf_alloc_fail: 0 >> dev.em.1.cluster_alloc_fail: 0 >> dev.em.1.dropped: 0 >> dev.em.1.tx_dma_fail: 0 >> dev.em.1.rx_overruns: 0 >> dev.em.1.watchdog_timeouts: 0 >> dev.em.1.device_control: 1477444168 >> dev.em.1.rx_control: 67141634 >> dev.em.1.fc_high_water: 18432 >> dev.em.1.fc_low_water: 16932 >> dev.em.1.queue0.txd_head: 78 >> dev.em.1.queue0.txd_tail: 78 >> dev.em.1.queue0.tx_irq: 17831483878 >> dev.em.1.queue0.no_desc_avail: 0 >> dev.em.1.queue0.rxd_head: 104 >> dev.em.1.queue0.rxd_tail: 103 >> dev.em.1.queue0.rx_irq: 49440805 >> dev.em.1.mac_stats.excess_coll: 0 >> dev.em.1.mac_stats.single_coll: 0 >> dev.em.1.mac_stats.multiple_coll: 0 >> dev.em.1.mac_stats.late_coll: 0 >> dev.em.1.mac_stats.collision_count: 0 >> dev.em.1.mac_stats.symbol_errors: 0 >> dev.em.1.mac_stats.sequence_errors: 0 >> dev.em.1.mac_stats.defer_count: 0 >> dev.em.1.mac_stats.missed_packets: 0 >> dev.em.1.mac_stats.recv_no_buff: 0 >> dev.em.1.mac_stats.recv_undersize: 0 >> dev.em.1.mac_stats.recv_fragmented: 0 >> dev.em.1.mac_stats.recv_oversize: 0 >> dev.em.1.mac_stats.recv_jabber: 0 >> dev.em.1.mac_stats.recv_errs: 0 >> dev.em.1.mac_stats.crc_errs: 0 >> dev.em.1.mac_stats.alignment_errs: 0 >> dev.em.1.mac_stats.coll_ext_errs: 0 >> dev.em.1.mac_stats.xon_recvd: 0 >> dev.em.1.mac_stats.xon_txd: 0 >> dev.em.1.mac_stats.xoff_recvd: 0 >> dev.em.1.mac_stats.xoff_txd: 0 >> dev.em.1.mac_stats.total_pkts_recvd: 49440891 >> dev.em.1.mac_stats.good_pkts_recvd: 49440891 >> dev.em.1.mac_stats.bcast_pkts_recvd: 49419308 >> dev.em.1.mac_stats.mcast_pkts_recvd: 21444 >> dev.em.1.mac_stats.rx_frames_64: 49419319 >> dev.em.1.mac_stats.rx_frames_65_127: 21536 >> dev.em.1.mac_stats.rx_frames_128_255: 1 >> dev.em.1.mac_stats.rx_frames_256_511: 11 >> dev.em.1.mac_stats.rx_frames_512_1023: 13 >> dev.em.1.mac_stats.rx_frames_1024_1522: 11 >> dev.em.1.mac_stats.good_octets_recvd: 3165480294 >> dev.em.1.mac_stats.good_octets_txd: 58735098276348 >> dev.em.1.mac_stats.total_pkts_txd: 50500079972 >> dev.em.1.mac_stats.good_pkts_txd: 50500079972 >> dev.em.1.mac_stats.bcast_pkts_txd: 0 >> dev.em.1.mac_stats.mcast_pkts_txd: 5 >> dev.em.1.mac_stats.tx_frames_64: 1267032327 >> dev.em.1.mac_stats.tx_frames_65_127: 9722353368 >> dev.em.1.mac_stats.tx_frames_128_255: 265847363 >> dev.em.1.mac_stats.tx_frames_256_511: 198177596 >> dev.em.1.mac_stats.tx_frames_512_1023: 568826323 >> dev.em.1.mac_stats.tx_frames_1024_1522: 38477842995 >> dev.em.1.mac_stats.tso_txd: 0 >> dev.em.1.mac_stats.tso_ctx_fail: 0 >> dev.em.1.interrupts.asserts: 4 >> dev.em.1.interrupts.rx_pkt_timer: 0 >> dev.em.1.interrupts.rx_abs_timer: 0 >> dev.em.1.interrupts.tx_pkt_timer: 0 >> dev.em.1.interrupts.tx_abs_timer: 0 >> dev.em.1.interrupts.tx_queue_empty: 0 >> dev.em.1.interrupts.tx_queue_min_thresh: 0 >> dev.em.1.interrupts.rx_desc_min_thresh: 0 >> dev.em.1.interrupts.rx_overrun: 0 >> >> hostb0@pci0:0:0:0: class=0x060000 card=0x00008086 chip=0x34068086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub to ESI Port' >> class = bridge >> subclass = HOST-PCI >> pcib1@pci0:0:1:0: class=0x060400 card=0x00008086 chip=0x34088086 rev=0x22 >> hdr=0x01 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 1' >> class = bridge >> subclass = PCI-PCI >> pcib2@pci0:0:2:0: class=0x060400 card=0x00008086 chip=0x34098086 rev=0x22 >> hdr=0x01 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 2' >> class = bridge >> subclass = PCI-PCI >> pcib3@pci0:0:3:0: class=0x060400 card=0x00008086 chip=0x340a8086 rev=0x22 >> hdr=0x01 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 3' >> class = bridge >> subclass = PCI-PCI >> pcib4@pci0:0:5:0: class=0x060400 card=0x00008086 chip=0x340c8086 rev=0x22 >> hdr=0x01 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 5' >> class = bridge >> subclass = PCI-PCI >> pcib5@pci0:0:7:0: class=0x060400 card=0x00008086 chip=0x340e8086 rev=0x22 >> hdr=0x01 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 7' >> class = bridge >> subclass = PCI-PCI >> ioapic0@pci0:0:19:0: class=0x080020 card=0x00000000 chip=0x342d8086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub I/OxAPIC Interrupt Controller' >> class = base peripheral >> subclass = interrupt controller >> bar [10] = type Memory, range 32, base 0xfec8a000, size 4096, enabled >> none0@pci0:0:20:0: class=0x080000 card=0x00000000 chip=0x342e8086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub System Management Registers' >> class = base peripheral >> subclass = interrupt controller >> none1@pci0:0:20:1: class=0x080000 card=0x00000000 chip=0x34228086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub GPIO and Scratch Pad Registers' >> class = base peripheral >> subclass = interrupt controller >> none2@pci0:0:20:2: class=0x080000 card=0x00000000 chip=0x34238086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub Control Status and RAS Registers' >> class = base peripheral >> subclass = interrupt controller >> none3@pci0:0:20:3: class=0x080000 card=0x00000000 chip=0x34388086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'QuickPath Architecture I/O Hub Throttle Registers' >> class = base peripheral >> subclass = interrupt controller >> none4@pci0:0:22:0: class=0x088000 card=0x000715d9 chip=0x34308086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbed8000, size 16384, enabled >> none5@pci0:0:22:1: class=0x088000 card=0x000715d9 chip=0x34318086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbedc000, size 16384, enabled >> none6@pci0:0:22:2: class=0x088000 card=0x000715d9 chip=0x34328086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbee0000, size 16384, enabled >> none7@pci0:0:22:3: class=0x088000 card=0x000715d9 chip=0x34338086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbee4000, size 16384, enabled >> none8@pci0:0:22:4: class=0x088000 card=0x000715d9 chip=0x34298086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbee8000, size 16384, enabled >> none9@pci0:0:22:5: class=0x088000 card=0x000715d9 chip=0x342a8086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbeec000, size 16384, enabled >> none10@pci0:0:22:6: class=0x088000 card=0x000715d9 chip=0x342b8086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbef0000, size 16384, enabled >> none11@pci0:0:22:7: class=0x088000 card=0x000715d9 chip=0x342c8086 >> rev=0x22 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'DMA Engine' >> class = base peripheral >> bar [10] = type Memory, range 64, base 0xfbef4000, size 16384, enabled >> none12@pci0:0:26:0: class=0x0c0300 card=0x000715d9 chip=0x3a378086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB UHCI Controller *4' >> class = serial bus >> subclass = USB >> none13@pci0:0:26:1: class=0x0c0300 card=0x000715d9 chip=0x3a388086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB UHCI Controller *5' >> class = serial bus >> subclass = USB >> none14@pci0:0:26:2: class=0x0c0300 card=0x000715d9 chip=0x3a398086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB UHCI Controller *6' >> class = serial bus >> subclass = USB >> none15@pci0:0:26:7: class=0x0c0320 card=0x000715d9 chip=0x3a3c8086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB EHCI Controller *2' >> class = serial bus >> subclass = USB >> none16@pci0:0:29:0: class=0x0c0300 card=0x000715d9 chip=0x3a348086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB UHCI Controller *1' >> class = serial bus >> subclass = USB >> none17@pci0:0:29:1: class=0x0c0300 card=0x000715d9 chip=0x3a358086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB UHCI Controller *2' >> class = serial bus >> subclass = USB >> none18@pci0:0:29:2: class=0x0c0300 card=0x000715d9 chip=0x3a368086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB UHCI Controller *3' >> class = serial bus >> subclass = USB >> none19@pci0:0:29:7: class=0x0c0320 card=0x000715d9 chip=0x3a3a8086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'USB EHCI Controller *1' >> class = serial bus >> subclass = USB >> pcib6@pci0:0:30:0: class=0x060401 card=0x000715d9 chip=0x244e8086 >> rev=0x90 >> hdr=0x01 >> vendor = 'Intel Corporation' >> device = '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface to PCI >> Bridge' >> class = bridge >> subclass = PCI-PCI >> isab0@pci0:0:31:0: class=0x060100 card=0x000715d9 chip=0x3a188086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'LPC Interface Controller' >> class = bridge >> subclass = PCI-ISA >> atapci0@pci0:0:31:2: class=0x01018f card=0x000715d9 chip=0x3a208086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'SATA2(4Port2) (ICH10 Family)' >> class = mass storage >> subclass = ATA >> bar [10] = type I/O Port, range 32, base 0xbc00, size 8, enabled >> bar [14] = type I/O Port, range 32, base 0xb880, size 4, enabled >> bar [18] = type I/O Port, range 32, base 0xb800, size 8, enabled >> bar [1c] = type I/O Port, range 32, base 0xb480, size 4, enabled >> bar [20] = type I/O Port, range 32, base 0xb400, size 16, enabled >> bar [24] = type I/O Port, range 32, base 0xb080, size 16, enabled >> none20@pci0:0:31:3: class=0x0c0500 card=0x000715d9 chip=0x3a308086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'SMB controller (50011458)' >> class = serial bus >> subclass = SMBus >> bar [10] = type Memory, range 64, base 0xfbefa000, size 256, enabled >> bar [20] = type I/O Port, range 32, base 0x400, size 32, enabled >> atapci1@pci0:0:31:5: class=0x010185 card=0x000715d9 chip=0x3a268086 >> rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'SATA2(2Port2) (ICH10 Family)' >> class = mass storage >> subclass = ATA >> bar [10] = type I/O Port, range 32, base 0xac00, size 8, enabled >> bar [14] = type I/O Port, range 32, base 0xa880, size 4, enabled >> bar [18] = type I/O Port, range 32, base 0xa800, size 8, enabled >> bar [1c] = type I/O Port, range 32, base 0xa480, size 4, enabled >> bar [20] = type I/O Port, range 32, base 0xa400, size 16, enabled >> bar [24] = type I/O Port, range 32, base 0xa080, size 16, enabled >> em0@pci0:1:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' >> class = network >> subclass = ethernet >> bar [10] = type Memory, range 32, base 0xfbbe0000, size 131072, enabled >> bar [18] = type I/O Port, range 32, base 0xcc00, size 32, enabled >> bar [1c] = type Memory, range 32, base 0xfbbdc000, size 16384, enabled >> em1@pci0:2:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00 >> hdr=0x00 >> vendor = 'Intel Corporation' >> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' >> class = network >> subclass = ethernet >> bar [10] = type Memory, range 32, base 0xfbce0000, size 131072, enabled >> bar [18] = type I/O Port, range 32, base 0xdc00, size 32, enabled >> bar [1c] = type Memory, range 32, base 0xfbcdc000, size 16384, enabled >> mps0@pci0:4:0:0: class=0x010700 card=0x040015d9 chip=0x00721000 rev=0x02 >> hdr=0x00 >> vendor = 'LSI Logic (Was: Symbios Logic, NCR)' >> class = mass storage >> subclass = SAS >> bar [10] = type I/O Port, range 32, base 0xe000, size 256, enabled >> bar [14] = type Memory, range 64, base 0xfbd3c000, size 16384, enabled >> bar [1c] = type Memory, range 64, base 0xfbd40000, size 262144, enabled >> vgapci0@pci0:6:1:0: class=0x030000 card=0x000715d9 chip=0x0532102b >> rev=0x0a >> hdr=0x00 >> vendor = 'Matrox Electronic Systems Ltd.' >> class = display >> subclass = VGA >> bar [10] = type Prefetchable Memory, range 32, base 0xf9000000, size >> 16777216, enabled >> bar [14] = type Memory, range 32, base 0xfaffc000, size 16384, enabled >> bar [18] = type Memory, range 32, base 0xfb000000, size 8388608, enabled >> hostb1@pci0:255:0:0: class=0x060000 card=0x80868086 chip=0x2c708086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb2@pci0:255:0:1: class=0x060000 card=0x80868086 chip=0x2d818086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb3@pci0:255:2:0: class=0x060000 card=0x80868086 chip=0x2d908086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb4@pci0:255:2:1: class=0x060000 card=0x80868086 chip=0x2d918086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb5@pci0:255:2:2: class=0x060000 card=0x80868086 chip=0x2d928086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb6@pci0:255:2:3: class=0x060000 card=0x80868086 chip=0x2d938086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb7@pci0:255:2:4: class=0x060000 card=0x80868086 chip=0x2d948086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb8@pci0:255:2:5: class=0x060000 card=0x80868086 chip=0x2d958086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb9@pci0:255:3:0: class=0x060000 card=0x80868086 chip=0x2d988086 >> rev=0x02 >> hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb10@pci0:255:3:1: class=0x060000 card=0x80868086 chip=0x2d998086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb11@pci0:255:3:2: class=0x060000 card=0x80868086 chip=0x2d9a8086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb12@pci0:255:3:4: class=0x060000 card=0x80868086 chip=0x2d9c8086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb13@pci0:255:4:0: class=0x060000 card=0x80868086 chip=0x2da08086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb14@pci0:255:4:1: class=0x060000 card=0x80868086 chip=0x2da18086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb15@pci0:255:4:2: class=0x060000 card=0x80868086 chip=0x2da28086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb16@pci0:255:4:3: class=0x060000 card=0x80868086 chip=0x2da38086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb17@pci0:255:5:0: class=0x060000 card=0x80868086 chip=0x2da88086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb18@pci0:255:5:1: class=0x060000 card=0x80868086 chip=0x2da98086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb19@pci0:255:5:2: class=0x060000 card=0x80868086 chip=0x2daa8086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb20@pci0:255:5:3: class=0x060000 card=0x80868086 chip=0x2dab8086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb21@pci0:255:6:0: class=0x060000 card=0x80868086 chip=0x2db08086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb22@pci0:255:6:1: class=0x060000 card=0x80868086 chip=0x2db18086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb23@pci0:255:6:2: class=0x060000 card=0x80868086 chip=0x2db28086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> hostb24@pci0:255:6:3: class=0x060000 card=0x80868086 chip=0x2db38086 >> rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> class = bridge >> subclass = HOST-PCI >> >> Thank you in advance sirs! >> Jason Wolfe >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> > >