Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 17 Jul 2007 09:17:36 -0700
From:      "Jack Vogel" <jfvogel@gmail.com>
To:        freebsd-net@freebsd.org
Subject:   Re: em(4)/82571eb: fifo not dma'ed to host memory
Message-ID:  <2a41acea0707170917n56e35cfbyc6e0bca094bfa729@mail.gmail.com>
In-Reply-To: <20070717110156.GA37722@hbnnbsddev03.sharedtcs.net>
References:  <20070717110156.GA37722@hbnnbsddev03.sharedtcs.net>

next in thread | previous in thread | raw e-mail | index | archive | help
As an experiment, search in if_em.c for 'msix' look at the logic there.
If the adapter is 82575 it will use msix, but the else clause has it
use msi ONLY if its '>82571', change that to >=82571 and let's
see if maybe using MSI will help you with your problems as I'm
pretty confident its interrupt related.

I had intended on making this change shortly anyway, my tests
have shown the 571 to work fine this way.

Let me know of the results.

Jack


On 7/17/07, Patrick Oeschger <paketix@bluewin.ch> wrote:
> bug description for 7.0-CURRENT - em(4) driver version 6.5.3
> - frame reception is not possible (missed packets counter incrementing)
> - frame transmission is not possible (driver watchdog fires)
> bug exists also on 6.2-RELENG - em(4) driver version 6.2.9
> bug does *not* exist on 6.1-RELENG - em(4) driver version 3.2.18
>
> jack vogel told me that the i82571 can be tricky when having a bunch
> of them - i have 8 such interfaces on the motherboard so i disabled
> 7 of them with a modified em_probe (if_em.c)
> running the driver on just one interface does not change the behaviour
>
> - init of the interface during verbose boot looks fine
> - bringing the interface to upness looks fine too
> - RDH0/RDT0 registers do *not* increment after frame reception
> - frames suspected *not* getting dma'ed from fifo to host memory
> - RX interrupt suspected *not* being sent to the driver
>
> see dmesg and debug ouput for futher details...
> anybody having some experience with this issue?
> any advice to track this further down?
> thanks, pat
>
>
> diff for em_probe subr to ensure that only one interface is init'ed:
>
>   freebsd70# diff -u if_em.c.orig if_em.c
>   --- if_em.c.orig        Tue Jul 17 11:18:18 2007
>   +++ if_em.c     Tue Jul 17 06:34:48 2007
>   @@ -379,6 +379,10 @@
>
>           INIT_DEBUGOUT("em_probe: begin");
>
>   +       // prevent init of all em(4) devices except pci9/0/0
>   +       if(pci_get_bus(dev) != 0x09 || pci_get_slot(dev) != 0x00 ||
>   +          pci_get_function(dev) != 0x00)
>   +               return (ENXIO);
>   +
>           pci_vendor_id = pci_get_vendor(dev);
>           if (pci_vendor_id != EM_VENDOR_ID)
>                   return (ENXIO);
>
> excerpt of verbose dmesg looks fine for em0:
>
>   pcib9: <PCI-PCI bridge> irq 19 at device 11.0 on pci2
>   pcib9:   secondary bus     9
>   pcib9:   subordinate bus   9
>   pcib9:   I/O decode        0x6000-0x6fff
>   pcib9:   memory decode     0xfd700000-0xfd7fffff
>   pcib9:   prefetched decode 0xfce00000-0xfcefffff
>   pci9: <PCI bus> on pcib9
>   pci9: physical bus=9
>   found-> vendor=0x8086, dev=0x105e, revid=0x06
>           bus=9, slot=0, func=0
>           class=02-00-00, hdrtype=0x00, mfdev=1
>           cmdreg=0x0000, statreg=0x0010, cachelnsz=16 (dwords)
>           lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
>           intpin=a, irq=255
>           powerspec 2  supports D0 D3  current D0
>           MSI supports 1 message, 64 bit
>           map[10]: type Memory, range 32, base 0, size 17, memory disabled
>           map[14]: type Memory, range 32, base 0, size 17, memory disabled
>           map[18]: type I/O Port, range 32, base 0, size  5, port disabled
>   found-> vendor=0x8086, dev=0x105e, revid=0x06
>           bus=9, slot=0, func=1
>           class=02-00-00, hdrtype=0x00, mfdev=1
>           cmdreg=0x0000, statreg=0x0010, cachelnsz=16 (dwords)
>           lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
>           intpin=b, irq=255
>           powerspec 2  supports D0 D3  current D0
>           MSI supports 1 message, 64 bit
>           map[10]: type Memory, range 32, base 0, size 17, memory disabled
>           map[14]: type Memory, range 32, base 0, size 17, memory disabled
>           map[18]: type I/O Port, range 32, base 0, size  5, port disabled
>   em0: <Intel(R) PRO/1000 Network Connection Version - 6.5.3>
>     at device 0.0 on pci9
>   pcib9: em0 requested memory range 0xfd700000-0xfd7fffff: good
>   pcib2: em0 requested memory range 0xfd700000-0xfd7fffff: good
>   pcib1: em0 requested memory range 0xfd700000-0xfd7fffff: good
>   em0: Lazy allocation of 0x20000 bytes rid 0x10 type 3 at 0xfd700000
>   pcib1: matched entry for 1.0.INTD
>   pcib1: slot 0 INTD hardwired to IRQ 19
>   pcib2: slot 11 INTA is routed to irq 19
>   pcib9: slot 0 INTA is routed to irq 19
>   em0: bpf attached
>   em0: Ethernet address: 00:10:f3:0c:5b:2a
>   ioapic0: routing intpin 19 (PCI IRQ 19) to vector 49
>   em0: [FILTER]
>   pci9: <network, ethernet> at device 0.1 (no driver attached)
>
> bringing em0 to upness seems to work fine:
> printf's inserted into subroutines em_handle_link and em_rxeof (if_em.c)
>
>   freebsd70# ifconfig em0 up
>   em0: Link is Down
>   em_handle_link
>   em_rxeof
>   em_handle_link
>   em_rxeof
>   em0: Link is up 1000 Mbps Full Duplex
>   freebsd70# ifconfig em0
>   em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0
>        mtu 1500
>           options=18b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWCSUM,TSO4>
>           ether 00:10:f3:0c:5b:2a
>           media: Ethernet autoselect (1000baseTX <full-duplex>)
>           status: active
>
> interface stats:
> good packets increment but no em_rxeof/interrupts generated
> fifo is full after 85 received frames
> memory and missed packets are incrementing because they cant be
> stored in fifo (fifo exhausted)
>
>   freebsd70# sysctl dev.em.0.stats=1
>   em0: Excessive collisions = 0
>   em0: Sequence errors = 0
>   em0: Defer count = 0
>   em0: Missed Packets = 144
>   em0: Receive No Buffers = 0
>   em0: Receive Length Errors = 0
>   em0: Receive errors = 0
>   em0: Crc errors = 0
>   em0: Alignment errors = 0
>   em0: Carrier extension errors = 0
>   em0: RX overruns = 0
>   em0: watchdog timeouts = 0
>   em0: XON Rcvd = 0
>   em0: XON Xmtd = 0
>   em0: XOFF Rcvd = 0
>   em0: XOFF Xmtd = 0
>   em0: Good Packets Rcvd = 85
>   em0: Good Packets Xmtd = 0
>   em0: TSO Contexts Xmtd = 0
>   em0: TSO Contexts Failed = 0
>
> interface debug_info:
> output for registers RDBAH0/RDBAL0/RDLEN0/RDH0/RDT0/RXDCTL added
> RDH0/RDT0 do not increment after frame reception...
> cp. 6.1-RELENG: RDH0/RDT0 incremented after frame reception
>                 RDT0 is always 'RDH0 - 1'
>
>   freebsd70# sysctl dev.em.0.debug_info=1
>   em0: Adapter hardware address = 0xc3b69a1c
>   em0: CTRL = 0x81c0241 RCTL = 0x8002
>   em0: RDBAH0 = 0x0 RDBAL0 = 0x1458000
>   em0: RDLEN0 = 0x1000 RDH0 = 0x0
>   em0: RDT0 = 0xff RXDCTL = 0x10000
>   em0: Packet buffer = Tx=16k Rx=32k
>   em0: Flow control watermarks high = 30720 low = 29220
>   em0: tx_int_delay = 66, tx_abs_int_delay = 66
>   em0: rx_int_delay = 0, rx_abs_int_delay = 66
>   em0: fifo workaround = 0, fifo_reset_count = 0
>   em0: hw tdh = 0, hw tdt = 0
>   em0: hw rdh = 0, hw rdt = 255
>   em0: Num Tx descriptors avail = 256
>   em0: Tx Descriptors not avail1 = 0
>   em0: Tx Descriptors not avail2 = 0
>   em0: Std mbuf failed = 0
>   em0: Std mbuf cluster failed = 0
>   em0: Driver dropped packets = 0
>   em0: Driver tx dma failure in encap = 0
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2a41acea0707170917n56e35cfbyc6e0bca094bfa729>