From owner-freebsd-net Wed Oct 23 17:29:38 2002 Delivered-To: freebsd-net@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3A35A37B401 for ; Wed, 23 Oct 2002 17:29:20 -0700 (PDT) Received: from yama.geminisolutions.com (yama.geminisolutions.com [216.57.214.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id EC6FD43E3B for ; Wed, 23 Oct 2002 17:29:15 -0700 (PDT) (envelope-from michael@staff.openaccess.org) Received: from [192.168.4.254] (internal.openaccess.org [216.57.214.120]) by yama.geminisolutions.com (8.12.3/8.11.6) with ESMTP id g9O0MTAo091006; Wed, 23 Oct 2002 17:22:29 -0700 (PDT) (envelope-from michael@staff.openaccess.org) User-Agent: Microsoft-Entourage/10.0.0.1309 Date: Wed, 23 Oct 2002 17:29:06 -0700 Subject: Re: which resources ends with ste interface? From: Michael DeMan To: <"."@babolo.ru>, Message-ID: In-Reply-To: <200210240013.g9O0DcLT081412@aaz.links.ru> Mime-version: 1.0 Content-type: text/plain; charset="US-ASCII" Content-transfer-encoding: 7bit Sender: owner-freebsd-net@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org We have a nightmare situation with DFE-580TX 4-port cards that use the ste driver. The driver seems to just choke. I'm not sure if its an issue with PCI interrupts or what. It throttles back the time-outs, but even then after its been up for days one of the interfaces will start acting up and our LAN seems more like an ISDN to the file server. On 10/23/02 5:13 PM, ""."@babolo.ru" <"."@babolo.ru> wrote: > > I have a router with 5 ste FX NIC > and 1 xl TP NIC > > ste0 is upstream, one ste not used and > all others are for home users net. > > after down/up ste0 works good. > about 1 day or about 5..10 GByte, > then some received packets delays > for 1..2 seconds, then most received > packets delays for 2..5 seconds, > packet drop on receive drops. > Transmit is good. > Measured by ping between directly > connected host and tcpdump on both, > where instrument host has about zero traffic > and has no problems (it is console server) > > User's ste interfaces works good after > ifconfig down/up, and delays appear > after massive arp scans, and usually > such a scan stops interface, > but state is UP. > > I have no instrumental host in that > network, so I cant say, is tx functioning > or not in that state. > > The good way to see breakage is > tcpdump -npiste0 ether broadcast and not ip > & /some/file & > (tcsh) and look in file after interface stops. > It ends up with huge amount of arp requests on > nonexistant hosts. > I reprodused this breakage. > 2 sec of intensive arp scanes leads > to change ping time to one of users > from usual 0..10 msec to 2..3 sec for at least > 10 min after scan ends. > > I can't reproduce this reaction on arp scan on ste0, > mean ping time do not change in or after scan time. > But may be such a scan reduce time of good > work of ste0. I can try to increase of arp > scan time to test if need. > > So my question is: how can I found the cause? > 0tw~(12)#netstat -m > 391/1056/65536 mbufs in use (current/peak/max): > 391 mbufs allocated to data > 390/814/16384 mbuf clusters in use (current/peak/max) > 1892 Kbytes allocated to network (3% of mb_map in use) > 0 requests for memory denied > 0 requests for memory delayed > 0 calls to protocol drain routines > > I saw 3 times bigger peak values, but > never saw values near the max. > > 0tw~(13)#uname -a > FreeBSD tw 4.7-STABLE FreeBSD 4.7-STABLE #2: Wed Oct 16 05:37:50 MSD 2002 > babolo@banny.pike.ru:/tmp/babolo/usr/src/sys/gw i386 > > dmesg exhausted by multiple > arp: X attempts to modify permanent entry for Y on ste4 > and > ipfw: X Deny ... > strings, so part of /var/log/all instead: > > Oct 23 16:18:39 tw /kernel: Copyright (c) 1992-2002 The FreeBSD Project. > Oct 23 16:18:39 tw /kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, > 1991, 1992, 1993, 1994 > Oct 23 16:18:39 tw /kernel: The Regents of the University of California. All > rights reserved. > Oct 23 16:18:39 tw /kernel: FreeBSD 4.7-STABLE #2: Wed Oct 16 05:37:50 MSD > 2002 > Oct 23 16:18:39 tw /kernel: babolo@banny.pike.ru:/tmp/babolo/usr/src/sys/gw > Oct 23 16:18:39 tw /kernel: Calibrating clock(s) ... TSC clock: 865576478 Hz, > i8254 clock: 1193259 Hz > Oct 23 16:18:39 tw /kernel: CLK_USE_I8254_CALIBRATION not specified - using > default frequency > Oct 23 16:18:39 tw /kernel: Timecounter "i8254" frequency 1193182 Hz > Oct 23 16:18:39 tw /kernel: CLK_USE_TSC_CALIBRATION not specified - using old > calibration method > Oct 23 16:18:39 tw /kernel: CPU: VIA C3 Samuel 2 (865.52-MHz 686-class CPU) > Oct 23 16:18:39 tw /kernel: Origin = "CentaurHauls" Id = 0x678 Stepping = 8 > Oct 23 16:18:39 tw /kernel: Features=0x803035 > Oct 23 16:18:39 tw /kernel: real memory = 134152192 (131008K bytes) > Oct 23 16:18:39 tw /kernel: Physical memory chunk(s): > Oct 23 16:18:39 tw /kernel: 0x00001000 - 0x0009efff, 647168 bytes (158 pages) > Oct 23 16:18:39 tw /kernel: 0x004d0000 - 0x07faffff, 128843776 bytes (31456 > pages) > Oct 23 16:18:39 tw /kernel: config> di adv0 > Oct 23 16:18:39 tw /kernel: config> di aha0 > Oct 23 16:18:39 tw /kernel: config> di aic0 > Oct 23 16:18:39 tw /kernel: config> di bt0 > Oct 23 16:18:39 tw /kernel: config> di cs0 > Oct 23 16:18:39 tw /kernel: config> di ed0 > Oct 23 16:18:39 tw /kernel: config> di fe0 > Oct 23 16:18:39 tw /kernel: config> di fdc0 > Oct 23 16:18:39 tw /kernel: config> di lnc0 > Oct 23 16:18:39 tw /kernel: config> di sn0 > Oct 23 16:18:39 tw /kernel: config> di sio2 > Oct 23 16:18:39 tw /kernel: config> q > Oct 23 16:18:39 tw /kernel: avail memory = 125022208 (122092K bytes) > Oct 23 16:18:39 tw /kernel: bios32: Found BIOS32 Service Directory header at > 0xc00fdb20 > Oct 23 16:18:39 tw /kernel: bios32: Entry = 0xfdb30 (c00fdb30) Rev = 0 Len = > 1 > Oct 23 16:18:39 tw /kernel: pcibios: PCI BIOS entry at 0xdb51 > Oct 23 16:18:39 tw /kernel: pnpbios: Found PnP BIOS data at 0xc00f6f70 > Oct 23 16:18:39 tw /kernel: pnpbios: Entry = f0000:5fb4 Rev = 1.0 > Oct 23 16:18:39 tw /kernel: Other BIOS signatures found: > Oct 23 16:18:39 tw /kernel: ACPI: 000fc3e0 > Oct 23 16:18:39 tw /kernel: Preloaded elf kernel "kernel" at 0xc04a9000. > Oct 23 16:18:39 tw /kernel: Preloaded userconfig_script "/boot/kernel.conf" at > 0xc04a90a8. > Oct 23 16:18:39 tw /kernel: VESA: information block > Oct 23 16:18:39 tw /kernel: 56 45 53 41 00 02 50 0b 00 c0 01 00 00 00 8b 0b > Oct 23 16:18:39 tw /kernel: 00 c0 40 00 01 01 68 0b 00 c0 79 0b 00 c0 83 0b > Oct 23 16:18:39 tw /kernel: 00 c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > Oct 23 16:18:39 tw /kernel: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > Oct 23 16:18:39 tw /kernel: VESA: 63 mode(s) found > Oct 23 16:18:39 tw /kernel: VESA: v2.0, 4096k memory, flags:0x1, mode > table:0xc00c0b8b (c0000b8b) > Oct 23 16:18:39 tw /kernel: VESA: S3 Incorporated. 86C362 > Oct 23 16:18:39 tw /kernel: VESA: S3 Incorporated. Trio3D/2X Rev C > Oct 23 16:18:39 tw /kernel: pci_open(1): mode 1 addr port (0x0cf8) is > 0x8000006c > Oct 23 16:18:39 tw /kernel: pci_open(1a): mode1res=0x80000000 > (0x80000000) > Oct 23 16:18:39 tw /kernel: pci_cfgcheck: device 0 [class=060000] > [hdr=00] is there (id=30911106) > Oct 23 16:18:39 tw /kernel: Using $PIR table, 10 entries at 0xc00f7590 > Oct 23 16:18:39 tw /kernel: npx0: on motherboard > Oct 23 16:18:39 tw /kernel: npx0: INT 16 interface > Oct 23 16:18:39 tw /kernel: pcib0: on motherboard > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1106, dev=0x3091, revid=0x01 > Oct 23 16:18:39 tw /kernel: class=06-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base e0000000, size 26 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1106, dev=0xb091, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=06-04-00, hdrtype=0x01, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=1 secondarybus=1 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1186, dev=0x1002, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=02-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=10 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base 0000dc00, size 7 > Oct 23 16:18:39 tw /kernel: map[14]: type 1, range 32, base dfffff80, size 7 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1186, dev=0x1002, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=02-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=11 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base 0000d800, size 7 > Oct 23 16:18:39 tw /kernel: map[14]: type 1, range 32, base dfffff00, size 7 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1186, dev=0x1002, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=02-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=12 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base 0000d400, size 7 > Oct 23 16:18:39 tw /kernel: map[14]: type 1, range 32, base dffffe80, size 7 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1186, dev=0x1002, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=02-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=5 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base 0000d000, size 7 > Oct 23 16:18:39 tw /kernel: map[14]: type 1, range 32, base dffffe00, size 7 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1186, dev=0x1002, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=02-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=10 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base 0000cc00, size 7 > Oct 23 16:18:39 tw /kernel: map[14]: type 1, range 32, base dffffd80, size 7 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x10b7, dev=0x9050, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=02-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=11 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base 0000c800, size 6 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x104c, dev=0x8020, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=0c-00-10, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: intpin=a, irq=12 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base dffff000, size 11 > Oct 23 16:18:39 tw /kernel: map[14]: type 1, range 32, base dfff8000, size 14 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1106, dev=0x3074, revid=0x00 > Oct 23 16:18:39 tw /kernel: class=06-01-00, hdrtype=0x00, mfdev=1 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x1106, dev=0x0571, revid=0x06 > Oct 23 16:18:39 tw /kernel: class=01-01-8a, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: map[20]: type 1, range 32, base 0000ff00, size 4 > Oct 23 16:18:39 tw /kernel: pci0: on pcib0 > Oct 23 16:18:39 tw /kernel: pcib1: device=b091)> at device 1.0 on pci0 > Oct 23 16:18:39 tw /kernel: found-> vendor=0x5333, dev=0x8a13, revid=0x02 > Oct 23 16:18:39 tw /kernel: class=03-00-00, hdrtype=0x00, mfdev=0 > Oct 23 16:18:39 tw /kernel: subordinatebus=0 secondarybus=0 > Oct 23 16:18:39 tw /kernel: map[10]: type 1, range 32, base d8000000, size 26 > Oct 23 16:18:39 tw /kernel: pci1: on pcib1 > Oct 23 16:18:39 tw /kernel: pci1: > (vendor=0x5333, dev=0x8a13) at 0.0 > Oct 23 16:18:39 tw /kernel: ste0: port > 0xdc00-0xdc7f mem 0xdfffff80-0xdfffffff > irq 10 at device 9.0 on pci0 > Oct 23 16:18:39 tw /kernel: ste0: Ethernet address: 00:05:5d:f6:ac:57 > Oct 23 16:18:39 tw /kernel: miibus0: on ste0 > Oct 23 16:18:39 tw /kernel: acphy0: on miibus0 > Oct 23 16:18:39 tw /kernel: acphy0: 10baseT, 10baseT-FDX, 100baseTX, > 100baseTX-FDX > Oct 23 16:18:39 tw /kernel: bpf: ste0 attached > Oct 23 16:18:39 tw /kernel: ste1: port > 0xd800-0xd87f mem 0xdfffff00-0xdfffff7f > irq 11 at device 10.0 on pci0 > Oct 23 16:18:39 tw /kernel: ste1: Ethernet address: 00:05:5d:f6:ac:5b > Oct 23 16:18:39 tw /kernel: miibus1: on ste1 > Oct 23 16:18:39 tw /kernel: acphy1: on miibus1 > Oct 23 16:18:39 tw /kernel: acphy1: 10baseT, 10baseT-FDX, 100baseTX, > 100baseTX-FDX > Oct 23 16:18:39 tw /kernel: bpf: ste1 attached > Oct 23 16:18:39 tw /kernel: ste2: port > 0xd400-0xd47f mem 0xdffffe80-0xdffffeff > irq 12 at device 11.0 on pci0 > Oct 23 16:18:39 tw /kernel: ste2: Ethernet address: 00:05:5d:f6:af:f9 > Oct 23 16:18:39 tw /kernel: miibus2: on ste2 > Oct 23 16:18:39 tw /kernel: acphy2: on miibus2 > Oct 23 16:18:39 tw /kernel: acphy2: 10baseT, 10baseT-FDX, 100baseTX, > 100baseTX-FDX > Oct 23 16:18:39 tw /kernel: bpf: ste2 attached > Oct 23 16:18:39 tw /kernel: ste3: port > 0xd000-0xd07f mem 0xdffffe00-0xdffffe7f > irq 5 at device 12.0 on pci0 > Oct 23 16:18:39 tw /kernel: ste3: Ethernet address: 00:05:5d:f6:ad:ab > Oct 23 16:18:39 tw /kernel: miibus3: on ste3 > Oct 23 16:18:39 tw /kernel: acphy3: on miibus3 > Oct 23 16:18:39 tw /kernel: acphy3: 10baseT, 10baseT-FDX, 100baseTX, > 100baseTX-FDX > Oct 23 16:18:39 tw /kernel: bpf: ste3 attached > Oct 23 16:18:39 tw /kernel: ste4: port > 0xcc00-0xcc7f mem 0xdffffd80-0xdffffdff > irq 10 at device 13.0 on pci0 > Oct 23 16:18:39 tw /kernel: using shared irq10. > Oct 23 16:18:39 tw /kernel: ste4: Ethernet address: 00:05:5d:f6:b0:05 > Oct 23 16:18:39 tw /kernel: miibus4: on ste4 > Oct 23 16:18:39 tw /kernel: acphy4: on miibus4 > Oct 23 16:18:39 tw /kernel: acphy4: 10baseT, 10baseT-FDX, 100baseTX, > 100baseTX-FDX > Oct 23 16:18:39 tw /kernel: bpf: ste4 attached > Oct 23 16:18:39 tw /kernel: xl0: <3Com 3c905-TX Fast Etherlink XL> port > 0xc800-0xc83f irq 11 at device 14.0 on > pci0 > Oct 23 16:18:39 tw /kernel: using shared irq11. > Oct 23 16:18:39 tw /kernel: xl0: Ethernet address: 00:10:4b:31:8a:8e > Oct 23 16:18:39 tw /kernel: xl0: media options word: e040 > Oct 23 16:18:39 tw /kernel: xl0: found MII/AUTO > Oct 23 16:18:39 tw /kernel: miibus5: on xl0 > Oct 23 16:18:39 tw /kernel: nsphy0: on > miibus5 > Oct 23 16:18:39 tw /kernel: nsphy0: 10baseT, 10baseT-FDX, 100baseTX, > 100baseTX-FDX, auto > Oct 23 16:18:39 tw /kernel: bpf: xl0 attached > Oct 23 16:18:39 tw /kernel: pci0: (vendor=0x104c, dev=0x8020) > at 15.0 irq 12 > Oct 23 16:18:39 tw /kernel: viapropm0: SMBus I/O base at 0x400 > Oct 23 16:18:39 tw /kernel: viapropm0: port > 0x400-0x40f at device 17.0 on pc > i0 > Oct 23 16:18:39 tw /kernel: viapropm0: SMBus revision code 0x0 > Oct 23 16:18:39 tw /kernel: smb0: on smbus0 > Oct 23 16:18:39 tw /kernel: atapci0: port > 0xff00-0xff0f at device 17.1 on pci0 > Oct 23 16:18:39 tw /kernel: ata0: iobase=0x01f0 altiobase=0x03f6 bmaddr=0xff00 > Oct 23 16:18:39 tw /kernel: ata0: mask=03 ostat0=50 ostat2=00 > Oct 23 16:18:39 tw /kernel: ata0-master: ATAPI 00 00 > Oct 23 16:18:39 tw /kernel: ata0-slave: ATAPI 00 00 > Oct 23 16:18:39 tw /kernel: ata0: mask=03 stat0=50 stat1=00 > Oct 23 16:18:39 tw /kernel: ata0-master: ATA 01 a5 > Oct 23 16:18:39 tw /kernel: ata0: devices=01 > Oct 23 16:18:39 tw /kernel: ata0: at 0x1f0 irq 14 on atapci0 > Oct 23 16:18:39 tw /kernel: ata1: iobase=0x0170 altiobase=0x0376 bmaddr=0xff08 > Oct 23 16:18:39 tw /kernel: ata1: mask=03 ostat0=50 ostat2=00 > Oct 23 16:18:39 tw /kernel: ata1-master: ATAPI 00 00 > Oct 23 16:18:39 tw /kernel: ata1-slave: ATAPI 00 00 > Oct 23 16:18:39 tw /kernel: ata1: mask=03 stat0=50 stat1=00 > Oct 23 16:18:39 tw /kernel: ata1-master: ATA 01 a5 > Oct 23 16:18:39 tw /kernel: ata1: devices=01 > Oct 23 16:18:39 tw /kernel: ata1: at 0x170 irq 15 on atapci0 > Oct 23 16:18:39 tw /kernel: isa0: on motherboard > Oct 23 16:18:39 tw /kernel: ex_isa_identify() > Oct 23 16:18:39 tw /kernel: ata-: ata0 exists, using next available unit > number > Oct 23 16:18:39 tw /kernel: ata-: ata1 exists, using next available unit > number > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 203 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 243 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 283 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 2c3 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 303 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 343 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 383 > Oct 23 16:18:39 tw /kernel: Trying Read_Port at 3c3 > Oct 23 16:18:39 tw /kernel: isa_probe_children: disabling PnP devices > Oct 23 16:18:39 tw /kernel: isa_probe_children: probing non-PnP devices > Oct 23 16:18:39 tw /kernel: orm0: