Date: Thu, 28 Sep 2006 11:57:22 -0300 From: "Alexandre Biancalana" <biancalana@gmail.com> To: freebsd-stable@freebsd.org Subject: 6-Stable High Interrupt Rate on network Message-ID: <8e10486b0609280757u2bc9b93cyfc9df589b7f4f732@mail.gmail.com>
next in thread | raw e-mail | index | archive | help
Hi list,
Today I changed the main gateway from our network from PIII 733, 512 MB
Ram running FreeBSD 4-STABLE to a Xeon 3.0, 1Gb Ram running FreeBSD
6-STABLE. But the performance of the network is worst than before.
The new machine is a Dell PowerEdge 1800 have one quad DLink DFE-580TX,
one quad Adaptec ANA-62044 and one on board Intel em. I enabled the polling
on all interfaces, set the HZ to 1000 and set kern.polling.user_frac=30, but
this does not happened.
Looking the new machine the high interrupt rate call my attention, follow
some infos:
======= sysctl kern.polling =========
kern.polling.idlepoll_sleeping: 1
kern.polling.stalled: 0
kern.polling.suspect: 66
kern.polling.phase: 0
kern.polling.enable: 1
kern.polling.handlers: 9
kern.polling.residual_burst: 0
kern.polling.pending_polls: 0
kern.polling.lost_polls: 19928
kern.polling.short_ticks: 1489
kern.polling.reg_frac: 20
kern.polling.user_frac: 30
kern.polling.idle_poll: 0
kern.polling.each_burst: 10
kern.polling.burst_max: 150
kern.polling.burst: 86
======= sysctl kern.polling =========
======= top -S =========
last pid: 71517; load averages: 0.63, 0.82, 0.93
up 0+05:03:58 11:45:45
222 processes: 5 running, 195 sleeping, 22 waiting
CPU states: 11.1% user, 0.0% nice, 9.5% system, 50.8% interrupt, 28.6%idle
Mem: 385M Active, 383M Inact, 130M Wired, 112M Buf, 102M Free
Swap: 1024M Total, 1024M Free
PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND
11 root 1 -44 -163 0K 8K WAIT 167:59 48.97% swi1: net
10 root 1 171 52 0K 8K RUN 105:03 40.14% idle
======= top -S =========
======= vmstat -i =========
interrupt total rate
irq1: atkbd0 6 0
irq6: fdc0 10 0
irq14: ata0 69 0
irq18: atapci1 744264 40
irq20: ste0 ste3 367659 20
irq21: ste1 68369 3
irq22: ste2 17363 0
irq37: amr0 163753 8
irq64: sf0 929986 50
irq65: sf1 88029 4
irq66: sf2 769382 42
irq67: sf3 243483 13
irq69: em0 49426 2
cpu0: timer 36297103 1989
Total 39738902 2178
======= vmstat -i =========
======= systat -vmstat 1 =========
5 users Load 0.63 0.78 0.90 Sep 28 11:46
Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER
Tot Share Tot Share Free in out in out
Act 385732 5800 505880 6192 113536 count
All 908416 9524 71515392 11096 pages
Interrupts
Proc:r p d s w Csw Trp Sys Int Sof Flt 190 cow 2004 total
7 13145 1 3259 14063972713350 76 1086 138836 wire 1:
atkb
377628 act 6:
fdc0
43.2%Sys 51.9%Intr 4.9%User 0.0%Nice 0.0%Idl 392568 inact 14:
ata
| | | | | | | | | | cache 18:
ata
======================++++++++++++++++++++++++++ 115184 free 20:
ste
daefr 21:
ste
Namei Name-cache Dir-cache 468 prcfr 22:
ste
Calls hits % hits % react 2 37:
amr
2684 2532 94 pdwak 64:
sf0
658 zfod pdpgs 65:
sf1
Disks amrd0 655 ozfod intrn 66:
sf2
KB/t 2.22 99 %slo-z 114288 buf 67:
sf3
tps 7 1256 tfree 107 dirty 69:
em0
MB/s 0.01 70226 desir 2002ecpu0:
time
% busy 7 20240 numvnodes
1304 freevnodes
======= systat -vmstat 1 =========
======= dmesg =========
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.2-PRERELEASE #0: Thu Sep 28 06:25:48 BRT 2006
root@Caco-new:/usr/src/sys/i386/compile/Caco
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.51-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf4a Stepping = 10
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,D
TS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
AMD Features=0x20100000<NX,LM>
AMD Features2=0x1<LAHF>
real memory = 1073479680 (1023 MB)
avail memory = 1045721088 (997 MB)
ACPI APIC Table: <DELL PE1800 >
ioapic0: Changing APIC ID to 1
ioapic1: Changing APIC ID to 2
ioapic1: WARNING: intbase 32 != expected base 24
ioapic2: Changing APIC ID to 3
ioapic2: WARNING: intbase 64 != expected base 56
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 32-55 on motherboard
ioapic2 <Version 2.0> irqs 64-87 on motherboard
kbd1 at kbdmux0
acpi0: <DELL PE1800> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pci2: <mass storage, SCSI> at device 4.0 (no driver attached)
amr0: <LSILogic MegaRAID 1.53> mem 0xf80f0000-0xf80fffff irq 37 at device
5.0 on pci2
amr0: delete logical drives supported by controller
amr0: <LSILogic PERC 4/SC> Firmware 351X, BIOS 1.10, 64MB RAM
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci1
pci3: <ACPI PCI bus> on pcib3
em0: <Intel(R) PRO/1000 Network Connection Version - 6.1.4> port
0xccc0-0xccff mem 0xfe4e0000-0xfe4ffff
f irq 69 at device 7.0 on pci3
em0: Ethernet address: 00:13:72:fd:ed:26
pcib4: <PCI-PCI bridge> at device 9.0 on pci3
pci4: <PCI bus> on pcib4
sf0: <Adaptec ANA-62044 10/100BaseTX> port 0xdc00-0xdcff mem
0xfe780000-0xfe7fffff irq 64 at device 4.0
on pci4
miibus0: <MII bus> on sf0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf0: Ethernet address: 00:00:d1:ef:75:15
sf1: <Adaptec ANA-62044 10/100BaseTX> port 0xd800-0xd8ff mem
0xfe700000-0xfe77ffff irq 65 at device 5.0
on pci4
miibus1: <MII bus> on sf1
ukphy1: <Generic IEEE 802.3u media interface> on miibus1
ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf1: Ethernet address: 00:00:d1:ef:75:16
sf2: <Adaptec ANA-62044 10/100BaseTX> port 0xd400-0xd4ff mem
0xfe680000-0xfe6fffff irq 66 at device 6.0
on pci4
miibus2: <MII bus> on sf2
ukphy2: <Generic IEEE 802.3u media interface> on miibus2
ukphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf2: Ethernet address: 00:00:d1:ef:75:17
sf3: <Adaptec ANA-62044 10/100BaseTX> port 0xd000-0xd0ff mem
0xfe600000-0xfe67ffff irq 67 at device 7.0
on pci4
miibus3: <MII bus> on sf3
ukphy3: <Generic IEEE 802.3u media interface> on miibus3
ukphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf3: Ethernet address: 00:00:d1:ef:75:18
pcib5: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci6: <ACPI PCI bus> on pcib6
pci0: <serial bus, USB> at device 29.0 (no driver attached)
pci0: <serial bus, USB> at device 29.1 (no driver attached)
pci0: <serial bus, USB> at device 29.2 (no driver attached)
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pcib8: <PCI-PCI bridge> at device 3.0 on pci7
pci8: <PCI bus> on pcib8
ste0: <D-Link DL10050 10/100BaseTX> port 0xbc80-0xbcff irq 20 at
device 4.0on pci8
miibus4: <MII bus> on ste0
ukphy4: <Generic IEEE 802.3u media interface> on miibus4
ukphy4: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste0: Ethernet address: 00:0d:88:c5:d2:54
ste1: <D-Link DL10050 10/100BaseTX> port 0xbc00-0xbc7f irq 21 at
device 5.0on pci8
miibus5: <MII bus> on ste1
ukphy5: <Generic IEEE 802.3u media interface> on miibus5
ukphy5: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste1: Ethernet address: 00:0d:88:c5:d2:55
ste2: <D-Link DL10050 10/100BaseTX> port 0xb880-0xb8ff irq 22 at
device 6.0on pci8
miibus6: <MII bus> on ste2
ukphy6: <Generic IEEE 802.3u media interface> on miibus6
ukphy6: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste2: Ethernet address: 00:0d:88:c5:d2:56
ste3: <D-Link DL10050 10/100BaseTX> port 0xb800-0xb87f irq 20 at
device 7.0on pci8
miibus7: <MII bus> on ste3
ukphy7: <Generic IEEE 802.3u media interface> on miibus7
ukphy7: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste3: Ethernet address: 00:0d:88:c5:d2:57
pci7: <display, VGA> at device 5.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at devi
ce 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <Intel ICH5 SATA150 controller> port
0x9c98-0x9c9f,0x9c90-0x9c93,0x9c80-0x9c87,0x9c78-0x9c7b,0
x9c60-0x9c6f irq 18 at device 31.2 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
pmtimer0 on isa0
ipmi0: <System Management BIOS> at iomem 0xfa490-0xfa4ae,0xfa4b0-0xfb0a1 on
isa0
ipmi0: SMBIOS Version: 2.03, revision: 2.03
ipmi0: KCS mode found at io 0xca8 alignment 0x4 on isa
ipmi0: IPMI device rev. 0, firmware rev. 1.81, version 1.5
ipmi0: Number of channels 4
ipmi0: Attached watchdog
orm0: <ISA Option ROMs> at iomem
0xc0000-0xcafff,0xcb000-0xcb7ff,0xec000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 2992510575 Hz quality 800
Timecounters tick every 1.000 msec
acd0: CDROM <GCR-8483B/1.10> at ata0-master UDMA33
amr0: delete logical drives supported by controller
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 69880MB (143114240 sectors) RAID 1 (optimal)
Trying to mount root from ufs:/dev/amrd0s3a
======= dmesg =========
Any ideas on how to decrease the interrupt rate and increase the performance
??
Best Regards,
Alexandre
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?8e10486b0609280757u2bc9b93cyfc9df589b7f4f732>