Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 28 Sep 2006 11:57:22 -0300
From:      "Alexandre Biancalana" <biancalana@gmail.com>
To:        freebsd-stable@freebsd.org
Subject:   6-Stable High Interrupt Rate on network
Message-ID:  <8e10486b0609280757u2bc9b93cyfc9df589b7f4f732@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
Hi list,

   Today I changed the main gateway from our network from PIII 733, 512 MB
Ram running FreeBSD 4-STABLE to a Xeon 3.0, 1Gb Ram running FreeBSD
6-STABLE. But the performance of the network is worst than before.

  The new machine is a Dell PowerEdge 1800 have one quad DLink DFE-580TX,
one quad Adaptec ANA-62044 and one on board Intel em. I enabled the polling
on all interfaces, set the HZ to 1000 and set kern.polling.user_frac=30, but
this does not happened.

   Looking the new machine the high interrupt rate call my attention, follow
some infos:


======= sysctl kern.polling =========

kern.polling.idlepoll_sleeping: 1
kern.polling.stalled: 0
kern.polling.suspect: 66
kern.polling.phase: 0
kern.polling.enable: 1
kern.polling.handlers: 9
kern.polling.residual_burst: 0
kern.polling.pending_polls: 0
kern.polling.lost_polls: 19928
kern.polling.short_ticks: 1489
kern.polling.reg_frac: 20
kern.polling.user_frac: 30
kern.polling.idle_poll: 0
kern.polling.each_burst: 10
kern.polling.burst_max: 150
kern.polling.burst: 86

======= sysctl kern.polling =========


======= top -S =========

last pid: 71517;  load averages:  0.63,  0.82,  0.93
up 0+05:03:58  11:45:45
222 processes: 5 running, 195 sleeping, 22 waiting
CPU states: 11.1% user,  0.0% nice,  9.5% system, 50.8% interrupt, 28.6%idle
Mem: 385M Active, 383M Inact, 130M Wired, 112M Buf, 102M Free
Swap: 1024M Total, 1024M Free

  PID USERNAME  THR PRI NICE   SIZE    RES STATE    TIME   WCPU COMMAND
   11 root        1 -44 -163     0K     8K WAIT   167:59 48.97% swi1: net
   10 root        1 171   52     0K     8K RUN    105:03 40.14% idle
======= top -S =========


======= vmstat -i =========
interrupt                          total       rate
irq1: atkbd0                           6          0
irq6: fdc0                            10          0
irq14: ata0                           69          0
irq18: atapci1                    744264         40
irq20: ste0 ste3                  367659         20
irq21: ste1                        68369          3
irq22: ste2                        17363          0
irq37: amr0                       163753          8
irq64: sf0                        929986         50
irq65: sf1                         88029          4
irq66: sf2                        769382         42
irq67: sf3                        243483         13
irq69: em0                         49426          2
cpu0: timer                     36297103       1989
Total                           39738902       2178
======= vmstat -i =========



======= systat -vmstat 1 =========

    5 users    Load  0.63  0.78  0.90                  Sep 28 11:46

Mem:KB    REAL            VIRTUAL                     VN PAGER  SWAP PAGER
        Tot   Share      Tot    Share    Free         in  out     in  out
Act  385732    5800   505880     6192  113536 count
All  908416    9524 71515392    11096         pages
                                                                 Interrupts
Proc:r  p  d  s  w    Csw  Trp  Sys  Int  Sof  Flt    190 cow    2004 total
     7    13145  1   3259 14063972713350   76 1086 138836 wire        1:
atkb
                                                   377628 act         6:
fdc0
43.2%Sys  51.9%Intr  4.9%User  0.0%Nice  0.0%Idl   392568 inact       14:
ata
|    |    |    |    |    |    |    |    |    |            cache       18:
ata
======================++++++++++++++++++++++++++   115184 free        20:
ste
                                                          daefr       21:
ste
Namei         Name-cache    Dir-cache                 468 prcfr       22:
ste
    Calls     hits    %     hits    %                     react     2 37:
amr
     2684     2532   94                                   pdwak       64:
sf0
                                      658 zfod            pdpgs       65:
sf1
Disks amrd0                           655 ozfod           intrn       66:
sf2
KB/t   2.22                            99 %slo-z   114288 buf         67:
sf3
tps       7                          1256 tfree       107 dirty       69:
em0
MB/s   0.01                                         70226 desir  2002ecpu0:
time
% busy    7                                         20240 numvnodes
                                                     1304 freevnodes
======= systat -vmstat 1 =========



======= dmesg =========
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 6.2-PRERELEASE #0: Thu Sep 28 06:25:48 BRT 2006
    root@Caco-new:/usr/src/sys/i386/compile/Caco
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.51-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf4a  Stepping = 10

Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,D
TS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
  AMD Features=0x20100000<NX,LM>
  AMD Features2=0x1<LAHF>
real memory  = 1073479680 (1023 MB)
avail memory = 1045721088 (997 MB)
ACPI APIC Table: <DELL   PE1800  >
ioapic0: Changing APIC ID to 1
ioapic1: Changing APIC ID to 2
ioapic1: WARNING: intbase 32 != expected base 24
ioapic2: Changing APIC ID to 3
ioapic2: WARNING: intbase 64 != expected base 56
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 32-55 on motherboard
ioapic2 <Version 2.0> irqs 64-87 on motherboard
kbd1 at kbdmux0
acpi0: <DELL PE1800> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pci2: <mass storage, SCSI> at device 4.0 (no driver attached)
amr0: <LSILogic MegaRAID 1.53> mem 0xf80f0000-0xf80fffff irq 37 at device
5.0 on pci2
amr0: delete logical drives supported by controller
amr0: <LSILogic PERC 4/SC> Firmware 351X, BIOS 1.10, 64MB RAM
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci1
pci3: <ACPI PCI bus> on pcib3
em0: <Intel(R) PRO/1000 Network Connection Version - 6.1.4> port
0xccc0-0xccff mem 0xfe4e0000-0xfe4ffff
f irq 69 at device 7.0 on pci3
em0: Ethernet address: 00:13:72:fd:ed:26
pcib4: <PCI-PCI bridge> at device 9.0 on pci3
pci4: <PCI bus> on pcib4
sf0: <Adaptec ANA-62044 10/100BaseTX> port 0xdc00-0xdcff mem
0xfe780000-0xfe7fffff irq 64 at device 4.0
 on pci4
miibus0: <MII bus> on sf0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf0: Ethernet address: 00:00:d1:ef:75:15
sf1: <Adaptec ANA-62044 10/100BaseTX> port 0xd800-0xd8ff mem
0xfe700000-0xfe77ffff irq 65 at device 5.0
 on pci4
miibus1: <MII bus> on sf1
ukphy1: <Generic IEEE 802.3u media interface> on miibus1
ukphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf1: Ethernet address: 00:00:d1:ef:75:16
sf2: <Adaptec ANA-62044 10/100BaseTX> port 0xd400-0xd4ff mem
0xfe680000-0xfe6fffff irq 66 at device 6.0
 on pci4
miibus2: <MII bus> on sf2
ukphy2: <Generic IEEE 802.3u media interface> on miibus2
ukphy2:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf2: Ethernet address: 00:00:d1:ef:75:17
sf3: <Adaptec ANA-62044 10/100BaseTX> port 0xd000-0xd0ff mem
0xfe600000-0xfe67ffff irq 67 at device 7.0
 on pci4
miibus3: <MII bus> on sf3
ukphy3: <Generic IEEE 802.3u media interface> on miibus3
ukphy3:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
sf3: Ethernet address: 00:00:d1:ef:75:18
pcib5: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci6: <ACPI PCI bus> on pcib6
pci0: <serial bus, USB> at device 29.0 (no driver attached)
pci0: <serial bus, USB> at device 29.1 (no driver attached)
pci0: <serial bus, USB> at device 29.2 (no driver attached)
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pcib8: <PCI-PCI bridge> at device 3.0 on pci7
pci8: <PCI bus> on pcib8
ste0: <D-Link DL10050 10/100BaseTX> port 0xbc80-0xbcff irq 20 at
device 4.0on pci8
miibus4: <MII bus> on ste0
ukphy4: <Generic IEEE 802.3u media interface> on miibus4
ukphy4:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste0: Ethernet address: 00:0d:88:c5:d2:54
ste1: <D-Link DL10050 10/100BaseTX> port 0xbc00-0xbc7f irq 21 at
device 5.0on pci8
miibus5: <MII bus> on ste1
ukphy5: <Generic IEEE 802.3u media interface> on miibus5
ukphy5:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste1: Ethernet address: 00:0d:88:c5:d2:55
ste2: <D-Link DL10050 10/100BaseTX> port 0xb880-0xb8ff irq 22 at
device 6.0on pci8
miibus6: <MII bus> on ste2
ukphy6: <Generic IEEE 802.3u media interface> on miibus6
ukphy6:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste2: Ethernet address: 00:0d:88:c5:d2:56
ste3: <D-Link DL10050 10/100BaseTX> port 0xb800-0xb87f irq 20 at
device 7.0on pci8
miibus7: <MII bus> on ste3
ukphy7: <Generic IEEE 802.3u media interface> on miibus7
ukphy7:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste3: Ethernet address: 00:0d:88:c5:d2:57
pci7: <display, VGA> at device 5.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at devi
ce 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <Intel ICH5 SATA150 controller> port
0x9c98-0x9c9f,0x9c90-0x9c93,0x9c80-0x9c87,0x9c78-0x9c7b,0
x9c60-0x9c6f irq 18 at device 31.2 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
pmtimer0 on isa0
ipmi0: <System Management BIOS> at iomem 0xfa490-0xfa4ae,0xfa4b0-0xfb0a1 on
isa0
ipmi0: SMBIOS Version: 2.03, revision: 2.03
ipmi0: KCS mode found at io 0xca8 alignment 0x4 on isa
ipmi0: IPMI device rev. 0, firmware rev. 1.81, version 1.5
ipmi0: Number of channels 4
ipmi0: Attached watchdog
orm0: <ISA Option ROMs> at iomem
0xc0000-0xcafff,0xcb000-0xcb7ff,0xec000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 2992510575 Hz quality 800
Timecounters tick every 1.000 msec
acd0: CDROM <GCR-8483B/1.10> at ata0-master UDMA33
amr0: delete logical drives supported by controller
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 69880MB (143114240 sectors) RAID 1 (optimal)
Trying to mount root from ufs:/dev/amrd0s3a
======= dmesg =========


Any ideas on how to decrease the interrupt rate and increase the performance
??


  Best Regards,
Alexandre



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?8e10486b0609280757u2bc9b93cyfc9df589b7f4f732>