From owner-freebsd-stable@FreeBSD.ORG Thu Sep 28 14:57:39 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AEE5B16A407 for ; Thu, 28 Sep 2006 14:57:39 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: from nz-out-0102.google.com (nz-out-0102.google.com [64.233.162.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id AABE543D67 for ; Thu, 28 Sep 2006 14:57:23 +0000 (GMT) (envelope-from biancalana@gmail.com) Received: by nz-out-0102.google.com with SMTP id 13so249767nzn for ; Thu, 28 Sep 2006 07:57:23 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type; b=mPvj72EaIk5XriUjw0xdqVziXnr8Z09Y3XHDnXUDmMY/qjw7Or4dwM4MiWzQW31kUM8gh60Wlji8j17uwGe+I7SULfDuX1fDQYd1yppsp+/rvs8ATt16rfBiADgacUZ9j8Ws9WVhNrorNb2buNJbcVYhO1WFVBBwIXzXgh/mb0Y= Received: by 10.35.9.15 with SMTP id m15mr435471pyi; Thu, 28 Sep 2006 07:57:22 -0700 (PDT) Received: by 10.35.26.5 with HTTP; Thu, 28 Sep 2006 07:57:21 -0700 (PDT) Message-ID: <8e10486b0609280757u2bc9b93cyfc9df589b7f4f732@mail.gmail.com> Date: Thu, 28 Sep 2006 11:57:22 -0300 From: "Alexandre Biancalana" To: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: 6-Stable High Interrupt Rate on network X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Sep 2006 14:57:39 -0000 Hi list, Today I changed the main gateway from our network from PIII 733, 512 MB Ram running FreeBSD 4-STABLE to a Xeon 3.0, 1Gb Ram running FreeBSD 6-STABLE. But the performance of the network is worst than before. The new machine is a Dell PowerEdge 1800 have one quad DLink DFE-580TX, one quad Adaptec ANA-62044 and one on board Intel em. I enabled the polling on all interfaces, set the HZ to 1000 and set kern.polling.user_frac=30, but this does not happened. Looking the new machine the high interrupt rate call my attention, follow some infos: ======= sysctl kern.polling ========= kern.polling.idlepoll_sleeping: 1 kern.polling.stalled: 0 kern.polling.suspect: 66 kern.polling.phase: 0 kern.polling.enable: 1 kern.polling.handlers: 9 kern.polling.residual_burst: 0 kern.polling.pending_polls: 0 kern.polling.lost_polls: 19928 kern.polling.short_ticks: 1489 kern.polling.reg_frac: 20 kern.polling.user_frac: 30 kern.polling.idle_poll: 0 kern.polling.each_burst: 10 kern.polling.burst_max: 150 kern.polling.burst: 86 ======= sysctl kern.polling ========= ======= top -S ========= last pid: 71517; load averages: 0.63, 0.82, 0.93 up 0+05:03:58 11:45:45 222 processes: 5 running, 195 sleeping, 22 waiting CPU states: 11.1% user, 0.0% nice, 9.5% system, 50.8% interrupt, 28.6%idle Mem: 385M Active, 383M Inact, 130M Wired, 112M Buf, 102M Free Swap: 1024M Total, 1024M Free PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND 11 root 1 -44 -163 0K 8K WAIT 167:59 48.97% swi1: net 10 root 1 171 52 0K 8K RUN 105:03 40.14% idle ======= top -S ========= ======= vmstat -i ========= interrupt total rate irq1: atkbd0 6 0 irq6: fdc0 10 0 irq14: ata0 69 0 irq18: atapci1 744264 40 irq20: ste0 ste3 367659 20 irq21: ste1 68369 3 irq22: ste2 17363 0 irq37: amr0 163753 8 irq64: sf0 929986 50 irq65: sf1 88029 4 irq66: sf2 769382 42 irq67: sf3 243483 13 irq69: em0 49426 2 cpu0: timer 36297103 1989 Total 39738902 2178 ======= vmstat -i ========= ======= systat -vmstat 1 ========= 5 users Load 0.63 0.78 0.90 Sep 28 11:46 Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 385732 5800 505880 6192 113536 count All 908416 9524 71515392 11096 pages Interrupts Proc:r p d s w Csw Trp Sys Int Sof Flt 190 cow 2004 total 7 13145 1 3259 14063972713350 76 1086 138836 wire 1: atkb 377628 act 6: fdc0 43.2%Sys 51.9%Intr 4.9%User 0.0%Nice 0.0%Idl 392568 inact 14: ata | | | | | | | | | | cache 18: ata ======================++++++++++++++++++++++++++ 115184 free 20: ste daefr 21: ste Namei Name-cache Dir-cache 468 prcfr 22: ste Calls hits % hits % react 2 37: amr 2684 2532 94 pdwak 64: sf0 658 zfod pdpgs 65: sf1 Disks amrd0 655 ozfod intrn 66: sf2 KB/t 2.22 99 %slo-z 114288 buf 67: sf3 tps 7 1256 tfree 107 dirty 69: em0 MB/s 0.01 70226 desir 2002ecpu0: time % busy 7 20240 numvnodes 1304 freevnodes ======= systat -vmstat 1 ========= ======= dmesg ========= Copyright (c) 1992-2006 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.2-PRERELEASE #0: Thu Sep 28 06:25:48 BRT 2006 root@Caco-new:/usr/src/sys/i386/compile/Caco Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.51-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf4a Stepping = 10 Features=0xbfebfbff Features2=0x641d> AMD Features=0x20100000 AMD Features2=0x1 real memory = 1073479680 (1023 MB) avail memory = 1045721088 (997 MB) ACPI APIC Table: ioapic0: Changing APIC ID to 1 ioapic1: Changing APIC ID to 2 ioapic1: WARNING: intbase 32 != expected base 24 ioapic2: Changing APIC ID to 3 ioapic2: WARNING: intbase 64 != expected base 56 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 32-55 on motherboard ioapic2 irqs 64-87 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 2.0 on pci0 pci1: on pcib1 pcib2: at device 0.0 on pci1 pci2: on pcib2 pci2: at device 4.0 (no driver attached) amr0: mem 0xf80f0000-0xf80fffff irq 37 at device 5.0 on pci2 amr0: delete logical drives supported by controller amr0: Firmware 351X, BIOS 1.10, 64MB RAM pcib3: at device 0.2 on pci1 pci3: on pcib3 em0: port 0xccc0-0xccff mem 0xfe4e0000-0xfe4ffff f irq 69 at device 7.0 on pci3 em0: Ethernet address: 00:13:72:fd:ed:26 pcib4: at device 9.0 on pci3 pci4: on pcib4 sf0: port 0xdc00-0xdcff mem 0xfe780000-0xfe7fffff irq 64 at device 4.0 on pci4 miibus0: on sf0 ukphy0: on miibus0 ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto sf0: Ethernet address: 00:00:d1:ef:75:15 sf1: port 0xd800-0xd8ff mem 0xfe700000-0xfe77ffff irq 65 at device 5.0 on pci4 miibus1: on sf1 ukphy1: on miibus1 ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto sf1: Ethernet address: 00:00:d1:ef:75:16 sf2: port 0xd400-0xd4ff mem 0xfe680000-0xfe6fffff irq 66 at device 6.0 on pci4 miibus2: on sf2 ukphy2: on miibus2 ukphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto sf2: Ethernet address: 00:00:d1:ef:75:17 sf3: port 0xd000-0xd0ff mem 0xfe600000-0xfe67ffff irq 67 at device 7.0 on pci4 miibus3: on sf3 ukphy3: on miibus3 ukphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto sf3: Ethernet address: 00:00:d1:ef:75:18 pcib5: at device 4.0 on pci0 pci5: on pcib5 pcib6: at device 6.0 on pci0 pci6: on pcib6 pci0: at device 29.0 (no driver attached) pci0: at device 29.1 (no driver attached) pci0: at device 29.2 (no driver attached) pci0: at device 29.7 (no driver attached) pcib7: at device 30.0 on pci0 pci7: on pcib7 pcib8: at device 3.0 on pci7 pci8: on pcib8 ste0: port 0xbc80-0xbcff irq 20 at device 4.0on pci8 miibus4: on ste0 ukphy4: on miibus4 ukphy4: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto ste0: Ethernet address: 00:0d:88:c5:d2:54 ste1: port 0xbc00-0xbc7f irq 21 at device 5.0on pci8 miibus5: on ste1 ukphy5: on miibus5 ukphy5: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto ste1: Ethernet address: 00:0d:88:c5:d2:55 ste2: port 0xb880-0xb8ff irq 22 at device 6.0on pci8 miibus6: on ste2 ukphy6: on miibus6 ukphy6: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto ste2: Ethernet address: 00:0d:88:c5:d2:56 ste3: port 0xb800-0xb87f irq 20 at device 7.0on pci8 miibus7: on ste3 ukphy7: on miibus7 ukphy7: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto ste3: Ethernet address: 00:0d:88:c5:d2:57 pci7: at device 5.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at devi ce 31.1 on pci0 ata0: on atapci0 ata1: on atapci0 atapci1: port 0x9c98-0x9c9f,0x9c90-0x9c93,0x9c80-0x9c87,0x9c78-0x9c7b,0 x9c60-0x9c6f irq 18 at device 31.2 on pci0 ata2: on atapci1 ata3: on atapci1 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] pmtimer0 on isa0 ipmi0: at iomem 0xfa490-0xfa4ae,0xfa4b0-0xfb0a1 on isa0 ipmi0: SMBIOS Version: 2.03, revision: 2.03 ipmi0: KCS mode found at io 0xca8 alignment 0x4 on isa ipmi0: IPMI device rev. 0, firmware rev. 1.81, version 1.5 ipmi0: Number of channels 4 ipmi0: Attached watchdog orm0: at iomem 0xc0000-0xcafff,0xcb000-0xcb7ff,0xec000-0xeffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounter "TSC" frequency 2992510575 Hz quality 800 Timecounters tick every 1.000 msec acd0: CDROM at ata0-master UDMA33 amr0: delete logical drives supported by controller amrd0: on amr0 amrd0: 69880MB (143114240 sectors) RAID 1 (optimal) Trying to mount root from ufs:/dev/amrd0s3a ======= dmesg ========= Any ideas on how to decrease the interrupt rate and increase the performance ?? Best Regards, Alexandre