From owner-freebsd-performance@FreeBSD.ORG Fri Jul 4 16:53:13 2008 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5FAA0106567A for ; Fri, 4 Jul 2008 16:53:13 +0000 (UTC) (envelope-from rabing@omc.net) Received: from office.omc.net (office.omc.net [212.77.224.22]) by mx1.freebsd.org (Postfix) with ESMTP id B91008FC15 for ; Fri, 4 Jul 2008 16:53:12 +0000 (UTC) (envelope-from rabing@omc.net) Received: from xoffice.omc.net (xoffice.omc.net [212.77.224.172]) by office.omc.net (8.14.1/8.14.1) with ESMTP id m64GDf4T088896 for ; Fri, 4 Jul 2008 18:13:41 +0200 (CEST) (envelope-from rabing@omc.net) Received: from [212.77.224.50] (lutz.omc.net [212.77.224.50]) by xoffice.omc.net (8.14.2/8.14.2) with ESMTP id m64GDfOm078941 for ; Fri, 4 Jul 2008 18:13:41 +0200 (CEST) (envelope-from rabing@omc.net) Message-ID: <486E4C20.7050102@omc.net> Date: Fri, 04 Jul 2008 18:13:20 +0200 From: Lutz Rabing User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: freebsd-performance@freebsd.org X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Fri, 04 Jul 2008 17:20:01 +0000 Subject: low sysbench scores on 8 core server X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rabing@omc.net List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2008 16:53:13 -0000 hi, I did some testing an a supermicro 2 x 4 core xeon server under 64bit "7.0-STABLE #1: Fri Jul 4". when we first tested the system under load (2000 apache threads) the system performed bad compare to other dual core systems under the same workload. the 8 core system had 0% idle time and almost 100% system load. I could not find out what the load was. disk IO was close to zero during that time. because of that I checked the sysbench results with this test: sysbench --test=oltp --mysql-socket=/tmp/mysql.sock --mysql-user=root \ --max-requests=0 --max-time=60 --oltp-read -only=on --num-threads=$1 run here are the sysbench results: - 1 thread -------------------------------------------------------- OLTP test statistics: queries performed: read: 354774 write: 0 other: 50682 total: 405456 transactions: 25341 (422.34 per sec.) deadlocks: 0 (0.00 per sec.) read/write requests: 354774 (5912.82 per sec.) other operations: 50682 (844.69 per sec.) - 8 threads ------------------------------------------------------- OLTP test statistics: queries performed: read: 145166 write: 0 other: 20738 total: 165904 transactions: 10369 (172.75 per sec.) deadlocks: 0 (0.00 per sec.) read/write requests: 145166 (2418.54 per sec.) other operations: 20738 (345.51 per sec.) -------------------------------------------------------------------- during the 8 thread test "top" looks like this: ----------------------------------------------------------------------------- last pid: 30104; load averages: 2.50, 0.65, 0.52 up 0+01:49:44 17:52:14 69 processes: 7 running, 62 sleeping CPU: 5.6% user, 0.0% nice, 64.0% system, 0.0% interrupt, 30.4% idle Mem: 44M Active, 296M Inact, 277M Wired, 84K Cache, 214M Buf, 15G Free Swap: 16G Total, 16G Free ----------------------------------------------------------------------------- software versions used: - mysql-server-5.1.25 - sysbench-0.4.8 any ideas what I should look for or what to change? I could supply more info if needed. dmesg appended. thanks, lutz ================================================================================================== FreeBSD 7.0-STABLE #1: Fri Jul 4 01:41:13 CEST 2008 root@www5.4eins.de:/usr/obj/usr/src/sys/OMC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU E5345 @ 2.33GHz (2333.35-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x6f7 Stepping = 7 Features=0xbfebfbff Features2=0x4e3bd AMD Features=0x20100800 AMD Features2=0x1 Cores per package: 4 usable memory = 17166041088 (16370 MB) avail memory = 16626790400 (15856 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 2.0 on pci0 pci1: on pcib1 pcib2: irq 16 at device 0.0 on pci1 pci2: on pcib2 pcib3: irq 16 at device 0.0 on pci2 pci3: on pcib3 pcib4: at device 2.0 on pci2 pci4: on pcib4 em0: port 0x2000-0x201f mem 0xda000000-0xda01ffff irq 18 at device 0.0 on pci4 em0: Using MSI interrupt em0: [FILTER] em0: Ethernet address: 00:30:48:79:cb:ba em1: port 0x2020-0x203f mem 0xda020000-0xda03ffff irq 19 at device 0.1 on pci4 em1: Using MSI interrupt em1: [FILTER] em1: Ethernet address: 00:30:48:79:cb:bb pcib5: at device 0.3 on pci1 pci5: on pcib5 pcib6: at device 4.0 on pci0 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 pcib8: at device 0.2 on pci6 pci8: on pcib8 pcib9: at device 6.0 on pci0 pci9: on pcib9 pcib10: at device 0.0 on pci9 pci10: on pcib10 3ware device driver for 9000 series storage controllers, version: 3.70.05.001 twa0: <3ware 9000 series Storage Controller> port 0x3000-0x303f mem 0xd8000000-0xd9ffffff,0xda300000-0xda300fff irq 18 at device 1.0 on pci10 twa0: [ITHREAD] twa0: INFO: (0x04: 0x0053): Battery capacity test is overdue: twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SXU-4LP, 4 ports, Firmware FE9X 3.04.00.005, BIOS BE9X 3.04.00.002 pcib11: at device 0.2 on pci9 pci11: on pcib11 pci0: at device 8.0 (no driver attached) uhci0: port 0x1800-0x181f irq 17 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered uhci1: port 0x1820-0x183f irq 19 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] uhci1: [ITHREAD] usb1: on uhci1 usb1: USB revision 1.0 uhub1: on usb1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0x1840-0x185f irq 18 at device 29.2 on pci0 uhci2: [GIANT-LOCKED] uhci2: [ITHREAD] usb2: on uhci2 usb2: USB revision 1.0 uhub2: on usb2 uhub2: 2 ports with 2 removable, self powered ehci0: mem 0xda600400-0xda6007ff irq 17 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb3: EHCI version 1.0 usb3: companion controllers, 2 ports each: usb0 usb1 usb2 usb3: on ehci0 usb3: USB revision 2.0 uhub3: on usb3 uhub3: 6 ports with 6 removable, self powered pcib12: at device 30.0 on pci0 pci12: on pcib12 vgapci0: port 0x4000-0x40ff mem 0xd0000000-0xd7ffffff,0xda200000-0xda20ffff irq 18 at device 1.0 on pci12 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1860-0x186f at device 31.1 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] atapci1: port 0x18a0-0x18a7,0x1874-0x1877,0x1878-0x187f,0x1870-0x1873,0x1880-0x189f mem 0xda600800-0xda600bff irq 19 at device 31.2 on pci0 atapci1: [ITHREAD] atapci1: AHCI Version 01.10 controller with 6 ports detected ata2: on atapci1 ata2: [ITHREAD] ata3: on atapci1 ata3: [ITHREAD] ata4: on atapci1 ata4: [ITHREAD] ata5: on atapci1 ata5: [ITHREAD] ata6: on atapci1 ata6: [ITHREAD] ata7: on atapci1 ata7: [ITHREAD] pci0: at device 31.3 (no driver attached) cpu0: on acpi0 est0: on cpu0 p4tcc0: on cpu0 cpu1: on acpi0 est1: on cpu1 p4tcc1: on cpu1 cpu2: on acpi0 est2: on cpu2 p4tcc2: on cpu2 cpu3: on acpi0 est3: on cpu3 p4tcc3: on cpu3 cpu4: on acpi0 est4: on cpu4 p4tcc4: on cpu4 cpu5: on acpi0 est5: on cpu5 p4tcc5: on cpu5 cpu6: on acpi0 est6: on cpu6 p4tcc6: on cpu6 cpu7: on acpi0 est7: on cpu7 p4tcc7: on cpu7 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A sio1: [FILTER] fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FILTER] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 acpi_button0: on acpi0 orm0: at iomem 0xc0000-0xcafff,0xcb000-0xcc7ff on isa0 ppc0: cannot reserve I/O port range sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec ipfw2 (+ipv6) initialized, divert loadable, nat loadable, rule-based forwarding disabled, default to accept, logging limited to 100 packets/entry by default acd0: CDRW at ata0-slave UDMA33 SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #5 Launched! da0 at twa0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 100.000MB/s transfers da0: 1430490MB (2929643520 512 byte sectors: 255H 63S/T 182361C) Trying to mount root from ufs:/dev/da0s1a