From owner-freebsd-bugs@FreeBSD.ORG Wed Sep 21 14:00:24 2005 Return-Path: X-Original-To: freebsd-bugs@hub.freebsd.org Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A9FE516A41F for ; Wed, 21 Sep 2005 14:00:24 +0000 (GMT) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id A2CF943D46 for ; Wed, 21 Sep 2005 14:00:23 +0000 (GMT) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.3/8.13.3) with ESMTP id j8LE0Nwx021865 for ; Wed, 21 Sep 2005 14:00:23 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.3/8.13.1/Submit) id j8LE0NWw021864; Wed, 21 Sep 2005 14:00:23 GMT (envelope-from gnats) Resent-Date: Wed, 21 Sep 2005 14:00:23 GMT Resent-Message-Id: <200509211400.j8LE0NWw021864@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Benjamin Lutz Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3A2E916A41F for ; Wed, 21 Sep 2005 13:53:55 +0000 (GMT) (envelope-from maxlor@maxlor.mine.nu) Received: from maxlor.mine.nu (c-213-160-32-54.customer.ggaweb.ch [213.160.32.54]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4854043D70 for ; Wed, 21 Sep 2005 13:53:35 +0000 (GMT) (envelope-from maxlor@maxlor.mine.nu) Received: from localhost (localhost [127.0.0.1]) by maxlor.mine.nu (Postfix) with ESMTP id D83EE33B for ; Wed, 21 Sep 2005 15:53:33 +0200 (CEST) Received: from maxlor.mine.nu ([127.0.0.1]) by localhost (midgard.intranet [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 02643-09 for ; Wed, 21 Sep 2005 15:53:32 +0200 (CEST) Received: by maxlor.mine.nu (Postfix, from userid 1000) id 87324364; Wed, 21 Sep 2005 15:53:32 +0200 (CEST) Message-Id: <20050921135332.87324364@maxlor.mine.nu> Date: Wed, 21 Sep 2005 15:53:32 +0200 (CEST) From: Benjamin Lutz To: FreeBSD-gnats-submit@FreeBSD.org X-Send-Pr-Version: 3.113 Cc: Subject: kern/86411: Very low performance of amr(4) under FreeBSD-6.0-BETA5 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Benjamin Lutz List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Sep 2005 14:00:24 -0000 >Number: 86411 >Category: kern >Synopsis: Very low performance of amr(4) under FreeBSD-6.0-BETA5 >Confidential: no >Severity: serious >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Wed Sep 21 14:00:23 GMT 2005 >Closed-Date: >Last-Modified: >Originator: Benjamin Lutz >Release: FreeBSD 6.0-BETA5 i386 >Organization: >Environment: System: FreeBSD gaia.intranet 6.0-BETA5 FreeBSD 6.0-BETA5 #0: Tue Sep 20 03:26:52 CEST 2005 maxlor@gaia.intranet:/usr/obj/usr/src/sys/GAIA i386 This is a GENERIC kernel with us.dvorak added as standard keyboard layout. ----- dmesg start ----- Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.0-BETA5 #0: Tue Sep 20 03:26:52 CEST 2005 maxlor@gaia.intranet:/usr/obj/usr/src/sys/GAIA ACPI APIC Table: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Pentium(R) 4 CPU 2.40GHz (2399.34-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf27 Stepping = 7 Features=0xbfebfbff Features2=0x400 real memory = 268369920 (255 MB) avail memory = 253079552 (241 MB) ioapic0: Changing APIC ID to 1 ioapic1: Changing APIC ID to 2 ioapic2: Changing APIC ID to 3 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-15 on motherboard ioapic1 irqs 16-31 on motherboard ioapic2 irqs 32-47 on motherboard npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) pci_link0: on acpi0 pci_link1: irq 10 on acpi0 pci_link2: on acpi0 pci_link3: on acpi0 pci_link4: irq 5 on acpi0 pci_link5: on acpi0 pci_link6: on acpi0 pci_link7: on acpi0 pci_link8: on acpi0 pci_link9: on acpi0 pci_link10: on acpi0 pci_link11: on acpi0 pci_link12: on acpi0 pci_link13: on acpi0 pci_link14: on acpi0 pci_link15: on acpi0 pci_link16: on acpi0 pci_link17: on acpi0 pci_link18: on acpi0 pci_link19: on acpi0 pci_link20: on acpi0 pci_link21: on acpi0 pci_link22: on acpi0 pci_link23: on acpi0 pci_link24: on acpi0 pci_link25: on acpi0 pci_link26: on acpi0 pci_link27: on acpi0 pci_link28: on acpi0 pci_link29: on acpi0 pci_link30: on acpi0 pci_link31: on acpi0 pci_link32: irq 3 on acpi0 pci_link33: irq 11 on acpi0 Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 p4tcc0: on cpu0 pcib0: on acpi0 pci0: on pcib0 em0: port 0xecc0-0xecff mem 0xfe100000-0xfe11ffff irq 17 at device 2.0 on pci0 em0: Ethernet address: 00:c0:9f:21:ac:ff em0: Speed:N/A Duplex:N/A amr0: mem 0xfeb00000-0xfeb0ffff irq 20 at device 4.0 on pci0 amr0: Firmware 1.78, BIOS 3.29, 32MB RAM pci0: at device 8.0 (no driver attached) atapci0: port 0x1e8-0x1ef,0x3ec-0x3ef,0x168-0x16f,0x36c-0x36f,0x900-0x90f irq 11 at device 14.0 on pci0 ata2: on atapci0 ata3: on atapci0 atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x8b0-0x8bf at device 15.1 on pci0 ata0: on atapci1 ata1: on atapci1 ohci0: mem 0xfe120000-0xfe120fff irq 3 at device 15.2 on pci0 ohci0: [GIANT-LOCKED] usb0: OHCI version 1.0, legacy support usb0: SMM does not respond, resetting usb0: on ohci0 usb0: USB revision 1.0 uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered isab0: at device 15.3 on pci0 isa0: on isab0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 1 on acpi0 ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff,0xec000-0xeffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 uhid0: American Power Conversion Back-UPS 350 FW: 5.4.I USB FW: c1, rev 1.10/1.00, addr 2, iclass 3/0 umass0: Western Digital Corporation Western Digital USB Hard Drive, rev 2.00/ff.ff, addr 3 uhub0: 2 ports with 2 removable, self powered isab0: at device 15.3 on pci0 isa0: on isab0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 1 on acpi0 ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff,0xec000-0xeffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 uhid0: American Power Conversion Back-UPS 350 FW: 5.4.I USB FW: c1, rev 1.10/1.00, addr 2, iclass 3/0 umass0: Western Digital Corporation Western Digital USB Hard Drive, rev 2.00/ff.ff, addr 3 Timecounter "TSC" frequency 2399337620 Hz quality 800 Timecounters tick every 1.000 msec acd0: CDROM at ata2-master UDMA33 amrd0: on amr0 amrd0: 34678MB (71020544 sectors) RAID 1 (optimal) da0 at umass-sim0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 1.000MB/s transfers da0: 76319MB (156301488 512 byte sectors: 255H 63S/T 9729C) Trying to mount root from ufs:/dev/amrd0s2a ----- dmesg end ----- >Description: A RAID-1 array connected to a Dell PERC 3/SC RAID Controller (looks like a rebranded LSILogic MegaRAID SCSI Controller of some sort) gives very low write performance: root@gaia/tmp> dd if=/dev/zero of=zeroes bs=1m count=100 ^Tload: 0.00 cmd: dd 6920 [wdrain] 0.00u 0.44s 1% 1656k 47+0 records in 46+0 records out 48234496 bytes transferred in 6.768442 secs (7126381 bytes/sec) 100+0 records in 100+0 records out 104857600 bytes transferred in 14.106778 secs (7433136 bytes/sec) root@gaia/tmp> swapoff -a swapoff: removing /dev/amrd0s2b as swap device root@gaia/tmp> dd if=/dev/zero of=/dev/amrd0s2b bs=1m count=100 ^Tload: 0.00 cmd: dd 6923 [physwr] 0.00u 0.08s 0% 1656k 31+0 records in 30+0 records out 31457280 bytes transferred in 3.652500 secs (8612534 bytes/sec) 100+0 records in 100+0 records out 104857600 bytes transferred in 11.750886 secs (8923378 bytes/sec) root@gaia/tmp> dd if=/dev/amrd0s2b of=/dev/null bs=1m count=100 100+0 records in 100+0 records out 104857600 bytes transferred in 5.468511 secs (19174799 bytes/sec) root@gaia/tmp> swapon -a swapon: adding /dev/amrd0s2b as swap device root@gaia/tmp> I pressed ^T during the dd so it shows which state the process is in. In both cases, it spends nearly all of its time in that state. With 7.1MB/sec for a filesystem and 8.5MB/sec for a raw sequential write, the performance of this RAID array remains *far* below its capabilities. I'm also thinking that 18.3MB/sec for a sequential read is a bit low. This machine was running under FreeBSD 4.11 before, and performance was as can be expected, a few dozen MB/sec (around 40MB/sec iirc). >How-To-Repeat: >Fix: >Release-Note: >Audit-Trail: >Unformatted: