From owner-freebsd-geom@FreeBSD.ORG Sun Apr 6 20:12:37 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 244BE1065670 for ; Sun, 6 Apr 2008 20:12:37 +0000 (UTC) (envelope-from nonsolosoft@diff.org) Received: from smtpout21.attiva.biz (smtpout21.attiva.biz [85.37.16.23]) by mx1.freebsd.org (Postfix) with ESMTP id A290B8FC20 for ; Sun, 6 Apr 2008 20:12:36 +0000 (UTC) (envelope-from nonsolosoft@diff.org) Received: from FBCMFE02B14.fbc.local ([192.168.30.160]) by smtpout21.attiva.biz with Microsoft SMTPSVC(6.0.3790.1830); Sun, 6 Apr 2008 22:00:26 +0200 Received: from lap.diff.org ([81.174.26.135]) by FBCMFE02B14.fbc.local with Microsoft SMTPSVC(6.0.3790.1830); Sun, 6 Apr 2008 22:00:26 +0200 Message-ID: <47F92BD9.1060207@diff.org> Date: Sun, 06 Apr 2008 22:00:25 +0200 From: Ferruccio Zamuner User-Agent: Thunderbird 2.0.0.6 (X11/20071020) MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 06 Apr 2008 20:00:26.0661 (UTC) FILETIME=[DB5B0550:01C89820] Subject: gmirror on a very slow but new HP architecture X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Apr 2008 20:12:37 -0000 on FreeBSD 6 and gmirror usually I get 50-60Mb/s with a pair PATA hds, speed higher than 130Mb/s with gstripe on the same 2 hds. Two weeks ago I've installed the new FreeBSD 7 on a brand new HP Proliant ML110 (G4): FreeBSD 7.0-RELEASE #0: Wed Apr 2 16:00:33 CEST 2008 root@free:/usr/obj/usr/src/sys/GENERIC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz (1862.01-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6f2 Stepping = 2 Features=0xbfebfbff Features2=0xe3bd AMD Features=0x20100000 AMD Features2=0x1 Cores per package: 2 real memory = 1609105408 (1534 MB) avail memory = 1563029504 (1490 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 [...] mpt0: port 0x4000-0x40ff mem 0xefc10000-0xefc13fff,0xefc00000-0xefc0ffff irq 18 at device 1.0 on pci10 atapci1: port 0x30c8-0x30cf,0x30bc-0x30bf,0x30c0-0x30c7,0x30b8-0x30bb,0x3090-0x309f mem 0xefd00400-0xefd007ff irq 19 at device 31.2 on pci0 [...] da0 at mpt0 bus 0 target 5 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing Enabled da0: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) da1 at mpt0 bus 0 target 6 lun 0 da1: Fixed Direct Access SCSI-5 device da1: 300.000MB/s transfers da1: Command Queueing Enabled da1: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) da2 at mpt0 bus 0 target 7 lun 0 da2: Fixed Direct Access SCSI-5 device da2: 300.000MB/s transfers da2: Command Queueing Enabled da2: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) da3 at mpt0 bus 0 target 8 lun 0 da3: Fixed Direct Access SCSI-5 device da3: 300.000MB/s transfers da3: Command Queueing Enabled da3: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) 1) gmirror gives kernel panic if I try to mirror slices instead of devices I'm used to gmirror disk slices, but it seems not possible on this HP. I had defined the gmirror on slices da1s1,da2s1,da3s1 but when I try to: # gmirror load GEOM_MIRROR: Device mirror/gm launched (3/3) WARNING: Expected rawoffset 0, found 63 Fatal double fault: eip = 0xc0707642 esp = 0xe4d9efd8 ebp = oxe4d9f024 cpuid=1;apicid=01 panic: double fault cpuid: 1 2) Here are instead catastrophic access speed on single drive: free# swapoff /dev/da0s1b free# dd if=/dev/zero of=/dev/da0s1b bs=8192 count=30000 30000+0 records in 30000+0 records out 245760000 bytes transferred in 254.051957 secs (967361 bytes/sec) Look! Lower than 1Mb/s Then I try to do the same write on the gmirror on da1,da2,da3 without soft-update but with journaling: free# dd if=/dev/zero of=/home1/test bs=8192 count=30000 30000+0 records in 30000+0 records out 245760000 bytes transferred in 68.658723 secs (3579443 bytes/sec) It's about 3.5Mb/s More info: /dev/mirror/datag.journal on /home1 (ufs, asynchronous, local, gjournal) free# gmirror list Geom name: data State: COMPLETE Components: 3 Balance: load Slice: 16384 Flags: NONE GenID: 0 SyncID: 1 ID: 106463476 Providers: 1. Name: mirror/data Mediasize: 250059349504 (233G) Sectorsize: 512 Mode: r5w5e6 Consumers: 1. Name: da3 Mediasize: 250059350016 (233G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 1 Flags: NONE GenID: 0 SyncID: 1 ID: 3940601321 2. Name: da2 Mediasize: 250059350016 (233G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 1 ID: 30649924 3. Name: da1 Mediasize: 250059350016 (233G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: HARDCODED GenID: 0 SyncID: 1 ID: 1985461154 I'll be glad for any info to make FreeBSD 7 to run faster than actually on this machine. thank you in advance, \fer