From owner-freebsd-current@FreeBSD.ORG Sun Aug 7 01:41:57 2005 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3EC1616A41F; Sun, 7 Aug 2005 01:41:57 +0000 (GMT) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id B5D6844306; Sun, 7 Aug 2005 01:41:56 +0000 (GMT) (envelope-from mike@sentex.net) Received: from pumice3.sentex.ca (pumice3.sentex.ca [64.7.153.26]) by smarthost1.sentex.ca (8.13.3/8.13.3) with ESMTP id j771f3Dq090542; Sat, 6 Aug 2005 21:41:03 -0400 (EDT) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by pumice3.sentex.ca (8.13.3/8.13.3) with ESMTP id j771ft9P071996; Sat, 6 Aug 2005 21:41:55 -0400 (EDT) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.3/8.13.3) with ESMTP id j771frOq019595 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 6 Aug 2005 21:41:53 -0400 (EDT) (envelope-from mike@sentex.net) Message-Id: <6.2.1.2.0.20050806205925.0522cad0@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.1.2 Date: Sat, 06 Aug 2005 21:44:24 -0400 To: Pawel Jakub Dawidek , freebsd-current@freebsd.org From: Mike Tancsa In-Reply-To: <20050728205413.GB762@darkness.comp.waw.pl> References: <20050728205413.GB762@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Scanned-By: MIMEDefang 2.51 on 64.7.153.18 X-Scanned-By: MIMEDefang 2.51 on 64.7.153.26 Cc: Subject: Re: GELI - disk encryption GEOM class committed. X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Aug 2005 01:41:57 -0000 At 04:54 PM 28/07/2005, Pawel Jakub Dawidek wrote: >- Utilize the crypto(9) framework, so when there is a crypto hardware > available, geli(8) will make use of it automatically. > If cryptography needs to be done in software, a dedicated kernel > thread(s) will be started to do the crypto work in there. Hi, I was trying this out on RELENG_6 and it seems to lock up the machine solid on my 4way SMP box with a hifn card. I have in the kernel options DDB options BREAK_TO_DEBUGGER options KDB options KDB_UNATTENDED options INVARIANTS # Enable calls of extra sanity checking options INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS options WITNESS # Enable checks to detect deadlocks and cycles options WITNESS_SKIPSPIN # Don't run witness on spinlocks for speed but it locks the box up solid-- cant even break to debugger. If I take the hifn card out of the equation, it seems to work under smp. If I use the hifn card with just a uni proc config, it also works. I can trigger the hang just using bonnie -s 300 -d /mnt dmesgs below. Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.0-BETA2 #4: Sat Aug 6 19:48:39 EDT 2005 mdtancsa@hippo.sentex.ca:/usr/obj/usr/src/sys/hippo WARNING: WITNESS option enabled, expect reduced performance. ACPI APIC Table: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Pentium III/Pentium III Xeon/Celeron (500.02-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x672 Stepping = 2 Features=0x383fbff real memory = 2147475456 (2047 MB) avail memory = 2096689152 (1999 MB) ioapic0: Changing APIC ID to 4 ioapic0 irqs 0-23 on motherboard npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) pci_link0: on acpi0 pci_link1: on acpi0 pci_link2: irq 10 on acpi0 pci_link3: irq 11 on acpi0 pci_link4: on acpi0 pci_link5: on acpi0 pci_link6: on acpi0 pci_link7: on acpi0 pci_link8: irq 14 on acpi0 pci_link9: on acpi0 Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 2.0 on pci0 isa0: on isab0 pci0: at device 2.1 (no driver attached) pci0: at device 2.2 (no driver attached) pci0: at device 2.3 (no driver attached) pci0: at device 4.0 (no driver attached) pcib1: at device 8.0 on pci0 pci1: on pcib1 amr0: mem 0xfe000000-0xfe3fffff irq 14 at device 8.1 on pci0 amr0: Firmware GH6D, BIOS 1.43, 32MB RAM pcib2: on acpi0 pci2: on pcib2 pcib3: on acpi0 pci3: on pcib3 em0: port 0xfcc0-0xfcff mem 0xfeb20000-0xfeb3ffff,0xfeb00000-0xfeb1ffff irq 19 at device 1.0 on pci3 em0: Ethernet address: 00:0e:0c:63:ea:cf em0: Speed:N/A Duplex:N/A hifn0 mem 0xfeb4a000-0xfeb4afff,0xfeb48000-0xfeb49fff,0xfeb40000-0xfeb47fff irq 18 at device 3.0 on pci3 hifn0: Hifn 7955, rev 0, 32KB dram, pll=0x800 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A, console sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 1 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounter "TSC" frequency 500019306 Hz quality 800 Timecounters tick every 1.000 msec amrd0: on amr0 amrd0: 34732MB (71131136 sectors) RAID 5 (optimal) ses0 at amr0 bus 0 target 6 lun 0 ses0: Fixed Processor SCSI-2 device ses0: SAF-TE Compliant Device Trying to mount root from ufs:/dev/amrd0s1a em0: link state changed to UP GEOM_ELI: Device amrd0s1e.eli created. GEOM_ELI: Cipher: 3DES GEOM_ELI: Key length: 192 GEOM_ELI: Crypto: hardware and [hippo]# cat /var/run/dmesg.boot Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.0-BETA2 #5: Sat Aug 6 21:24:21 EDT 2005 mdtancsa@hippo.sentex.ca:/usr/obj/usr/src/sys/hippo WARNING: WITNESS option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Pentium III/Pentium III Xeon/Celeron (500.02-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x672 Stepping = 2 Features=0x383fbff real memory = 2147475456 (2047 MB) avail memory = 2096541696 (1999 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 3 cpu1 (AP): APIC ID: 0 cpu2 (AP): APIC ID: 1 cpu3 (AP): APIC ID: 2 ioapic0: Changing APIC ID to 4 ioapic0 irqs 0-23 on motherboard npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) pci_link0: on acpi0 pci_link1: on acpi0 pci_link2: irq 10 on acpi0 pci_link3: irq 11 on acpi0 pci_link4: on acpi0 pci_link5: on acpi0 pci_link6: on acpi0 pci_link7: on acpi0 pci_link8: irq 14 on acpi0 pci_link9: on acpi0 Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 2.0 on pci0 isa0: on isab0 pci0: at device 2.1 (no driver attached) pci0: at device 2.2 (no driver attached) pci0: at device 2.3 (no driver attached) pci0: at device 4.0 (no driver attached) pcib1: at device 8.0 on pci0 pci1: on pcib1 amr0: mem 0xfe000000-0xfe3fffff irq 14 at device 8.1 on pci0 amr0: Firmware GH6D, BIOS 1.43, 32MB RAM pcib2: on acpi0 pci2: on pcib2 pcib3: on acpi0 pci3: on pcib3 em0: port 0xfcc0-0xfcff mem 0xfeb20000-0xfeb3ffff,0xfeb00000-0xfeb1ffff irq 19 at device 1.0 on pci3 em0: Ethernet address: 00:0e:0c:63:ea:cf em0: Speed:N/A Duplex:N/A hifn0 mem 0xfeb4a000-0xfeb4afff,0xfeb48000-0xfeb49fff,0xfeb40000-0xfeb47fff irq 18 at device 3.0 on pci3 hifn0: Hifn 7955, rev 0, 32KB dram, pll=0x800 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A, console sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 1 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec amrd0: on amr0 amrd0: 34732MB (71131136 sectors) RAID 5 (optimal) ses0 at amr0 bus 0 target 6 lun 0 ses0: Fixed Processor SCSI-2 device ses0: SAF-TE Compliant Device SMP: AP CPU #3 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! Trying to mount root from ufs:/dev/amrd0s1a em0: link state changed to UP [hippo]# GEOM_ELI: Device amrd0s1e.eli created. GEOM_ELI: Cipher: 3DES GEOM_ELI: Key length: 192 GEOM_ELI: Crypto: hardware After starting bonnie, it only takes a few seconds [hippo]# iostat -c 1000 tty amrd0 pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id 1 49 12.68 3 0.04 0.00 0 0.00 0 0 2 0 97 0 179 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 61 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 1 127 89.33 21 1.83 0.00 0 0.00 3 0 5 1 91 0 60 128.00 18 2.24 0.00 0 0.00 1 0 4 1 93 0 61 100.73 22 2.16 0.00 0 0.00 2 0 5 2 92 0 61 128.00 17 2.12 0.00 0 0.00 2 0 4 2 93 0 61 128.00 18 2.24 0.00 0 0.00 2 0 6 1 91 0 61 128.00 17 2.12 0.00 0 0.00 2 0 3 1 93 0 61 128.00 18 2.24 0.00 0 0.00 1 0 4 1 93 0 61 128.00 17 2.12 0.00 0 0.00 1 0 5 1 93 ---Mike