From owner-freebsd-current@FreeBSD.ORG Tue Feb 12 12:02:49 2008 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E17B816A469 for ; Tue, 12 Feb 2008 12:02:49 +0000 (UTC) (envelope-from me@lexasoft.ru) Received: from mmx.lexasoft.ru (lexasoft.ru [92.241.160.6]) by mx1.freebsd.org (Postfix) with ESMTP id 0818813C4EC for ; Tue, 12 Feb 2008 12:02:48 +0000 (UTC) (envelope-from me@lexasoft.ru) Received: from [10.100.0.2] (petrovich-telecom-gw.wahome.ru [77.91.225.38]) by mmx.lexasoft.ru (Postfix) with ESMTPSA id 6541B28419 for ; Tue, 12 Feb 2008 12:02:19 +0300 (MSK) Message-Id: <95E99923-DF5A-4B77-AB48-E0730B22B930@lexasoft.ru> From: Alexey Tarasov To: current@freebsd.org In-Reply-To: <20080212115952.GI75665@pafoo.okejl.dk> Content-Type: text/plain; charset=UTF-8; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v919.2) Date: Tue, 12 Feb 2008 15:02:44 +0300 References: <9DA6FFCD-11DB-4580-9314-52B0885351D8@lexasoft.ru> <20080212054758.GH75665@pafoo.okejl.dk> <569076FB-CF40-4ED0-B179-A1796140EC10@lexasoft.ru> <20080212115952.GI75665@pafoo.okejl.dk> X-Mailer: Apple Mail (2.919.2) Cc: Subject: Re: Disappointing speed with ZFS X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2008 12:02:50 -0000 Please take a look at my first mail. On 12.02.2008, at 14:59, Asbj=C3=B8rn Clemmensen wrote: > I've never experienced that error, but when it happens, how much =20 > free memory > does the system have? Are you running FreeBSD as i386 or amd64? I =20 > had to > switch to amd64 because performance was extremely poor running with =20= > a i386 > system. > > - Asbj=C3=B8rn > > On Tue, Feb 12, 2008 at 01:36:39PM +0300, Alexey Tarasov wrote: >> Hello. >> >> Thanks, hashing works good with this options. >> >> Another issue. Sometimes I get the following error in rtorrent: >> >> Storage error: [File chunk write error: Cannot allocate memory.] >> >> Is it an issue of ZFS or Rtorrent bug? >> >> On 12.02.2008, at 8:47, Asbj=C3=B8rn Clemmensen wrote: >> >>> On Mon, Feb 11, 2008 at 03:49:40PM +0300, Alexey Tarasov wrote: >>>> Hello. >>>> >>>> I am trying to use ZFS to store my torrent downloads. I noticed =20 >>>> that hashing in rtorrent works 10 times slower than the same disk =20= >>>> with UFS. >>> >>> You might want to try changing rtorrent's settings for hashing =20 >>> files. I had >>> the same problem when switching to ZFS - files hashed at < 1mb/=20 >>> sec. I ended up >>> using these settings: >>> >>> hash_read_ahead =3D 32 >>> hash_max_tries =3D 1 >>> hash_interval =3D 1 >>> >>> This way the drives are utilized much more, and same goes for the =20= >>> CPU. Now I'm >>> getting 20-30 mb/sec when hashing. >>> >>> (7.0-PRERELEASE amd64, Athlon64 3800+ X2, 3 Gb of RAM) >>> >>>> >>>> I've done tuning as described in WIKI: >>>> >>>> vm.kmem_size_max=3D"1073741824" >>>> vm.kmem_size=3D"1073741824" >>>> >>>> kern.maxvnodes=3D800000 >>>> >>>> My DMESG: >>>> >>>> Copyright (c) 1992-2008 The FreeBSD Project. >>>> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, =20 >>>> 1993, 1994 >>>> The Regents of the University of California. All rights =20 >>>> reserved. >>>> FreeBSD is a registered trademark of The FreeBSD Foundation. >>>> FreeBSD 7.0-PRERELEASE #1: Wed Feb 6 15:39:32 MSK 2008 >>>> lexa@alpha.lexasoft.ru:/usr/obj/usr/src/sys/ALPHA >>>> Timecounter "i8254" frequency 1193182 Hz quality 0 >>>> CPU: Genuine Intel(R) CPU 2160 @ 1.80GHz (1795.51-MHz =20= >>>> K8-class CPU) >>>> Origin =3D "GenuineIntel" Id =3D 0x6f2 Stepping =3D 2 >>>> Features=20 >>>> =3D=20 >>>> 0xbfebfbff=20 >>>> <=20 >>>> FPU=20 >>>> ,VME=20 >>>> ,DE=20 >>>> ,PSE=20 >>>> ,TSC=20 >>>> ,MSR=20 >>>> ,PAE=20 >>>> ,MCE=20 >>>> ,CX8=20 >>>> ,APIC=20 >>>> ,SEP=20 >>>> ,MTRR=20 >>>> ,PGE=20 >>>> ,MCA=20 >>>> ,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> >>>> Features2=20 >>>> =3D0xe39d >>>> AMD Features=3D0x20100800 >>>> AMD Features2=3D0x1 >>>> Cores per package: 2 >>>> usable memory =3D 4280516608 (4082 MB) >>>> avail memory =3D 4125683712 (3934 MB) >>>> ACPI APIC Table: >>>> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs >>>> cpu0 (BSP): APIC ID: 0 >>>> cpu1 (AP): APIC ID: 1 >>>> ioapic0 irqs 0-23 on motherboard >>>> ioapic1 irqs 24-47 on motherboard >>>> kbd1 at kbdmux0 >>>> ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, =20 >>>> RF2413, RF5413) >>>> hptrr: HPT RocketRAID controller driver v1.1 (Feb 6 2008 15:37:30) >>>> acpi0: on motherboard >>>> acpi0: [ITHREAD] >>>> acpi0: Power Button (fixed) >>>> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 >>>> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on =20= >>>> acpi0 >>>> cpu0: on acpi0 >>>> est0: on cpu0 >>>> est: CPU supports Enhanced Speedstep, but is not recognized. >>>> est: cpu_vendor GenuineIntel, msr 928092806000928 >>>> device_attach: est0 attach returned 6 >>>> p4tcc0: on cpu0 >>>> cpu1: on acpi0 >>>> est1: on cpu1 >>>> est: CPU supports Enhanced Speedstep, but is not recognized. >>>> est: cpu_vendor GenuineIntel, msr 928092806000928 >>>> device_attach: est1 attach returned 6 >>>> p4tcc1: on cpu1 >>>> pcib0: port 0xcf8-0xcff on acpi0 >>>> pci0: on pcib0 >>>> pcib1: irq 16 at device 1.0 on pci0 >>>> pci1: on pcib1 >>>> pcib2: irq 17 at device 28.0 on pci0 >>>> pci9: on pcib2 >>>> pcib3: at device 0.0 on pci9 >>>> pci10: on pcib3 >>>> pcib4: irq 17 at device 28.4 on pci0 >>>> pci13: on pcib4 >>>> em0: port =20= >>>> 0x4000-0x401f mem 0xe0200000-0xe021ffff irq 16 at device 0.0 on =20 >>>> pci13 >>>> em0: Using MSI interrupt >>>> em0: Ethernet address: 00:30:48:8f:78:ca >>>> em0: [FILTER] >>>> pcib5: irq 16 at device 28.5 on pci0 >>>> pci14: on pcib5 >>>> em1: port =20= >>>> 0x5000-0x501f mem 0xe0300000-0xe031ffff irq 17 at device 0.0 on =20 >>>> pci14 >>>> em1: Using MSI interrupt >>>> em1: Ethernet address: 00:30:48:8f:78:cb >>>> em1: [FILTER] >>>> uhci0: port 0x3000-0x301f irq 23 =20= >>>> at device 29.0 on pci0 >>>> uhci0: [GIANT-LOCKED] >>>> uhci0: [ITHREAD] >>>> usb0: on uhci0 >>>> usb0: USB revision 1.0 >>>> uhub0: on =20= >>>> usb0 >>>> uhub0: 2 ports with 2 removable, self powered >>>> uhci1: port 0x3020-0x303f irq 19 =20= >>>> at device 29.1 on pci0 >>>> uhci1: [GIANT-LOCKED] >>>> uhci1: [ITHREAD] >>>> usb1: on uhci1 >>>> usb1: USB revision 1.0 >>>> uhub1: on =20= >>>> usb1 >>>> uhub1: 2 ports with 2 removable, self powered >>>> uhci2: port 0x3040-0x305f irq 18 =20= >>>> at device 29.2 on pci0 >>>> uhci2: [GIANT-LOCKED] >>>> uhci2: [ITHREAD] >>>> usb2: on uhci2 >>>> usb2: USB revision 1.0 >>>> uhub2: on =20= >>>> usb2 >>>> uhub2: 2 ports with 2 removable, self powered >>>> uhci3: port 0x3060-0x307f irq 16 =20= >>>> at device 29.3 on pci0 >>>> uhci3: [GIANT-LOCKED] >>>> uhci3: [ITHREAD] >>>> usb3: on uhci3 >>>> usb3: USB revision 1.0 >>>> uhub3: on =20= >>>> usb3 >>>> uhub3: 2 ports with 2 removable, self powered >>>> ehci0: mem =20 >>>> 0xe0000000-0xe00003ff irq 23 at device 29.7 on pci0 >>>> ehci0: [GIANT-LOCKED] >>>> ehci0: [ITHREAD] >>>> usb4: EHCI version 1.0 >>>> usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 >>>> usb4: on ehci0 >>>> usb4: USB revision 2.0 >>>> uhub4: on =20= >>>> usb4 >>>> uhub4: 8 ports with 8 removable, self powered >>>> pcib6: at device 30.0 on pci0 >>>> pci15: on pcib6 >>>> vgapci0: port 0x6000-0x60ff mem =20 >>>> 0xe8000000-0xefffffff,0xe0400000-0xe040ffff irq 16 at device 0.0 =20= >>>> on pci15 >>>> isab0: at device 31.0 on pci0 >>>> isa0: on isab0 >>>> atapci0: port =20 >>>> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x30a0-0x30af at device 31.1 =20= >>>> on pci0 >>>> ata0: on atapci0 >>>> ata0: [ITHREAD] >>>> ata1: on atapci0 >>>> ata1: [ITHREAD] >>>> atapci1: port 0x30e8-0x30ef,=20 >>>> 0x30dc-0x30df,0x30e0-0x30e7,0x30d8-0x30db,0x30b0-0x30bf mem =20 >>>> 0xe0000400-0xe00007ff irq 19 at device 31.2 on pci0 >>>> atapci1: [ITHREAD] >>>> ata2: on atapci1 >>>> ata2: [ITHREAD] >>>> ata3: on atapci1 >>>> ata3: [ITHREAD] >>>> pci0: at device 31.3 (no driver attached) >>>> acpi_button0: on acpi0 >>>> atkbdc0: port 0x60,0x64 irq 1 on =20 >>>> acpi0 >>>> atkbd0: irq 1 on atkbdc0 >>>> kbd0 at atkbd0 >>>> atkbd0: [GIANT-LOCKED] >>>> atkbd0: [ITHREAD] >>>> sio0: configured irq 4 not in bitmap of probed irqs 0 >>>> sio0: port may not be enabled >>>> sio0: configured irq 4 not in bitmap of probed irqs 0 >>>> sio0: port may not be enabled >>>> sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags =20 >>>> 0x10 on acpi0 >>>> sio0: type 16550A >>>> sio0: [FILTER] >>>> sio1: configured irq 3 not in bitmap of probed irqs 0 >>>> sio1: port may not be enabled >>>> sio1: configured irq 3 not in bitmap of probed irqs 0 >>>> sio1: port may not be enabled >>>> sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 >>>> sio1: type 16550A >>>> sio1: [FILTER] >>>> fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq =20= >>>> 2 on acpi0 >>>> fdc0: does not respond >>>> device_attach: fdc0 attach returned 6 >>>> ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on =20= >>>> acpi0 >>>> ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode >>>> ppc0: FIFO with 16/16/9 bytes threshold >>>> ppbus0: on ppc0 >>>> plip0: on ppbus0 >>>> lpt0: on ppbus0 >>>> lpt0: Interrupt-driven port >>>> ppi0: on ppbus0 >>>> ppc0: [GIANT-LOCKED] >>>> ppc0: [ITHREAD] >>>> fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq =20= >>>> 2 on acpi0 >>>> fdc0: does not respond >>>> device_attach: fdc0 attach returned 6 >>>> orm0: at iomem 0xc0000-0xcafff,0xcb000-0xcbfff,=20= >>>> 0xcc000-0xccfff on isa0 >>>> sc0: at flags 0x100 on isa0 >>>> sc0: VGA <16 virtual consoles, flags=3D0x300> >>>> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff =20= >>>> on isa0 >>>> Timecounters tick every 1.000 msec >>>> hptrr: no controller detected. >>>> acd0: CDROM at ata0-master UDMA33 >>>> ad4: 157066MB at ata2-master SATA150 >>>> ad5: 381553MB at ata2-slave =20 >>>> SATA150 >>>> ad6: 157066MB at ata3-master SATA150 >>>> SMP: AP CPU #1 Launched! >>>> Trying to mount root from ufs:/dev/ad4s1a >>>> WARNING: ZFS is considered to be an experimental feature in =20 >>>> FreeBSD. >>>> ZFS filesystem version 6 >>>> ZFS storage pool version 6 >>>> >>>> >>>> KERNEL CONFIG is Generic with debug turned off and SCHED_ULE. >>>> >>>> Could you please tell me where I am not right? Or what should I =20 >>>> do to make it faster? >>>> >>>> -- >>>> Alexey Tarasov >>>> >>>> (\__/) >>>> (=3D'.'=3D) >>>> E[: | | | | :]=D0=97 >>>> (")_(") >>>> >>>> _______________________________________________ >>>> freebsd-current@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-current >>>> To unsubscribe, send any mail to = "freebsd-current-unsubscribe@freebsd.org=20 >>>> " >>>> >>> >>> - Asbj=C3=B8rn Clemmensen >> >> -- >> Alexey Tarasov >> >> (\__/) >> (=3D'.'=3D) >> E[: | | | | :]=D0=97 >> (")_(") >> >> -- Alexey Tarasov (\__/) (=3D'.'=3D) E[: | | | | :]=D0=97 (")_(")