From owner-freebsd-geom@FreeBSD.ORG Mon Aug 3 11:06:57 2009 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BA1C8106566C for ; Mon, 3 Aug 2009 11:06:57 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id A66448FC1A for ; Mon, 3 Aug 2009 11:06:57 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n73B6vl8088606 for ; Mon, 3 Aug 2009 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n73B6vgt088602 for freebsd-geom@FreeBSD.org; Mon, 3 Aug 2009 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 3 Aug 2009 11:06:57 GMT Message-Id: <200908031106.n73B6vgt088602@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Aug 2009 11:06:58 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/136467 geom [geom] glabel(8) destroys access to GEOM tree if volum o kern/135898 geom [geom] Severe filesystem corruption - large files or l o kern/134922 geom [gmirror] [panic] kernel panic when use fdisk on disk o kern/134113 geom [geli] Problem setting secondary GELI key o kern/134044 geom [geom] gmirror(8) overwrites fs with stale data from r o kern/133931 geom [geli] [request] intentionally wrong password to destr o bin/132845 geom [geom] [patch] ggated(8) does not close files opened a o kern/132273 geom glabel(8): [patch] failing on journaled partition o kern/132242 geom [gmirror] gmirror.ko fails to fully initialize o kern/131353 geom [geom] gjournal(8) kernel lock o kern/131037 geom [geli] Unable to create disklabel on .eli-Device p docs/130548 geom [patch] gjournal(8) man page is missing sysctls o kern/130528 geom gjournal fsck during boot o kern/129674 geom [geom] gjournal root did not mount on boot o kern/129645 geom gjournal(8): GEOM_JOURNAL causes system to fail to boo o kern/129245 geom [geom] gcache is more suitable for suffix based provid f kern/128276 geom [gmirror] machine lock up when gmirror module is used o kern/126902 geom [geom] geom_label: kernel panic during install boot o kern/124973 geom [gjournal] [patch] boot order affects geom_journal con o kern/124969 geom gvinum(8): gvinum raid5 plex does not detect missing s o kern/124294 geom [geom] gmirror(8) have inappropriate logic when workin o kern/124130 geom [gmirror] [usb] gmirror fails to start usb devices tha o kern/123962 geom [panic] [gjournal] gjournal (455Gb data, 8Gb journal), o kern/123630 geom [patch] [gmirror] gmirror doesnt allow the original dr o kern/123122 geom [geom] GEOM / gjournal kernel lock o kern/122738 geom [geom] gmirror list "losts consumers" after gmirror de f kern/122415 geom [geom] UFS labels are being constantly created and rem o kern/122067 geom [geom] [panic] Geom crashed during boot o kern/121559 geom [patch] [geom] geom label class allows to create inacc o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/120231 geom [geom] GEOM_CONCAT error adding second drive o kern/120091 geom [geom] [geli] [gjournal] geli does not prompt for pass o kern/120044 geom [msdosfs] [geom] incorrect MSDOSFS label fries adminis o kern/120021 geom [geom] [panic] net-p2p/qbittorrent crashes system when o kern/119743 geom [geom] geom label for cds is keeped after dismount and o kern/115856 geom [geli] ZFS thought it was degraded when it should have o kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/114532 geom [geom] GEOM_MIRROR shows up in kldstat even if compile o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/113885 geom [gmirror] [patch] improved gmirror balance algorithm o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113419 geom [geom] geom fox multipathing not failing back p bin/110705 geom gmirror(8) control utility does not exit with correct o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o bin/90093 geom fdisk(8) incapable of altering in-core geometry a kern/89660 geom [vinum] [patch] [panic] due to g_malloc returning null o kern/89546 geom [geom] GEOM error o kern/88601 geom [geli] geli cause kernel panic under heavy disk usage o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/84556 geom [geom] [panic] GBDE-encrypted swap causes panic at shu o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o bin/78131 geom gbde(8) "destroy" not working. s kern/73177 geom kldload geom_* causes panic due to memory exhaustion 58 problems total. From owner-freebsd-geom@FreeBSD.ORG Wed Aug 5 11:32:08 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54DCB106566B for ; Wed, 5 Aug 2009 11:32:08 +0000 (UTC) (envelope-from achilov-rn@askd.ru) Received: from master.askd.ru (master.askd.ru [80.242.75.6]) by mx1.freebsd.org (Postfix) with ESMTP id BB3A38FC16 for ; Wed, 5 Aug 2009 11:32:07 +0000 (UTC) (envelope-from achilov-rn@askd.ru) Received: from to-495.askd.gmbh (IDENT:shelton@sentry [192.168.1.94]) by master.askd.ru (8.14.3/8.14.3) with ESMTP id n75BLQg1059744 for ; Wed, 5 Aug 2009 18:21:26 +0700 (NOVST) (envelope-from achilov-rn@askd.ru) From: "Rashid N. Achilov" Organization: =?koi8-r?b?7+/v?= "=?koi8-r?b?4fMt88nT1MXNwQ==?= =?koi8-r?b?IOvPzdDMxcvT?=" To: freebsd-geom@freebsd.org Date: Wed, 5 Aug 2009 18:24:26 +0700 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200908051824.26539.achilov-rn@askd.ru> Subject: 28-in-1 Acorp card reader X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "Achilov, Rashid" List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Aug 2009 11:32:08 -0000 I have asked this in freebsd-usb@, but take an answer, that's not USB-related trouble. I have 28-in-1 Acorp internal cardreader, which connects to USB port. When I insert card in reader and boot, all OK. When I boot, and later insert card - does nothing - /dev/da0s1 not appeared, in spite of presence /dev/da0. I have search this advice - open /dev/da0 for writing and immediately close it. I.e. cat /dev/null > /dev/da0 or dd if=/dev/null of=/dev/da0 count=0 Well, after these "magic actions" /dev/da0s1 appears. But I think, that opening raw device for writing isn't good idea. How to mount flash, inserted in cardreader another way, without opening raw device for writing or is there any program, which does it by itself? -- With Best Regards. Rashid N. Achilov (RNA1-RIPE), JID: citycat4@jabber.org OOO "ACK" telecommunications administrator, e-mail: achilov-rn [at] askd.ru PGP: 83 CD E2 A7 37 4A D5 81 D6 D6 52 BF C9 2F 85 AF 97 BE CB 0A From owner-freebsd-geom@FreeBSD.ORG Wed Aug 5 15:34:08 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D42710656D8 for ; Wed, 5 Aug 2009 15:34:08 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from lennier.cc.vt.edu (lennier.cc.vt.edu [198.82.162.213]) by mx1.freebsd.org (Postfix) with ESMTP id 42E448FC23 for ; Wed, 5 Aug 2009 15:34:07 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from dagger.cc.vt.edu (dagger.cc.vt.edu [198.82.163.114]) by lennier.cc.vt.edu (8.13.8/8.13.8) with ESMTP id n75FXbv7016919 for ; Wed, 5 Aug 2009 11:33:37 -0400 Received: from auth3.smtp.vt.edu (EHLO auth3.smtp.vt.edu) ([198.82.161.152]) by dagger.cc.vt.edu (MOS 4.1.6-GA FastPath queued) with ESMTP id ARW64796; Wed, 05 Aug 2009 11:21:57 -0400 (EDT) Received: from gromit.tower.lib.vt.edu (gromit.tower.lib.vt.edu [128.173.51.22]) (authenticated bits=0) by auth3.smtp.vt.edu (8.13.8/8.13.8) with ESMTP id n75FZcwk025852 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO) for ; Wed, 5 Aug 2009 11:35:38 -0400 Message-Id: <3E2345AC-55AD-4D23-B76C-B0C37CB62A51@gromit.dlib.vt.edu> From: Paul Mather To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v935.3) Date: Wed, 5 Aug 2009 11:33:36 -0400 X-Mailer: Apple Mail (2.935.3) X-Mirapoint-Received-SPF: 198.82.161.152 auth3.smtp.vt.edu paul@gromit.dlib.vt.edu 5 none X-Mirapoint-IP-Reputation: reputation=neutral-1, source=Fixed, refid=n/a, actions=MAILHURDLE SPF TAG X-Junkmail-Info: (0) X-Junkmail-Status: score=10/50, host=dagger.cc.vt.edu X-Junkmail-SD-Raw: score=unknown, refid=str=0001.0A020206.4A79A651.0179,ss=1,fgs=0, ip=198.82.161.152, so=2009-06-02 18:41:42, dmn=2009-06-06 00:02:10, mode=multiengine X-Junkmail-IWF: false Subject: ZFS slow write performance X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Aug 2009 15:34:08 -0000 I have a system I intend to use to back up a remote system via rsync. It is running FreeBSD/i386 7.2-STABLE and has a ZFS raidz1 pool consisting of four 1 TB SATA drives. The system has 768 MiB of RAM and a 2 GHz Pentium 4 CPU. Currently, I am just trying to rsync data locally from a read-only UFS2-mounted USB-attached hard drive, and am getting (IMHO) poor write speeds of only about 5 MiB/sec. I can't figure out why this is so relatively low. Looking at gstat shows the source drive and destination drives as cruising along at an average of 30%--50% busy (the destination drives averaging between 1800--2000 kBps each in the gstat display). Top shows an average of ~20% system time and ~70% idle (though when I changed "compression=on" to "compression=gzip-9" for the target file system, system CPU load shot up to ~70% utilization). Memory usage is pretty static, with ~165 MiB wired and 512-523 MiB inactive RAM usage. Given there appears to be nothing stressing the system, why isn't it apparently making more use of the available resources, in particular, disk bandwidth? A dd of a large file from the source USB drive reports a transfer rate of about 15 MiB/sec from it, so getting only about a third of this when rsyncing to an otherwise idle ZFS pool is disappointing when the source drive can obviously go faster than it is. If I dd /dev/zero to a file on the target ZFS file system I get about 15 MiB/sec write speed with "compression=off" set and about 18 MiB/sec with "compression=on" set, indicating that the target can go faster, too. Even though I am rsyncing from one local filesystem to another, could the problem lie with rsync overheads? Has anyone else encountered poor rsync performance with ZFS and can offer any tuning advice? Otherwise, does anyone have any advice for speeding up my local copy performance? Here is some dmesg information about the attached hardware: atapci0: port 0xecf8-0xecff, 0xecf0-0xecf3,0xece0-0xece7,0xecd8-0xecdb,0xecc0-0xeccf mem 0xff8ffc00-0xff8fffff irq 16 at device 7.0 on pci1 atapci0: [ITHREAD] ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] [...] ehci0: mem 0xffa00000-0xffa003ff irq 23 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb3: EHCI version 1.0 usb3: companion controllers, 2 ports each: usb0 usb1 usb2 usb3: on ehci0 usb3: USB revision 2.0 uhub3: on usb3 uhub3: 6 ports with 6 removable, self powered umass0: on uhub3 [...] ad4: 953869MB at ata2-master SATA150 ad6: 953869MB at ata3-master SATA150 ad8: 953869MB at ata4-master SATA150 ad10: 953869MB at ata5-master SATA150 da0 at umass-sim0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-4 device da0: 40.000MB/s transfers da0: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C) I have the following tuning in /boot/loader.conf: vm.kmem_size="640M" vm.kmem_size_max="640M" vfs.zfs.arc_max="320M" #vfs.zfs.vdev.cache.size="5M" vfs.zfs.prefetch_disable="1" Any help or advice is appreciated. Cheers, Paul. From owner-freebsd-geom@FreeBSD.ORG Fri Aug 7 11:56:35 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DD9A71065674 for ; Fri, 7 Aug 2009 11:56:34 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from mail.digiware.nl (mail.ip6.digiware.nl [IPv6:2001:4cb8:1:106::2]) by mx1.freebsd.org (Postfix) with ESMTP id 73A6D8FC15 for ; Fri, 7 Aug 2009 11:56:34 +0000 (UTC) Received: from localhost (localhost.digiware.nl [127.0.0.1]) by mail.digiware.nl (Postfix) with ESMTP id 67BCA153434; Fri, 7 Aug 2009 13:56:33 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from mail.digiware.nl ([127.0.0.1]) by localhost (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jOSABsACM7xV; Fri, 7 Aug 2009 13:56:31 +0200 (CEST) Received: from [192.168.10.67] (opteron [192.168.10.67]) by mail.digiware.nl (Postfix) with ESMTP id 20E7B153433; Fri, 7 Aug 2009 13:56:30 +0200 (CEST) Message-ID: <4A7C16E6.7070901@digiware.nl> Date: Fri, 07 Aug 2009 13:58:30 +0200 From: Willem Jan Withagen Organization: Digiware User-Agent: Thunderbird 2.0.0.22 (Windows/20090605) MIME-Version: 1.0 To: John Nielsen References: <4A7305A9.3080506@digiware.nl> <200907311118.33490.lists@jnielsen.net> In-Reply-To: <200907311118.33490.lists@jnielsen.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: Gmirror rebuilding X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Aug 2009 11:56:35 -0000 John Nielsen wrote: > On Friday 31 July 2009 10:54:33 Willem Jan Withagen wrote: >> I lost one of my disk in a gmirror, so I inserted a fresh one. >> And thusfar things went rather smoothly,it started rebuilding >> automagically. >> >> That's good,but what isn't is: >> >> Jul 31 16:43:15 www kernel: ad2: FAILURE - READ_DMA >> status=51 error=40 LBA=16344448 >> Jul 31 16:43:15 www kernel: GEOM_MIRROR: Synchronization request failed >> (error=5). mirror/mirror[READ(offset=8368291840, length=131072)] >> Jul 31 16:43:40 www kernel: ad2: FAILURE - READ_DMA >> status=51 error=40 LBA=16910976 >> Jul 31 16:43:40 www kernel: GEOM_MIRROR: Synchronization request failed >> (error=5). mirror/mirror[READ(offset=8658354176, length=131072)] >> >> and ad2 is the original disk. So somewhere I'm left with corrupt files. >> >> And what's worse, once this happens, geom_mirror does not continue with the >> remainder of the disk... >> It claims it is, but there is no activity at all on the disks. >> >> So what to do???? >> >> Hard way out would be to make a backup, reinstall the basic system with >> another/second fresh harddisk, and recover the backup. >> But that is a lot of work. > > If you have a backup already then restoring from it would be the best option. > If you don't then the "hard" way above is a good second (assuming you can > read enough of your remaining disk to get your backup tool to cooperate). > > You should make a backup in any case, but if you want to try to avoid > reinstalling you could do some dd trickery. Remove the new disk from the > mirror. Create a new mirror containing only the new disk. Run > dd if=/dev/mirror/ of=/dev/mirror/ conv=noerror,sync > > This will take a long time with the default block size (512 bytes, one > sector), but the plus side is that you only lose the data from the sectors > that cannot be read. Depending on the extent of the damage to the original > disk and your level of desperation, you may want to make note of which > sectors fail to copy on the first run and try to copy them again (dd if=... > of=... skip=NN seek=NN count=1). See also sysutils/ddrescue, > sysutils/recoverdm and similar (I haven't used any of them). > > If you get a (mostly) viable clone, run fsck -f on it, assess the damage, > update your fstab(s), reboot and add a second new disk to your new mirror. > >> Why doesn't geom_mirror continue with the remainder of the disk? > > I'll leave this question for someone else, but I suspect the behavior is > intentional. As you say, you now have corruption on your volume so the best > recourse is to restore from a known good backup. Well... I did it slightly different. Used sysinstall to partitioned/formatted the fresh disk and then rsynced everything over to the new disk. Hoping that the bad sectors where in empty space or some trivial std file.... Which actually did the job. No complaints about bad files... Now I just need to find a new 80Gb seagate IDE disk to stick in. This is because of the spacing between power-connector and IDE-cableheader. :( Western-Digital's just don't fit. Still remains the question why gmirror does not continue copying the remainder of the disk to get at least a working mirror again. Flags on the state of the disks should still be able to resolve error read conflicts (I think) --WjW