From owner-freebsd-current@FreeBSD.ORG Tue Jan 22 15:06:08 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id CA38B1B1; Tue, 22 Jan 2013 15:06:08 +0000 (UTC) (envelope-from bland@bbnest.net) Received: from mail1.asahi-net.or.jp (mail1.asahi-net.or.jp [202.224.39.197]) by mx1.freebsd.org (Postfix) with ESMTP id 73682BDC; Tue, 22 Jan 2013 15:06:08 +0000 (UTC) Received: from eee.bbnest.net (w133033.ppp.asahi-net.or.jp [121.1.133.33]) by mail1.asahi-net.or.jp (Postfix) with ESMTP id AA038E57E; Tue, 22 Jan 2013 23:47:37 +0900 (JST) Received: from nest.bbnest.net (nest.bbnest.net [192.168.1.108]) (authenticated bits=0) by eee.bbnest.net (8.14.6/8.14.5) with ESMTP id r0MElQao084331 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Tue, 22 Jan 2013 23:47:27 +0900 (JST) (envelope-from bland@bbnest.net) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: ZFS + usb in trouble? From: Alexander Nedotsukov In-Reply-To: <20130121211718.GD1341@garage.freebsd.pl> Date: Tue, 22 Jan 2013 23:47:29 +0900 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20130121205851.GB1341@garage.freebsd.pl> <20130121211718.GD1341@garage.freebsd.pl> To: Pawel Jakub Dawidek X-Mailer: Apple Mail (2.1499) X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Tue Jan 22 23:47:37 2013 X-DSPAM-Confidence: 0.9996 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 50fea689843321386813696 X-Mailman-Approved-At: Tue, 22 Jan 2013 16:40:36 +0000 Cc: FreeBSD Current , hselasky@FreeBSD.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jan 2013 15:06:08 -0000 Hi Pawel, Here what I did. # geli onetime -a hmac/sha1 -s 4096 /dev/da5=20 # dmesg | tail -15 wlan0: link state changed to UP ugen5.4: at usbus5 umass2: on usbus5 umass2: SCSI over Bulk-Only; quirks =3D 0x0100 umass2:4:2:-1: Attached to scbus4 da5 at umass-sim2 bus 2 scbus4 target 0 lun 0 da5: Removable Direct Access SCSI-2 device=20 da5: 40.000MB/s transfers da5: 983MB (2015231 512 byte sectors: 64H 32S/T 983C) GEOM_ELI: Device da5.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Integrity: HMAC/SHA1 GEOM_ELI: Crypto: software GEOM_ELI: da5.eli: Failed to authenticate 4096 bytes of data at offset = 4096. GEOM_ELI: da5.eli: Failed to authenticate 4096 bytes of data at offset = 0. # dd if=3D/dev/random of=3D/dev/da5.eli bs=3D1m dd: /dev/da5.eli: short write on character device dd: /dev/da5.eli: end of device 875+0 records in 874+1 records out 917151744 bytes transferred in 1530.831674 secs (599120 bytes/sec) # dd if=3D/dev/da5.eli of=3D/dev/null bs=3D1m 874+1 records in 874+1 records out 917151744 bytes transferred in 178.874312 secs (5127353 bytes/sec) All clear. No new errors. Zpool created on the same usb stick is still failing with cksum errors. # usbconfig -d 5.4 add_quirk UQ_MSC_NO_SYNC_CACHE umass2: SCSI over Bulk-Only; quirks =3D 0x4000 Re-created zpool is still failing with cksum errors. Every new scrub run = is triggering another "repairing". Thanks, Alexander. On 22.01.2013, at 6:17, Pawel Jakub Dawidek wrote: > I used wrong Hans' login, resending with the proper e-mail. >=20 > On Mon, Jan 21, 2013 at 09:58:52PM +0100, Pawel Jakub Dawidek wrote: >> On Sat, Jan 19, 2013 at 11:26:39PM +0900, Alexander Nedotsukov wrote: >>> Let's use some space out of it. >>>=20 >>> #dd if=3D/dev/zero of=3D/tank/foo >>> ^C250939+0 records in >>> 250938+0 records out >>> 128480256 bytes transferred in 30.402453 secs (4225983 bytes/sec) >>>=20 >>> Oops... >>>=20 >>> #zpool status >>> pool: tank >>> state: ONLINE >>> status: One or more devices has experienced an unrecoverable error. = An >>> attempt was made to correct the error. Applications are = unaffected. >>> action: Determine if the device needs to be replaced, and clear the = errors >>> using 'zpool clear' or replace the device with 'zpool replace'. >>> see: http://illumos.org/msg/ZFS-8000-9P >>> scan: scrub repaired 5K in 0h0m with 0 errors on Sat Jan 19 = 23:11:20 2013 >>> config: >>>=20 >>> NAME STATE READ WRITE CKSUM >>> tank ONLINE 0 0 0 >>> raidz1-0 ONLINE 0 0 0 >>> da1 ONLINE 0 0 1 >>> da2 ONLINE 0 0 0 >>> da3 ONLINE 0 0 1 >>=20 >> This seems like umass/usb issue (hps@ CCed). Can you also try GELI = with >> data integrity verification? >>=20 >>=20 >> # geli onetime -a hmac/sha1 -s 4096 /dev/da0 >>=20 >> It will report some problems due to GEOM tasting, but ignore them and = run: >>=20 >> # dd if=3D/dev/random of=3D/dev/da0.eli bs=3D1m >>=20 >> Once that done try to read the data back and look at the logs to see = if >> any corruptions are reported. >>=20 >> --=20 >> Pawel Jakub Dawidek http://www.wheelsystems.com >> FreeBSD committer http://www.FreeBSD.org >> Am I Evil? Yes, I Am! http://tupytaj.pl >=20 >=20 > --=20 > Pawel Jakub Dawidek http://www.wheelsystems.com > FreeBSD committer http://www.FreeBSD.org > Am I Evil? Yes, I Am! http://tupytaj.pl