From owner-freebsd-fs@freebsd.org Sun Sep 27 17:06:09 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4C5349CF259 for ; Sun, 27 Sep 2015 17:06:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 39999151 for ; Sun, 27 Sep 2015 17:06:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8RH69Tc008027 for ; Sun, 27 Sep 2015 17:06:09 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 203330] ZFS free space bug or HDD driver bug Date: Sun, 27 Sep 2015 17:06:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: smh@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Sep 2015 17:06:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203330 Steven Hartland changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |smh@FreeBSD.org --- Comment #2 from Steven Hartland --- Could you try a current / head kernel + world to see if this has already been addressed? -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Sun Sep 27 21:00:50 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3A77A0AE5E for ; Sun, 27 Sep 2015 21:00:50 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AEFFA8DB for ; Sun, 27 Sep 2015 21:00:50 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8RL0o4B003514 for ; Sun, 27 Sep 2015 21:00:50 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201509272100.t8RL0o4B003514@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-fs@FreeBSD.org Subject: Problem reports for freebsd-fs@FreeBSD.org that need special attention X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 Date: Sun, 27 Sep 2015 21:00:50 +0000 Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Sep 2015 21:00:50 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f 3 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Sun Sep 27 21:43:36 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97CC8A0A6D8 for ; Sun, 27 Sep 2015 21:43:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 843B47F4 for ; Sun, 27 Sep 2015 21:43:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8RLha6H090979 for ; Sun, 27 Sep 2015 21:43:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Sun, 27 Sep 2015 21:43:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gibbs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Sep 2015 21:43:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #22 from Justin T. Gibbs --- Created attachment 161461 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=161461&action=edit Generically handle deferred dbuf eviction This patch was developed and tested using an illumos VM. I don't have access to a physical ZFS test rig right now, so only apply if you understand the risks and have a real test environment. It passes ztest, but needs to have the objset eviction path validated via the ZFS test suite. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Mon Sep 28 13:35:47 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D5DD9A0A9DA for ; Mon, 28 Sep 2015 13:35:47 +0000 (UTC) (envelope-from mikej@mikej.com) Received: from mx2.paymentallianceintl.com (mx2.paymentallianceintl.com [216.26.158.171]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx2.paymentallianceintl.com", Issuer "Go Daddy Secure Certification Authority" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 898F11EE6 for ; Mon, 28 Sep 2015 13:35:46 +0000 (UTC) (envelope-from mikej@mikej.com) Received: from firewall.mikej.com (162-230-214-65.lightspeed.lsvlky.sbcglobal.net [162.230.214.65]) by mx2.paymentallianceintl.com (8.15.1/8.15.1) with ESMTPS id t8SDZhQn048882 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Mon, 28 Sep 2015 09:35:44 -0400 (EDT) (envelope-from mikej@mikej.com) X-Authentication-Warning: mx2.paymentallianceintl.com: Host 162-230-214-65.lightspeed.lsvlky.sbcglobal.net [162.230.214.65] claimed to be firewall.mikej.com Received: from mail.mikej.com (firewall.mikej.com [192.168.6.63]) by firewall.mikej.com (8.15.2/8.14.9) with ESMTP id t8SDZgB1007309 for ; Mon, 28 Sep 2015 09:35:42 -0400 (EDT) (envelope-from mikej@mikej.com) X-Authentication-Warning: firewall.mikej.com: Host firewall.mikej.com [192.168.6.63] claimed to be mail.mikej.com MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Mon, 28 Sep 2015 09:35:42 -0400 From: Michael Jung To: freebsd-fs@freebsd.org Subject: Fwd: two different solaris asserts in r288019 In-Reply-To: <38ee1fb571b3c0800c2111765c7c9f8d@mail.mikej.com> References: <38ee1fb571b3c0800c2111765c7c9f8d@mail.mikej.com> Message-ID: X-Sender: mikej@mikej.com User-Agent: Roundcube Webmail/1.1.3 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 13:35:47 -0000 I guess better to post here. -------- Original Message -------- Subject: two different solaris asserts in r288019 Date: 2015-09-28 09:34 From: Michael Jung To: freebsd-current@freebsd.org This is my poudriere build box that has been running current for a very long time. It was recently upgraded to r288019 and since then I have been getting these panics. One panic I could not find reported, maybe additional information here. I followed the thread here http://lists.freebsd.org/pipermail/freebsd-fs/2015-August/021856.html but haven't found any movement. Regards, --mikej Dump header from device: /dev/da2p1 Architecture: amd64 Architecture Version: 2 Dump Length: 3271299072 Blocksize: 512 Dumptime: Thu Sep 24 17:10:33 2015 Hostname: bsd11 Magic: FreeBSD Kernel Dump Version String: FreeBSD 11.0-CURRENT #0 r288019: Sun Sep 20 17:16:46 EDT 2015 mikej@bsd11:/usr/obj/usr/src/sys/GENERIC Panic String: solaris assert: avl_is_empty(&dn->dn_dbufs), file: /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c, line: 495 Dump Parity: 3609444522 Bounds: 1 Dump Status: good https://charon.gopai.com/info.1 https://charon.gopai.com/core.txt.1 https://charon.gopai.com/vmcore.1 Dump header from device: /dev/da2p1 Architecture: amd64 Architecture Version: 2 Dump Length: 3141214208 Blocksize: 512 Dumptime: Mon Sep 28 08:19:47 2015 Hostname: bsd11 Magic: FreeBSD Kernel Dump Version String: FreeBSD 11.0-CURRENT #0 r288019: Sun Sep 20 17:16:46 EDT 2015 mikej@bsd11:/usr/obj/usr/src/sys/GENERIC Panic String: solaris assert: (dn->dn_phys->dn_nlevels == 0 && db->db_level == 0) || dn->dn_phys->dn_nlevels > db->db_level || dn->dn_next_nlevels[txgoff] > db->db_level || dn->dn_next_nlevels[(tx->tx_txg- Dump Parity: 1563774101 Bounds: 2 Dump Status: good https://charon.gopai.com/info.2 https://charon.gopai.com/core.txt.2 https://charon.gopai.com/vmcore.2 From owner-freebsd-fs@freebsd.org Mon Sep 28 13:36:33 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A2DA8A0AA6B for ; Mon, 28 Sep 2015 13:36:33 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-3.slu.se (pop.slu.se [77.235.224.123]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3CA491F7D for ; Mon, 28 Sep 2015 13:36:32 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-3.slu.se (77.235.224.123) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Mon, 28 Sep 2015 15:36:23 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Mon, 28 Sep 2015 15:36:23 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: "freebsd-fs@freebsd.org" Subject: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqIMkbw8w3f0SwU1IRt793EQ== Date: Mon, 28 Sep 2015 13:36:22 +0000 Message-ID: <1443447383.5271.66.camel@data-b104.adm.slu.se> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <181D80B49814E9409364D0677F5AD103@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 13:36:33 -0000 SGV5IGFsbCENCg0KScK0bSBqdXN0IGdpdmluZyBhIHNob3V0IG91dCBoZXJlIHRvIHNlZSBpZiBh bnlvbmUgZWxzZSBoYXZlIGhhZCBzaW1pbGFyDQpleHBlcmllbmNlcyB3b3JraW5nIHdpdGggTFNJ L0F2YWdvIEhCQSdzIGluIEZyZWVCU0QuDQoNCkZvciBzb21lIHRpbWUgbm93LCBhYm91dCBhIHll YXIgb3Igc28sIHdlwrR2ZSBoYWQgc2V2ZXJhbCB0aW1lcyB3ZXJlIGhhcmQNCmRyaXZlcyBoYXZl IGRyb3BwZWQgb3V0LCB5b3UgcHVsbCBpdCBvdXQsIHBvcCBhIG5ldyBiYWNrIGluLCBidXQgaXQN Cm5ldmVyIHNob3dzIHVwIGluIHRoZSBPUy4gV2hlbiBpbnNlcnRlZCwgbm90aGluZyBwcmludHMg aW4gdGhlIGxvZ3MsIGFuZA0KcGh5c2ljYWxseSwgaXQganVzdCBibGlua3MgZm9yIGEgaGFsZiBh IHNlY29uZCwgdGhlbiBub3RoaW5nLiBUaGUgZW50aXJlDQpzZXJ2ZXIgdGhlbiBuZWVkcyB0byBi ZSByZWJvb3RlZCB0byBnZXQgdGhlIGRyaXZlIGJhY2suDQoNCkFzIGZvciB0aGUgaGFyZHdhcmUs IHdlIGhhdmUgc2V2ZXJhbCBTdXBlck1pY3JvIHNlcnZlcnMsIGFuIEhQLCBhbmQgYW4NCm9sZCBT VU4gc2VydmVyIHRoYXQgYWxsIGhhdmUgdGhpcyBwcm9ibGVtLiBJdMK0cyBoYXBwZW5lZCB3aXRo IGJvdGggb2xkDQphbmQgbmV3IGRyaXZlcyBmcm9tIGRpZmZlcmVudCBtYW51ZmFjdHVyZXJzIGFu ZCBzaXplcy4gVGhlIG9ubHkgdGhpbmcgaW4NCmNvbW1vbiBoYXMgYmVlbiB0aGUgTFNJL0F2YWdv IEhCQS4NCg0KVGhlIHNvZnR3YXJlIGlzIEZyZWVCU0QtMTAuMS1TVEFCTEUgYXMgcGVyIHRoaXNb Kl0gYnVnLCB2ZXJ5IGNsb3NlIHRvDQoxMC4yLVJFTEVBU0UsIG1wcyBkcml2ZXIgdmVyc2lvbiAy MCBhbmQgdGhlIGZpcm13YXJlIGhhcyBiZWVuIGZsYXNoZWQgdG8NCjE5LiBBbHNvIHRyaWVkIGZp cm13YXJlIHZlcnNpb24gMjAgYnV0IFpGUyB3ZW50IG51dHMsIGRpc3BsYXlpbmcNCmNoZWNrc3Vt IGVycm9ycyBvbiBqdXN0IGFib3V0IGV2ZXJ5IGRpc2sgaW4gdGhlIHBvb2wuDQoNCknCtHRzIGdv dHRlbiB0byB0aGUgcG9pbnQgScK0bSBmZWQgdXAgYW5kIGhhdmUgdG8gYXNrIGlmIHNvbWVvbmUg ZWxzZQ0KY291bGQgdGhpbmsgb2YgYSBmaXgsIHNpbmNlIG5laXRoZXIgc29mdHdhcmUgbm9yIGZp cm13YXJlIHVwZ3JhZGUgc2VlbXMNCnRvIG1ha2UgYSBkaWZmZXJlbmNlLiBPciB0byBzdWdnZXN0 IGFub3RoZXIgSEJBIGluc3RlYWQ/DQoNClRoYW5rcyBpbiBhZHZhbmNlIQ0KDQovSw0KDQpbKl06 IGh0dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MTkxMzQ4 DQoNCg== From owner-freebsd-fs@freebsd.org Mon Sep 28 14:00:21 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0590CA0B9AA for ; Mon, 28 Sep 2015 14:00:21 +0000 (UTC) (envelope-from laza.ita@gmail.com) Received: from mail-wi0-x230.google.com (mail-wi0-x230.google.com [IPv6:2a00:1450:400c:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 909961E18 for ; Mon, 28 Sep 2015 14:00:20 +0000 (UTC) (envelope-from laza.ita@gmail.com) Received: by wicgb1 with SMTP id gb1so105502897wic.1 for ; Mon, 28 Sep 2015 07:00:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=sMlSb61fcPqyIhAvsCOF93bRlmDoexd2XOhMg8rrhQo=; b=BUFRQ14eYrA7j+jyN3fExJ3zYBaXM4cNph0nMW2k4/2y2BQZkbMbwLJqConkpIF2+t CL6fJNCNqVisyg7f7GFUa+/c2RDtd8M+mAX1M1iecFlRzos3TGab1yxSJ8XHV8aHlNnT 7QPyV4/VLd6Lzr3m2NTLov0urGzWb2TbkGjWOnf9jewAQT2zSJQUawB/l218JTfaQ28M opyhYjiljqJMD73MPfmiQQPr+8/gZTvHGY4+Xkf0HEJdtzUQPv822xewNGZ81COvxJfG GbQweTPRiQyctTp5GTrB073Yam3dw6GSm2OUaQ9MtziVXYL75rV8+1JnrijTvn2mDzD+ bM/g== X-Received: by 10.194.7.106 with SMTP id i10mr22190856wja.86.1443448818987; Mon, 28 Sep 2015 07:00:18 -0700 (PDT) Received: from tmt-laza.tomatowin.local (fast100.tomato.it. [81.208.47.59]) by smtp.googlemail.com with ESMTPSA id gc8sm18500754wib.2.2015.09.28.07.00.18 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 28 Sep 2015 07:00:18 -0700 (PDT) Message-ID: <560947F1.2040607@gmail.com> Date: Mon, 28 Sep 2015 16:00:17 +0200 From: "Marco.re" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Tim Gustafson , freebsd-fs@freebsd.org Subject: Re: Switching from MFI to MRSAS References: In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 14:00:21 -0000 On 09/23/2015 01:26, Tim Gustafson wrote: > mfi0: port 0x2000-0x20ff mem > 0x92000000-0x9200ffff,0x91f00000-0x91ffffff irq 26 at device 0.0 on > pci2 > mfi0: Using MSI > mfi0: Megaraid SAS driver Ver 4.23 > mfi0: FW MaxCmds = 240, limiting to 128 > mfi0: MaxCmd = 240, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c00f0 > > I see that there's a tunable for /boot/device.hints that I can set to > prefer mrsas over mfi: > > hw.mfi.mrsas_enable="1" > > and then add this to /boot/loader.conf: > > mrsas_load="yes" > > So, my question is: if I add those options and then reboot, will my > drives magically re-appear as /dev/da* devices? Will the data on them > still be accessible as-is, or would I need to re-install the OS to get > this to go? Would switching to this other driver enable the TRIM > command, as the devices will now be /dev/da* rather than > /dev/mfisyspd*? Or am I just being naive here? :) I'm not sure, I've installed one Dell R730 with a new controller H730/P, I'm not sure if the mfi driver was seeing the raid, I don't remember :-( if you have this controller # pciconf -lv mrsas0@pci0:2:0:0: class=0x010400 card=0x1f491028 chip=0x005d1000 rev=0x02 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'MegaRAID SAS-3 3108 [Invader]' class = mass storage subclass = RAID it works with the mrsas driver. # cat /boot/loader.conf hw.mfi.mrsas_enable=1 mrsas_load="yes" # dmesg | grep -i mrsas module_register: module pci/mrsas already exists! Module pci/mrsas failed to register: 17 LSI MegaRAID SAS FreeBSD mrsas driver version: 06.704.01.01-fbsd mrsas0: port 0x2000-0x20ff mem 0x92000000-0x9200ffff,0x91f00000-0x91ffffff irq 26 at device 0.0 on pci2 mrsas0: FW supports: UnevenSpanSupport=1 mrsas0: Internal command timed out after 180 seconds. da0 at mrsas0 bus 0 scbus0 target 0 lun 0 Cioa Marco From owner-freebsd-fs@freebsd.org Mon Sep 28 14:27:09 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49FEAA0A84E for ; Mon, 28 Sep 2015 14:27:09 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ig0-x22a.google.com (mail-ig0-x22a.google.com [IPv6:2607:f8b0:4001:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 17C201CD9 for ; Mon, 28 Sep 2015 14:27:09 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by igxx6 with SMTP id x6so51089964igx.1 for ; Mon, 28 Sep 2015 07:27:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=IlYblRx2rNcoXmmLd0YnLp4YETVW1Ml7rmrlundVCzc=; b=0zSVe5I9TdP777GPblhhXLmfFsNWbSorbzXrU+oOoo0WNtvVUt2VvpNSVdAR3KLT8E 0RGnvgd5UGekgZDSNF2HHGRojVZ0nFD1tTWkc+7JOos3r5FI6I15iFk8e0Td4bPgkIPp 2oUaEeeRO/Lxpwpn+y0IyyCXewNoBf/WGOF4CJNNPae/xs0XpLO22MJZYFk1+HBnKdzl MbgQBciw4Bm8Tshb+tkpu2iTAMo+sKkKyZD1c5mysjLGzPTjKtvUPSiF8VCmM1QPI2Kc aO6gULaTJ1Gh8v5EupZBXkPe1r0dfQ2m7nY5kxhli2nK4RX8Dy9okrmkWod3R0bbZphl AVCw== MIME-Version: 1.0 X-Received: by 10.50.79.232 with SMTP id m8mr2328510igx.83.1443450428458; Mon, 28 Sep 2015 07:27:08 -0700 (PDT) Received: by 10.36.200.212 with HTTP; Mon, 28 Sep 2015 07:27:08 -0700 (PDT) In-Reply-To: <1443447383.5271.66.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> Date: Mon, 28 Sep 2015 10:27:08 -0400 Message-ID: Subject: Re: Cannot replace broken hard drive with LSI HBA From: Rich To: =?UTF-8?Q?Karli_Sj=C3=B6berg?= Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 14:27:09 -0000 Hi Karli, Which mps-supported HBA? Your firmware version indicates it's something in the 92xx family, but there's a number of variants on that flavor. Have you played with any of the drive timeout settings in the HBA firmware/OS/drives themselves (the dark vendor-specific magic known variously as TLER, CCTL, ERC...)? What models are the servers? There are a number of possible complicating factors here - whether the drives are SAS or SATA (and any "quirks" of the drives), whether the backplanes are passive or have SAS expanders, what version of SAS/SATA these backplanes are capable of handling, any firmware strangeness on the passive or otherwise backplane... How does the machine misbehave once you re-insert the drive? Does the machine misbehave if you keep the drive removed? One final quirk I'll mention is that a number of SAS expander backplanes I've encountered sometimes will not notice a drive is physically pulled until a new drive is inserted, and sometimes the best way to convince it to see a drive after pulling one that was misbehaving is: - seat a "new" (not otherwise in the machine) drive - unseat said drive after a few seconds - seat whatever drive you intended to seat in the first place, be it "new" or the original drive Good luck, - Rich On Mon, Sep 28, 2015 at 9:36 AM, Karli Sj=C3=B6berg = wrote: > Hey all! > > I=C2=B4m just giving a shout out here to see if anyone else have had simi= lar > experiences working with LSI/Avago HBA's in FreeBSD. > > For some time now, about a year or so, we=C2=B4ve had several times were = hard > drives have dropped out, you pull it out, pop a new back in, but it > never shows up in the OS. When inserted, nothing prints in the logs, and > physically, it just blinks for a half a second, then nothing. The entire > server then needs to be rebooted to get the drive back. > > As for the hardware, we have several SuperMicro servers, an HP, and an > old SUN server that all have this problem. It=C2=B4s happened with both o= ld > and new drives from different manufacturers and sizes. The only thing in > common has been the LSI/Avago HBA. > > The software is FreeBSD-10.1-STABLE as per this[*] bug, very close to > 10.2-RELEASE, mps driver version 20 and the firmware has been flashed to > 19. Also tried firmware version 20 but ZFS went nuts, displaying > checksum errors on just about every disk in the pool. > > I=C2=B4ts gotten to the point I=C2=B4m fed up and have to ask if someone = else > could think of a fix, since neither software nor firmware upgrade seems > to make a difference. Or to suggest another HBA instead? > > Thanks in advance! > > /K > > [*]: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191348 > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Mon Sep 28 15:07:05 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 996BCA0A0E0 for ; Mon, 28 Sep 2015 15:07:05 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from mail.physics.umn.edu (smtp.spa.umn.edu [128.101.220.4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 75DD91175 for ; Mon, 28 Sep 2015 15:07:04 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from c-66-41-25-68.hsd1.mn.comcast.net ([66.41.25.68] helo=[192.168.0.107]) by mail.physics.umn.edu with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.77 (FreeBSD)) (envelope-from ) id 1Zga12-000Bhm-8j; Mon, 28 Sep 2015 10:06:56 -0500 Subject: Re: Cannot replace broken hard drive with LSI HBA To: =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" References: <1443447383.5271.66.camel@data-b104.adm.slu.se> From: Graham Allan Message-ID: <5609578E.1050606@physics.umn.edu> Date: Mon, 28 Sep 2015 10:06:54 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <1443447383.5271.66.camel@data-b104.adm.slu.se> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 15:07:05 -0000 I have seen this and keep experiencing it. I posted a question about it a while back but I don't think there was much response. https://lists.freebsd.org/pipermail/freebsd-fs/2014-July/019715.html My original question was with 9.1, and at the time we discovered that if you ran the LSI utility "sas2ircu", for example simply "sas2ircu 0 DISPLAY", it was seem to ang for a while, then issue a bus reset, and the replaced drives are detected. Now that I also see the same issue on 9.3, running sas2ircu in this situation usually seems to cause a panic, so it's not exactly progress. https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006794.html I am using Dell servers, generally R710 and R720, with LSI 9207-8e controllers, Supermicro JBZOD chassis, and mostly WD drives. I got the above problems using firmware 16 (probably) with both 9.1 and 9.3. Regarding your experience with firmware 20, I believe it is "known bad", though some seem to disagree. Certainly when building my recent-ish large 9.3 servers I specifically tested it and got consistent data corruption. There is now a newer release of firmware 20 , "20.00.04.00" which seems to be fixed - see this thread: https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006793.html This is kind of painful as the new firmware was posted by LSI with no comment or no release notes, yet if you follow all the references there are hints that it was known internally to be problematic. It's bad if selecting the HBA firmware for FreeBSD is degenerated to a "black art" but that seems to be where it is right now. I don't know that there are any other viable choices for SAS HBA besides LSI - I've never heard of any. Your bugzilla link is interesting. We are also using WD drives and Supermicro enclosures so there is a lot in common. I wonder if these changes are in 10.2-RELEASE? Graham On 9/28/2015 8:36 AM, Karli Sjöberg wrote: > Hey all! > > I´m just giving a shout out here to see if anyone else have had similar > experiences working with LSI/Avago HBA's in FreeBSD. > > For some time now, about a year or so, we´ve had several times were hard > drives have dropped out, you pull it out, pop a new back in, but it > never shows up in the OS. When inserted, nothing prints in the logs, and > physically, it just blinks for a half a second, then nothing. The entire > server then needs to be rebooted to get the drive back. > > As for the hardware, we have several SuperMicro servers, an HP, and an > old SUN server that all have this problem. It´s happened with both old > and new drives from different manufacturers and sizes. The only thing in > common has been the LSI/Avago HBA. > > The software is FreeBSD-10.1-STABLE as per this[*] bug, very close to > 10.2-RELEASE, mps driver version 20 and the firmware has been flashed to > 19. Also tried firmware version 20 but ZFS went nuts, displaying > checksum errors on just about every disk in the pool. > > I´ts gotten to the point I´m fed up and have to ask if someone else > could think of a fix, since neither software nor firmware upgrade seems > to make a difference. Or to suggest another HBA instead? > > Thanks in advance! > > /K > > [*]: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191348 > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-fs@freebsd.org Mon Sep 28 15:07:06 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 10EE7A0A0E2 for ; Mon, 28 Sep 2015 15:07:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F1D3A117A for ; Mon, 28 Sep 2015 15:07:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8SF75WX073839 for ; Mon, 28 Sep 2015 15:07:05 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Mon, 28 Sep 2015 15:07:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 15:07:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #23 from Andriy Gapon --- (In reply to Justin T. Gibbs from comment #22) Justin, I am testing this patch now. Should I expect any verifiable effects from it other than those from the simple removal of the assertion? -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Mon Sep 28 15:32:32 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 27FC7A0B052 for ; Mon, 28 Sep 2015 15:32:32 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 5487C107C for ; Mon, 28 Sep 2015 15:32:27 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id SAA25938; Mon, 28 Sep 2015 18:32:19 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ZgaPb-000K0D-GP; Mon, 28 Sep 2015 18:32:19 +0300 Subject: Re: Fwd: two different solaris asserts in r288019 To: Michael Jung , freebsd-fs@FreeBSD.org References: <38ee1fb571b3c0800c2111765c7c9f8d@mail.mikej.com> From: Andriy Gapon Message-ID: <56095D4A.5010407@FreeBSD.org> Date: Mon, 28 Sep 2015 18:31:22 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 15:32:32 -0000 On 28/09/2015 16:35, Michael Jung wrote: > I guess better to post here. The first of the panics has been already reported and can be considered to be an issue in progress: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 For the second one it's probably worth while creating a new problem report. > -------- Original Message -------- > Subject: two different solaris asserts in r288019 > Date: 2015-09-28 09:34 > From: Michael Jung > To: freebsd-current@freebsd.org > > This is my poudriere build box that has been running current for a very long > time. It was recently upgraded to r288019 and since then I have been getting > these panics. One panic I could not find reported, maybe additional information > here. > > I followed the thread here > http://lists.freebsd.org/pipermail/freebsd-fs/2015-August/021856.html but > haven't found any movement. > > Regards, > > --mikej > > Dump header from device: /dev/da2p1 > Architecture: amd64 > Architecture Version: 2 > Dump Length: 3271299072 > Blocksize: 512 > Dumptime: Thu Sep 24 17:10:33 2015 > Hostname: bsd11 > Magic: FreeBSD Kernel Dump > Version String: FreeBSD 11.0-CURRENT #0 r288019: Sun Sep 20 17:16:46 EDT 2015 > mikej@bsd11:/usr/obj/usr/src/sys/GENERIC > Panic String: solaris assert: avl_is_empty(&dn->dn_dbufs), file: > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c, line: 495 > Dump Parity: 3609444522 > Bounds: 1 > Dump Status: good > > https://charon.gopai.com/info.1 > https://charon.gopai.com/core.txt.1 > https://charon.gopai.com/vmcore.1 > > > Dump header from device: /dev/da2p1 > Architecture: amd64 > Architecture Version: 2 > Dump Length: 3141214208 > Blocksize: 512 > Dumptime: Mon Sep 28 08:19:47 2015 > Hostname: bsd11 > Magic: FreeBSD Kernel Dump > Version String: FreeBSD 11.0-CURRENT #0 r288019: Sun Sep 20 17:16:46 EDT 2015 > mikej@bsd11:/usr/obj/usr/src/sys/GENERIC > Panic String: solaris assert: (dn->dn_phys->dn_nlevels == 0 && db->db_level == > 0) || dn->dn_phys->dn_nlevels > db->db_level || dn->dn_next_nlevels[txgoff] > > db->db_level || dn->dn_next_nlevels[(tx->tx_txg- > Dump Parity: 1563774101 > Bounds: 2 > Dump Status: good > > https://charon.gopai.com/info.2 > https://charon.gopai.com/core.txt.2 > https://charon.gopai.com/vmcore.2 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > -- Andriy Gapon From owner-freebsd-fs@freebsd.org Mon Sep 28 15:44:09 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 06F4BA0B5B9 for ; Mon, 28 Sep 2015 15:44:09 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ig0-x231.google.com (mail-ig0-x231.google.com [IPv6:2607:f8b0:4001:c05::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C88B51771 for ; Mon, 28 Sep 2015 15:44:08 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by igcpb10 with SMTP id pb10so58562996igc.1 for ; Mon, 28 Sep 2015 08:44:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=2ZNN85DpNHF3LVm6ZqQXCW9XDeG/IJdnW7s5S5FTAOE=; b=Csi/2CBUYYNqcEms35SGrq+TJ6g3vt2jMspXMyB3OWykdIKcUllzDoJWr12D+jydxM DzeDcrzzJr6A/bFFvle7X/rwuMpg+tJ7g//gmu4h/kKzaFXdfuC+sTFgzyWkyvrI96Z+ Yf9+EY+U0xUtqlUt+vkf9aH8NTJBwJD30ld0RtpqCYn1oihNxzJINgGB4fUdSgX4tRz+ Dy0dF+yyBXcOKsWhA7jk3380RmZHtftGSONSNrKTDrJUKj8ufzXsdiSZ1sacLZgeQsfI 83MjLT3OBamI5DvLEPjMvPkKRX+vUrWIBPYxpXmd11Redd/pwZkkpuuYg6a+BH0KO79u nxIw== MIME-Version: 1.0 X-Received: by 10.50.73.8 with SMTP id h8mr3601074igv.94.1443455047128; Mon, 28 Sep 2015 08:44:07 -0700 (PDT) Received: by 10.36.200.212 with HTTP; Mon, 28 Sep 2015 08:44:06 -0700 (PDT) In-Reply-To: <5609578E.1050606@physics.umn.edu> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> Date: Mon, 28 Sep 2015 11:44:06 -0400 Message-ID: Subject: Re: Cannot replace broken hard drive with LSI HBA From: Rich To: Graham Allan Cc: =?UTF-8?Q?Karli_Sj=C3=B6berg?= , "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 15:44:09 -0000 On Mon, Sep 28, 2015 at 11:06 AM, Graham Allan wrote: > I have seen this and keep experiencing it. I posted a question about it a > while back but I don't think there was much response. > > https://lists.freebsd.org/pipermail/freebsd-fs/2014-July/019715.html > > My original question was with 9.1, and at the time we discovered that if you > ran the LSI utility "sas2ircu", for example simply "sas2ircu 0 DISPLAY", it > was seem to ang for a while, then issue a bus reset, and the replaced drives > are detected. > > Now that I also see the same issue on 9.3, running sas2ircu in this > situation usually seems to cause a panic, so it's not exactly progress. > > https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006794.html Neat. In theory, the driver architecture is supposed to try resetting increasingly large parts of the tree, I believe (e.g. a drive reset, then the parent of that drive in the topology, then the parent of that, and so on, until it ultimately should try resetting the controller...) Does using sas2ircu to induce a bus reset still work with P19 firmware on 9.1, or older firmware on 9.3? Does anything in the atacontrol/camcontrol family of commands do anything useful for you? > I am using Dell servers, generally R710 and R720, with LSI 9207-8e > controllers, Supermicro JBZOD chassis, and mostly WD drives. I got the above > problems using firmware 16 (probably) with both 9.1 and 9.3. > > Regarding your experience with firmware 20, I believe it is "known bad", > though some seem to disagree. Certainly when building my recent-ish large > 9.3 servers I specifically tested it and got consistent data corruption. > There is now a newer release of firmware 20 , "20.00.04.00" which seems to > be fixed - see this thread: > > https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006793.html > > This is kind of painful as the new firmware was posted by LSI with no > comment or no release notes, yet if you follow all the references there are > hints that it was known internally to be problematic. It's bad if selecting > the HBA firmware for FreeBSD is degenerated to a "black art" but that seems > to be where it is right now. It's kind of impressive; I have all of the P20 firmware files downloaded for the old and new releases, and none of the "new" firmware files include a changelog newer than the one in the "original" P20 releases. > I don't know that there are any other viable choices for SAS HBA besides LSI > - I've never heard of any. Only vendors I ever knew of were Areca and Adaptec - the former uses LSI chips with some additional sauce in their SAS cards these days, and the latter got bought by PMC and seems to be badly playing catch-up with LSI (e.g. they have no 12 Gb/s HBAs at all, currently...) Marvell made SATA-only cards, but I haven't seen any large-scale versions of those since PCI-X, and that doesn't help if you have anything but a pure SATA topology. - Rich From owner-freebsd-fs@freebsd.org Mon Sep 28 15:44:29 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75953A0B5F2 for ; Mon, 28 Sep 2015 15:44:29 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wi0-x22b.google.com (mail-wi0-x22b.google.com [IPv6:2a00:1450:400c:c05::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 15AC217EE for ; Mon, 28 Sep 2015 15:44:29 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by wicfx3 with SMTP id fx3so107253886wic.0 for ; Mon, 28 Sep 2015 08:44:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=8hzrxrFKa4hIt0vf9NQ4uqFxUED05SGChGctxl3r0OU=; b=paSZA6mRRIQR2ucr9i/fkTHC09LX46cVReKq0yn93hPFUMjh2MwrcfH9+XdwxWmt4O j1I5kCKNAJrCQSAenBlBzyMxLQHecfPub2oz7t0mZGJWfwqKWI8Lxx8+2CEeUTCULWJR OHbDkyIqSgxsO1zSd/INOzPSsLGqTZ3jc1xxfhzWwvNgyJWMNIWiVvx2k+shOgjWAic2 kgjmKYgiBLatq3WkFRWIMMcGNspUgvR/Xsm4JqPF2LSJ92ls3Xao85R6zxOuBHxwtq3W w3jfx5SWkkut6KWN0l/gSGoqE5v8cmzKIPUOqow1NjHTlBvf8adyRtyJG4s9xRrp4+qh WX1A== X-Received: by 10.194.82.198 with SMTP id k6mr22358953wjy.139.1443455067399; Mon, 28 Sep 2015 08:44:27 -0700 (PDT) Received: from [192.168.0.1] (cag06-2-82-237-68-117.fbx.proxad.net. [82.237.68.117]) by smtp.gmail.com with ESMTPSA id kj5sm18997725wjb.19.2015.09.28.08.44.26 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 28 Sep 2015 08:44:26 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Subject: Re: Cannot replace broken hard drive with LSI HBA From: Ben RUBSON In-Reply-To: <5609578E.1050606@physics.umn.edu> Date: Mon, 28 Sep 2015 17:44:24 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <75069031-4111-4F67-A836-A509994A35DC@gmail.com> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> To: "freebsd-fs@freebsd.org" X-Mailer: Apple Mail (2.2104) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 15:44:29 -0000 Hello, I also plan to use a LSI SAS adapter (9211-8i), with FreeBSD / ZFS. 2 types of firmware exist for this card, The IT (Initiator Target) one = and the IR (Integrated RAID) one. According to my findings, the IT one is the recommended one to use with = ZFS. Of course, not sure it is related, but did U try the IT firmware ? Best regards, Ben > Le 28 sept. 2015 =C3=A0 17:06, Graham Allan a = =C3=A9crit : >=20 > I have seen this and keep experiencing it. I posted a question about = it a while back but I don't think there was much response. >=20 > https://lists.freebsd.org/pipermail/freebsd-fs/2014-July/019715.html >=20 > My original question was with 9.1, and at the time we discovered that = if you ran the LSI utility "sas2ircu", for example simply "sas2ircu 0 = DISPLAY", it was seem to ang for a while, then issue a bus reset, and = the replaced drives are detected. >=20 > Now that I also see the same issue on 9.3, running sas2ircu in this = situation usually seems to cause a panic, so it's not exactly progress. >=20 > = https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006794.html >=20 > I am using Dell servers, generally R710 and R720, with LSI 9207-8e = controllers, Supermicro JBZOD chassis, and mostly WD drives. I got the = above problems using firmware 16 (probably) with both 9.1 and 9.3. >=20 > Regarding your experience with firmware 20, I believe it is "known = bad", though some seem to disagree. Certainly when building my = recent-ish large 9.3 servers I specifically tested it and got consistent = data corruption. There is now a newer release of firmware 20 , = "20.00.04.00" which seems to be fixed - see this thread: >=20 > = https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006793.html >=20 > This is kind of painful as the new firmware was posted by LSI with no = comment or no release notes, yet if you follow all the references there = are hints that it was known internally to be problematic. It's bad if = selecting the HBA firmware for FreeBSD is degenerated to a "black art" = but that seems to be where it is right now. >=20 > I don't know that there are any other viable choices for SAS HBA = besides LSI - I've never heard of any. >=20 > Your bugzilla link is interesting. We are also using WD drives and = Supermicro enclosures so there is a lot in common. I wonder if these = changes are in 10.2-RELEASE? >=20 > Graham >=20 > On 9/28/2015 8:36 AM, Karli Sj=C3=B6berg wrote: >> Hey all! >>=20 >> I=C2=B4m just giving a shout out here to see if anyone else have had = similar >> experiences working with LSI/Avago HBA's in FreeBSD. >>=20 >> For some time now, about a year or so, we=C2=B4ve had several times = were hard >> drives have dropped out, you pull it out, pop a new back in, but it >> never shows up in the OS. When inserted, nothing prints in the logs, = and >> physically, it just blinks for a half a second, then nothing. The = entire >> server then needs to be rebooted to get the drive back. >>=20 >> As for the hardware, we have several SuperMicro servers, an HP, and = an >> old SUN server that all have this problem. It=C2=B4s happened with = both old >> and new drives from different manufacturers and sizes. The only thing = in >> common has been the LSI/Avago HBA. >>=20 >> The software is FreeBSD-10.1-STABLE as per this[*] bug, very close to >> 10.2-RELEASE, mps driver version 20 and the firmware has been flashed = to >> 19. Also tried firmware version 20 but ZFS went nuts, displaying >> checksum errors on just about every disk in the pool. >>=20 >> I=C2=B4ts gotten to the point I=C2=B4m fed up and have to ask if = someone else >> could think of a fix, since neither software nor firmware upgrade = seems >> to make a difference. Or to suggest another HBA instead? >>=20 >> Thanks in advance! >>=20 >> /K >>=20 >> [*]: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191348 From owner-freebsd-fs@freebsd.org Mon Sep 28 16:18:13 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62EC0A0AB13 for ; Mon, 28 Sep 2015 16:18:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F6881B00 for ; Mon, 28 Sep 2015 16:18:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8SGIDvX048289 for ; Mon, 28 Sep 2015 16:18:13 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Mon, 28 Sep 2015 16:18:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gibbs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 16:18:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #24 from Justin T. Gibbs --- (In reply to Andriy Gapon from comment #23) You should not see any different behavior. The areas that were changed but that I couldn't test locally were filesystem mount/unmount, pool import/export, and completely unloading the module. All three of these exercise the objset eviction path. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Mon Sep 28 18:18:08 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AE08CA0B2EE for ; Mon, 28 Sep 2015 18:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9AAF51EA9 for ; Mon, 28 Sep 2015 18:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8SII8b1085295 for ; Mon, 28 Sep 2015 18:18:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 203419] solaris assert: (dn->dn_phys->dn_nlevels == 0 && db->db_level == ... Date: Mon, 28 Sep 2015 18:18:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 18:18:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203419 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |avg@FreeBSD.org Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Mon Sep 28 18:56:57 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A1CFCA0B4D6 for ; Mon, 28 Sep 2015 18:56:57 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-2.slu.se (webmail.slu.se [77.235.224.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 28B5212A4 for ; Mon, 28 Sep 2015 18:56:56 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-2.slu.se (77.235.224.122) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Mon, 28 Sep 2015 20:41:44 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Mon, 28 Sep 2015 20:41:44 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Rich CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+h1SdLe7t4w1YE6vWvblBTZjQA== Date: Mon, 28 Sep 2015 18:41:44 +0000 Message-ID: <4d1a3af8-5439-4c47-95de-20989747eb3c@email.android.com> Accept-Language: sv-SE, en-US Content-Language: sv-SE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted Content-Type: text/plain; charset="utf-8" Content-ID: <96EBB80909529644926EFDFF35ED7E6F@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 18:56:57 -0000 CkRlbiAyOCBzZXAgMjAxNSA0OjI3IGVtIHNrcmV2IFJpY2ggPHJpbmNlYnJhaW5AZ21haWwuY29t PjoKPgo+IEhpIEthcmxpLAo+IFdoaWNoIG1wcy1zdXBwb3J0ZWQgSEJBPyBZb3VyIGZpcm13YXJl IHZlcnNpb24gaW5kaWNhdGVzIGl0J3MKPiBzb21ldGhpbmcgaW4gdGhlIDkyeHggZmFtaWx5LCBi dXQgdGhlcmUncyBhIG51bWJlciBvZiB2YXJpYW50cyBvbiB0aGF0Cj4gZmxhdm9yLgoKU2V2ZXJh bCBkaWZmZXJlbnQgbW9kZWxzLiBXZSBoYXZlIDkyMDAsIDkyMDEsIDkyMTEgYW5kIHNldmVyYWwg U3VwZXJNaWNybyBBT0MtVVNBUzItTDhpIChMU0kyMDA4KQoKPgo+IEhhdmUgeW91IHBsYXllZCB3 aXRoIGFueSBvZiB0aGUgZHJpdmUgdGltZW91dCBzZXR0aW5ncyBpbiB0aGUgSEJBCj4gZmlybXdh cmUvT1MvZHJpdmVzIHRoZW1zZWx2ZXMgKHRoZSBkYXJrIHZlbmRvci1zcGVjaWZpYyBtYWdpYyBr bm93bgo+IHZhcmlvdXNseSBhcyBUTEVSLCBDQ1RMLCBFUkMuLi4pPwoKT1MgdGltZW91dCBpczoK ZGV2Lm1wcy4wLnNwaW51cF93YWl0X3RpbWU6IDUKCk5vdGhpbmcgZWxzZS4gRGVmYXVsdHMgc2hv dWxkIGJlIHRoZXJlIGZvciBhIHJlYXNvbiwgYXQgbGVhc3QgdW50aWwgSSBrbm93IG9mIGEgYmV0 dGVyIG9uZTopCgo+Cj4gV2hhdCBtb2RlbHMgYXJlIHRoZSBzZXJ2ZXJzPwoKU2V2ZXJhbCBkaWZm ZXJlbnQgbW9kZWxzL21ha2Vycy4gVGhlcmUgYXJlIGEgY291cGxlIG9mIGRpZmZlcmVudCBTdXBl ck1pY3JvIG1vdGhlcmJvYXJkcywgWDlTUkgtRiwgWDhTSUwtRiwgWDlEQlUtRiwgYW4gSFAgREwx ODAgRzYsIGFuZCBhIFN1biBGaXJlIFg0MTQwLiBNb3N0IGhhdmUgb25lIG9yIHNldmVyYWwgU3Vw ZXJNaWNybyBTQzgzN0UyNi1SSkJPRDEgYnV0IHRoZSBIUCBqdXN0IGhhdmUgdGhlIGludGVybmFs IGJheXMgYW5kIHRoZSBYNDE0MCBoYXMgdHdvIHN0YW5kYXJkIFN1biBKQk9EJ3MsIGNhbid0IHJl bWVtYmVyIHRoZWlyIG5hbWVzIHJpZ2h0IG5vdy4gU28gdmVyeSB2YXJ5aW5nIGluIG5hdHVyZSwg ZXhjZXB0IGZvciB0aGUgSEJBJ3MsIHRoYXQgYXJlIGFsbCBvZiB0aGUgc2FtZSBtYWtlci4KCj4K PiBUaGVyZSBhcmUgYSBudW1iZXIgb2YgcG9zc2libGUgY29tcGxpY2F0aW5nIGZhY3RvcnMgaGVy ZSAtIHdoZXRoZXIgdGhlCj4gZHJpdmVzIGFyZSBTQVMgb3IgU0FUQSAoYW5kIGFueSAicXVpcmtz IiBvZiB0aGUgZHJpdmVzKSwgd2hldGhlciB0aGUKPiBiYWNrcGxhbmVzIGFyZSBwYXNzaXZlIG9y IGhhdmUgU0FTIGV4cGFuZGVycywgd2hhdCB2ZXJzaW9uIG9mIFNBUy9TQVRBCj4gdGhlc2UgYmFj a3BsYW5lcyBhcmUgY2FwYWJsZSBvZiBoYW5kbGluZywgYW55IGZpcm13YXJlIHN0cmFuZ2VuZXNz IG9uCj4gdGhlIHBhc3NpdmUgb3Igb3RoZXJ3aXNlIGJhY2twbGFuZS4uLgoKU0FUQSBkcml2ZXMg b25seSwgZGlmZmVyZW50IG1vZGVscyBhbmQgbWFrZXJzLiBBbGwgb2YgdGhlbSBoYXZlIGRpZmZl cmVudCBleHBhbmRlcnMsIGRpZmZlcmVudCB2ZXJzaW9ucy4gVGhlIEhQIGFuZCBTdW4gc2hvdWxk IGhhdmUgU0FTMSwgd2hpbGUgdGhlIFNNIEpCT0QncyBzaG91bGQgYmUgU0FTMgoKPgo+IEhvdyBk b2VzIHRoZSBtYWNoaW5lIG1pc2JlaGF2ZSBvbmNlIHlvdSByZS1pbnNlcnQgdGhlIGRyaXZlPwoK VGhlIGV4cGVjdGVkIHJlc3VsdCBvZiBpbnNlcnRpbmcgYSBuZXcgZHJpdmUgd291bGQgYmUgdG8g aGF2ZSBpdCBzaG93IHVwIGluIHRoZSBPUy4KCj4KPiBEb2VzIHRoZSBtYWNoaW5lIG1pc2JlaGF2 ZSBpZiB5b3Uga2VlcCB0aGUgZHJpdmUgcmVtb3ZlZD8KCk5vdGhpbmcgaW4gcGFydGljdWxhciwg ZXhjZXB0IGZvciBfbm90XyBiZWluZyBhYmxlIHRvIHJlc2lsdmVyIHRoZSB6cG9vbDopCgpPbmUg aW50ZXJlc3RpbmcgdGhpbmcgdG8gbWVudGlvbiBpcyB0aGF0IEkndmUgdHJpZWQgaW5zZXJ0aW5n IGEgU0FTIGRyaXZlIGluIHRoYXQgYmF5IGFuZCBpdCBzdWNjZXNzZnVsbHkgc2hvd2VkIHVwLiBC dXQgYW55IG90aGVyIFNBVEEgZHJpdmUgaW4gdGhlIHNhbWUgYmF5IGlzICJibG9ja2VkIiB1bnRp bCBhZnRlciBhIHJlYm9vdC4KCj4KPiBPbmUgZmluYWwgcXVpcmsgSSdsbCBtZW50aW9uIGlzIHRo YXQgYSBudW1iZXIgb2YgU0FTIGV4cGFuZGVyCj4gYmFja3BsYW5lcyBJJ3ZlIGVuY291bnRlcmVk IHNvbWV0aW1lcyB3aWxsIG5vdCBub3RpY2UgYSBkcml2ZSBpcwo+IHBoeXNpY2FsbHkgcHVsbGVk IHVudGlsIGEgbmV3IGRyaXZlIGlzIGluc2VydGVkLCBhbmQgc29tZXRpbWVzIHRoZQo+IGJlc3Qg d2F5IHRvIGNvbnZpbmNlIGl0IHRvIHNlZSBhIGRyaXZlIGFmdGVyIHB1bGxpbmcgb25lIHRoYXQg d2FzCj4gbWlzYmVoYXZpbmcgaXM6Cj4gLSBzZWF0IGEgIm5ldyIgKG5vdCBvdGhlcndpc2UgaW4g dGhlIG1hY2hpbmUpIGRyaXZlCj4gLSB1bnNlYXQgc2FpZCBkcml2ZSBhZnRlciBhIGZldyBzZWNv bmRzCj4gLSBzZWF0IHdoYXRldmVyIGRyaXZlIHlvdSBpbnRlbmRlZCB0byBzZWF0IGluIHRoZSBm aXJzdCBwbGFjZSwgYmUgaXQKPiAibmV3IiBvciB0aGUgb3JpZ2luYWwgZHJpdmUKClRoZSBkcml2 ZXMgaGF2ZSBiZWVuIG5ld2x5IG9yZGVyZWQgYXMgcmVwbGFjZW1lbnRzIGFuZCBzbyBoYXZlIG5l dmVyIHByZXZpb3VzbHkgYmVlbiBpbiB0aGUgbWFjaGluZS4KCi9LCgo+Cj4gR29vZCBsdWNrLAo+ Cj4gLSBSaWNoCj4KPiBPbiBNb24sIFNlcCAyOCwgMjAxNSBhdCA5OjM2IEFNLCBLYXJsaSBTasO2 YmVyZyA8a2FybGkuc2pvYmVyZ0BzbHUuc2U+IHdyb3RlOgo+ID4gSGV5IGFsbCEKPiA+Cj4gPiBJ wrRtIGp1c3QgZ2l2aW5nIGEgc2hvdXQgb3V0IGhlcmUgdG8gc2VlIGlmIGFueW9uZSBlbHNlIGhh dmUgaGFkIHNpbWlsYXIKPiA+IGV4cGVyaWVuY2VzIHdvcmtpbmcgd2l0aCBMU0kvQXZhZ28gSEJB J3MgaW4gRnJlZUJTRC4KPiA+Cj4gPiBGb3Igc29tZSB0aW1lIG5vdywgYWJvdXQgYSB5ZWFyIG9y IHNvLCB3ZcK0dmUgaGFkIHNldmVyYWwgdGltZXMgd2VyZSBoYXJkCj4gPiBkcml2ZXMgaGF2ZSBk cm9wcGVkIG91dCwgeW91IHB1bGwgaXQgb3V0LCBwb3AgYSBuZXcgYmFjayBpbiwgYnV0IGl0Cj4g PiBuZXZlciBzaG93cyB1cCBpbiB0aGUgT1MuIFdoZW4gaW5zZXJ0ZWQsIG5vdGhpbmcgcHJpbnRz IGluIHRoZSBsb2dzLCBhbmQKPiA+IHBoeXNpY2FsbHksIGl0IGp1c3QgYmxpbmtzIGZvciBhIGhh bGYgYSBzZWNvbmQsIHRoZW4gbm90aGluZy4gVGhlIGVudGlyZQo+ID4gc2VydmVyIHRoZW4gbmVl ZHMgdG8gYmUgcmVib290ZWQgdG8gZ2V0IHRoZSBkcml2ZSBiYWNrLgo+ID4KPiA+IEFzIGZvciB0 aGUgaGFyZHdhcmUsIHdlIGhhdmUgc2V2ZXJhbCBTdXBlck1pY3JvIHNlcnZlcnMsIGFuIEhQLCBh bmQgYW4KPiA+IG9sZCBTVU4gc2VydmVyIHRoYXQgYWxsIGhhdmUgdGhpcyBwcm9ibGVtLiBJdMK0 cyBoYXBwZW5lZCB3aXRoIGJvdGggb2xkCj4gPiBhbmQgbmV3IGRyaXZlcyBmcm9tIGRpZmZlcmVu dCBtYW51ZmFjdHVyZXJzIGFuZCBzaXplcy4gVGhlIG9ubHkgdGhpbmcgaW4KPiA+IGNvbW1vbiBo YXMgYmVlbiB0aGUgTFNJL0F2YWdvIEhCQS4KPiA+Cj4gPiBUaGUgc29mdHdhcmUgaXMgRnJlZUJT RC0xMC4xLVNUQUJMRSBhcyBwZXIgdGhpc1sqXSBidWcsIHZlcnkgY2xvc2UgdG8KPiA+IDEwLjIt UkVMRUFTRSwgbXBzIGRyaXZlciB2ZXJzaW9uIDIwIGFuZCB0aGUgZmlybXdhcmUgaGFzIGJlZW4g Zmxhc2hlZCB0bwo+ID4gMTkuIEFsc28gdHJpZWQgZmlybXdhcmUgdmVyc2lvbiAyMCBidXQgWkZT IHdlbnQgbnV0cywgZGlzcGxheWluZwo+ID4gY2hlY2tzdW0gZXJyb3JzIG9uIGp1c3QgYWJvdXQg ZXZlcnkgZGlzayBpbiB0aGUgcG9vbC4KPiA+Cj4gPiBJwrR0cyBnb3R0ZW4gdG8gdGhlIHBvaW50 IEnCtG0gZmVkIHVwIGFuZCBoYXZlIHRvIGFzayBpZiBzb21lb25lIGVsc2UKPiA+IGNvdWxkIHRo aW5rIG9mIGEgZml4LCBzaW5jZSBuZWl0aGVyIHNvZnR3YXJlIG5vciBmaXJtd2FyZSB1cGdyYWRl IHNlZW1zCj4gPiB0byBtYWtlIGEgZGlmZmVyZW5jZS4gT3IgdG8gc3VnZ2VzdCBhbm90aGVyIEhC QSBpbnN0ZWFkPwo+ID4KPiA+IFRoYW5rcyBpbiBhZHZhbmNlIQo+ID4KPiA+IC9LCj4gPgo+ID4g WypdOiBodHRwczovL2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcuY2dpP2lkPTE5 MTM0OAo+ID4KPiA+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fCj4gPiBmcmVlYnNkLWZzQGZyZWVic2Qub3JnIG1haWxpbmcgbGlzdAo+ID4gaHR0cHM6Ly9s aXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVic2QtZnMKPiA+IFRvIHVuc3Vi c2NyaWJlLCBzZW5kIGFueSBtYWlsIHRvICJmcmVlYnNkLWZzLXVuc3Vic2NyaWJlQGZyZWVic2Qu b3JnIgo= From owner-freebsd-fs@freebsd.org Mon Sep 28 19:11:59 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF0FDA0BE3B for ; Mon, 28 Sep 2015 19:11:59 +0000 (UTC) (envelope-from michael@fuckner.net) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48B301F28 for ; Mon, 28 Sep 2015 19:11:58 +0000 (UTC) (envelope-from michael@fuckner.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1443467513; l=602; s=domk; d=fuckner.net; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version: Date:From:References:To:Subject; bh=/Zy6nA2waB++gUyD7ODTp7eO8ilaGjoBYPF16NQ95Oc=; b=mUPmTLd/eEJN8s9fX7zdRywyNLGc/QqoLSd3Gnc+fdfoJmNZLKNnQ/AZLB1l6P3UvHZ 3zJhhF368d1slY8lKRxCzwlLovpS/B6eFb1U4YsLMi1cKDfnahbnIEE4qeQ2m/zsdjCmk lEjjlmKN+u12PBFZHZWjHeFYPVJsWWRNz10= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgknstV9BEzWRmW1bS4clqANgTb7kGMhlKo9rGjLGvLBJvqKuJqKPYw== X-RZG-CLASS-ID: mo00 Received: from [IPv6:2a02:2028:841:f401:6041:39ef:1281:a7cb] (some-ipv6-address.wtnet.de [IPv6:2a02:2028:841:f401:6041:39ef:1281:a7cb]) by smtp.strato.de (RZmta 37.12 AUTH) with ESMTPSA id C047c0r8SJBpSB8 (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA (curve secp521r1 with 521 ECDH bits, eq. 15360 bits RSA)) (Client did not present a certificate); Mon, 28 Sep 2015 21:11:51 +0200 (CEST) Subject: Re: Switching from MFI to MRSAS To: "Marco.re" , Tim Gustafson , freebsd-fs@freebsd.org References: <560947F1.2040607@gmail.com> From: Michael Fuckner Message-ID: <560990F9.40002@fuckner.net> Date: Mon, 28 Sep 2015 21:11:53 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560947F1.2040607@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Sep 2015 19:11:59 -0000 On 9/28/2015 4:00 PM, Marco.re wrote: > # dmesg | grep -i mrsas > module_register: module pci/mrsas already exists! > Module pci/mrsas failed to register: 17 > LSI MegaRAID SAS FreeBSD mrsas driver version: 06.704.01.01-fbsd > mrsas0: port 0x2000-0x20ff mem > 0x92000000-0x9200ffff,0x91f00000-0x91ffffff irq 26 at device 0.0 on pci2 > mrsas0: FW supports: UnevenSpanSupport=1 > mrsas0: Internal command timed out after 180 seconds. > da0 at mrsas0 bus 0 scbus0 target 0 lun 0 > OK, we see Devices da instead of /dev/mfispd... but does it really do trim now? From owner-freebsd-fs@freebsd.org Tue Sep 29 05:47:43 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C93C1A0AC95 for ; Tue, 29 Sep 2015 05:47:43 +0000 (UTC) (envelope-from heiko-rhauderfehn@t-online.de) Received: from mailout06.t-online.de (mailout06.t-online.de [194.25.134.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailout00.t-online.de", Issuer "TeleSec ServerPass DE-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 74C8410BC for ; Tue, 29 Sep 2015 05:47:43 +0000 (UTC) (envelope-from heiko-rhauderfehn@t-online.de) Received: from fwd16.aul.t-online.de (fwd16.aul.t-online.de [172.20.26.243]) by mailout06.t-online.de (Postfix) with SMTP id 150AC2A724E for ; Tue, 29 Sep 2015 07:47:40 +0200 (CEST) Received: from [192.168.1.253] (TD+Uv0ZG8he5I-yF3Q45z+5vSGEiyMbKG05ama300S1DrhmGP1rWYE4iyQ98IqXQOb@[2.232.70.62]) by fwd16.t-online.de with (TLSv1:DHE-RSA-AES256-SHA encrypted) esmtp id 1ZgnlJ-38xgIs0; Tue, 29 Sep 2015 07:47:37 +0200 MIME-Version: 1.0 Subject: E-mail Notice!!!(freebsd-fs@freebsd.org) To: freebsd-fs@freebsd.org From: "E-mail Administrator" Date: Tue, 29 Sep 2015 07:47:38 +0200 Message-ID: <1ZgnlJ-38xgIs0@fwd16.t-online.de> X-ID: TD+Uv0ZG8he5I-yF3Q45z+5vSGEiyMbKG05ama300S1DrhmGP1rWYE4iyQ98IqXQOb X-TOI-MSGID: e5d7f39d-ce69-4e6d-8f5f-4d050e0e4c9a Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Description: Mail message body X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 05:47:43 -0000 E-mail Notice for freebsd-fs@freebsd.org. = Dear freebsd-fs@freebsd.org, = 3840MB 4096MB = Current size Maximum size = This is to notify you that you wont be able to send or receive mails As = you have used 98% of your quota and your account will be closed. The safety of your E-mail account is important. To avoid this from happening please click here to avoid suspension of E-m= ail account. Warning!!! please do not ignore message to avoid your email -freebsd-fs@= freebsd.org- account from being closed. Thanks, Mail System Administrat= or This notification was sent to dprince_eze@yahoo.com; =20 From owner-freebsd-fs@freebsd.org Tue Sep 29 06:09:41 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75B0AA0BD21 for ; Tue, 29 Sep 2015 06:09:41 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (webmail.slu.se [77.235.224.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0B06F1D11 for ; Tue, 29 Sep 2015 06:09:40 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by exch2-4.slu.se (77.235.224.124) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Tue, 29 Sep 2015 07:54:29 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Tue, 29 Sep 2015 07:54:29 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Ben RUBSON CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAAKegCAAO2CAA== Date: Tue, 29 Sep 2015 05:54:28 +0000 Message-ID: <1443506068.5271.67.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <75069031-4111-4F67-A836-A509994A35DC@gmail.com> In-Reply-To: <75069031-4111-4F67-A836-A509994A35DC@gmail.com> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <7FF053F769E4924EB0DD310AA2939AFB@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 06:09:41 -0000 bcOlbiAyMDE1LTA5LTI4IGtsb2NrYW4gMTc6NDQgKzAyMDAgc2tyZXYgQmVuIFJVQlNPTjoNCj4g SGVsbG8sDQo+IA0KPiBJIGFsc28gcGxhbiB0byB1c2UgYSBMU0kgU0FTIGFkYXB0ZXIgKDkyMTEt OGkpLCB3aXRoIEZyZWVCU0QgLyBaRlMuDQo+IA0KPiAyIHR5cGVzIG9mIGZpcm13YXJlIGV4aXN0 IGZvciB0aGlzIGNhcmQsIFRoZSBJVCAoSW5pdGlhdG9yIFRhcmdldCkgb25lIGFuZCB0aGUgSVIg KEludGVncmF0ZWQgUkFJRCkgb25lLg0KPiBBY2NvcmRpbmcgdG8gbXkgZmluZGluZ3MsIHRoZSBJ VCBvbmUgaXMgdGhlIHJlY29tbWVuZGVkIG9uZSB0byB1c2Ugd2l0aCBaRlMuDQo+IA0KPiBPZiBj b3Vyc2UsIG5vdCBzdXJlIGl0IGlzIHJlbGF0ZWQsIGJ1dCBkaWQgVSB0cnkgdGhlIElUIGZpcm13 YXJlID8NCg0KWWVzLCBpdCBpcyBQMTkgSVQgZmlybXdhcmUgYW5kIHN0aWxsIHdlIGhhdmUgdGhp cyBpc3N1ZS4NCg0KL0sNCg0KPiANCj4gQmVzdCByZWdhcmRzLA0KPiANCj4gQmVuDQo+IA0KPiA+ IExlIDI4IHNlcHQuIDIwMTUgw6AgMTc6MDYsIEdyYWhhbSBBbGxhbiA8YWxsYW5AcGh5c2ljcy51 bW4uZWR1PiBhIMOpY3JpdCA6DQo+ID4gDQo+ID4gSSBoYXZlIHNlZW4gdGhpcyBhbmQga2VlcCBl eHBlcmllbmNpbmcgaXQuIEkgcG9zdGVkIGEgcXVlc3Rpb24gYWJvdXQgaXQgYSB3aGlsZSBiYWNr IGJ1dCBJIGRvbid0IHRoaW5rIHRoZXJlIHdhcyBtdWNoIHJlc3BvbnNlLg0KPiA+IA0KPiA+IGh0 dHBzOi8vbGlzdHMuZnJlZWJzZC5vcmcvcGlwZXJtYWlsL2ZyZWVic2QtZnMvMjAxNC1KdWx5LzAx OTcxNS5odG1sDQo+ID4gDQo+ID4gTXkgb3JpZ2luYWwgcXVlc3Rpb24gd2FzIHdpdGggOS4xLCBh bmQgYXQgdGhlIHRpbWUgd2UgZGlzY292ZXJlZCB0aGF0IGlmIHlvdSByYW4gdGhlIExTSSB1dGls aXR5ICJzYXMyaXJjdSIsIGZvciBleGFtcGxlIHNpbXBseSAic2FzMmlyY3UgMCBESVNQTEFZIiwg aXQgd2FzIHNlZW0gdG8gYW5nIGZvciBhIHdoaWxlLCB0aGVuIGlzc3VlIGEgYnVzIHJlc2V0LCBh bmQgdGhlIHJlcGxhY2VkIGRyaXZlcyBhcmUgZGV0ZWN0ZWQuDQo+ID4gDQo+ID4gTm93IHRoYXQg SSBhbHNvIHNlZSB0aGUgc2FtZSBpc3N1ZSBvbiA5LjMsIHJ1bm5pbmcgc2FzMmlyY3UgaW4gdGhp cyBzaXR1YXRpb24gdXN1YWxseSBzZWVtcyB0byBjYXVzZSBhIHBhbmljLCBzbyBpdCdzIG5vdCBl eGFjdGx5IHByb2dyZXNzLg0KPiA+IA0KPiA+IGh0dHBzOi8vbGlzdHMuZnJlZWJzZC5vcmcvcGlw ZXJtYWlsL2ZyZWVic2Qtc2NzaS8yMDE1LUF1Z3VzdC8wMDY3OTQuaHRtbA0KPiA+IA0KPiA+IEkg YW0gdXNpbmcgRGVsbCBzZXJ2ZXJzLCBnZW5lcmFsbHkgUjcxMCBhbmQgUjcyMCwgd2l0aCBMU0kg OTIwNy04ZSBjb250cm9sbGVycywgU3VwZXJtaWNybyBKQlpPRCBjaGFzc2lzLCBhbmQgbW9zdGx5 IFdEIGRyaXZlcy4gSSBnb3QgdGhlIGFib3ZlIHByb2JsZW1zIHVzaW5nIGZpcm13YXJlIDE2IChw cm9iYWJseSkgd2l0aCBib3RoIDkuMSBhbmQgOS4zLg0KPiA+IA0KPiA+IFJlZ2FyZGluZyB5b3Vy IGV4cGVyaWVuY2Ugd2l0aCBmaXJtd2FyZSAyMCwgSSBiZWxpZXZlIGl0IGlzICJrbm93biBiYWQi LCB0aG91Z2ggc29tZSBzZWVtIHRvIGRpc2FncmVlLiBDZXJ0YWlubHkgd2hlbiBidWlsZGluZyBt eSByZWNlbnQtaXNoIGxhcmdlIDkuMyBzZXJ2ZXJzIEkgc3BlY2lmaWNhbGx5IHRlc3RlZCBpdCBh bmQgZ290IGNvbnNpc3RlbnQgZGF0YSBjb3JydXB0aW9uLiBUaGVyZSBpcyBub3cgYSBuZXdlciBy ZWxlYXNlIG9mIGZpcm13YXJlIDIwICwgIjIwLjAwLjA0LjAwIiB3aGljaCBzZWVtcyB0byBiZSBm aXhlZCAtIHNlZSB0aGlzIHRocmVhZDoNCj4gPiANCj4gPiBodHRwczovL2xpc3RzLmZyZWVic2Qu b3JnL3BpcGVybWFpbC9mcmVlYnNkLXNjc2kvMjAxNS1BdWd1c3QvMDA2NzkzLmh0bWwNCj4gPiAN Cj4gPiBUaGlzIGlzIGtpbmQgb2YgcGFpbmZ1bCBhcyB0aGUgbmV3IGZpcm13YXJlIHdhcyBwb3N0 ZWQgYnkgTFNJIHdpdGggbm8gY29tbWVudCBvciBubyByZWxlYXNlIG5vdGVzLCB5ZXQgaWYgeW91 IGZvbGxvdyBhbGwgdGhlIHJlZmVyZW5jZXMgdGhlcmUgYXJlIGhpbnRzIHRoYXQgaXQgd2FzIGtu b3duIGludGVybmFsbHkgdG8gYmUgcHJvYmxlbWF0aWMuIEl0J3MgYmFkIGlmIHNlbGVjdGluZyB0 aGUgSEJBIGZpcm13YXJlIGZvciBGcmVlQlNEIGlzIGRlZ2VuZXJhdGVkIHRvIGEgImJsYWNrIGFy dCIgYnV0IHRoYXQgc2VlbXMgdG8gYmUgd2hlcmUgaXQgaXMgcmlnaHQgbm93Lg0KPiA+IA0KPiA+ IEkgZG9uJ3Qga25vdyB0aGF0IHRoZXJlIGFyZSBhbnkgb3RoZXIgdmlhYmxlIGNob2ljZXMgZm9y IFNBUyBIQkEgYmVzaWRlcyBMU0kgLSBJJ3ZlIG5ldmVyIGhlYXJkIG9mIGFueS4NCj4gPiANCj4g PiBZb3VyIGJ1Z3ppbGxhIGxpbmsgaXMgaW50ZXJlc3RpbmcuIFdlIGFyZSBhbHNvIHVzaW5nIFdE IGRyaXZlcyBhbmQgU3VwZXJtaWNybyBlbmNsb3N1cmVzIHNvIHRoZXJlIGlzIGEgbG90IGluIGNv bW1vbi4gSSB3b25kZXIgaWYgdGhlc2UgY2hhbmdlcyBhcmUgaW4gMTAuMi1SRUxFQVNFPw0KPiA+ IA0KPiA+IEdyYWhhbQ0KPiA+IA0KPiA+IE9uIDkvMjgvMjAxNSA4OjM2IEFNLCBLYXJsaSBTasO2 YmVyZyB3cm90ZToNCj4gPj4gSGV5IGFsbCENCj4gPj4gDQo+ID4+IEnCtG0ganVzdCBnaXZpbmcg YSBzaG91dCBvdXQgaGVyZSB0byBzZWUgaWYgYW55b25lIGVsc2UgaGF2ZSBoYWQgc2ltaWxhcg0K PiA+PiBleHBlcmllbmNlcyB3b3JraW5nIHdpdGggTFNJL0F2YWdvIEhCQSdzIGluIEZyZWVCU0Qu DQo+ID4+IA0KPiA+PiBGb3Igc29tZSB0aW1lIG5vdywgYWJvdXQgYSB5ZWFyIG9yIHNvLCB3ZcK0 dmUgaGFkIHNldmVyYWwgdGltZXMgd2VyZSBoYXJkDQo+ID4+IGRyaXZlcyBoYXZlIGRyb3BwZWQg b3V0LCB5b3UgcHVsbCBpdCBvdXQsIHBvcCBhIG5ldyBiYWNrIGluLCBidXQgaXQNCj4gPj4gbmV2 ZXIgc2hvd3MgdXAgaW4gdGhlIE9TLiBXaGVuIGluc2VydGVkLCBub3RoaW5nIHByaW50cyBpbiB0 aGUgbG9ncywgYW5kDQo+ID4+IHBoeXNpY2FsbHksIGl0IGp1c3QgYmxpbmtzIGZvciBhIGhhbGYg YSBzZWNvbmQsIHRoZW4gbm90aGluZy4gVGhlIGVudGlyZQ0KPiA+PiBzZXJ2ZXIgdGhlbiBuZWVk cyB0byBiZSByZWJvb3RlZCB0byBnZXQgdGhlIGRyaXZlIGJhY2suDQo+ID4+IA0KPiA+PiBBcyBm b3IgdGhlIGhhcmR3YXJlLCB3ZSBoYXZlIHNldmVyYWwgU3VwZXJNaWNybyBzZXJ2ZXJzLCBhbiBI UCwgYW5kIGFuDQo+ID4+IG9sZCBTVU4gc2VydmVyIHRoYXQgYWxsIGhhdmUgdGhpcyBwcm9ibGVt LiBJdMK0cyBoYXBwZW5lZCB3aXRoIGJvdGggb2xkDQo+ID4+IGFuZCBuZXcgZHJpdmVzIGZyb20g ZGlmZmVyZW50IG1hbnVmYWN0dXJlcnMgYW5kIHNpemVzLiBUaGUgb25seSB0aGluZyBpbg0KPiA+ PiBjb21tb24gaGFzIGJlZW4gdGhlIExTSS9BdmFnbyBIQkEuDQo+ID4+IA0KPiA+PiBUaGUgc29m dHdhcmUgaXMgRnJlZUJTRC0xMC4xLVNUQUJMRSBhcyBwZXIgdGhpc1sqXSBidWcsIHZlcnkgY2xv c2UgdG8NCj4gPj4gMTAuMi1SRUxFQVNFLCBtcHMgZHJpdmVyIHZlcnNpb24gMjAgYW5kIHRoZSBm aXJtd2FyZSBoYXMgYmVlbiBmbGFzaGVkIHRvDQo+ID4+IDE5LiBBbHNvIHRyaWVkIGZpcm13YXJl IHZlcnNpb24gMjAgYnV0IFpGUyB3ZW50IG51dHMsIGRpc3BsYXlpbmcNCj4gPj4gY2hlY2tzdW0g ZXJyb3JzIG9uIGp1c3QgYWJvdXQgZXZlcnkgZGlzayBpbiB0aGUgcG9vbC4NCj4gPj4gDQo+ID4+ IEnCtHRzIGdvdHRlbiB0byB0aGUgcG9pbnQgScK0bSBmZWQgdXAgYW5kIGhhdmUgdG8gYXNrIGlm IHNvbWVvbmUgZWxzZQ0KPiA+PiBjb3VsZCB0aGluayBvZiBhIGZpeCwgc2luY2UgbmVpdGhlciBz b2Z0d2FyZSBub3IgZmlybXdhcmUgdXBncmFkZSBzZWVtcw0KPiA+PiB0byBtYWtlIGEgZGlmZmVy ZW5jZS4gT3IgdG8gc3VnZ2VzdCBhbm90aGVyIEhCQSBpbnN0ZWFkPw0KPiA+PiANCj4gPj4gVGhh bmtzIGluIGFkdmFuY2UhDQo+ID4+IA0KPiA+PiAvSw0KPiA+PiANCj4gPj4gWypdOiBodHRwczov L2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcuY2dpP2lkPTE5MTM0OA0KPiBfX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXw0KPiBmcmVlYnNkLWZz QGZyZWVic2Qub3JnIG1haWxpbmcgbGlzdA0KPiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL21h aWxtYW4vbGlzdGluZm8vZnJlZWJzZC1mcw0KPiBUbyB1bnN1YnNjcmliZSwgc2VuZCBhbnkgbWFp bCB0byAiZnJlZWJzZC1mcy11bnN1YnNjcmliZUBmcmVlYnNkLm9yZyINCg0K From owner-freebsd-fs@freebsd.org Tue Sep 29 06:32:36 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9812AA0BA5D for ; Tue, 29 Sep 2015 06:32:36 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from EXCH2-1.slu.se (pop.slu.se [77.235.224.121]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F60A191C for ; Tue, 29 Sep 2015 06:32:35 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by EXCH2-1.slu.se (77.235.224.121) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Tue, 29 Sep 2015 08:17:21 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Tue, 29 Sep 2015 08:17:21 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Graham Allan CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAD+XwA= Date: Tue, 29 Sep 2015 06:17:19 +0000 Message-ID: <1443507440.5271.72.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> In-Reply-To: <5609578E.1050606@physics.umn.edu> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <0BD2E23AD38DB94BAAB1B20D218BC201@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 06:32:36 -0000 bcOlbiAyMDE1LTA5LTI4IGtsb2NrYW4gMTA6MDYgLTA1MDAgc2tyZXYgR3JhaGFtIEFsbGFuOg0K PiBJIGhhdmUgc2VlbiB0aGlzIGFuZCBrZWVwIGV4cGVyaWVuY2luZyBpdC4gSSBwb3N0ZWQgYSBx dWVzdGlvbiBhYm91dCBpdCANCj4gYSB3aGlsZSBiYWNrIGJ1dCBJIGRvbid0IHRoaW5rIHRoZXJl IHdhcyBtdWNoIHJlc3BvbnNlLg0KPiANCj4gaHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9waXBl cm1haWwvZnJlZWJzZC1mcy8yMDE0LUp1bHkvMDE5NzE1Lmh0bWwNCj4gDQo+IE15IG9yaWdpbmFs IHF1ZXN0aW9uIHdhcyB3aXRoIDkuMSwgYW5kIGF0IHRoZSB0aW1lIHdlIGRpc2NvdmVyZWQgdGhh dCBpZiANCj4geW91IHJhbiB0aGUgTFNJIHV0aWxpdHkgInNhczJpcmN1IiwgZm9yIGV4YW1wbGUg c2ltcGx5ICJzYXMyaXJjdSAwIA0KPiBESVNQTEFZIiwgaXQgd2FzIHNlZW0gdG8gYW5nIGZvciBh IHdoaWxlLCB0aGVuIGlzc3VlIGEgYnVzIHJlc2V0LCBhbmQgDQo+IHRoZSByZXBsYWNlZCBkcml2 ZXMgYXJlIGRldGVjdGVkLg0KPiANCj4gTm93IHRoYXQgSSBhbHNvIHNlZSB0aGUgc2FtZSBpc3N1 ZSBvbiA5LjMsIHJ1bm5pbmcgc2FzMmlyY3UgaW4gdGhpcyANCj4gc2l0dWF0aW9uIHVzdWFsbHkg c2VlbXMgdG8gY2F1c2UgYSBwYW5pYywgc28gaXQncyBub3QgZXhhY3RseSBwcm9ncmVzcy4NCj4g DQo+IGh0dHBzOi8vbGlzdHMuZnJlZWJzZC5vcmcvcGlwZXJtYWlsL2ZyZWVic2Qtc2NzaS8yMDE1 LUF1Z3VzdC8wMDY3OTQuaHRtbA0KPiANCj4gSSBhbSB1c2luZyBEZWxsIHNlcnZlcnMsIGdlbmVy YWxseSBSNzEwIGFuZCBSNzIwLCB3aXRoIExTSSA5MjA3LThlIA0KPiBjb250cm9sbGVycywgU3Vw ZXJtaWNybyBKQlpPRCBjaGFzc2lzLCBhbmQgbW9zdGx5IFdEIGRyaXZlcy4gSSBnb3QgdGhlIA0K PiBhYm92ZSBwcm9ibGVtcyB1c2luZyBmaXJtd2FyZSAxNiAocHJvYmFibHkpIHdpdGggYm90aCA5 LjEgYW5kIDkuMy4NCj4gDQo+IFJlZ2FyZGluZyB5b3VyIGV4cGVyaWVuY2Ugd2l0aCBmaXJtd2Fy ZSAyMCwgSSBiZWxpZXZlIGl0IGlzICJrbm93biBiYWQiLCANCj4gdGhvdWdoIHNvbWUgc2VlbSB0 byBkaXNhZ3JlZS4gQ2VydGFpbmx5IHdoZW4gYnVpbGRpbmcgbXkgcmVjZW50LWlzaCANCj4gbGFy Z2UgOS4zIHNlcnZlcnMgSSBzcGVjaWZpY2FsbHkgdGVzdGVkIGl0IGFuZCBnb3QgY29uc2lzdGVu dCBkYXRhIA0KPiBjb3JydXB0aW9uLiBUaGVyZSBpcyBub3cgYSBuZXdlciByZWxlYXNlIG9mIGZp cm13YXJlIDIwICwgIjIwLjAwLjA0LjAwIiANCj4gd2hpY2ggc2VlbXMgdG8gYmUgZml4ZWQgLSBz ZWUgdGhpcyB0aHJlYWQ6DQo+IA0KPiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL3BpcGVybWFp bC9mcmVlYnNkLXNjc2kvMjAxNS1BdWd1c3QvMDA2NzkzLmh0bWwNCg0KTm8sIGZpcm13YXJlIDIw LjAwLjA0LjAwIGFuZCBkcml2ZXIgMjAuMDAuMDAuMDAtZmJzZCB3YXMgdGhlIG9uZSB0aGF0DQp3 YXMgdXNlZCB3aGVuIFpGUyBmcmVha2VkIG91dCwgc28gaXTCtHMgZGVmaW5pdGVseSBub3QgZml4 ZWQuDQoNCkkgdGhpbmsgdGhpcyBjYWxscyBmb3IgYSBidWcgcmVwb3J0Lg0KDQovSw0KDQo+IA0K PiBUaGlzIGlzIGtpbmQgb2YgcGFpbmZ1bCBhcyB0aGUgbmV3IGZpcm13YXJlIHdhcyBwb3N0ZWQg YnkgTFNJIHdpdGggbm8gDQo+IGNvbW1lbnQgb3Igbm8gcmVsZWFzZSBub3RlcywgeWV0IGlmIHlv dSBmb2xsb3cgYWxsIHRoZSByZWZlcmVuY2VzIHRoZXJlIA0KPiBhcmUgaGludHMgdGhhdCBpdCB3 YXMga25vd24gaW50ZXJuYWxseSB0byBiZSBwcm9ibGVtYXRpYy4gSXQncyBiYWQgaWYgDQo+IHNl bGVjdGluZyB0aGUgSEJBIGZpcm13YXJlIGZvciBGcmVlQlNEIGlzIGRlZ2VuZXJhdGVkIHRvIGEg ImJsYWNrIGFydCIgDQo+IGJ1dCB0aGF0IHNlZW1zIHRvIGJlIHdoZXJlIGl0IGlzIHJpZ2h0IG5v dy4NCj4gDQo+IEkgZG9uJ3Qga25vdyB0aGF0IHRoZXJlIGFyZSBhbnkgb3RoZXIgdmlhYmxlIGNo b2ljZXMgZm9yIFNBUyBIQkEgYmVzaWRlcyANCj4gTFNJIC0gSSd2ZSBuZXZlciBoZWFyZCBvZiBh bnkuDQo+IA0KPiBZb3VyIGJ1Z3ppbGxhIGxpbmsgaXMgaW50ZXJlc3RpbmcuIFdlIGFyZSBhbHNv IHVzaW5nIFdEIGRyaXZlcyBhbmQgDQo+IFN1cGVybWljcm8gZW5jbG9zdXJlcyBzbyB0aGVyZSBp cyBhIGxvdCBpbiBjb21tb24uIEkgd29uZGVyIGlmIHRoZXNlIA0KPiBjaGFuZ2VzIGFyZSBpbiAx MC4yLVJFTEVBU0U/DQo+IA0KPiBHcmFoYW0NCj4gDQo+IE9uIDkvMjgvMjAxNSA4OjM2IEFNLCBL YXJsaSBTasO2YmVyZyB3cm90ZToNCj4gPiBIZXkgYWxsIQ0KPiA+DQo+ID4gScK0bSBqdXN0IGdp dmluZyBhIHNob3V0IG91dCBoZXJlIHRvIHNlZSBpZiBhbnlvbmUgZWxzZSBoYXZlIGhhZCBzaW1p bGFyDQo+ID4gZXhwZXJpZW5jZXMgd29ya2luZyB3aXRoIExTSS9BdmFnbyBIQkEncyBpbiBGcmVl QlNELg0KPiA+DQo+ID4gRm9yIHNvbWUgdGltZSBub3csIGFib3V0IGEgeWVhciBvciBzbywgd2XC tHZlIGhhZCBzZXZlcmFsIHRpbWVzIHdlcmUgaGFyZA0KPiA+IGRyaXZlcyBoYXZlIGRyb3BwZWQg b3V0LCB5b3UgcHVsbCBpdCBvdXQsIHBvcCBhIG5ldyBiYWNrIGluLCBidXQgaXQNCj4gPiBuZXZl ciBzaG93cyB1cCBpbiB0aGUgT1MuIFdoZW4gaW5zZXJ0ZWQsIG5vdGhpbmcgcHJpbnRzIGluIHRo ZSBsb2dzLCBhbmQNCj4gPiBwaHlzaWNhbGx5LCBpdCBqdXN0IGJsaW5rcyBmb3IgYSBoYWxmIGEg c2Vjb25kLCB0aGVuIG5vdGhpbmcuIFRoZSBlbnRpcmUNCj4gPiBzZXJ2ZXIgdGhlbiBuZWVkcyB0 byBiZSByZWJvb3RlZCB0byBnZXQgdGhlIGRyaXZlIGJhY2suDQo+ID4NCj4gPiBBcyBmb3IgdGhl IGhhcmR3YXJlLCB3ZSBoYXZlIHNldmVyYWwgU3VwZXJNaWNybyBzZXJ2ZXJzLCBhbiBIUCwgYW5k IGFuDQo+ID4gb2xkIFNVTiBzZXJ2ZXIgdGhhdCBhbGwgaGF2ZSB0aGlzIHByb2JsZW0uIEl0wrRz IGhhcHBlbmVkIHdpdGggYm90aCBvbGQNCj4gPiBhbmQgbmV3IGRyaXZlcyBmcm9tIGRpZmZlcmVu dCBtYW51ZmFjdHVyZXJzIGFuZCBzaXplcy4gVGhlIG9ubHkgdGhpbmcgaW4NCj4gPiBjb21tb24g aGFzIGJlZW4gdGhlIExTSS9BdmFnbyBIQkEuDQo+ID4NCj4gPiBUaGUgc29mdHdhcmUgaXMgRnJl ZUJTRC0xMC4xLVNUQUJMRSBhcyBwZXIgdGhpc1sqXSBidWcsIHZlcnkgY2xvc2UgdG8NCj4gPiAx MC4yLVJFTEVBU0UsIG1wcyBkcml2ZXIgdmVyc2lvbiAyMCBhbmQgdGhlIGZpcm13YXJlIGhhcyBi ZWVuIGZsYXNoZWQgdG8NCj4gPiAxOS4gQWxzbyB0cmllZCBmaXJtd2FyZSB2ZXJzaW9uIDIwIGJ1 dCBaRlMgd2VudCBudXRzLCBkaXNwbGF5aW5nDQo+ID4gY2hlY2tzdW0gZXJyb3JzIG9uIGp1c3Qg YWJvdXQgZXZlcnkgZGlzayBpbiB0aGUgcG9vbC4NCj4gPg0KPiA+IEnCtHRzIGdvdHRlbiB0byB0 aGUgcG9pbnQgScK0bSBmZWQgdXAgYW5kIGhhdmUgdG8gYXNrIGlmIHNvbWVvbmUgZWxzZQ0KPiA+ IGNvdWxkIHRoaW5rIG9mIGEgZml4LCBzaW5jZSBuZWl0aGVyIHNvZnR3YXJlIG5vciBmaXJtd2Fy ZSB1cGdyYWRlIHNlZW1zDQo+ID4gdG8gbWFrZSBhIGRpZmZlcmVuY2UuIE9yIHRvIHN1Z2dlc3Qg YW5vdGhlciBIQkEgaW5zdGVhZD8NCj4gPg0KPiA+IFRoYW5rcyBpbiBhZHZhbmNlIQ0KPiA+DQo+ ID4gL0sNCj4gPg0KPiA+IFsqXTogaHR0cHM6Ly9idWdzLmZyZWVic2Qub3JnL2J1Z3ppbGxhL3No b3dfYnVnLmNnaT9pZD0xOTEzNDgNCj4gPg0KPiA+IF9fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fDQo+ID4gZnJlZWJzZC1mc0BmcmVlYnNkLm9yZyBtYWlsaW5n IGxpc3QNCj4gPiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL21haWxtYW4vbGlzdGluZm8vZnJl ZWJzZC1mcw0KPiA+IFRvIHVuc3Vic2NyaWJlLCBzZW5kIGFueSBtYWlsIHRvICJmcmVlYnNkLWZz LXVuc3Vic2NyaWJlQGZyZWVic2Qub3JnIg0KPiA+DQoNCg== From owner-freebsd-fs@freebsd.org Tue Sep 29 06:59:15 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2D847A0ABC6 for ; Tue, 29 Sep 2015 06:59:15 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (exch2-4.slu.se [77.235.224.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B72E4123F for ; Tue, 29 Sep 2015 06:59:14 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by exch2-4.slu.se (77.235.224.124) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Tue, 29 Sep 2015 08:59:11 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Tue, 29 Sep 2015 08:59:11 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Graham Allan CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAD+XwCAAAuygA== Date: Tue, 29 Sep 2015 06:59:11 +0000 Message-ID: <1443509951.5271.74.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <1443507440.5271.72.camel@data-b104.adm.slu.se> In-Reply-To: <1443507440.5271.72.camel@data-b104.adm.slu.se> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 06:59:15 -0000 dGlzIDIwMTUtMDktMjkga2xvY2thbiAwNjoxNyArMDAwMCBza3JldiBLYXJsaSBTasO2YmVyZzoN Cj4gbcOlbiAyMDE1LTA5LTI4IGtsb2NrYW4gMTA6MDYgLTA1MDAgc2tyZXYgR3JhaGFtIEFsbGFu Og0KPiA+IEkgaGF2ZSBzZWVuIHRoaXMgYW5kIGtlZXAgZXhwZXJpZW5jaW5nIGl0LiBJIHBvc3Rl ZCBhIHF1ZXN0aW9uIGFib3V0IGl0IA0KPiA+IGEgd2hpbGUgYmFjayBidXQgSSBkb24ndCB0aGlu ayB0aGVyZSB3YXMgbXVjaCByZXNwb25zZS4NCj4gPiANCj4gPiBodHRwczovL2xpc3RzLmZyZWVi c2Qub3JnL3BpcGVybWFpbC9mcmVlYnNkLWZzLzIwMTQtSnVseS8wMTk3MTUuaHRtbA0KPiA+IA0K PiA+IE15IG9yaWdpbmFsIHF1ZXN0aW9uIHdhcyB3aXRoIDkuMSwgYW5kIGF0IHRoZSB0aW1lIHdl IGRpc2NvdmVyZWQgdGhhdCBpZiANCj4gPiB5b3UgcmFuIHRoZSBMU0kgdXRpbGl0eSAic2FzMmly Y3UiLCBmb3IgZXhhbXBsZSBzaW1wbHkgInNhczJpcmN1IDAgDQo+ID4gRElTUExBWSIsIGl0IHdh cyBzZWVtIHRvIGFuZyBmb3IgYSB3aGlsZSwgdGhlbiBpc3N1ZSBhIGJ1cyByZXNldCwgYW5kIA0K PiA+IHRoZSByZXBsYWNlZCBkcml2ZXMgYXJlIGRldGVjdGVkLg0KPiA+IA0KPiA+IE5vdyB0aGF0 IEkgYWxzbyBzZWUgdGhlIHNhbWUgaXNzdWUgb24gOS4zLCBydW5uaW5nIHNhczJpcmN1IGluIHRo aXMgDQo+ID4gc2l0dWF0aW9uIHVzdWFsbHkgc2VlbXMgdG8gY2F1c2UgYSBwYW5pYywgc28gaXQn cyBub3QgZXhhY3RseSBwcm9ncmVzcy4NCj4gPiANCj4gPiBodHRwczovL2xpc3RzLmZyZWVic2Qu b3JnL3BpcGVybWFpbC9mcmVlYnNkLXNjc2kvMjAxNS1BdWd1c3QvMDA2Nzk0Lmh0bWwNCj4gPiAN Cj4gPiBJIGFtIHVzaW5nIERlbGwgc2VydmVycywgZ2VuZXJhbGx5IFI3MTAgYW5kIFI3MjAsIHdp dGggTFNJIDkyMDctOGUgDQo+ID4gY29udHJvbGxlcnMsIFN1cGVybWljcm8gSkJaT0QgY2hhc3Np cywgYW5kIG1vc3RseSBXRCBkcml2ZXMuIEkgZ290IHRoZSANCj4gPiBhYm92ZSBwcm9ibGVtcyB1 c2luZyBmaXJtd2FyZSAxNiAocHJvYmFibHkpIHdpdGggYm90aCA5LjEgYW5kIDkuMy4NCj4gPiAN Cj4gPiBSZWdhcmRpbmcgeW91ciBleHBlcmllbmNlIHdpdGggZmlybXdhcmUgMjAsIEkgYmVsaWV2 ZSBpdCBpcyAia25vd24gYmFkIiwgDQo+ID4gdGhvdWdoIHNvbWUgc2VlbSB0byBkaXNhZ3JlZS4g Q2VydGFpbmx5IHdoZW4gYnVpbGRpbmcgbXkgcmVjZW50LWlzaCANCj4gPiBsYXJnZSA5LjMgc2Vy dmVycyBJIHNwZWNpZmljYWxseSB0ZXN0ZWQgaXQgYW5kIGdvdCBjb25zaXN0ZW50IGRhdGEgDQo+ ID4gY29ycnVwdGlvbi4gVGhlcmUgaXMgbm93IGEgbmV3ZXIgcmVsZWFzZSBvZiBmaXJtd2FyZSAy MCAsICIyMC4wMC4wNC4wMCIgDQo+ID4gd2hpY2ggc2VlbXMgdG8gYmUgZml4ZWQgLSBzZWUgdGhp cyB0aHJlYWQ6DQo+ID4gDQo+ID4gaHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9waXBlcm1haWwv ZnJlZWJzZC1zY3NpLzIwMTUtQXVndXN0LzAwNjc5My5odG1sDQo+IA0KPiBObywgZmlybXdhcmUg MjAuMDAuMDQuMDAgYW5kIGRyaXZlciAyMC4wMC4wMC4wMC1mYnNkIHdhcyB0aGUgb25lIHRoYXQN Cj4gd2FzIHVzZWQgd2hlbiBaRlMgZnJlYWtlZCBvdXQsIHNvIGl0wrRzIGRlZmluaXRlbHkgbm90 IGZpeGVkLg0KPiANCj4gSSB0aGluayB0aGlzIGNhbGxzIGZvciBhIGJ1ZyByZXBvcnQuDQoNCkkg ZGVjaWRlZCBub3QgdG8gYWRkIG1vcmUgbm9pc2UgYW5kIGp1c3Qga2VlcCBmaWxsaW5nIDE5MTM0 OFsqXSBpbnN0ZWFkLg0KDQovSw0KDQpbKl06IGh0dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6 aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MTkxMzQ4DQoNCg0KPiANCj4gL0sNCj4gDQo+ID4gDQo+ID4g VGhpcyBpcyBraW5kIG9mIHBhaW5mdWwgYXMgdGhlIG5ldyBmaXJtd2FyZSB3YXMgcG9zdGVkIGJ5 IExTSSB3aXRoIG5vIA0KPiA+IGNvbW1lbnQgb3Igbm8gcmVsZWFzZSBub3RlcywgeWV0IGlmIHlv dSBmb2xsb3cgYWxsIHRoZSByZWZlcmVuY2VzIHRoZXJlIA0KPiA+IGFyZSBoaW50cyB0aGF0IGl0 IHdhcyBrbm93biBpbnRlcm5hbGx5IHRvIGJlIHByb2JsZW1hdGljLiBJdCdzIGJhZCBpZiANCj4g PiBzZWxlY3RpbmcgdGhlIEhCQSBmaXJtd2FyZSBmb3IgRnJlZUJTRCBpcyBkZWdlbmVyYXRlZCB0 byBhICJibGFjayBhcnQiIA0KPiA+IGJ1dCB0aGF0IHNlZW1zIHRvIGJlIHdoZXJlIGl0IGlzIHJp Z2h0IG5vdy4NCj4gPiANCj4gPiBJIGRvbid0IGtub3cgdGhhdCB0aGVyZSBhcmUgYW55IG90aGVy IHZpYWJsZSBjaG9pY2VzIGZvciBTQVMgSEJBIGJlc2lkZXMgDQo+ID4gTFNJIC0gSSd2ZSBuZXZl ciBoZWFyZCBvZiBhbnkuDQo+ID4gDQo+ID4gWW91ciBidWd6aWxsYSBsaW5rIGlzIGludGVyZXN0 aW5nLiBXZSBhcmUgYWxzbyB1c2luZyBXRCBkcml2ZXMgYW5kIA0KPiA+IFN1cGVybWljcm8gZW5j bG9zdXJlcyBzbyB0aGVyZSBpcyBhIGxvdCBpbiBjb21tb24uIEkgd29uZGVyIGlmIHRoZXNlIA0K PiA+IGNoYW5nZXMgYXJlIGluIDEwLjItUkVMRUFTRT8NCj4gPiANCj4gPiBHcmFoYW0NCj4gPiAN Cj4gPiBPbiA5LzI4LzIwMTUgODozNiBBTSwgS2FybGkgU2rDtmJlcmcgd3JvdGU6DQo+ID4gPiBI ZXkgYWxsIQ0KPiA+ID4NCj4gPiA+IEnCtG0ganVzdCBnaXZpbmcgYSBzaG91dCBvdXQgaGVyZSB0 byBzZWUgaWYgYW55b25lIGVsc2UgaGF2ZSBoYWQgc2ltaWxhcg0KPiA+ID4gZXhwZXJpZW5jZXMg d29ya2luZyB3aXRoIExTSS9BdmFnbyBIQkEncyBpbiBGcmVlQlNELg0KPiA+ID4NCj4gPiA+IEZv ciBzb21lIHRpbWUgbm93LCBhYm91dCBhIHllYXIgb3Igc28sIHdlwrR2ZSBoYWQgc2V2ZXJhbCB0 aW1lcyB3ZXJlIGhhcmQNCj4gPiA+IGRyaXZlcyBoYXZlIGRyb3BwZWQgb3V0LCB5b3UgcHVsbCBp dCBvdXQsIHBvcCBhIG5ldyBiYWNrIGluLCBidXQgaXQNCj4gPiA+IG5ldmVyIHNob3dzIHVwIGlu IHRoZSBPUy4gV2hlbiBpbnNlcnRlZCwgbm90aGluZyBwcmludHMgaW4gdGhlIGxvZ3MsIGFuZA0K PiA+ID4gcGh5c2ljYWxseSwgaXQganVzdCBibGlua3MgZm9yIGEgaGFsZiBhIHNlY29uZCwgdGhl biBub3RoaW5nLiBUaGUgZW50aXJlDQo+ID4gPiBzZXJ2ZXIgdGhlbiBuZWVkcyB0byBiZSByZWJv b3RlZCB0byBnZXQgdGhlIGRyaXZlIGJhY2suDQo+ID4gPg0KPiA+ID4gQXMgZm9yIHRoZSBoYXJk d2FyZSwgd2UgaGF2ZSBzZXZlcmFsIFN1cGVyTWljcm8gc2VydmVycywgYW4gSFAsIGFuZCBhbg0K PiA+ID4gb2xkIFNVTiBzZXJ2ZXIgdGhhdCBhbGwgaGF2ZSB0aGlzIHByb2JsZW0uIEl0wrRzIGhh cHBlbmVkIHdpdGggYm90aCBvbGQNCj4gPiA+IGFuZCBuZXcgZHJpdmVzIGZyb20gZGlmZmVyZW50 IG1hbnVmYWN0dXJlcnMgYW5kIHNpemVzLiBUaGUgb25seSB0aGluZyBpbg0KPiA+ID4gY29tbW9u IGhhcyBiZWVuIHRoZSBMU0kvQXZhZ28gSEJBLg0KPiA+ID4NCj4gPiA+IFRoZSBzb2Z0d2FyZSBp cyBGcmVlQlNELTEwLjEtU1RBQkxFIGFzIHBlciB0aGlzWypdIGJ1ZywgdmVyeSBjbG9zZSB0bw0K PiA+ID4gMTAuMi1SRUxFQVNFLCBtcHMgZHJpdmVyIHZlcnNpb24gMjAgYW5kIHRoZSBmaXJtd2Fy ZSBoYXMgYmVlbiBmbGFzaGVkIHRvDQo+ID4gPiAxOS4gQWxzbyB0cmllZCBmaXJtd2FyZSB2ZXJz aW9uIDIwIGJ1dCBaRlMgd2VudCBudXRzLCBkaXNwbGF5aW5nDQo+ID4gPiBjaGVja3N1bSBlcnJv cnMgb24ganVzdCBhYm91dCBldmVyeSBkaXNrIGluIHRoZSBwb29sLg0KPiA+ID4NCj4gPiA+IEnC tHRzIGdvdHRlbiB0byB0aGUgcG9pbnQgScK0bSBmZWQgdXAgYW5kIGhhdmUgdG8gYXNrIGlmIHNv bWVvbmUgZWxzZQ0KPiA+ID4gY291bGQgdGhpbmsgb2YgYSBmaXgsIHNpbmNlIG5laXRoZXIgc29m dHdhcmUgbm9yIGZpcm13YXJlIHVwZ3JhZGUgc2VlbXMNCj4gPiA+IHRvIG1ha2UgYSBkaWZmZXJl bmNlLiBPciB0byBzdWdnZXN0IGFub3RoZXIgSEJBIGluc3RlYWQ/DQo+ID4gPg0KPiA+ID4gVGhh bmtzIGluIGFkdmFuY2UhDQo+ID4gPg0KPiA+ID4gL0sNCj4gPiA+DQo+ID4gPiBbKl06IGh0dHBz Oi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MTkxMzQ4DQo+ID4g Pg0KPiA+ID4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18N Cj4gPiA+IGZyZWVic2QtZnNAZnJlZWJzZC5vcmcgbWFpbGluZyBsaXN0DQo+ID4gPiBodHRwczov L2xpc3RzLmZyZWVic2Qub3JnL21haWxtYW4vbGlzdGluZm8vZnJlZWJzZC1mcw0KPiA+ID4gVG8g dW5zdWJzY3JpYmUsIHNlbmQgYW55IG1haWwgdG8gImZyZWVic2QtZnMtdW5zdWJzY3JpYmVAZnJl ZWJzZC5vcmciDQo+ID4gPg0KPiANCj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX18NCj4gZnJlZWJzZC1mc0BmcmVlYnNkLm9yZyBtYWlsaW5nIGxpc3QNCj4g aHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVic2QtZnMNCj4g VG8gdW5zdWJzY3JpYmUsIHNlbmQgYW55IG1haWwgdG8gImZyZWVic2QtZnMtdW5zdWJzY3JpYmVA ZnJlZWJzZC5vcmciDQoNCg== From owner-freebsd-fs@freebsd.org Tue Sep 29 08:05:39 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75618A0A215 for ; Tue, 29 Sep 2015 08:05:39 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 02172123C for ; Tue, 29 Sep 2015 08:05:38 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id 94A751472006; Tue, 29 Sep 2015 10:05:30 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id u8k+KG-6w9QC; Tue, 29 Sep 2015 10:05:24 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id DCB044C4C811; Tue, 29 Sep 2015 10:05:24 +0200 (CEST) Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> To: Graham Allan , =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" From: InterNetX - Juergen Gotteswinter Reply-To: jg@internetx.com Message-ID: <560A4640.3030200@internetx.com> Date: Tue, 29 Sep 2015 10:05:20 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <5609578E.1050606@physics.umn.edu> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 08:05:39 -0000 Are there any Serial ATA Drives hooked up to the SAS Controller, maybe even with an Expander Backplane in between? Am 28.09.2015 um 17:06 schrieb Graham Allan: > I have seen this and keep experiencing it. I posted a question about it > a while back but I don't think there was much response. > > https://lists.freebsd.org/pipermail/freebsd-fs/2014-July/019715.html > > My original question was with 9.1, and at the time we discovered that if > you ran the LSI utility "sas2ircu", for example simply "sas2ircu 0 > DISPLAY", it was seem to ang for a while, then issue a bus reset, and > the replaced drives are detected. > > Now that I also see the same issue on 9.3, running sas2ircu in this > situation usually seems to cause a panic, so it's not exactly progress. > > https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006794.html > > I am using Dell servers, generally R710 and R720, with LSI 9207-8e > controllers, Supermicro JBZOD chassis, and mostly WD drives. I got the > above problems using firmware 16 (probably) with both 9.1 and 9.3. > > Regarding your experience with firmware 20, I believe it is "known bad", > though some seem to disagree. Certainly when building my recent-ish > large 9.3 servers I specifically tested it and got consistent data > corruption. There is now a newer release of firmware 20 , "20.00.04.00" > which seems to be fixed - see this thread: > > https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006793.html > > This is kind of painful as the new firmware was posted by LSI with no > comment or no release notes, yet if you follow all the references there > are hints that it was known internally to be problematic. It's bad if > selecting the HBA firmware for FreeBSD is degenerated to a "black art" > but that seems to be where it is right now. > > I don't know that there are any other viable choices for SAS HBA besides > LSI - I've never heard of any. > > Your bugzilla link is interesting. We are also using WD drives and > Supermicro enclosures so there is a lot in common. I wonder if these > changes are in 10.2-RELEASE? > > Graham > > On 9/28/2015 8:36 AM, Karli Sjöberg wrote: >> Hey all! >> >> I´m just giving a shout out here to see if anyone else have had similar >> experiences working with LSI/Avago HBA's in FreeBSD. >> >> For some time now, about a year or so, we´ve had several times were hard >> drives have dropped out, you pull it out, pop a new back in, but it >> never shows up in the OS. When inserted, nothing prints in the logs, and >> physically, it just blinks for a half a second, then nothing. The entire >> server then needs to be rebooted to get the drive back. >> >> As for the hardware, we have several SuperMicro servers, an HP, and an >> old SUN server that all have this problem. It´s happened with both old >> and new drives from different manufacturers and sizes. The only thing in >> common has been the LSI/Avago HBA. >> >> The software is FreeBSD-10.1-STABLE as per this[*] bug, very close to >> 10.2-RELEASE, mps driver version 20 and the firmware has been flashed to >> 19. Also tried firmware version 20 but ZFS went nuts, displaying >> checksum errors on just about every disk in the pool. >> >> I´ts gotten to the point I´m fed up and have to ask if someone else >> could think of a fix, since neither software nor firmware upgrade seems >> to make a difference. Or to suggest another HBA instead? >> >> Thanks in advance! >> >> /K >> >> [*]: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191348 >> >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Tue Sep 29 10:30:19 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 25219A0B0A8 for ; Tue, 29 Sep 2015 10:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1197C1322 for ; Tue, 29 Sep 2015 10:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8TAUISm011386 for ; Tue, 29 Sep 2015 10:30:18 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Tue, 29 Sep 2015 10:30:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 10:30:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #25 from Andriy Gapon --- (In reply to Justin T. Gibbs from comment #24) I do not see any regressions while running typical workloads and tests. Thank you! -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Tue Sep 29 13:30:26 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B508CA0A823 for ; Tue, 29 Sep 2015 13:30:26 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B8CD1179B for ; Tue, 29 Sep 2015 13:30:25 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 1210A153408 for ; Tue, 29 Sep 2015 15:30:16 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fuPBNb0rBg8O; Tue, 29 Sep 2015 15:29:55 +0200 (CEST) Received: from [IPv6:2001:4cb8:3:1:8d7f:fb85:493b:d15b] (unknown [IPv6:2001:4cb8:3:1:8d7f:fb85:493b:d15b]) by smtp.digiware.nl (Postfix) with ESMTP id 66BC0153401 for ; Tue, 29 Sep 2015 14:20:01 +0200 (CEST) To: "freebsd-fs@freebsd.org" From: Willem Jan Withagen Subject: ZFS files server crash: solaris assert: start < end in trim_map.c Organization: Digiware Management b.v. Message-ID: <560A81EE.7010604@digiware.nl> Date: Tue, 29 Sep 2015 14:19:58 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 13:30:26 -0000 Hi, Just found this after a crash: Architecture: amd64 Architecture Version: 2 Dump Length: 7031291904B (6705 MB) Blocksize: 512 Dumptime: Tue Sep 29 12:55:01 2015 Hostname: zfs.digiware.nl Magic: FreeBSD Kernel Dump Version String: FreeBSD 10.2-STABLE #2 r287746M: Sun Sep 13 12:33:23 CEST 2015 root@zfs.digiware.nl:/home/obj/amd64/usr/srcs/work10/src/sys/ZFS Panic String: solaris assert: start < end, file: /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c, line: 219 (kgdb) bt #0 doadump (textdump=1) at pcpu.h:219 #1 0xffffffff804f9d97 in kern_reboot (howto=260) at /usr/srcs/work10/src/sys/kern/kern_shutdown.c:451 #2 0xffffffff804fa195 in vpanic (fmt=, ap=) at /usr/srcs/work10/src/sys/kern/kern_shutdown.c:758 #3 0xffffffff804fa023 in panic (fmt=0x0) at /usr/srcs/work10/src/sys/kern/kern_shutdown.c:687 #4 0xffffffff8106a1fd in assfail (a=, f=, l=) at /usr/srcs/work10/src/sys/modules/opensolaris/../../cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:81 #5 0xffffffff80e65161 in trim_map_segment_add (tm=0xfffff8001432ba00, start=7704576, end=7704576, txg=0) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:219 #6 0xffffffff80e6464f in trim_map_free_locked (tm=, start=, end=, txg=) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:319 #7 0xffffffff80e64588 in trim_map_free (vd=0xfffff8000ae3b800, offset=7704576, size=, txg=0) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:337 #8 0xffffffff80db490c in arc_hdr_destroy (hdr=0xfffff800198ac5e8) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1825 #9 0xffffffff80db980a in l2arc_evict (dev=0xfffff8000aa2d480, distance=, all=0) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:5004 #10 0xffffffff80dba0da in l2arc_feed_thread (dummy=) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:5581 #11 0xffffffff804c9855 in fork_exit (callout=0xffffffff80db9b80 , arg=0x0, frame=0xfffffe023bbc4bc0) at /usr/srcs/work10/src/sys/kern/kern_fork.c:1018 #12 0xffffffff807773ee in fork_trampoline () at /usr/srcs/work10/src/sys/amd64/amd64/exception.S:611 #13 0x0000000000000000 in ?? () And the values there are: #5 0xffffffff80e65161 in trim_map_segment_add (tm=0xfffff8001432ba00, start=7704576, end=7704576, txg=0) at /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:219 219 VERIFY(start < end); (kgdb) p start $1 = 7704576 (kgdb) p end $2 = 7704576 Which suggests to me that the comparison might need to be '<=', but that will probably not be this simple... --WjW From owner-freebsd-fs@freebsd.org Tue Sep 29 13:38:47 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6572DA0B520 for ; Tue, 29 Sep 2015 13:38:47 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from mail.physics.umn.edu (smtp.spa.umn.edu [128.101.220.4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 41B461D40 for ; Tue, 29 Sep 2015 13:38:46 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from c-66-41-25-68.hsd1.mn.comcast.net ([66.41.25.68] helo=[192.168.0.107]) by mail.physics.umn.edu with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.77 (FreeBSD)) (envelope-from ) id 1Zgv7C-0007PP-PN; Tue, 29 Sep 2015 08:38:42 -0500 Subject: Re: Cannot replace broken hard drive with LSI HBA To: jg@internetx.com, =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> From: Graham Allan Message-ID: <560A9461.8090300@physics.umn.edu> Date: Tue, 29 Sep 2015 08:38:41 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560A4640.3030200@internetx.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 13:38:47 -0000 That could certainly be an issue in our case (it's all SATA, which I guess at least is better than having it mixed). Although Supermicro do list some SATA drives as being tested compatible with their chassis/expander, for example WD RE - not that we actually have RE drives, it's what I would have preferred but we ended up with Reds. I will say that I consulted informally with a WD field engineer who felt that the Reds should work ok in this situation, and they have generally tested quite well. No doubt the SATA RE model may well have more solid firmware. Graham On 9/29/2015 3:05 AM, InterNetX - Juergen Gotteswinter wrote: > Are there any Serial ATA Drives hooked up to the SAS Controller, maybe > even with an Expander Backplane in between? > > Am 28.09.2015 um 17:06 schrieb Graham Allan: >> I have seen this and keep experiencing it. I posted a question about it >> a while back but I don't think there was much response. From owner-freebsd-fs@freebsd.org Tue Sep 29 13:41:47 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 32F05A0B859 for ; Tue, 29 Sep 2015 13:41:47 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from mail.physics.umn.edu (smtp.spa.umn.edu [128.101.220.4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0DF30102B for ; Tue, 29 Sep 2015 13:41:46 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from c-66-41-25-68.hsd1.mn.comcast.net ([66.41.25.68] helo=[192.168.0.107]) by mail.physics.umn.edu with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.77 (FreeBSD)) (envelope-from ) id 1ZgvA9-0007an-Uf; Tue, 29 Sep 2015 08:41:45 -0500 Subject: Re: Cannot replace broken hard drive with LSI HBA To: =?UTF-8?Q?Karli_Sj=c3=b6berg?= References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <1443507440.5271.72.camel@data-b104.adm.slu.se> <1443509951.5271.74.camel@data-b104.adm.slu.se> Cc: "freebsd-fs@freebsd.org" From: Graham Allan Message-ID: <560A9518.5060305@physics.umn.edu> Date: Tue, 29 Sep 2015 08:41:44 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <1443509951.5271.74.camel@data-b104.adm.slu.se> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 13:41:47 -0000 On 9/29/2015 1:59 AM, Karli Sjöberg wrote: > > I decided not to add more noise and just keep filling 191348[*] instead. > > /K > > [*]: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191348 That's also interesting that when you insert a SAS drive in this situation, it *is* detected. I will need to try that next time. Now I will need to hope for some drive failures so I'm in a position to test...! Graham From owner-freebsd-fs@freebsd.org Tue Sep 29 13:51:10 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6F806A0BDC0 for ; Tue, 29 Sep 2015 13:51:10 +0000 (UTC) (envelope-from karl@denninger.net) Received: from mail.denninger.net (wsip-70-169-168-7.pn.at.cox.net [70.169.168.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2286515DB for ; Tue, 29 Sep 2015 13:51:09 +0000 (UTC) (envelope-from karl@denninger.net) Received: from [192.168.1.40] (Karl-Desktop.Denninger.net [192.168.1.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.denninger.net (Postfix) with ESMTPSA id E8DD1A3E8D for ; Tue, 29 Sep 2015 08:41:46 -0500 (CDT) Subject: Re: Cannot replace broken hard drive with LSI HBA To: freebsd-fs@freebsd.org References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> From: Karl Denninger Message-ID: <560A951A.6010602@denninger.net> Date: Tue, 29 Sep 2015 08:41:46 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560A9461.8090300@physics.umn.edu> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms080101030308010409010200" X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 13:51:10 -0000 This is a cryptographically signed message in MIME format. --------------ms080101030308010409010200 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable IMHO be careful with that LSI firmware. I have, like many others, run into trouble with anything that starts with a "2" as the first digit. I have a quite-large system here that has an LSI adapter and an expander behind that, then a gaggle of SATA drives. Zero trouble over the space of many months and very, very heavy load. The only "gotcha" is that I've been able to get it to boot off anything on the expander, so you need to leave one HBA port open for boot drives; that appears to be a limitation in the IT firmware on the LSI board as you can't designate such a drive as a boot candidate for the BIOS. On 9/29/2015 08:38, Graham Allan wrote: > That could certainly be an issue in our case (it's all SATA, which I > guess at least is better than having it mixed). > > Although Supermicro do list some SATA drives as being tested > compatible with their chassis/expander, for example WD RE - not that > we actually have RE drives, it's what I would have preferred but we > ended up with Reds. I will say that I consulted informally with a WD > field engineer who felt that the Reds should work ok in this > situation, and they have generally tested quite well. No doubt the > SATA RE model may well have more solid firmware. > > Graham > > On 9/29/2015 3:05 AM, InterNetX - Juergen Gotteswinter wrote: >> Are there any Serial ATA Drives hooked up to the SAS Controller, maybe= >> even with an Expander Backplane in between? >> >> Am 28.09.2015 um 17:06 schrieb Graham Allan: >>> I have seen this and keep experiencing it. I posted a question about = it >>> a while back but I don't think there was much response. > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms080101030308010409010200 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp 3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5 vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/ o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6 eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+ JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ 3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0 FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG 1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5 c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNTA5MjkxMzQxNDZaME8GCSqGSIb3DQEJBDFCBEBm YO7j9GUx0cT31Dk9HGIxIg4RtQN2XON+dQsKmsDmbvepcsa2GA0dWq7bz3/zj1JntBtYw7or yi6rNOjgetGrMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1 ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG 9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIAecWG1Jdg PMOFvAW3Ops0Zr/lPDBoPJoYuIhXL1+/HenOFtXZEOwetHtfm5IV0koZ1ypBCXPGR7S859g8 ksPWRDuZR7pbfd03lTZgQfPu15lclcoF+wsWSQwmnu3dYcJVy+o63cPzrJVq3MYfAd5zkU2G b8Iaiq9XHCMSdA2ThhDJFReW/B+u36OY67N2FCV5otYaCa8SjcJwvVKQzDdCPvUwlqBrHw3S MA9JQiu0J93FansSUp2L4BiejjqYHXbfQfQtiwQNczS7Lw0ufva+DhFNV2yiaRqOLTQgI7S7 +O7Pv9Mo8HUHbw4eSeu/U6N6qzPi3FZAhgtNx9TUgTlsM8M/3hMqg8f3PgyT6Q+giAiYtkt9 D54zTWPWd09DrMWPOf+q305SFFChNpZHfxUFFlidsUXQEbicKRv+NpKsZprmjinL4OCbBc5C LE9WJtxzFx74ewn7U/JJHG1s0kCOZ97zSPMR84lBsyTRw+IoV5PNZFvsB16Ej/SEGV8GwA3H FcIUTv8m9H1xQWZFOl6znmmVnUFxIEYEhdkO0s+0tf9x9k/ymMV4AzAiP9sanF7+JqcVeLcf UtHdO+y23/tB++OxAIiDsjh1z300yAfga3378P14mBjuPnyK6c0k6AcVwM0aMsgqKlLlffcz 7R+V8C2kJze8KSXoM8xJNz6hzUkAAAAAAAA= --------------ms080101030308010409010200-- From owner-freebsd-fs@freebsd.org Tue Sep 29 13:52:06 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8E495A0BE6F for ; Tue, 29 Sep 2015 13:52:06 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B6B418E7 for ; Tue, 29 Sep 2015 13:52:06 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id 7C6644C4C145; Tue, 29 Sep 2015 15:52:03 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id K4fAFmODOGbY; Tue, 29 Sep 2015 15:52:01 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id 43D2C4C4C81C; Tue, 29 Sep 2015 15:52:01 +0200 (CEST) Reply-To: jg@internetx.com Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> To: Graham Allan , =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" From: InterNetX - Juergen Gotteswinter Message-ID: <560A977C.1070102@internetx.com> Date: Tue, 29 Sep 2015 15:51:56 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560A9461.8090300@physics.umn.edu> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 13:52:06 -0000 >From my Experience using SATA Disks on SAS Controllers, no matter if theres an Expander between or not or mixed, those Setups keep on beeing flakey / unreliable. I might work under certain conditions, but its nothing you can bet on. Garret Damore (Illumos Project) describes the problem more detailed here http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html Am 29.09.2015 um 15:38 schrieb Graham Allan: > That could certainly be an issue in our case (it's all SATA, which I > guess at least is better than having it mixed). > > Although Supermicro do list some SATA drives as being tested compatible > with their chassis/expander, for example WD RE - not that we actually > have RE drives, it's what I would have preferred but we ended up with > Reds. I will say that I consulted informally with a WD field engineer > who felt that the Reds should work ok in this situation, and they have > generally tested quite well. No doubt the SATA RE model may well have > more solid firmware. > > Graham > > On 9/29/2015 3:05 AM, InterNetX - Juergen Gotteswinter wrote: >> Are there any Serial ATA Drives hooked up to the SAS Controller, maybe >> even with an Expander Backplane in between? >> >> Am 28.09.2015 um 17:06 schrieb Graham Allan: >>> I have seen this and keep experiencing it. I posted a question about it >>> a while back but I don't think there was much response. From owner-freebsd-fs@freebsd.org Tue Sep 29 18:04:47 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0BC8DA0B13A for ; Tue, 29 Sep 2015 18:04:47 +0000 (UTC) (envelope-from michael@fuckner.net) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9C0901D0A for ; Tue, 29 Sep 2015 18:04:46 +0000 (UTC) (envelope-from michael@fuckner.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1443549883; l=1042; s=domk; d=fuckner.net; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version: Date:From:References:To:Subject; bh=iVxTs+y/pJnSos97jJ95mjVphaSEv/wumJLvOpXY7b4=; b=PFM1OPGudkhKEJeVonDye996bForIR9KF/5Kxxz4ecJmUYpT3NfPTKVJweVbbkDXrso eui7XJ4W8j3VEad0ly52BsRcs1/KrA4LUL+ci1XCO+d4Xj/Bz32OrL+X68ifgAJ3yP7RA okIe6lGhU1psNHUNtFqQMIkJ6wfWYkb1Xp4= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgknstV9BEzWRmW1VTdMloDLywfq0FgrD3IBhKcc7x4l//jtG+1R3pQ== X-RZG-CLASS-ID: mo00 Received: from [IPv6:2a02:2028:62e:a301:1d35:5a28:edf0:3b7a] (some-ipv6-address.wtnet.de [IPv6:2a02:2028:62e:a301:1d35:5a28:edf0:3b7a]) by smtp.strato.de (RZmta 37.12 AUTH) with ESMTPSA id Y01bacr8TI4c9pr (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA (curve secp521r1 with 521 ECDH bits, eq. 15360 bits RSA)) (Client did not present a certificate); Tue, 29 Sep 2015 20:04:38 +0200 (CEST) Subject: Re: Cannot replace broken hard drive with LSI HBA To: jg@internetx.com, Graham Allan , =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> From: Michael Fuckner Message-ID: <560AD2B9.5040706@fuckner.net> Date: Tue, 29 Sep 2015 20:04:41 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560A977C.1070102@internetx.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:04:47 -0000 On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: > From my Experience using SATA Disks on SAS Controllers, no matter if > theres an Expander between or not or mixed, those Setups keep on beeing > flakey / unreliable. I might work under certain conditions, but its > nothing you can bet on. > > Garret Damore (Illumos Project) describes the problem more detailed here > > http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html > come on, the article is 5 years old, some things changed since then! - MUX Boards are unreliable and expensive- long time since I last saw those boards - SAS Disks are not just 10/15k high performance Disks anymore, most Nearline Disks are available with native SAS interface as well - if you pick the right disk there is no trouble using SATA Disks on SAS Expanders or SAS Controllers (they should have R/V sensors, optimized FW...). - if you use desktop drives in a shelf with lets say 24 slots you should not expect it to work ;-) Regards, Michael! From owner-freebsd-fs@freebsd.org Tue Sep 29 18:22:11 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 272EFA0BEEC for ; Tue, 29 Sep 2015 18:22:11 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D70781C70 for ; Tue, 29 Sep 2015 18:22:10 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id 0FB1C147200A; Tue, 29 Sep 2015 20:22:07 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2QxAQxgRCI9Z; Tue, 29 Sep 2015 20:22:04 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id 7AC701472006; Tue, 29 Sep 2015 20:22:00 +0200 (CEST) Reply-To: jg@internetx.com Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> To: Michael Fuckner , Graham Allan , =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" From: InterNetX - Juergen Gotteswinter X-Enigmail-Draft-Status: N1110 Message-ID: <560AD6C7.80800@internetx.com> Date: Tue, 29 Sep 2015 20:21:59 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560AD2B9.5040706@fuckner.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:22:11 -0000 Am 29.09.2015 um 20:04 schrieb Michael Fuckner: > On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: >> From my Experience using SATA Disks on SAS Controllers, no matter if >> theres an Expander between or not or mixed, those Setups keep on beeing >> flakey / unreliable. I might work under certain conditions, but its >> nothing you can bet on. >> >> Garret Damore (Illumos Project) describes the problem more detailed here >> >> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html >> >> > > come on, the article is 5 years old, some things changed since then! > > - MUX Boards are unreliable and expensive- long time since I last saw > those boards i am not talking about sata multiplexers, i am talking about sas expanders. no one ever should think that sata multiplexers are a reliable piece of hardware. they arent. this problems are design related, since Natacount on disks cant talk native with sas controllers. they still exist and occour. like you can see here. a few months ago i had a setup which had exactly what one whould expect from sata/sas mix. bus resets, device hangs and so on. in the end, it turned out that the indel dcs 3500 ssd wich where connected via a lsi sas 2008 where the root cause of all. after they where hooked onto the onboard sata ports, everything was fine. on the other side the intel dcs 3700 sata ssd works fine in sas/sata mix. you see, its nothing you can count on. stay with sas, or with sata and use proper controllers. except you like hunting server gremlins > - SAS Disks are not just 10/15k high performance Disks anymore, most > Nearline Disks are available with native SAS interface as well nearline sas disks are equipped with a real sas interface, they just work with less rpm. > - if you pick the right disk there is no trouble using SATA Disks on SAS > Expanders or SAS Controllers (they should have R/V sensors, optimized > FW...). yes, but still russian roulette with data > - if you use desktop drives in a shelf with lets say 24 slots you should > not expect it to work ;-) well, depends on the usecase, controllers and cabling. look at backblaze... > > Regards, > Michael! From owner-freebsd-fs@freebsd.org Tue Sep 29 18:25:58 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76878A0C10C for ; Tue, 29 Sep 2015 18:25:58 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-oi0-x233.google.com (mail-oi0-x233.google.com [IPv6:2607:f8b0:4003:c06::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3BA8E1D99 for ; Tue, 29 Sep 2015 18:25:58 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by oiev17 with SMTP id v17so8989293oie.1 for ; Tue, 29 Sep 2015 11:25:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CAialjvqXyCiICDujTrvDOavbRyswRa5dsdVYdZMnNw=; b=ijGmeX5EqDau4tafzNTi1ilPe/SGh4H7cyqELRIxxcX6gjbt3SNgGBhBx4YtGcDtA4 NUeCsIcfA2maN8Pag0NsVbNEC4HFoc+5S5BX/7Ofq8VM7rjVC3LYYtCNVLY8caC9+Br0 /lRgJoG8kifYzG0WdDmyXtoTik2/mvBE8oMWLnK5bQaPZ8f2H2lXbSMtDMSNlUEWuQKb WHq7stKVpkhneKAI1aOnM6b1dm2lW6XFQpDpLRoqd70cSVvjFLlZAojktHinPLf4ctsI M4RMXCQfRlgSL6+o2igAUyt73qhRoCBICnYK0iYgYmMeFWMAu+jw+DdegV+Fu9xtBuSd u1JQ== MIME-Version: 1.0 X-Received: by 10.202.51.87 with SMTP id z84mr3829853oiz.35.1443551157507; Tue, 29 Sep 2015 11:25:57 -0700 (PDT) Received: by 10.76.68.38 with HTTP; Tue, 29 Sep 2015 11:25:57 -0700 (PDT) In-Reply-To: <560AD2B9.5040706@fuckner.net> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> Date: Tue, 29 Sep 2015 11:25:57 -0700 Message-ID: Subject: Re: Cannot replace broken hard drive with LSI HBA From: Freddie Cash To: Michael Fuckner Cc: jg@internetx.com, Graham Allan , =?UTF-8?Q?Karli_Sj=C3=B6berg?= , "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:25:58 -0000 On Tue, Sep 29, 2015 at 11:04 AM, Michael Fuckner wrote: > On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: > >> From my Experience using SATA Disks on SAS Controllers, no matter if >> theres an Expander between or not or mixed, those Setups keep on beeing >> flakey / unreliable. I might work under certain conditions, but its >> nothing you can bet on. >> >> Garret Damore (Illumos Project) describes the problem more detailed here >> >> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.ht= ml >> >> > come on, the article is 5 years old, some things changed since then! > > - MUX Boards are unreliable and expensive- long time since I last saw > those boards > - SAS Disks are not just 10/15k high performance Disks anymore, most > Nearline Disks are available with native SAS interface as well > - if you pick the right disk there is no trouble using SATA Disks on SAS > Expanders or SAS Controllers (they should have R/V sensors, optimized > FW...). > - if you use desktop drives in a shelf with lets say 24 slots you should > not expect it to work ;-) > =E2=80=8BWhy not? ;) We use desktop-class drives in our backups storage servers without any issues. Even the monster boxes with 90 drives in them (2 JBODs of 45 drives each) run without issues using desktop-class drives. We're using a mix of WD Black (1, 2, 4 TB), Toshiba (2 TB), and Seagate (1, 2 TB). 2 systems using 24 drive bays. 2 systems using 90 drive bays. Plugged into SuperMicro SAS expanders and LSI 9211-8i or 9211-8e (I think that's the model number) controllers.=E2=80=8B All SAS2008 chipsets using mps(4) = drivers. We're not looking for uber-performance and millions of IOps from these systems, as the gigabit NIC is the bottleneck (rsync and zfs send both saturate that link, but all operations still complete within the allotted 8 hours window). We replace maybe 6-8 drives per year across all 4 systems; a little more than that this year due to overheating in one location, but that's been fixed. When a 2 TB desktop-class harddrive is $ 80 CDN in bulk, and we're only replacing 8 drives per year (under warranty, of course), it just doesn't make sense to spend the extra money on server-class, RAID-aware, nearline, or SAS drives. :) =E2=80=8BIf you =E2=80=8Bare building a storage server that requires millio= ns of IOps with multiple 10 Gbps connections, then sure, desktop-class drives won't cut it. But for everything else, they're fine. --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-fs@freebsd.org Tue Sep 29 18:28:19 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4FDB7A0C24F for ; Tue, 29 Sep 2015 18:28:19 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 7997D1F22 for ; Tue, 29 Sep 2015 18:28:18 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id VAA18240; Tue, 29 Sep 2015 21:28:10 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ZgzdK-000Lks-Ca; Tue, 29 Sep 2015 21:28:10 +0300 Subject: Re: ZFS files server crash: solaris assert: start < end in trim_map.c To: Willem Jan Withagen , "freebsd-fs@freebsd.org" References: <560A81EE.7010604@digiware.nl> From: Andriy Gapon Message-ID: <560AD801.70307@FreeBSD.org> Date: Tue, 29 Sep 2015 21:27:13 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560A81EE.7010604@digiware.nl> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:28:19 -0000 On 29/09/2015 15:19, Willem Jan Withagen wrote: > Hi, > > Just found this after a crash: > Architecture: amd64 > Architecture Version: 2 > Dump Length: 7031291904B (6705 MB) > Blocksize: 512 > Dumptime: Tue Sep 29 12:55:01 2015 > Hostname: zfs.digiware.nl > Magic: FreeBSD Kernel Dump > Version String: FreeBSD 10.2-STABLE #2 r287746M: Sun Sep 13 12:33:23 CEST 2015 > root@zfs.digiware.nl:/home/obj/amd64/usr/srcs/work10/src/sys/ZFS > Panic String: solaris assert: start < end, file: > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c, > line: 219 This could be an oversight in a change of mine. Could you please open a bug report? > (kgdb) bt > #0 doadump (textdump=1) at pcpu.h:219 > #1 0xffffffff804f9d97 in kern_reboot (howto=260) at > /usr/srcs/work10/src/sys/kern/kern_shutdown.c:451 > #2 0xffffffff804fa195 in vpanic (fmt=, ap= out>) at /usr/srcs/work10/src/sys/kern/kern_shutdown.c:758 > #3 0xffffffff804fa023 in panic (fmt=0x0) at > /usr/srcs/work10/src/sys/kern/kern_shutdown.c:687 > #4 0xffffffff8106a1fd in assfail (a=, f= out>, l=) > at > /usr/srcs/work10/src/sys/modules/opensolaris/../../cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:81 > > #5 0xffffffff80e65161 in trim_map_segment_add (tm=0xfffff8001432ba00, > start=7704576, end=7704576, txg=0) > at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:219 > > #6 0xffffffff80e6464f in trim_map_free_locked (tm=, > start=, end=, txg=) > at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:319 > > #7 0xffffffff80e64588 in trim_map_free (vd=0xfffff8000ae3b800, offset=7704576, > size=, txg=0) > at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:337 > > #8 0xffffffff80db490c in arc_hdr_destroy (hdr=0xfffff800198ac5e8) at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1825 > > #9 0xffffffff80db980a in l2arc_evict (dev=0xfffff8000aa2d480, distance= optimized out>, all=0) > at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:5004 > > #10 0xffffffff80dba0da in l2arc_feed_thread (dummy=) > at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:5581 > > #11 0xffffffff804c9855 in fork_exit (callout=0xffffffff80db9b80 > , arg=0x0, frame=0xfffffe023bbc4bc0) > at /usr/srcs/work10/src/sys/kern/kern_fork.c:1018 > #12 0xffffffff807773ee in fork_trampoline () at > /usr/srcs/work10/src/sys/amd64/amd64/exception.S:611 > #13 0x0000000000000000 in ?? () > > And the values there are: > #5 0xffffffff80e65161 in trim_map_segment_add (tm=0xfffff8001432ba00, > start=7704576, end=7704576, txg=0) > at > /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:219 > > 219 VERIFY(start < end); > (kgdb) p start > $1 = 7704576 > (kgdb) p end > $2 = 7704576 > > Which suggests to me that the comparison might need to be '<=', but that will > probably not be this simple... -- Andriy Gapon From owner-freebsd-fs@freebsd.org Tue Sep 29 18:29:21 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62C69A0C2EA for ; Tue, 29 Sep 2015 18:29:21 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) by mx1.freebsd.org (Postfix) with ESMTP id E24331FA7 for ; Tue, 29 Sep 2015 18:29:20 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id C82361472007 for ; Tue, 29 Sep 2015 20:29:18 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8BQW6m3rm9FO for ; Tue, 29 Sep 2015 20:29:13 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id 523FD1472006 for ; Tue, 29 Sep 2015 20:29:13 +0200 (CEST) Reply-To: jg@internetx.com Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> To: "freebsd-fs@freebsd.org" From: InterNetX - Juergen Gotteswinter Message-ID: <560AD879.2010004@internetx.com> Date: Tue, 29 Sep 2015 20:29:13 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:29:21 -0000 Am 29.09.2015 um 20:25 schrieb Freddie Cash: > On Tue, Sep 29, 2015 at 11:04 AM, Michael Fuckner >wrote: > > On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: > > From my Experience using SATA Disks on SAS Controllers, no > matter if > theres an Expander between or not or mixed, those Setups keep on > beeing > flakey / unreliable. I might work under certain conditions, but its > nothing you can bet on. > > Garret Damore (Illumos Project) describes the problem more > detailed here > > http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html > > > come on, the article is 5 years old, some things changed since then! > > - MUX Boards are unreliable and expensive- long time since I last > saw those boards > - SAS Disks are not just 10/15k high performance Disks anymore, most > Nearline Disks are available with native SAS interface as well > - if you pick the right disk there is no trouble using SATA Disks on > SAS Expanders or SAS Controllers (they should have R/V sensors, > optimized FW...). > - if you use desktop drives in a shelf with lets say 24 slots you > should not expect it to work ;-) > > > ​Why not? ;) > > We use desktop-class drives in our backups storage servers without any > issues. Even the monster boxes with 90 drives in them (2 JBODs of 45 > drives each) run without issues using desktop-class drives. > > We're using a mix of WD Black (1, 2, 4 TB), Toshiba (2 TB), and Seagate > (1, 2 TB). > > 2 systems using 24 drive bays. 2 systems using 90 drive bays. Plugged > into SuperMicro SAS expanders and LSI 9211-8i or 9211-8e (I think that's > the model number) controllers.​ All SAS2008 chipsets using mps(4) drivers. > > We're not looking for uber-performance and millions of IOps from these > systems, as the gigabit NIC is the bottleneck (rsync and zfs send both > saturate that link, but all operations still complete within the > allotted 8 hours window). > > We replace maybe 6-8 drives per year across all 4 systems; a little more > than that this year due to overheating in one location, but that's been > fixed. > > When a 2 TB desktop-class harddrive is $ 80 CDN in bulk, and we're only > replacing 8 drives per year (under warranty, of course), it just doesn't > make sense to spend the extra money on server-class, RAID-aware, > nearline, or SAS drives. :) > > ​If you ​are building a storage server that requires millions of IOps > with multiple 10 Gbps connections, then sure, desktop-class drives won't > cut it. But for everything else, they're fine. > > -- > Freddie Cash > fjwcash@gmail.com hello backplaze? :) sounds legit to me, since you dont seem to mix sata/sas From owner-freebsd-fs@freebsd.org Tue Sep 29 18:43:10 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F6FDA0CF3C for ; Tue, 29 Sep 2015 18:43:10 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-oi0-x22e.google.com (mail-oi0-x22e.google.com [IPv6:2607:f8b0:4003:c06::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 652431172 for ; Tue, 29 Sep 2015 18:43:10 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by oixx17 with SMTP id x17so9287325oix.0 for ; Tue, 29 Sep 2015 11:43:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=l+jmJ6aafp0LMdgxXrSTBmAqthTtWnZ9v6CzC59o+p0=; b=JzeoWsTMLM5WZkcZd4Zg7+qVvIp4YWFgcimG+CdPxz1g+p7UzvJPd/mX79W7gYql4x HHM5NuNUuo7kBt3gZn/ZZhK3K5BRlsorJ2dHO0Q/39OYy/Ma0fn2JcNyST8Ur1XQADr4 9pz1KdlEnMZEkX17KnG2qn/XmA9Nh29WgCaAfQgQvc53Ac6VLGDb+86pUqK8cK1ezZFz XVMtGzxXloZhgrvvtXV0+1juYUPXJBHSVVO9jqsxuc4qy12t5ddGefokI1hC3JKAIK7P ZFbcsJCjVf6WTkuqmIDEZos7E1r2mRpzt6K4ct1ftAvxGm8hqz7x4yyU+xuGGPOTwa2E AKtg== MIME-Version: 1.0 X-Received: by 10.202.51.87 with SMTP id z84mr3880722oiz.35.1443552189802; Tue, 29 Sep 2015 11:43:09 -0700 (PDT) Received: by 10.76.68.38 with HTTP; Tue, 29 Sep 2015 11:43:09 -0700 (PDT) In-Reply-To: <560AD879.2010004@internetx.com> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <560AD879.2010004@internetx.com> Date: Tue, 29 Sep 2015 11:43:09 -0700 Message-ID: Subject: Re: Cannot replace broken hard drive with LSI HBA From: Freddie Cash To: jg@internetx.com Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:43:10 -0000 On Tue, Sep 29, 2015 at 11:29 AM, InterNetX - Juergen Gotteswinter < jg@internetx.com> wrote: > > hello backplaze? > =E2=80=8BNo, just a lowly K-12 school district in BC, Canada, trying to do = without funds what the big boys do with mega-funds. :)=E2=80=8B Desktop drives, FreeBSD, and ZFS have saved us mega-bucks over the past 5+ years. sounds legit to me, since you dont seem to mix sata/sas > --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-fs@freebsd.org Tue Sep 29 19:01:01 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1E843A0AE23 for ; Tue, 29 Sep 2015 19:01:01 +0000 (UTC) (envelope-from rcv-cmlja0BoYXZva21vbi5jb20AQDE0NDM1NTI4NTg=@vfemail.net) Received: from smtp101-5.vfemail.net (eightfive.vfemail.net [96.30.253.185]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E2E2A100D for ; Tue, 29 Sep 2015 19:01:00 +0000 (UTC) (envelope-from rcv-cmlja0BoYXZva21vbi5jb20AQDE0NDM1NTI4NTg=@vfemail.net) Received: (qmail 8066 invoked by uid 89); 29 Sep 2015 18:54:18 -0000 Received: by simscan 1.4.0 ppid: 8058, pid: 8061, t: 0.0813s scanners:none Received: from unknown (HELO d3d3MTEwQDE0NDM1NTI4NTg=) (cmlja0BoYXZva21vbi5jb21AMTQ0MzU1Mjg1OA==@MTcyLjE2LjEwMC45MkAxNDQzNTUyODU4) by 172.16.100.61 with ESMTPA; 29 Sep 2015 18:54:18 -0000 Date: Tue, 29 Sep 2015 13:54:17 -0500 Message-ID: <20150929135417.Horde.W2X_CSKI8gBxk1Df7JVOPQ1@www.vfemail.net> From: Rick Romero To: freebsd-fs@freebsd.org Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <560AD6C7.80800@internetx.com> In-Reply-To: <560AD6C7.80800@internetx.com> User-Agent: Internet Messaging Program (IMP) H5 (6.2.2) X-VFEmail-Originating-IP: MTIuMzEuMTAwLjE0Ng== X-VFEmail-AntiSpam: Notify admin@vfemail.net of any spam, and include VFEmail headers MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed; DelSp=Yes Content-Transfer-Encoding: 8bit Content-Disposition: inline Content-Description: Plaintext Message X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 19:01:01 -0000 Quoting InterNetX - Juergen Gotteswinter : > Am 29.09.2015 um 20:04 schrieb Michael Fuckner: >> On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: >>> From my Experience using SATA Disks on SAS Controllers, no matter if >>> theres an Expander between or not or mixed, those Setups keep on beeing >>> flakey / unreliable. I might work under certain conditions, but its >>> nothing you can bet on. >>> >>> Garret Damore (Illumos Project) describes the problem more detailed here >>> >>> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html >>>   >> >> come on, the article is 5 years old, some things changed since then! >> >> - MUX Boards are unreliable and expensive- long time since I last saw >> those boards > > i am not talking about sata multiplexers, i am talking about sas > expanders. no one ever should think that sata multiplexers are a > reliable piece of hardware. they arent. > > this problems are design related, since Natacount on disks cant talk > native with sas controllers. they still exist and occour. like you can > see here. > > a few months ago i had a setup which had exactly what one whould expect > from sata/sas mix. bus resets, device hangs and so on. in the end, it > turned out that the indel dcs 3500 ssd wich where connected via a lsi > sas 2008 where the root cause of all. after they where hooked onto the > onboard sata ports, everything was fine. on the other side the intel dcs > 3700 sata ssd works fine in sas/sata mix. you see, its nothing you can > count on. stay with sas, or with sata and use proper controllers. I've seen both.  I have two nice Asus boxes with 12 4GB SATA drives in RAIDZ2, and they work wonderfully. OTOH, I recently built a new system with a 3 drive RAIDZ (using SSD), and it constantly blew chunks (timeouts etc). After going through multiple servers, drives,backplanes (both expanders and just generic hot-swap) and controllers, it turns out the latest LSI firmware is garbage.  You have to downgrade the LSI firmware to 'p17' (IIRC) - and preferrably if you're using ZFS, change it to IT firmware (for 'real' JBOD). http://lime-technology.com/forum/index.php?topic=12767.630 https://forums.freenas.org/index.php?threads/confused-about-that-lsi-card-join-the-crowd.11901/page-5 Rick From owner-freebsd-fs@freebsd.org Tue Sep 29 20:38:12 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD573A0A68C for ; Tue, 29 Sep 2015 20:38:12 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from mail.physics.umn.edu (smtp.spa.umn.edu [128.101.220.4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 89395188A for ; Tue, 29 Sep 2015 20:38:11 +0000 (UTC) (envelope-from allan@physics.umn.edu) Received: from spa-sysadm-01.spa.umn.edu ([134.84.199.8]) by mail.physics.umn.edu with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.77 (FreeBSD)) (envelope-from ) id 1Zh1f2-000Ojh-Sb; Tue, 29 Sep 2015 15:38:04 -0500 Message-ID: <560AF6AD.3010803@physics.umn.edu> Date: Tue, 29 Sep 2015 15:38:05 -0500 From: Graham Allan User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: =?UTF-8?B?S2FybGkgU2rDtmJlcmc=?= CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <1443507440.5271.72.camel@data-b104.adm.slu.se> In-Reply-To: <1443507440.5271.72.camel@data-b104.adm.slu.se> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 20:38:12 -0000 On 9/29/2015 1:17 AM, Karli Sjöberg wrote: >> >> Regarding your experience with firmware 20, I believe it is "known bad", >> though some seem to disagree. Certainly when building my recent-ish >> large 9.3 servers I specifically tested it and got consistent data >> corruption. There is now a newer release of firmware 20 , "20.00.04.00" >> which seems to be fixed - see this thread: >> >> https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006793.html > > No, firmware 20.00.04.00 and driver 20.00.00.00-fbsd was the one that > was used when ZFS freaked out, so it´s definitely not fixed. > > I think this calls for a bug report. That is curious, since I could rapidly get data corruption with firmware 20.00.00.00, yet ran a stress test for about a week with 20.00.04.00 with no issues. That was with FreeBSD 9.3, but I just updated my test system to 10.2, and it has been running the same stress test for 4-5 hours again with no issues. I don't doubt your experience at all, of course, but I wonder what is different? For what it's worth, my test machine is a Dell R610 with Dell TYVGC HBA (unclear whether this is a 9207-8e or 9205-8e), and WD Red drives in a Supermicro SC847 chassis. Graham From owner-freebsd-fs@freebsd.org Wed Sep 30 00:47:21 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 809B8A0C073 for ; Wed, 30 Sep 2015 00:47:21 +0000 (UTC) (envelope-from pmurray@nevada.net.nz) Received: from bellagio.open2view.net (bellagio.open2view.net [210.48.79.75]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 406CC1611 for ; Wed, 30 Sep 2015 00:47:20 +0000 (UTC) (envelope-from pmurray@nevada.net.nz) Received: from dhcp100.akl.open2view.lan (unknown [114.23.246.97]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: pmurray@nevada.net.nz) by bellagio.open2view.net (Postfix) with ESMTPSA id 0692F12AA7FE; Wed, 30 Sep 2015 13:39:16 +1300 (NZDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Subject: Re: Cannot replace broken hard drive with LSI HBA From: Philip Murray In-Reply-To: <560AF6AD.3010803@physics.umn.edu> Date: Wed, 30 Sep 2015 13:39:15 +1300 Cc: =?utf-8?Q?Karli_Sj=C3=B6berg?= , "freebsd-fs@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <1A19B1E0-FC2F-4847-A3BA-E6F694589E4E@nevada.net.nz> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <1443507440.5271.72.camel@data-b104.adm.slu.se> <560AF6AD.3010803@physics.umn.edu> To: Graham Allan X-Mailer: Apple Mail (2.2104) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 00:47:21 -0000 > On 30/09/2015, at 9:38 am, Graham Allan wrote: >=20 > On 9/29/2015 1:17 AM, Karli Sj=C3=B6berg wrote: >>>=20 >>> Regarding your experience with firmware 20, I believe it is "known = bad", >>> though some seem to disagree. Certainly when building my recent-ish >>> large 9.3 servers I specifically tested it and got consistent data >>> corruption. There is now a newer release of firmware 20 , = "20.00.04.00" >>> which seems to be fixed - see this thread: >>>=20 >>> = https://lists.freebsd.org/pipermail/freebsd-scsi/2015-August/006793.html >>=20 >> No, firmware 20.00.04.00 and driver 20.00.00.00-fbsd was the one that >> was used when ZFS freaked out, so it=C2=B4s definitely not fixed. >>=20 >> I think this calls for a bug report. >=20 > That is curious, since I could rapidly get data corruption with = firmware 20.00.00.00, yet ran a stress test for about a week with = 20.00.04.00 with no issues. That was with FreeBSD 9.3, but I just = updated my test system to 10.2, and it has been running the same stress = test for 4-5 hours again with no issues. I don't doubt your experience = at all, of course, but I wonder what is different? >=20 > For what it's worth, my test machine is a Dell R610 with Dell TYVGC = HBA (unclear whether this is a 9207-8e or 9205-8e), and WD Red drives in = a Supermicro SC847 chassis. Just as an additional datapoint (this thread is giving me chills) with = the LSI IT firmware version 20.00.02.00=E2=80=A6 * FreeBSD 10.2-RELEASE * Supermicro SC826 Chassis * LSI SAS2004 Controller mps0: port 0xe000-0xe0ff mem = 0xf72c0000-0xf72c3fff,0xf7280000-0xf72bffff irq 16 at device 0.0 on pci1 mps0: Firmware: 20.00.02.00, Driver: 20.00.00.00-fbsd mps0: IOCCapabilities: = 1285c= * LSI SAS2X28 Expander/Backplane ses0: Fixed Enclosure Services SPC-3 SCSI = device=20 * 12x SATA WD RE 2TB drives (WD2000FYYZ arranged as 2x RAIDZ2 vdevs) Repeatedly filled up with data with regular scrubs without any issues = and performance is pretty good, although I haven=E2=80=99t had a disk = fail yet.=20 Cheers Phil=20= From owner-freebsd-fs@freebsd.org Wed Sep 30 05:33:13 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 088D8A0C6F0 for ; Wed, 30 Sep 2015 05:33:13 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-2.slu.se (imap.slu.se [77.235.224.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 91A2D1A51 for ; Wed, 30 Sep 2015 05:33:11 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-2.slu.se (77.235.224.122) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 30 Sep 2015 07:33:02 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Wed, 30 Sep 2015 07:33:02 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Graham Allan CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAD+XwCAAPB+gIAAlXWA Date: Wed, 30 Sep 2015 05:33:02 +0000 Message-ID: <1443591181.5271.85.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <1443507440.5271.72.camel@data-b104.adm.slu.se> <560AF6AD.3010803@physics.umn.edu> In-Reply-To: <560AF6AD.3010803@physics.umn.edu> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <0DC9054CC612584D97086305C18230AC@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 05:33:13 -0000 dGlzIDIwMTUtMDktMjkga2xvY2thbiAxNTozOCAtMDUwMCBza3JldiBHcmFoYW0gQWxsYW46DQo+ IE9uIDkvMjkvMjAxNSAxOjE3IEFNLCBLYXJsaSBTasO2YmVyZyB3cm90ZToNCj4gPj4NCj4gPj4g UmVnYXJkaW5nIHlvdXIgZXhwZXJpZW5jZSB3aXRoIGZpcm13YXJlIDIwLCBJIGJlbGlldmUgaXQg aXMgImtub3duIGJhZCIsDQo+ID4+IHRob3VnaCBzb21lIHNlZW0gdG8gZGlzYWdyZWUuIENlcnRh aW5seSB3aGVuIGJ1aWxkaW5nIG15IHJlY2VudC1pc2gNCj4gPj4gbGFyZ2UgOS4zIHNlcnZlcnMg SSBzcGVjaWZpY2FsbHkgdGVzdGVkIGl0IGFuZCBnb3QgY29uc2lzdGVudCBkYXRhDQo+ID4+IGNv cnJ1cHRpb24uIFRoZXJlIGlzIG5vdyBhIG5ld2VyIHJlbGVhc2Ugb2YgZmlybXdhcmUgMjAgLCAi MjAuMDAuMDQuMDAiDQo+ID4+IHdoaWNoIHNlZW1zIHRvIGJlIGZpeGVkIC0gc2VlIHRoaXMgdGhy ZWFkOg0KPiA+Pg0KPiA+PiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL3BpcGVybWFpbC9mcmVl YnNkLXNjc2kvMjAxNS1BdWd1c3QvMDA2NzkzLmh0bWwNCj4gPg0KPiA+IE5vLCBmaXJtd2FyZSAy MC4wMC4wNC4wMCBhbmQgZHJpdmVyIDIwLjAwLjAwLjAwLWZic2Qgd2FzIHRoZSBvbmUgdGhhdA0K PiA+IHdhcyB1c2VkIHdoZW4gWkZTIGZyZWFrZWQgb3V0LCBzbyBpdMK0cyBkZWZpbml0ZWx5IG5v dCBmaXhlZC4NCj4gPg0KPiA+IEkgdGhpbmsgdGhpcyBjYWxscyBmb3IgYSBidWcgcmVwb3J0Lg0K PiANCj4gVGhhdCBpcyBjdXJpb3VzLCBzaW5jZSBJIGNvdWxkIHJhcGlkbHkgZ2V0IGRhdGEgY29y cnVwdGlvbiB3aXRoIGZpcm13YXJlIA0KPiAyMC4wMC4wMC4wMCwgeWV0IHJhbiBhIHN0cmVzcyB0 ZXN0IGZvciBhYm91dCBhIHdlZWsgd2l0aCAyMC4wMC4wNC4wMCANCj4gd2l0aCBubyBpc3N1ZXMu IFRoYXQgd2FzIHdpdGggRnJlZUJTRCA5LjMsIGJ1dCBJIGp1c3QgdXBkYXRlZCBteSB0ZXN0IA0K PiBzeXN0ZW0gdG8gMTAuMiwgYW5kIGl0IGhhcyBiZWVuIHJ1bm5pbmcgdGhlIHNhbWUgc3RyZXNz IHRlc3QgZm9yIDQtNSANCj4gaG91cnMgYWdhaW4gd2l0aCBubyBpc3N1ZXMuIEkgZG9uJ3QgZG91 YnQgeW91ciBleHBlcmllbmNlIGF0IGFsbCwgb2YgDQo+IGNvdXJzZSwgYnV0IEkgd29uZGVyIHdo YXQgaXMgZGlmZmVyZW50Pw0KPiANCj4gRm9yIHdoYXQgaXQncyB3b3J0aCwgbXkgdGVzdCBtYWNo aW5lIGlzIGEgRGVsbCBSNjEwIHdpdGggRGVsbCBUWVZHQyBIQkEgDQo+ICh1bmNsZWFyIHdoZXRo ZXIgdGhpcyBpcyBhIDkyMDctOGUgb3IgOTIwNS04ZSksIGFuZCBXRCBSZWQgZHJpdmVzIGluIGEg DQo+IFN1cGVybWljcm8gU0M4NDcgY2hhc3Npcy4NCj4gDQo+IEdyYWhhbQ0KPiANCg0KSGF2ZSB5 b3UgdHJpZWQgc2NydWIvcmVzaWx2ZXI/IFRoYXTCtHMgd2hhdCB0cmlnZ2VyZWQgbXkgImJhZCIu DQoNClRoYXQgc3lzdGVtIGlzIHRoZSBvbGQgU3VuIHNlcnZlciB3aXRoIGEgOTIwMC4gTWF5YmUg UDIwIGlzIGp1c3QgdG94aWMNCm9uIHNvbWUgY29udHJvbGxlciBtb2RlbHMsIGFuZCBvdGhlcnMg YXJlIGZpbmUuLi4NCg0KL0sNCg== From owner-freebsd-fs@freebsd.org Wed Sep 30 06:27:52 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CAED5A0CDCD for ; Wed, 30 Sep 2015 06:27:52 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-2.slu.se (exch2-2.slu.se [77.235.224.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5DB2612C2 for ; Wed, 30 Sep 2015 06:27:52 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-2.slu.se (77.235.224.122) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 30 Sep 2015 08:27:49 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Wed, 30 Sep 2015 08:27:49 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Freddie Cash CC: Michael Fuckner , "jg@internetx.com" , Graham Allan , "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAEcjACAAF0jgIAAA7QAgABGnoCAAAXxgIAAybCA Date: Wed, 30 Sep 2015 06:27:49 +0000 Message-ID: <1443594469.5271.91.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> In-Reply-To: Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <68FA68D6E021624A8A58F8DF4F121395@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 06:27:52 -0000 dGlzIDIwMTUtMDktMjkga2xvY2thbiAxMToyNSAtMDcwMCBza3JldiBGcmVkZGllIENhc2g6DQo+ IE9uIFR1ZSwgU2VwIDI5LCAyMDE1IGF0IDExOjA0IEFNLCBNaWNoYWVsIEZ1Y2tuZXINCj4gPG1p Y2hhZWxAZnVja25lci5uZXQ+IHdyb3RlOg0KPiANCj4gICAgICAgICBPbiA5LzI5LzIwMTUgMzo1 MSBQTSwgSW50ZXJOZXRYIC0gSnVlcmdlbiBHb3R0ZXN3aW50ZXIgd3JvdGU6DQo+ICAgICAgICAg ICAgICAgICAgRnJvbSBteSBFeHBlcmllbmNlIHVzaW5nIFNBVEEgRGlza3Mgb24gU0FTDQo+ICAg ICAgICAgICAgICAgICBDb250cm9sbGVycywgbm8gbWF0dGVyIGlmDQo+ICAgICAgICAgICAgICAg ICB0aGVyZXMgYW4gRXhwYW5kZXIgYmV0d2VlbiBvciBub3Qgb3IgbWl4ZWQsIHRob3NlDQo+ICAg ICAgICAgICAgICAgICBTZXR1cHMga2VlcCBvbiBiZWVpbmcNCj4gICAgICAgICAgICAgICAgIGZs YWtleSAvIHVucmVsaWFibGUuIEkgbWlnaHQgd29yayB1bmRlciBjZXJ0YWluDQo+ICAgICAgICAg ICAgICAgICBjb25kaXRpb25zLCBidXQgaXRzDQo+ICAgICAgICAgICAgICAgICBub3RoaW5nIHlv dSBjYW4gYmV0IG9uLg0KPiAgICAgICAgICAgICAgICAgDQo+ICAgICAgICAgICAgICAgICBHYXJy ZXQgRGFtb3JlIChJbGx1bW9zIFByb2plY3QpIGRlc2NyaWJlcyB0aGUgcHJvYmxlbQ0KPiAgICAg ICAgICAgICAgICAgbW9yZSBkZXRhaWxlZCBoZXJlDQo+ICAgICAgICAgICAgICAgICANCj4gICAg ICAgICAgICAgICAgIGh0dHA6Ly9nYXJyZXR0LmRhbW9yZS5vcmcvMjAxMC8wOC93aHktc2FzLXNh dGEtaXMtbm90LXN1Y2gtZ3JlYXQtaWRlYS5odG1sDQo+ICAgICAgICAgICAgICAgICANCj4gICAg ICAgICANCj4gICAgICAgICBjb21lIG9uLCB0aGUgYXJ0aWNsZSBpcyA1IHllYXJzIG9sZCwgc29t ZSB0aGluZ3MgY2hhbmdlZCBzaW5jZQ0KPiAgICAgICAgIHRoZW4hDQo+ICAgICAgICAgDQo+ICAg ICAgICAgLSBNVVggQm9hcmRzIGFyZSB1bnJlbGlhYmxlIGFuZCBleHBlbnNpdmUtIGxvbmcgdGlt ZSBzaW5jZSBJDQo+ICAgICAgICAgbGFzdCBzYXcgdGhvc2UgYm9hcmRzDQo+ICAgICAgICAgLSBT QVMgRGlza3MgYXJlIG5vdCBqdXN0IDEwLzE1ayBoaWdoIHBlcmZvcm1hbmNlIERpc2tzDQo+ICAg ICAgICAgYW55bW9yZSwgbW9zdCBOZWFybGluZSBEaXNrcyBhcmUgYXZhaWxhYmxlIHdpdGggbmF0 aXZlIFNBUw0KPiAgICAgICAgIGludGVyZmFjZSBhcyB3ZWxsDQo+ICAgICAgICAgLSBpZiB5b3Ug cGljayB0aGUgcmlnaHQgZGlzayB0aGVyZSBpcyBubyB0cm91YmxlIHVzaW5nIFNBVEENCj4gICAg ICAgICBEaXNrcyBvbiBTQVMgRXhwYW5kZXJzIG9yIFNBUyBDb250cm9sbGVycyAodGhleSBzaG91 bGQgaGF2ZQ0KPiAgICAgICAgIFIvViBzZW5zb3JzLCBvcHRpbWl6ZWQgRlcuLi4pLg0KPiAgICAg ICAgIC0gaWYgeW91IHVzZSBkZXNrdG9wIGRyaXZlcyBpbiBhIHNoZWxmIHdpdGggbGV0cyBzYXkg MjQgc2xvdHMNCj4gICAgICAgICB5b3Ugc2hvdWxkIG5vdCBleHBlY3QgaXQgdG8gd29yayA7LSkN Cj4gDQo+IA0KPiANCj4g4oCLV2h5IG5vdD8gIDspDQo+IA0KPiANCj4gV2UgdXNlIGRlc2t0b3At Y2xhc3MgZHJpdmVzIGluIG91ciBiYWNrdXBzIHN0b3JhZ2Ugc2VydmVycyB3aXRob3V0IGFueQ0K PiBpc3N1ZXMuICBFdmVuIHRoZSBtb25zdGVyIGJveGVzIHdpdGggOTAgZHJpdmVzIGluIHRoZW0g KDIgSkJPRHMgb2YgNDUNCj4gZHJpdmVzIGVhY2gpIHJ1biB3aXRob3V0IGlzc3VlcyB1c2luZyBk ZXNrdG9wLWNsYXNzIGRyaXZlcy4NCj4gDQo+IA0KPiBXZSdyZSB1c2luZyBhIG1peCBvZiBXRCBC bGFjayAoMSwgMiwgNCBUQiksIFRvc2hpYmEgKDIgVEIpLCBhbmQNCj4gU2VhZ2F0ZSAoMSwgMiBU QikuDQo+IA0KPiANCj4gMiBzeXN0ZW1zIHVzaW5nIDI0IGRyaXZlIGJheXMuICAyIHN5c3RlbXMg dXNpbmcgOTAgZHJpdmUgYmF5cy4NCj4gUGx1Z2dlZCBpbnRvIFN1cGVyTWljcm8gU0FTIGV4cGFu ZGVycyBhbmQgTFNJIDkyMTEtOGkgb3IgOTIxMS04ZSAoSQ0KPiB0aGluayB0aGF0J3MgdGhlIG1v ZGVsIG51bWJlcikgY29udHJvbGxlcnMu4oCLICBBbGwgU0FTMjAwOCBjaGlwc2V0cw0KPiB1c2lu ZyBtcHMoNCkgZHJpdmVycy4NCj4gDQo+IA0KPiBXZSdyZSBub3QgbG9va2luZyBmb3IgdWJlci1w ZXJmb3JtYW5jZSBhbmQgbWlsbGlvbnMgb2YgSU9wcyBmcm9tIHRoZXNlDQo+IHN5c3RlbXMsIGFz IHRoZSBnaWdhYml0IE5JQyBpcyB0aGUgYm90dGxlbmVjayAocnN5bmMgYW5kIHpmcyBzZW5kIGJv dGgNCj4gc2F0dXJhdGUgdGhhdCBsaW5rLCBidXQgYWxsIG9wZXJhdGlvbnMgc3RpbGwgY29tcGxl dGUgd2l0aGluIHRoZQ0KPiBhbGxvdHRlZCA4IGhvdXJzIHdpbmRvdykuDQo+IA0KPiANCj4gV2Ug cmVwbGFjZSBtYXliZSA2LTggZHJpdmVzIHBlciB5ZWFyIGFjcm9zcyBhbGwgNCBzeXN0ZW1zOyBh IGxpdHRsZQ0KPiBtb3JlIHRoYW4gdGhhdCB0aGlzIHllYXIgZHVlIHRvIG92ZXJoZWF0aW5nIGlu IG9uZSBsb2NhdGlvbiwgYnV0DQo+IHRoYXQncyBiZWVuIGZpeGVkLg0KPiANCj4gDQo+IFdoZW4g YSAyIFRCIGRlc2t0b3AtY2xhc3MgaGFyZGRyaXZlIGlzICQgODAgQ0ROIGluIGJ1bGssIGFuZCB3 ZSdyZQ0KPiBvbmx5IHJlcGxhY2luZyA4IGRyaXZlcyBwZXIgeWVhciAodW5kZXIgd2FycmFudHks IG9mIGNvdXJzZSksIGl0IGp1c3QNCj4gZG9lc24ndCBtYWtlIHNlbnNlIHRvIHNwZW5kIHRoZSBl eHRyYSBtb25leSBvbiBzZXJ2ZXItY2xhc3MsDQo+IFJBSUQtYXdhcmUsIG5lYXJsaW5lLCBvciBT QVMgZHJpdmVzLiAgOikNCj4gDQo+IA0KPiDigItJZiB5b3Ug4oCLYXJlIGJ1aWxkaW5nIGEgc3Rv cmFnZSBzZXJ2ZXIgdGhhdCByZXF1aXJlcyBtaWxsaW9ucyBvZiBJT3BzDQo+IHdpdGggbXVsdGlw bGUgMTAgR2JwcyBjb25uZWN0aW9ucywgdGhlbiBzdXJlLCBkZXNrdG9wLWNsYXNzIGRyaXZlcw0K PiB3b24ndCBjdXQgaXQuICBCdXQgZm9yIGV2ZXJ5dGhpbmcgZWxzZSwgdGhleSdyZSBmaW5lLg0K PiANCj4gDQo+IC0tIA0KPiBGcmVkZGllIENhc2gNCj4gZmp3Y2FzaEBnbWFpbC5jb20NCg0KSGV5 IEZyZWRkaWUhDQoNClNvIHdpdGggYWxsIHRoYXQgbWV0YWwsIHlvdSBoYXZlIG5ldmVyIGV4cGVy aWVuY2VkIGEgdGltZSB3aGVyZSB5b3XCtHZlDQpoYWQgdG8gcmVib290IGFueSBvbmUgb2YgdGhl bSB0byByZXBsYWNlIGEgYnJva2VuIGhhcmQgZHJpdmU/DQoNCkNoZWNrIHdoYXQgZHJpdmVyL2Zp cm13YXJlIGl0IGlzOg0KIyBzeXNjdGwgLWEgfCBlZ3JlcCAnbXBzLlswLTldLihkcml2ZXJ8Zmly bXdhcmUpX3ZlcnNpb24nDQoNClNvIGZhciwgScK0dmUgZ2F0aGVyZWQgdGhhdCBvdXIgc2V0dXBz IGFyZSB2ZXJ5IHNpbWlsYXIsIGV4Y2VwdCB5b3UgaGF2ZQ0KV0QgQmxhY2tzLCB3aGlsZSB3ZSBh cmUgdXNpbmcgR3JlZW5zLiBCdXQgd2UgYWxzbyBoYXZlIFNlYWdhdGVzIGFuZA0KVG9zaGliYXMg YXMgd2VsbCwgYW5kIHRoZXkgYWxsIHNlZW0gdG8gYmVoYXZlIHRoaXMgd2F5Lg0KDQpUaGF0wrRz IG5vdCBmYWlyISA6UCAoV2hhdCBhcmUgd2UgZG9pbmcgd3JvbmcgdGhlbj8pDQoNCi9LDQoNCg== From owner-freebsd-fs@freebsd.org Wed Sep 30 06:28:50 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AAF88A0CE42 for ; Wed, 30 Sep 2015 06:28:50 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-3.slu.se (imap.slu.se [77.235.224.123]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E95F1348 for ; Wed, 30 Sep 2015 06:28:50 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-3.slu.se (77.235.224.123) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 30 Sep 2015 08:28:41 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Wed, 30 Sep 2015 08:28:41 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: "jg@internetx.com" CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAEcjACAAF0jgIAAA7QAgABGnoCAAAXxgIAAAOqAgADJBIA= Date: Wed, 30 Sep 2015 06:28:41 +0000 Message-ID: <1443594521.5271.92.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <560AD879.2010004@internetx.com> In-Reply-To: <560AD879.2010004@internetx.com> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 06:28:50 -0000 dGlzIDIwMTUtMDktMjkga2xvY2thbiAyMDoyOSArMDIwMCBza3JldiBJbnRlck5ldFggLSBKdWVy Z2VuDQpHb3R0ZXN3aW50ZXI6DQo+IEFtIDI5LjA5LjIwMTUgdW0gMjA6MjUgc2NocmllYiBGcmVk ZGllIENhc2g6DQo+ID4gT24gVHVlLCBTZXAgMjksIDIwMTUgYXQgMTE6MDQgQU0sIE1pY2hhZWwg RnVja25lciA8bWljaGFlbEBmdWNrbmVyLm5ldA0KPiA+IDxtYWlsdG86bWljaGFlbEBmdWNrbmVy Lm5ldD4+d3JvdGU6DQo+ID4gDQo+ID4gICAgIE9uIDkvMjkvMjAxNSAzOjUxIFBNLCBJbnRlck5l dFggLSBKdWVyZ2VuIEdvdHRlc3dpbnRlciB3cm90ZToNCj4gPiANCj4gPiAgICAgICAgICBGcm9t IG15IEV4cGVyaWVuY2UgdXNpbmcgU0FUQSBEaXNrcyBvbiBTQVMgQ29udHJvbGxlcnMsIG5vDQo+ ID4gICAgICAgICBtYXR0ZXIgaWYNCj4gPiAgICAgICAgIHRoZXJlcyBhbiBFeHBhbmRlciBiZXR3 ZWVuIG9yIG5vdCBvciBtaXhlZCwgdGhvc2UgU2V0dXBzIGtlZXAgb24NCj4gPiAgICAgICAgIGJl ZWluZw0KPiA+ICAgICAgICAgZmxha2V5IC8gdW5yZWxpYWJsZS4gSSBtaWdodCB3b3JrIHVuZGVy IGNlcnRhaW4gY29uZGl0aW9ucywgYnV0IGl0cw0KPiA+ICAgICAgICAgbm90aGluZyB5b3UgY2Fu IGJldCBvbi4NCj4gPiANCj4gPiAgICAgICAgIEdhcnJldCBEYW1vcmUgKElsbHVtb3MgUHJvamVj dCkgZGVzY3JpYmVzIHRoZSBwcm9ibGVtIG1vcmUNCj4gPiAgICAgICAgIGRldGFpbGVkIGhlcmUN Cj4gPiANCj4gPiAgICAgICAgIGh0dHA6Ly9nYXJyZXR0LmRhbW9yZS5vcmcvMjAxMC8wOC93aHkt c2FzLXNhdGEtaXMtbm90LXN1Y2gtZ3JlYXQtaWRlYS5odG1sDQo+ID4gDQo+ID4gDQo+ID4gICAg IGNvbWUgb24sIHRoZSBhcnRpY2xlIGlzIDUgeWVhcnMgb2xkLCBzb21lIHRoaW5ncyBjaGFuZ2Vk IHNpbmNlIHRoZW4hDQo+ID4gDQo+ID4gICAgIC0gTVVYIEJvYXJkcyBhcmUgdW5yZWxpYWJsZSBh bmQgZXhwZW5zaXZlLSBsb25nIHRpbWUgc2luY2UgSSBsYXN0DQo+ID4gICAgIHNhdyB0aG9zZSBi b2FyZHMNCj4gPiAgICAgLSBTQVMgRGlza3MgYXJlIG5vdCBqdXN0IDEwLzE1ayBoaWdoIHBlcmZv cm1hbmNlIERpc2tzIGFueW1vcmUsIG1vc3QNCj4gPiAgICAgTmVhcmxpbmUgRGlza3MgYXJlIGF2 YWlsYWJsZSB3aXRoIG5hdGl2ZSBTQVMgaW50ZXJmYWNlIGFzIHdlbGwNCj4gPiAgICAgLSBpZiB5 b3UgcGljayB0aGUgcmlnaHQgZGlzayB0aGVyZSBpcyBubyB0cm91YmxlIHVzaW5nIFNBVEEgRGlz a3Mgb24NCj4gPiAgICAgU0FTIEV4cGFuZGVycyBvciBTQVMgQ29udHJvbGxlcnMgKHRoZXkgc2hv dWxkIGhhdmUgUi9WIHNlbnNvcnMsDQo+ID4gICAgIG9wdGltaXplZCBGVy4uLikuDQo+ID4gICAg IC0gaWYgeW91IHVzZSBkZXNrdG9wIGRyaXZlcyBpbiBhIHNoZWxmIHdpdGggbGV0cyBzYXkgMjQg c2xvdHMgeW91DQo+ID4gICAgIHNob3VsZCBub3QgZXhwZWN0IGl0IHRvIHdvcmsgOy0pDQo+ID4g DQo+ID4gDQo+ID4g4oCLV2h5IG5vdD8gIDspDQo+ID4gDQo+ID4gV2UgdXNlIGRlc2t0b3AtY2xh c3MgZHJpdmVzIGluIG91ciBiYWNrdXBzIHN0b3JhZ2Ugc2VydmVycyB3aXRob3V0IGFueQ0KPiA+ IGlzc3Vlcy4gIEV2ZW4gdGhlIG1vbnN0ZXIgYm94ZXMgd2l0aCA5MCBkcml2ZXMgaW4gdGhlbSAo MiBKQk9EcyBvZiA0NQ0KPiA+IGRyaXZlcyBlYWNoKSBydW4gd2l0aG91dCBpc3N1ZXMgdXNpbmcg ZGVza3RvcC1jbGFzcyBkcml2ZXMuDQo+ID4gDQo+ID4gV2UncmUgdXNpbmcgYSBtaXggb2YgV0Qg QmxhY2sgKDEsIDIsIDQgVEIpLCBUb3NoaWJhICgyIFRCKSwgYW5kIFNlYWdhdGUNCj4gPiAoMSwg MiBUQikuDQo+ID4gDQo+ID4gMiBzeXN0ZW1zIHVzaW5nIDI0IGRyaXZlIGJheXMuICAyIHN5c3Rl bXMgdXNpbmcgOTAgZHJpdmUgYmF5cy4gIFBsdWdnZWQNCj4gPiBpbnRvIFN1cGVyTWljcm8gU0FT IGV4cGFuZGVycyBhbmQgTFNJIDkyMTEtOGkgb3IgOTIxMS04ZSAoSSB0aGluayB0aGF0J3MNCj4g PiB0aGUgbW9kZWwgbnVtYmVyKSBjb250cm9sbGVycy7igIsgIEFsbCBTQVMyMDA4IGNoaXBzZXRz IHVzaW5nIG1wcyg0KSBkcml2ZXJzLg0KPiA+IA0KPiA+IFdlJ3JlIG5vdCBsb29raW5nIGZvciB1 YmVyLXBlcmZvcm1hbmNlIGFuZCBtaWxsaW9ucyBvZiBJT3BzIGZyb20gdGhlc2UNCj4gPiBzeXN0 ZW1zLCBhcyB0aGUgZ2lnYWJpdCBOSUMgaXMgdGhlIGJvdHRsZW5lY2sgKHJzeW5jIGFuZCB6ZnMg c2VuZCBib3RoDQo+ID4gc2F0dXJhdGUgdGhhdCBsaW5rLCBidXQgYWxsIG9wZXJhdGlvbnMgc3Rp bGwgY29tcGxldGUgd2l0aGluIHRoZQ0KPiA+IGFsbG90dGVkIDggaG91cnMgd2luZG93KS4NCj4g PiANCj4gPiBXZSByZXBsYWNlIG1heWJlIDYtOCBkcml2ZXMgcGVyIHllYXIgYWNyb3NzIGFsbCA0 IHN5c3RlbXM7IGEgbGl0dGxlIG1vcmUNCj4gPiB0aGFuIHRoYXQgdGhpcyB5ZWFyIGR1ZSB0byBv dmVyaGVhdGluZyBpbiBvbmUgbG9jYXRpb24sIGJ1dCB0aGF0J3MgYmVlbg0KPiA+IGZpeGVkLg0K PiA+IA0KPiA+IFdoZW4gYSAyIFRCIGRlc2t0b3AtY2xhc3MgaGFyZGRyaXZlIGlzICQgODAgQ0RO IGluIGJ1bGssIGFuZCB3ZSdyZSBvbmx5DQo+ID4gcmVwbGFjaW5nIDggZHJpdmVzIHBlciB5ZWFy ICh1bmRlciB3YXJyYW50eSwgb2YgY291cnNlKSwgaXQganVzdCBkb2Vzbid0DQo+ID4gbWFrZSBz ZW5zZSB0byBzcGVuZCB0aGUgZXh0cmEgbW9uZXkgb24gc2VydmVyLWNsYXNzLCBSQUlELWF3YXJl LA0KPiA+IG5lYXJsaW5lLCBvciBTQVMgZHJpdmVzLiAgOikNCj4gPiANCj4gPiDigItJZiB5b3Ug 4oCLYXJlIGJ1aWxkaW5nIGEgc3RvcmFnZSBzZXJ2ZXIgdGhhdCByZXF1aXJlcyBtaWxsaW9ucyBv ZiBJT3BzDQo+ID4gd2l0aCBtdWx0aXBsZSAxMCBHYnBzIGNvbm5lY3Rpb25zLCB0aGVuIHN1cmUs IGRlc2t0b3AtY2xhc3MgZHJpdmVzIHdvbid0DQo+ID4gY3V0IGl0LiAgQnV0IGZvciBldmVyeXRo aW5nIGVsc2UsIHRoZXkncmUgZmluZS4NCj4gPiANCj4gPiAtLSANCj4gPiBGcmVkZGllIENhc2gN Cj4gPiBmandjYXNoQGdtYWlsLmNvbSA8bWFpbHRvOmZqd2Nhc2hAZ21haWwuY29tPg0KPiANCj4g aGVsbG8gYmFja3BsYXplPw0KPiANCj4gOikNCj4gDQo+IHNvdW5kcyBsZWdpdCB0byBtZSwgc2lu Y2UgeW91IGRvbnQgc2VlbSB0byBtaXggc2F0YS9zYXMNCg0KV2UgZG9uwrR0IG1peC4gSnVzdCBT QVRBLCBidXQgc3RpbGwgaXQgYmVoYXZlcyB0aGlzIHdheS4NCg0KL0sNCg== From owner-freebsd-fs@freebsd.org Wed Sep 30 06:32:02 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 51A1DA0B97A for ; Wed, 30 Sep 2015 06:32:02 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-2.slu.se (exch2-2.slu.se [77.235.224.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D838319A0 for ; Wed, 30 Sep 2015 06:32:01 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-2.slu.se (77.235.224.122) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 30 Sep 2015 08:31:59 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Wed, 30 Sep 2015 08:31:59 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Rick Romero CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAEcjACAAF0jgIAAA7QAgABGnoCAAATVgIAACQeAgADC7gA= Date: Wed, 30 Sep 2015 06:31:58 +0000 Message-ID: <1443594718.5271.95.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <560AD6C7.80800@internetx.com> <20150929135417.Horde.W2X_CSKI8gBxk1Df7JVOPQ1@www.vfemail.net> In-Reply-To: <20150929135417.Horde.W2X_CSKI8gBxk1Df7JVOPQ1@www.vfemail.net> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 06:32:02 -0000 dGlzIDIwMTUtMDktMjkga2xvY2thbiAxMzo1NCAtMDUwMCBza3JldiBSaWNrIFJvbWVybzoNCj4g ICBRdW90aW5nIEludGVyTmV0WCAtIEp1ZXJnZW4gR290dGVzd2ludGVyIDxqZ0BpbnRlcm5ldHgu Y29tPjoNCj4gDQo+ID4gQW0gMjkuMDkuMjAxNSB1bSAyMDowNCBzY2hyaWViIE1pY2hhZWwgRnVj a25lcjoNCj4gPj4gT24gOS8yOS8yMDE1IDM6NTEgUE0sIEludGVyTmV0WCAtIEp1ZXJnZW4gR290 dGVzd2ludGVyIHdyb3RlOg0KPiA+Pj4gRnJvbSBteSBFeHBlcmllbmNlIHVzaW5nIFNBVEEgRGlz a3Mgb24gU0FTIENvbnRyb2xsZXJzLCBubyBtYXR0ZXIgaWYNCj4gPj4+IHRoZXJlcyBhbiBFeHBh bmRlciBiZXR3ZWVuIG9yIG5vdCBvciBtaXhlZCwgdGhvc2UgU2V0dXBzIGtlZXAgb24gYmVlaW5n DQo+ID4+PiBmbGFrZXkgLyB1bnJlbGlhYmxlLiBJIG1pZ2h0IHdvcmsgdW5kZXIgY2VydGFpbiBj b25kaXRpb25zLCBidXQgaXRzDQo+ID4+PiBub3RoaW5nIHlvdSBjYW4gYmV0IG9uLg0KPiA+Pj4N Cj4gPj4+IEdhcnJldCBEYW1vcmUgKElsbHVtb3MgUHJvamVjdCkgZGVzY3JpYmVzIHRoZSBwcm9i bGVtIG1vcmUgZGV0YWlsZWQNCj4gaGVyZQ0KPiA+Pj4NCj4gPj4+DQo+IGh0dHA6Ly9nYXJyZXR0 LmRhbW9yZS5vcmcvMjAxMC8wOC93aHktc2FzLXNhdGEtaXMtbm90LXN1Y2gtZ3JlYXQtaWRlYS5o dG1sDQo+ID4+PiAgDQo+ID4+DQo+ID4+IGNvbWUgb24sIHRoZSBhcnRpY2xlIGlzIDUgeWVhcnMg b2xkLCBzb21lIHRoaW5ncyBjaGFuZ2VkIHNpbmNlIHRoZW4hDQo+ID4+DQo+ID4+IC0gTVVYIEJv YXJkcyBhcmUgdW5yZWxpYWJsZSBhbmQgZXhwZW5zaXZlLSBsb25nIHRpbWUgc2luY2UgSSBsYXN0 IHNhdw0KPiA+PiB0aG9zZSBib2FyZHMNCj4gPg0KPiA+IGkgYW0gbm90IHRhbGtpbmcgYWJvdXQg c2F0YSBtdWx0aXBsZXhlcnMsIGkgYW0gdGFsa2luZyBhYm91dCBzYXMNCj4gPiBleHBhbmRlcnMu IG5vIG9uZSBldmVyIHNob3VsZCB0aGluayB0aGF0IHNhdGEgbXVsdGlwbGV4ZXJzIGFyZSBhDQo+ ID4gcmVsaWFibGUgcGllY2Ugb2YgaGFyZHdhcmUuIHRoZXkgYXJlbnQuDQo+ID4NCj4gPiB0aGlz IHByb2JsZW1zIGFyZSBkZXNpZ24gcmVsYXRlZCwgc2luY2UgTmF0YWNvdW50IG9uIGRpc2tzIGNh bnQgdGFsaw0KPiA+IG5hdGl2ZSB3aXRoIHNhcyBjb250cm9sbGVycy4gdGhleSBzdGlsbCBleGlz dCBhbmQgb2Njb3VyLiBsaWtlIHlvdSBjYW4NCj4gPiBzZWUgaGVyZS4NCj4gPg0KPiA+IGEgZmV3 IG1vbnRocyBhZ28gaSBoYWQgYSBzZXR1cCB3aGljaCBoYWQgZXhhY3RseSB3aGF0IG9uZSB3aG91 bGQgZXhwZWN0DQo+ID4gZnJvbSBzYXRhL3NhcyBtaXguIGJ1cyByZXNldHMsIGRldmljZSBoYW5n cyBhbmQgc28gb24uIGluIHRoZSBlbmQsIGl0DQo+ID4gdHVybmVkIG91dCB0aGF0IHRoZSBpbmRl bCBkY3MgMzUwMCBzc2Qgd2ljaCB3aGVyZSBjb25uZWN0ZWQgdmlhIGEgbHNpDQo+ID4gc2FzIDIw MDggd2hlcmUgdGhlIHJvb3QgY2F1c2Ugb2YgYWxsLiBhZnRlciB0aGV5IHdoZXJlIGhvb2tlZCBv bnRvIHRoZQ0KPiA+IG9uYm9hcmQgc2F0YSBwb3J0cywgZXZlcnl0aGluZyB3YXMgZmluZS4gb24g dGhlIG90aGVyIHNpZGUgdGhlIGludGVsIGRjcw0KPiA+IDM3MDAgc2F0YSBzc2Qgd29ya3MgZmlu ZSBpbiBzYXMvc2F0YSBtaXguIHlvdSBzZWUsIGl0cyBub3RoaW5nIHlvdSBjYW4NCj4gPiBjb3Vu dCBvbi4gc3RheSB3aXRoIHNhcywgb3Igd2l0aCBzYXRhIGFuZCB1c2UgcHJvcGVyIGNvbnRyb2xs ZXJzLg0KPiANCj4gSSd2ZSBzZWVuIGJvdGguICBJIGhhdmUgdHdvIG5pY2UgQXN1cyBib3hlcyB3 aXRoIDEyIDRHQiBTQVRBIGRyaXZlcyBpbg0KPiBSQUlEWjIsIGFuZCB0aGV5IHdvcmsgd29uZGVy ZnVsbHkuDQo+IA0KPiBPVE9ILCBJIHJlY2VudGx5IGJ1aWx0IGEgbmV3IHN5c3RlbSB3aXRoIGEg MyBkcml2ZSBSQUlEWiAodXNpbmcgU1NEKSwgYW5kDQo+IGl0IGNvbnN0YW50bHkgYmxldyBjaHVu a3MgKHRpbWVvdXRzIGV0YykuIEFmdGVyIGdvaW5nIHRocm91Z2ggbXVsdGlwbGUNCj4gc2VydmVy cywgZHJpdmVzLGJhY2twbGFuZXMgKGJvdGggZXhwYW5kZXJzIGFuZCBqdXN0IGdlbmVyaWMgaG90 LXN3YXApIGFuZA0KPiBjb250cm9sbGVycywgaXQgdHVybnMgb3V0IHRoZSBsYXRlc3QgTFNJIGZp cm13YXJlIGlzIGdhcmJhZ2UuICBZb3UgaGF2ZSB0bw0KPiBkb3duZ3JhZGUgdGhlIExTSSBmaXJt d2FyZSB0byAncDE3JyAoSUlSQykgLSBhbmQgcHJlZmVycmFibHkgaWYgeW91J3JlDQo+IHVzaW5n IFpGUywgY2hhbmdlIGl0IHRvIElUIGZpcm13YXJlIChmb3IgJ3JlYWwnIEpCT0QpLg0KDQpJdCB3 b3VsZCBzZWVtIGFzIGlmIGZpeGVzIGhhdmUgZ29uZSBpbnRvIFAxOSB0aGF0IHNvdW5kZWQgbGlr ZSBpdCBzaG91bGQNCmZpeCBvdXIgaXNzdWVzIGJ1dCBkb2VzbsK0dCBzZWVtIGxpa2UgaXTCtHMg ZG9uZSB1cyBkaWZmZXJlbmNlOg0KaHR0cDovL3d3dy5zcGluaWNzLm5ldC9saXN0cy9saW51eC1z Y3NpL21zZzc0MzEzLmh0bWwNCg0KL0sNCg== From owner-freebsd-fs@freebsd.org Wed Sep 30 06:35:16 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1FD3AA0BB60 for ; Wed, 30 Sep 2015 06:35:16 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-3.slu.se (webmail.slu.se [77.235.224.123]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A67731A54 for ; Wed, 30 Sep 2015 06:35:14 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-3.slu.se (77.235.224.123) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 30 Sep 2015 08:35:12 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Wed, 30 Sep 2015 08:35:12 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Philip Murray CC: Graham Allan , "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAD+XwCAAPB+gIAAQ2KAgABjcoA= Date: Wed, 30 Sep 2015 06:35:11 +0000 Message-ID: <1443594911.5271.98.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <1443507440.5271.72.camel@data-b104.adm.slu.se> <560AF6AD.3010803@physics.umn.edu> <1A19B1E0-FC2F-4847-A3BA-E6F694589E4E@nevada.net.nz> In-Reply-To: <1A19B1E0-FC2F-4847-A3BA-E6F694589E4E@nevada.net.nz> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <997E5DF074733D459CA7EA83DFC8BF71@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 06:35:16 -0000 b25zIDIwMTUtMDktMzAga2xvY2thbiAxMzozOSArMTMwMCBza3JldiBQaGlsaXAgTXVycmF5Og0K PiANCj4gPiBPbiAzMC8wOS8yMDE1LCBhdCA5OjM4IGFtLCBHcmFoYW0gQWxsYW4gPGFsbGFuQHBo eXNpY3MudW1uLmVkdT4gd3JvdGU6DQo+ID4gDQo+ID4gT24gOS8yOS8yMDE1IDE6MTcgQU0sIEth cmxpIFNqw7ZiZXJnIHdyb3RlOg0KPiA+Pj4gDQo+ID4+PiBSZWdhcmRpbmcgeW91ciBleHBlcmll bmNlIHdpdGggZmlybXdhcmUgMjAsIEkgYmVsaWV2ZSBpdCBpcyAia25vd24gYmFkIiwNCj4gPj4+ IHRob3VnaCBzb21lIHNlZW0gdG8gZGlzYWdyZWUuIENlcnRhaW5seSB3aGVuIGJ1aWxkaW5nIG15 IHJlY2VudC1pc2gNCj4gPj4+IGxhcmdlIDkuMyBzZXJ2ZXJzIEkgc3BlY2lmaWNhbGx5IHRlc3Rl ZCBpdCBhbmQgZ290IGNvbnNpc3RlbnQgZGF0YQ0KPiA+Pj4gY29ycnVwdGlvbi4gVGhlcmUgaXMg bm93IGEgbmV3ZXIgcmVsZWFzZSBvZiBmaXJtd2FyZSAyMCAsICIyMC4wMC4wNC4wMCINCj4gPj4+ IHdoaWNoIHNlZW1zIHRvIGJlIGZpeGVkIC0gc2VlIHRoaXMgdGhyZWFkOg0KPiA+Pj4gDQo+ID4+ PiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL3BpcGVybWFpbC9mcmVlYnNkLXNjc2kvMjAxNS1B dWd1c3QvMDA2NzkzLmh0bWwNCj4gPj4gDQo+ID4+IE5vLCBmaXJtd2FyZSAyMC4wMC4wNC4wMCBh bmQgZHJpdmVyIDIwLjAwLjAwLjAwLWZic2Qgd2FzIHRoZSBvbmUgdGhhdA0KPiA+PiB3YXMgdXNl ZCB3aGVuIFpGUyBmcmVha2VkIG91dCwgc28gaXTCtHMgZGVmaW5pdGVseSBub3QgZml4ZWQuDQo+ ID4+IA0KPiA+PiBJIHRoaW5rIHRoaXMgY2FsbHMgZm9yIGEgYnVnIHJlcG9ydC4NCj4gPiANCj4g PiBUaGF0IGlzIGN1cmlvdXMsIHNpbmNlIEkgY291bGQgcmFwaWRseSBnZXQgZGF0YSBjb3JydXB0 aW9uIHdpdGggZmlybXdhcmUgMjAuMDAuMDAuMDAsIHlldCByYW4gYSBzdHJlc3MgdGVzdCBmb3Ig YWJvdXQgYSB3ZWVrIHdpdGggMjAuMDAuMDQuMDAgd2l0aCBubyBpc3N1ZXMuIFRoYXQgd2FzIHdp dGggRnJlZUJTRCA5LjMsIGJ1dCBJIGp1c3QgdXBkYXRlZCBteSB0ZXN0IHN5c3RlbSB0byAxMC4y LCBhbmQgaXQgaGFzIGJlZW4gcnVubmluZyB0aGUgc2FtZSBzdHJlc3MgdGVzdCBmb3IgNC01IGhv dXJzIGFnYWluIHdpdGggbm8gaXNzdWVzLiBJIGRvbid0IGRvdWJ0IHlvdXIgZXhwZXJpZW5jZSBh dCBhbGwsIG9mIGNvdXJzZSwgYnV0IEkgd29uZGVyIHdoYXQgaXMgZGlmZmVyZW50Pw0KPiA+IA0K PiA+IEZvciB3aGF0IGl0J3Mgd29ydGgsIG15IHRlc3QgbWFjaGluZSBpcyBhIERlbGwgUjYxMCB3 aXRoIERlbGwgVFlWR0MgSEJBICh1bmNsZWFyIHdoZXRoZXIgdGhpcyBpcyBhIDkyMDctOGUgb3Ig OTIwNS04ZSksIGFuZCBXRCBSZWQgZHJpdmVzIGluIGEgU3VwZXJtaWNybyBTQzg0NyBjaGFzc2lz Lg0KPiANCj4gSnVzdCBhcyBhbiBhZGRpdGlvbmFsIGRhdGFwb2ludCAodGhpcyB0aHJlYWQgaXMg Z2l2aW5nIG1lIGNoaWxscykgd2l0aCB0aGUgTFNJIElUIGZpcm13YXJlIHZlcnNpb24gMjAuMDAu MDIuMDDigKYNCj4gDQo+ICogRnJlZUJTRCAxMC4yLVJFTEVBU0UNCj4gKiBTdXBlcm1pY3JvIFND ODI2IENoYXNzaXMNCj4gKiBMU0kgU0FTMjAwNCBDb250cm9sbGVyDQo+IAltcHMwOiA8QXZhZ28g VGVjaG5vbG9naWVzIChMU0kpIFNBUzIwMDQ+IHBvcnQgMHhlMDAwLTB4ZTBmZiBtZW0gMHhmNzJj MDAwMC0weGY3MmMzZmZmLDB4ZjcyODAwMDAtMHhmNzJiZmZmZiBpcnEgMTYgYXQgZGV2aWNlIDAu MCBvbiBwY2kxDQo+IAltcHMwOiBGaXJtd2FyZTogMjAuMDAuMDIuMDAsIERyaXZlcjogMjAuMDAu MDAuMDAtZmJzZA0KPiAJbXBzMDogSU9DQ2FwYWJpbGl0aWVzOiAxMjg1YzxTY3NpVGFza0Z1bGws RGlhZ1RyYWNlLFNuYXBCdWYsRUVEUCxUcmFuc1JldHJ5LEV2ZW50UmVwbGF5LEhvc3REaXNjPg0K PiANCj4gKiBMU0kgU0FTMlgyOCBFeHBhbmRlci9CYWNrcGxhbmUNCj4gCXNlczA6IDxMU0kgU0FT MlgyOCAwZTEyPiBGaXhlZCBFbmNsb3N1cmUgU2VydmljZXMgU1BDLTMgU0NTSSBkZXZpY2UgDQo+ IA0KPiAqIDEyeCBTQVRBIFdEIFJFIDJUQiAgZHJpdmVzIChXRDIwMDBGWVlaIGFycmFuZ2VkIGFz IDJ4IFJBSURaMiB2ZGV2cykNCj4gDQo+IFJlcGVhdGVkbHkgZmlsbGVkIHVwIHdpdGggZGF0YSB3 aXRoIHJlZ3VsYXIgc2NydWJzIHdpdGhvdXQgYW55IGlzc3VlcyBhbmQgcGVyZm9ybWFuY2UgaXMg cHJldHR5IGdvb2QsIGFsdGhvdWdoIEkgaGF2ZW7igJl0IGhhZCBhIGRpc2sgZmFpbCB5ZXQuIA0K PiANCj4gQ2hlZXJzDQo+IA0KPiBQaGlsIA0KDQpSZWFsbHkgZ29vZCB0byBoZWFyIFBoaWwsIHRo YW5rcyEgScK0bSBnb2luZyB0byB0ZXN0IGEgOTIwMSB0b2RheSB3aXRoDQpQMjAuMDAuMDQuMDAg YW5kIDIwLjAwLjAwLjAwLWZic2QgdG8gc2VlIGlmIHRoZXJlwrRzIGFueSBkaWZmZXJlbmNlIGlu DQptb2RlbHMuDQoNCi9LDQo= From owner-freebsd-fs@freebsd.org Wed Sep 30 11:39:40 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B66EFA0ACE0 for ; Wed, 30 Sep 2015 11:39:40 +0000 (UTC) (envelope-from tevans.uk@googlemail.com) Received: from mail-ig0-x22a.google.com (mail-ig0-x22a.google.com [IPv6:2607:f8b0:4001:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 883EB1BCF for ; Wed, 30 Sep 2015 11:39:40 +0000 (UTC) (envelope-from tevans.uk@googlemail.com) Received: by igbni9 with SMTP id ni9so28279661igb.0 for ; Wed, 30 Sep 2015 04:39:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:cc :content-type; bh=gjNhW9LXEEGeJIdCq4XXTIroMB65BsY52ZWFTg1xQlI=; b=KPMoiJTSJ5u5o7n7QyAqCKe9feR5o5UAroKgelq1xy6GOGYGa9U0AkRZNNrvjzkDb2 1pBCer/gQFPCxJNWwf2x5Rjv68oDP8pm3NmCGRaQnZjK4WzWZkbOu2L390wAUja/NyX/ QPNNUxjG7U6ObXpt2PxDN6yS0XAoES7PWHWBjKVwnM3mSRki9Ej4fP9Xkb9FNkI/zRyo NI9OQEcOYmIaeyLJ1cz1VClFYC8qIPzQ8Gbcj5Z+AQE8KfX4Gcvx5XXvDk3PDDO4ekX5 93EfSVQRtFg3DZOEwPa+gnj0ZAc6b93d0CHHdEYJwdqZzQKd9O9tUpHOUMBT1VoWefsP nU0g== MIME-Version: 1.0 X-Received: by 10.50.147.71 with SMTP id ti7mr3712370igb.19.1443613179803; Wed, 30 Sep 2015 04:39:39 -0700 (PDT) Received: by 10.107.200.211 with HTTP; Wed, 30 Sep 2015 04:39:39 -0700 (PDT) In-Reply-To: References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> Date: Wed, 30 Sep 2015 12:39:39 +0100 Message-ID: Subject: Re: Cannot replace broken hard drive with LSI HBA From: Tom Evans Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 11:39:40 -0000 On Tue, Sep 29, 2015 at 7:25 PM, Freddie Cash wrote: > On Tue, Sep 29, 2015 at 11:04 AM, Michael Fuckner > wrote: > >> On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: >> >>> From my Experience using SATA Disks on SAS Controllers, no matter if >>> theres an Expander between or not or mixed, those Setups keep on beeing >>> flakey / unreliable. I might work under certain conditions, but its >>> nothing you can bet on. >>> >>> Garret Damore (Illumos Project) describes the problem more detailed here >>> >>> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html >>> >>> >> come on, the article is 5 years old, some things changed since then! >> >> - MUX Boards are unreliable and expensive- long time since I last saw >> those boards >> - SAS Disks are not just 10/15k high performance Disks anymore, most >> Nearline Disks are available with native SAS interface as well >> - if you pick the right disk there is no trouble using SATA Disks on SAS >> Expanders or SAS Controllers (they should have R/V sensors, optimized >> FW...). >> - if you use desktop drives in a shelf with lets say 24 slots you should >> not expect it to work ;-) >> > > Why not? ;) > > We use desktop-class drives in our backups storage servers without any > issues. Even the monster boxes with 90 drives in them (2 JBODs of 45 > drives each) run without issues using desktop-class drives. > > We're using a mix of WD Black (1, 2, 4 TB), Toshiba (2 TB), and Seagate (1, > 2 TB). > > 2 systems using 24 drive bays. 2 systems using 90 drive bays. Plugged > into SuperMicro SAS expanders and LSI 9211-8i or 9211-8e (I think that's > the model number) controllers. All SAS2008 chipsets using mps(4) drivers. > Just a me too. This is just for my own personal storage (so everything is second hand from ebay), but I use LSI SAS2008 [1], which is mps(4), with a couple of Rackable SE3016 16 bay enclosures, using around 20 of the cheapest SATA drives[2] I could afford at the time. I've never had any problems with it, my party trick[3] is to pull and swap drive locations, it does a full scrub every other weekend, and I've replaced several drives that have died and resilvered with no complications. Of course, I don't put that much stress on the hardware, so I'm aware that problems may not be occurring for me because of that. Perhaps I've just been lucky so far, but they are easily the best $300 I've spent on ebay. No SSDs however, they are all directly attached to motherboard SATA controllers. Cheers Tom [1] With firmware 15, in IT mode - I know, I should update.. [2] Currently a mix of "SAMSUNG HD154UI 1118", "TOSHIBA DT01ABA3 ABB0" and "WDC WD30EZRX-00M 0A80". Yep, super-cheap consumer desktop hard drives. [3] Yes, they are quite dull parties. From owner-freebsd-fs@freebsd.org Wed Sep 30 11:43:57 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5852A0B163 for ; Wed, 30 Sep 2015 11:43:57 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from Exch2-2.slu.se (exch2-2.slu.se [77.235.224.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "webmail.slu.se", Issuer "TERENA SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 495A51ED6 for ; Wed, 30 Sep 2015 11:43:56 +0000 (UTC) (envelope-from karli.sjoberg@slu.se) Received: from exch2-4.slu.se (77.235.224.124) by Exch2-2.slu.se (77.235.224.122) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 30 Sep 2015 13:43:53 +0200 Received: from exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae]) by exch2-4.slu.se ([fe80::bc24:95e8:1e1e:f3ae%22]) with mapi id 15.00.1104.000; Wed, 30 Sep 2015 13:43:53 +0200 From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= To: Tom Evans CC: "freebsd-fs@freebsd.org" Subject: Re: Cannot replace broken hard drive with LSI HBA Thread-Topic: Cannot replace broken hard drive with LSI HBA Thread-Index: AQHQ+fKqdLe7t4w1YE6vWvblBTZjQJ5R6TIAgAEcjACAAF0jgIAAA7QAgABGnoCAAAXxgIABINCAgAABLgA= Date: Wed, 30 Sep 2015 11:43:52 +0000 Message-ID: <1443613432.5271.100.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> In-Reply-To: Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [77.235.228.63] Content-Type: text/plain; charset="utf-8" Content-ID: <22B6C95FFF6BD4499224EE1D6AB1A3F2@ad.slu.se> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 11:43:57 -0000 b25zIDIwMTUtMDktMzAga2xvY2thbiAxMjozOSArMDEwMCBza3JldiBUb20gRXZhbnMgdmlhIGZy ZWVic2QtZnM6DQo+IE9uIFR1ZSwgU2VwIDI5LCAyMDE1IGF0IDc6MjUgUE0sIEZyZWRkaWUgQ2Fz aCA8Zmp3Y2FzaEBnbWFpbC5jb20+IHdyb3RlOg0KPiA+IE9uIFR1ZSwgU2VwIDI5LCAyMDE1IGF0 IDExOjA0IEFNLCBNaWNoYWVsIEZ1Y2tuZXIgPG1pY2hhZWxAZnVja25lci5uZXQ+DQo+ID4gd3Jv dGU6DQo+ID4NCj4gPj4gT24gOS8yOS8yMDE1IDM6NTEgUE0sIEludGVyTmV0WCAtIEp1ZXJnZW4g R290dGVzd2ludGVyIHdyb3RlOg0KPiA+Pg0KPiA+Pj4gIEZyb20gbXkgRXhwZXJpZW5jZSB1c2lu ZyBTQVRBIERpc2tzIG9uIFNBUyBDb250cm9sbGVycywgbm8gbWF0dGVyIGlmDQo+ID4+PiB0aGVy ZXMgYW4gRXhwYW5kZXIgYmV0d2VlbiBvciBub3Qgb3IgbWl4ZWQsIHRob3NlIFNldHVwcyBrZWVw IG9uIGJlZWluZw0KPiA+Pj4gZmxha2V5IC8gdW5yZWxpYWJsZS4gSSBtaWdodCB3b3JrIHVuZGVy IGNlcnRhaW4gY29uZGl0aW9ucywgYnV0IGl0cw0KPiA+Pj4gbm90aGluZyB5b3UgY2FuIGJldCBv bi4NCj4gPj4+DQo+ID4+PiBHYXJyZXQgRGFtb3JlIChJbGx1bW9zIFByb2plY3QpIGRlc2NyaWJl cyB0aGUgcHJvYmxlbSBtb3JlIGRldGFpbGVkIGhlcmUNCj4gPj4+DQo+ID4+PiBodHRwOi8vZ2Fy cmV0dC5kYW1vcmUub3JnLzIwMTAvMDgvd2h5LXNhcy1zYXRhLWlzLW5vdC1zdWNoLWdyZWF0LWlk ZWEuaHRtbA0KPiA+Pj4NCj4gPj4+DQo+ID4+IGNvbWUgb24sIHRoZSBhcnRpY2xlIGlzIDUgeWVh cnMgb2xkLCBzb21lIHRoaW5ncyBjaGFuZ2VkIHNpbmNlIHRoZW4hDQo+ID4+DQo+ID4+IC0gTVVY IEJvYXJkcyBhcmUgdW5yZWxpYWJsZSBhbmQgZXhwZW5zaXZlLSBsb25nIHRpbWUgc2luY2UgSSBs YXN0IHNhdw0KPiA+PiB0aG9zZSBib2FyZHMNCj4gPj4gLSBTQVMgRGlza3MgYXJlIG5vdCBqdXN0 IDEwLzE1ayBoaWdoIHBlcmZvcm1hbmNlIERpc2tzIGFueW1vcmUsIG1vc3QNCj4gPj4gTmVhcmxp bmUgRGlza3MgYXJlIGF2YWlsYWJsZSB3aXRoIG5hdGl2ZSBTQVMgaW50ZXJmYWNlIGFzIHdlbGwN Cj4gPj4gLSBpZiB5b3UgcGljayB0aGUgcmlnaHQgZGlzayB0aGVyZSBpcyBubyB0cm91YmxlIHVz aW5nIFNBVEEgRGlza3Mgb24gU0FTDQo+ID4+IEV4cGFuZGVycyBvciBTQVMgQ29udHJvbGxlcnMg KHRoZXkgc2hvdWxkIGhhdmUgUi9WIHNlbnNvcnMsIG9wdGltaXplZA0KPiA+PiBGVy4uLikuDQo+ ID4+IC0gaWYgeW91IHVzZSBkZXNrdG9wIGRyaXZlcyBpbiBhIHNoZWxmIHdpdGggbGV0cyBzYXkg MjQgc2xvdHMgeW91IHNob3VsZA0KPiA+PiBub3QgZXhwZWN0IGl0IHRvIHdvcmsgOy0pDQo+ID4+ DQo+ID4NCj4gPiBXaHkgbm90PyAgOykNCj4gPg0KPiA+IFdlIHVzZSBkZXNrdG9wLWNsYXNzIGRy aXZlcyBpbiBvdXIgYmFja3VwcyBzdG9yYWdlIHNlcnZlcnMgd2l0aG91dCBhbnkNCj4gPiBpc3N1 ZXMuICBFdmVuIHRoZSBtb25zdGVyIGJveGVzIHdpdGggOTAgZHJpdmVzIGluIHRoZW0gKDIgSkJP RHMgb2YgNDUNCj4gPiBkcml2ZXMgZWFjaCkgcnVuIHdpdGhvdXQgaXNzdWVzIHVzaW5nIGRlc2t0 b3AtY2xhc3MgZHJpdmVzLg0KPiA+DQo+ID4gV2UncmUgdXNpbmcgYSBtaXggb2YgV0QgQmxhY2sg KDEsIDIsIDQgVEIpLCBUb3NoaWJhICgyIFRCKSwgYW5kIFNlYWdhdGUgKDEsDQo+ID4gMiBUQiku DQo+ID4NCj4gPiAyIHN5c3RlbXMgdXNpbmcgMjQgZHJpdmUgYmF5cy4gIDIgc3lzdGVtcyB1c2lu ZyA5MCBkcml2ZSBiYXlzLiAgUGx1Z2dlZA0KPiA+IGludG8gU3VwZXJNaWNybyBTQVMgZXhwYW5k ZXJzIGFuZCBMU0kgOTIxMS04aSBvciA5MjExLThlIChJIHRoaW5rIHRoYXQncw0KPiA+IHRoZSBt b2RlbCBudW1iZXIpIGNvbnRyb2xsZXJzLiAgQWxsIFNBUzIwMDggY2hpcHNldHMgdXNpbmcgbXBz KDQpIGRyaXZlcnMuDQo+ID4NCj4gDQo+IEp1c3QgYSBtZSB0b28uIFRoaXMgaXMganVzdCBmb3Ig bXkgb3duIHBlcnNvbmFsIHN0b3JhZ2UgKHNvIGV2ZXJ5dGhpbmcNCj4gaXMgc2Vjb25kIGhhbmQg ZnJvbSBlYmF5KSwgYnV0IEkgdXNlIExTSSBTQVMyMDA4IFsxXSwgd2hpY2ggaXMgbXBzKDQpLA0K PiB3aXRoIGEgY291cGxlIG9mIFJhY2thYmxlIFNFMzAxNiAxNiBiYXkgZW5jbG9zdXJlcywgdXNp bmcgYXJvdW5kIDIwIG9mDQo+IHRoZSBjaGVhcGVzdCBTQVRBIGRyaXZlc1syXSBJIGNvdWxkIGFm Zm9yZCBhdCB0aGUgdGltZS4gSSd2ZSBuZXZlciBoYWQNCj4gYW55IHByb2JsZW1zIHdpdGggaXQs IG15IHBhcnR5IHRyaWNrWzNdIGlzIHRvIHB1bGwgYW5kIHN3YXAgZHJpdmUNCj4gbG9jYXRpb25z LCBpdCBkb2VzIGEgZnVsbCBzY3J1YiBldmVyeSBvdGhlciB3ZWVrZW5kLCBhbmQgSSd2ZSByZXBs YWNlZA0KPiBzZXZlcmFsIGRyaXZlcyB0aGF0IGhhdmUgZGllZCBhbmQgcmVzaWx2ZXJlZCB3aXRo IG5vIGNvbXBsaWNhdGlvbnMuDQo+IA0KPiBPZiBjb3Vyc2UsIEkgZG9uJ3QgcHV0IHRoYXQgbXVj aCBzdHJlc3Mgb24gdGhlIGhhcmR3YXJlLCBzbyBJJ20gYXdhcmUNCj4gdGhhdCBwcm9ibGVtcyBt YXkgbm90IGJlIG9jY3VycmluZyBmb3IgbWUgYmVjYXVzZSBvZiB0aGF0LiBQZXJoYXBzDQo+IEkn dmUganVzdCBiZWVuIGx1Y2t5IHNvIGZhciwgYnV0IHRoZXkgYXJlIGVhc2lseSB0aGUgYmVzdCAk MzAwIEkndmUNCj4gc3BlbnQgb24gZWJheS4NCj4gDQo+IE5vIFNTRHMgaG93ZXZlciwgdGhleSBh cmUgYWxsIGRpcmVjdGx5IGF0dGFjaGVkIHRvIG1vdGhlcmJvYXJkIFNBVEEgY29udHJvbGxlcnMu DQo+IA0KPiBDaGVlcnMNCj4gDQo+IFRvbQ0KPiANCj4gWzFdIFdpdGggZmlybXdhcmUgMTUsIGlu IElUIG1vZGUgLSBJIGtub3csIEkgc2hvdWxkIHVwZGF0ZS4uDQo+IFsyXSBDdXJyZW50bHkgYSBt aXggb2YgIlNBTVNVTkcgSEQxNTRVSSAxMTE4IiwgIlRPU0hJQkEgRFQwMUFCQTMgQUJCMCINCj4g YW5kICJXREMgV0QzMEVaUlgtMDBNIDBBODAiLiBZZXAsIHN1cGVyLWNoZWFwIGNvbnN1bWVyIGRl c2t0b3AgaGFyZA0KPiBkcml2ZXMuDQo+IFszXSBZZXMsIHRoZXkgYXJlIHF1aXRlIGR1bGwgcGFy dGllcy4NCj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18N Cj4gZnJlZWJzZC1mc0BmcmVlYnNkLm9yZyBtYWlsaW5nIGxpc3QNCj4gaHR0cHM6Ly9saXN0cy5m cmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVic2QtZnMNCj4gVG8gdW5zdWJzY3JpYmUs IHNlbmQgYW55IG1haWwgdG8gImZyZWVic2QtZnMtdW5zdWJzY3JpYmVAZnJlZWJzZC5vcmciDQoN Cg0KV2hpY2ggdmVyc2lvbiBGcmVlQlNEIGlzIGl0IHJ1bm5pbmc/DQoNCi9LDQoNCg== From owner-freebsd-fs@freebsd.org Wed Sep 30 12:03:51 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 71D63A0C275 for ; Wed, 30 Sep 2015 12:03:51 +0000 (UTC) (envelope-from ubm.freebsd@googlemail.com) Received: from mail-wi0-x233.google.com (mail-wi0-x233.google.com [IPv6:2a00:1450:400c:c05::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0684C1C02 for ; Wed, 30 Sep 2015 12:03:51 +0000 (UTC) (envelope-from ubm.freebsd@googlemail.com) Received: by wiclk2 with SMTP id lk2so58283555wic.1 for ; Wed, 30 Sep 2015 05:03:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=from:date:to:subject:message-id:in-reply-to:references:mime-version :content-type:content-transfer-encoding; bh=QHPUjRmaKPQvkWLaN+0CG1/3vzD3RVeuiPbLQ8plSTs=; b=MSodWke/yGoXUOngtXPB9M8ksBIIHQ01Oqh9+r05HlwSaNYN3GPaQyDfiAxfsOo9tg GZ5xyh+e7Rz1iAWb1D9jVLCAHpjp+8LF4RrFucliRafJPn67+4hgd80JG0DgSh4rCzXM d+RkXEjFBbf00s8GK2APof8HjtLF//4xAQa2x6iKV0X93iRYFK+13kRChmbUdty8XzsN YoDtuiaBa6Dlfmyx0OtTXYWsHTqO23ByQzAX8n+Q8C7mBSISu8jij3ObcQijkNKAV+v3 /DabsVe9Ow/dYGL1NqhjWbchEQbc3W+UlT/hCohmqbEdRbR/0DhQ+Oo+WQm83E3dAeNR n1pA== X-Received: by 10.194.221.4 with SMTP id qa4mr4118841wjc.145.1443614629081; Wed, 30 Sep 2015 05:03:49 -0700 (PDT) Received: from ubm.strangled.net (ipbcc16d85.dynamic.kabel-deutschland.de. [188.193.109.133]) by smtp.gmail.com with ESMTPSA id ki7sm278896wjc.28.2015.09.30.05.03.48 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 30 Sep 2015 05:03:48 -0700 (PDT) From: Marc UBM X-Google-Original-From: Marc "UBM" Bocklet Date: Wed, 30 Sep 2015 14:03:47 +0200 To: freebsd-fs@freebsd.org Subject: Re: Cannot replace broken hard drive with LSI HBA Message-Id: <20150930140347.fcc10439bd1b1c9bee87d560@gmail.com> In-Reply-To: <1443613432.5271.100.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <1443613432.5271.100.camel@data-b104.adm.slu.se> X-Mailer: Sylpheed 3.4.3 (GTK+ 2.24.28; amd64-portbld-freebsd11.0) Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 12:03:51 -0000 On Wed, 30 Sep 2015 11:43:52 +0000 Karli Sj=F6berg wrote: > ons 2015-09-30 klockan 12:39 +0100 skrev Tom Evans via freebsd-fs: > > On Tue, Sep 29, 2015 at 7:25 PM, Freddie Cash wrote: > > > On Tue, Sep 29, 2015 at 11:04 AM, Michael Fuckner > > > wrote: > > > > > >> On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: > > >> > > >>> From my Experience using SATA Disks on SAS Controllers, no matter = if > > >>> theres an Expander between or not or mixed, those Setups keep on be= eing > > >>> flakey / unreliable. I might work under certain conditions, but its > > >>> nothing you can bet on. > > >>> > > >>> Garret Damore (Illumos Project) describes the problem more detailed= here > > >>> > > >>> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-id= ea.html > > >>> > > >>> > > >> come on, the article is 5 years old, some things changed since then! > > >> > > >> - MUX Boards are unreliable and expensive- long time since I last saw > > >> those boards > > >> - SAS Disks are not just 10/15k high performance Disks anymore, most > > >> Nearline Disks are available with native SAS interface as well > > >> - if you pick the right disk there is no trouble using SATA Disks on= SAS > > >> Expanders or SAS Controllers (they should have R/V sensors, optimized > > >> FW...). > > >> - if you use desktop drives in a shelf with lets say 24 slots you sh= ould > > >> not expect it to work ;-) > > >> > > > > > > Why not? ;) > > > > > > We use desktop-class drives in our backups storage servers without any > > > issues. Even the monster boxes with 90 drives in them (2 JBODs of 45 > > > drives each) run without issues using desktop-class drives. > > > > > > We're using a mix of WD Black (1, 2, 4 TB), Toshiba (2 TB), and Seaga= te (1, > > > 2 TB). > > > > > > 2 systems using 24 drive bays. 2 systems using 90 drive bays. Plugg= ed > > > into SuperMicro SAS expanders and LSI 9211-8i or 9211-8e (I think tha= t's > > > the model number) controllers. All SAS2008 chipsets using mps(4) dri= vers. > > > > >=20 > > Just a me too. This is just for my own personal storage (so everything > > is second hand from ebay), but I use LSI SAS2008 [1], which is mps(4), > > with a couple of Rackable SE3016 16 bay enclosures, using around 20 of > > the cheapest SATA drives[2] I could afford at the time. I've never had > > any problems with it, my party trick[3] is to pull and swap drive > > locations, it does a full scrub every other weekend, and I've replaced > > several drives that have died and resilvered with no complications. > >=20 > > Of course, I don't put that much stress on the hardware, so I'm aware > > that problems may not be occurring for me because of that. Perhaps > > I've just been lucky so far, but they are easily the best $300 I've > > spent on ebay. > >=20 > > No SSDs however, they are all directly attached to motherboard SATA con= trollers. > >=20 > > Cheers > >=20 > > Tom > >=20 > > [1] With firmware 15, in IT mode - I know, I should update.. > > [2] Currently a mix of "SAMSUNG HD154UI 1118", "TOSHIBA DT01ABA3 ABB0" > > and "WDC WD30EZRX-00M 0A80". Yep, super-cheap consumer desktop hard > > drives. > > [3] Yes, they are quite dull parties. > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >=20 >=20 > Which version FreeBSD is it running? Just a "me too" here, running a mix of 16 consumer-/servergrade SATA-drives (WD and Samsung) on a LSI SAS2116 (mps, flashed with IT firmware (JBOD)). Drives are connected with a SAS-4x SATA cable (1m length). I've been running regular scrubs and encountered no problems at all so far - the system is used as a file server with low usage though. FreeBSD version is 10.1-BETA1. Bye Marc=20 From owner-freebsd-fs@freebsd.org Wed Sep 30 21:11:17 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E8916A0BA5D for ; Wed, 30 Sep 2015 21:11:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D54AC19A2 for ; Wed, 30 Sep 2015 21:11:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t8ULBHSf089726 for ; Wed, 30 Sep 2015 21:11:17 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 159402] [zfs][loader] symlinks cause I/O errors Date: Wed, 30 Sep 2015 21:11:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rg@progtech.net X-Bugzilla-Status: In Progress X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Sep 2015 21:11:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=159402 --- Comment #1 from Rolf Grossmann --- I'm also experiencing this problem. However my understanding of the zfs code ended when I couldn't find documentation on ZFS system attributes (other than the comment in /sys/cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c). The problem seems (to my limited understanding) that symlinks are now stored in system attributes blocks instead of the physical znode. However the code in /sys/boot/zfs/zfsimpl.c uses some magical constants from /sys/cddl/boot/zfs/zfsimpl.h to determine e.g. the file type in zfs_dnode_stat(). However when zfs_lookup() hits a symlink, it doesn't check for the SA block. Instead it finds that the link target can't be in dn_bonus (even clang notices) and tries to read file contents for it. Of course there aren't any, which results in the error message. Now id anybody could point out how to get the link data offset in the SA block, I'd prepare a patch. The zfs_sa_readlink() function in /sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_sa.c did not help :( -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Thu Oct 1 08:51:49 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EE9FA0CCEA for ; Thu, 1 Oct 2015 08:51:49 +0000 (UTC) (envelope-from tevans.uk@googlemail.com) Received: from mail-io0-x236.google.com (mail-io0-x236.google.com [IPv6:2607:f8b0:4001:c06::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 06FC11B7A for ; Thu, 1 Oct 2015 08:51:49 +0000 (UTC) (envelope-from tevans.uk@googlemail.com) Received: by iofh134 with SMTP id h134so77716738iof.0 for ; Thu, 01 Oct 2015 01:51:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=/MJnMz4Jj8Ey2BbpbWI9bSFjw99VBt4HSGvhffwr/xw=; b=0Mbn2Czs+1Nct+D6nLWJYkkyZL9T6pIRRRSsBdESV9+Sae0IwfDGpzs1a6z3XI9602 DMRmmjfaruZFYxGfkGSYoKIDBb0Hd6WRAzkX/8Doy1Sp/HLqFmTvnQxh15GhlqCA1ZdU +Q2DON3wSAVpvURN7HvWl8NLkul7HAYts3/Ghaiu1W3uFaurCr7oh9Juq8Y5DO7IQPNC sP+1v03xEQQ7/68BOvrOI/jKA04WGS2lcHAR/h9myaIj7yfELIgtMDubWJ+nJiVVrs40 0jPVuUoPvMfPl9fH1vuybBr+l3CsyeUrwTSasNjbf8HYYkwiSOmvVuRs8yci2FGBTpsO MIug== MIME-Version: 1.0 X-Received: by 10.107.160.143 with SMTP id j137mr10063091ioe.13.1443689508488; Thu, 01 Oct 2015 01:51:48 -0700 (PDT) Received: by 10.107.200.211 with HTTP; Thu, 1 Oct 2015 01:51:48 -0700 (PDT) In-Reply-To: <1443613432.5271.100.camel@data-b104.adm.slu.se> References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <1443613432.5271.100.camel@data-b104.adm.slu.se> Date: Thu, 1 Oct 2015 09:51:48 +0100 Message-ID: Subject: Re: Cannot replace broken hard drive with LSI HBA From: Tom Evans To: =?UTF-8?Q?Karli_Sj=C3=B6berg?= Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 08:51:49 -0000 On Wed, Sep 30, 2015 at 12:43 PM, Karli Sj=C3=B6berg = wrote: > Which version FreeBSD is it running? > 10.1-STABLE (r279893), for no real reason other than I haven't updated to 10.2-STABLE yet. Cheers Tom From owner-freebsd-fs@freebsd.org Thu Oct 1 15:09:29 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0C308A0DB87 for ; Thu, 1 Oct 2015 15:09:29 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C03D119FB; Thu, 1 Oct 2015 15:09:28 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id CD208153416; Thu, 1 Oct 2015 17:09:18 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pts4_7aaLRLF; Thu, 1 Oct 2015 17:09:17 +0200 (CEST) Received: from [IPv6:2001:4cb8:3:1:5e8:47bc:61d1:f590] (unknown [IPv6:2001:4cb8:3:1:5e8:47bc:61d1:f590]) by smtp.digiware.nl (Postfix) with ESMTP id A666C15340A; Thu, 1 Oct 2015 17:09:17 +0200 (CEST) Subject: Re: ZFS files server crash: solaris assert: start < end in trim_map.c To: Andriy Gapon , "freebsd-fs@freebsd.org" References: <560A81EE.7010604@digiware.nl> <560AD801.70307@FreeBSD.org> From: Willem Jan Withagen Organization: Digiware Management b.v. Message-ID: <560D4C93.2030907@digiware.nl> Date: Thu, 1 Oct 2015 17:09:07 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <560AD801.70307@FreeBSD.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 15:09:29 -0000 On 29-9-2015 20:27, Andriy Gapon wrote: > On 29/09/2015 15:19, Willem Jan Withagen wrote: >> Hi, >> >> Just found this after a crash: >> Architecture: amd64 >> Architecture Version: 2 >> Dump Length: 7031291904B (6705 MB) >> Blocksize: 512 >> Dumptime: Tue Sep 29 12:55:01 2015 >> Hostname: zfs.digiware.nl >> Magic: FreeBSD Kernel Dump >> Version String: FreeBSD 10.2-STABLE #2 r287746M: Sun Sep 13 12:33:23 CEST 2015 >> root@zfs.digiware.nl:/home/obj/amd64/usr/srcs/work10/src/sys/ZFS >> Panic String: solaris assert: start < end, file: >> /usr/srcs/work10/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c, >> line: 219 Submitted as: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203473 --WjW From owner-freebsd-fs@freebsd.org Thu Oct 1 16:30:06 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8A5DA0D4C5; Thu, 1 Oct 2015 16:30:06 +0000 (UTC) (envelope-from vrock28@gmail.com) Received: from mail-ob0-x22c.google.com (mail-ob0-x22c.google.com [IPv6:2607:f8b0:4003:c01::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7532B1E1A; Thu, 1 Oct 2015 16:30:06 +0000 (UTC) (envelope-from vrock28@gmail.com) Received: by obcgx8 with SMTP id gx8so61940177obc.3; Thu, 01 Oct 2015 09:30:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=xL+uvJHE0RSQiZVhGh84J6TQ9T3zLgmWpBWbvXq/08g=; b=mFrpdaKgkf2NvduJgSVmfxIA9Fz+FtLUefS9oX+PI4STWc4M348sE+bB0yTxbckD01 1xSIk65XIDn/tHEBDSELQQ1vYBK6HGozkEwctwkCMxcfojADdzkfVzrRxiYq4CnE1Zw+ tmOuOxHlyUbSddSoH6odSDECqls7bVRnACGqItlJ+XnpEky81o+bjAVrlw5W5+/MbrNm FwSMX30+ITq7HeCrc5pjqYnZotvVzB7L/A6r/+8zUdAr5X79WrOFKz/Ml9AnWh/zA+ZT u0rqjGsM4m4XTChcXICOLEONCDZ5fu4ulTLSr5lCGBQxDmxvmwwU/vFqbcuMrSlvsiFi NeXQ== X-Received: by 10.60.23.40 with SMTP id j8mr6926614oef.15.1443717005732; Thu, 01 Oct 2015 09:30:05 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.197.147 with HTTP; Thu, 1 Oct 2015 09:29:26 -0700 (PDT) From: Rakshith Venkatesh Date: Thu, 1 Oct 2015 21:59:26 +0530 Message-ID: Subject: LibCURL in Kernel To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 16:30:06 -0000 Hi, I wanted to know if there is any library which does the job of libCURL in FreeBSD kernel. I know libCURL is a user-space library but was looking for something similar in kernel. Porting is one option but i think it surely will not be a straight forward thing. Any leads on the above query would be great! Thanks, Rakshith From owner-freebsd-fs@freebsd.org Thu Oct 1 16:50:46 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1CC49A0D33F for ; Thu, 1 Oct 2015 16:50:46 +0000 (UTC) (envelope-from kris@nivenly.com) Received: from mail-wi0-f179.google.com (mail-wi0-f179.google.com [209.85.212.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B47401568 for ; Thu, 1 Oct 2015 16:50:45 +0000 (UTC) (envelope-from kris@nivenly.com) Received: by wiclk2 with SMTP id lk2so37358204wic.1 for ; Thu, 01 Oct 2015 09:50:37 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=6jUCzxX0xUB3PSFfCxxeQLxzkxJUcCEXGt+h9TUcFMs=; b=SmWLzg3QTRnkVULzNfTPVgm1sjw8ICsNAXIeJaJfL5WzxxGdqDV++IXX77/kpZFGMb YwFUZegp5uLwY9YazWtnm5hv3zK18xsTHo9ShU7ED3GcfUnmOzNWipM7XppM3LazKxmk Hk/3G/17WDKtIRNRcJkay5mNgLlG2n1jtxitKNy9qiPUZwBqjr3zOjw9NrzVWxmsRMcF dHSYn9A/+VG+JzqqWBgZFsRdbUjX1KSU6RoPitRkbwdCahRJzSF5KFocajLxq9CR6Q2L qtUzUsX3DV9HdCjC3q+I/ZNqExlH3EnvrBom948BZidwQZArUh7uRrpEamVPrYFL19H8 3M3A== X-Gm-Message-State: ALoCoQk9CAmXv0viUQ/KQxdz15+QPPMmWAofkSR7hqG2hPKG03H/r0lwUevDwfPfIaSyR/Vdhi8Q MIME-Version: 1.0 X-Received: by 10.194.178.196 with SMTP id da4mr13657870wjc.41.1443718237794; Thu, 01 Oct 2015 09:50:37 -0700 (PDT) Received: by 10.28.97.70 with HTTP; Thu, 1 Oct 2015 09:50:37 -0700 (PDT) X-Originating-IP: [96.88.83.245] In-Reply-To: References: Date: Thu, 1 Oct 2015 10:50:37 -0600 Message-ID: Subject: Re: LibCURL in Kernel From: Kris November To: Rakshith Venkatesh Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 16:50:46 -0000 I think *libfetch* is the droid you are looking for. https://svnweb.freebsd.org/base/head/lib/libfetch/ On Thu, Oct 1, 2015 at 10:29 AM, Rakshith Venkatesh wrote: > Hi, > > I wanted to know if there is any library which does the job of libCURL in > FreeBSD kernel. I know libCURL is a user-space library but was looking for > something similar in kernel. Porting is one option but i think it surely > will not be a straight forward thing. > > Any leads on the above query would be great! > > > Thanks, > > Rakshith > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-fs@freebsd.org Thu Oct 1 16:55:50 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D40B2A0D780; Thu, 1 Oct 2015 16:55:50 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-wi0-x22c.google.com (mail-wi0-x22c.google.com [IPv6:2a00:1450:400c:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7A7881C99; Thu, 1 Oct 2015 16:55:50 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by wicge5 with SMTP id ge5so38996913wic.0; Thu, 01 Oct 2015 09:55:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=nj7tsj4O8fp49fZ/mFMnKJBcyN/muRij5Hwv2FMzjK8=; b=NoDDetovJHg2i3kzn5S/nAF3hvVWYJu6exy2kVP3eprlmRCQgUahF8+cJtpX4Db62t K4byfOKDRndCORXM9VFYoMD4ZUodT2cL0Ggx1Nfqf8U7aatNXIKFPUDF6CyOJRJuDg0O 6VNTpfWDAsgMG+aKpFvdkDu8p/u7xMVQOd6HW26okmFLjmsGjYcp82qylGmMRP2yOwkJ 8JBOBPqjWpCZAeEHvODgBCAC+znC0BjdDDGeIoOYHyohYxck+EjNsSj2gWE4NYq4mWxV Wvd1vYMLyfxgE/uJEEA3BundkEdMZx7tcQKrk5G1AVaqvqBIyjDxtyL/lftYXcUcMZW8 TlaA== X-Received: by 10.194.87.74 with SMTP id v10mr11148179wjz.114.1443718548976; Thu, 01 Oct 2015 09:55:48 -0700 (PDT) Received: from dft-labs.eu (n1x0n-1-pt.tunnel.tserv5.lon1.ipv6.he.net. [2001:470:1f08:1f7::2]) by smtp.gmail.com with ESMTPSA id gl4sm7029588wjb.29.2015.10.01.09.55.47 (version=TLSv1.2 cipher=RC4-SHA bits=128/128); Thu, 01 Oct 2015 09:55:47 -0700 (PDT) Date: Thu, 1 Oct 2015 18:55:45 +0200 From: Mateusz Guzik To: Rakshith Venkatesh Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: LibCURL in Kernel Message-ID: <20151001165545.GA7491@dft-labs.eu> Mail-Followup-To: Mateusz Guzik , Rakshith Venkatesh , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 16:55:50 -0000 On Thu, Oct 01, 2015 at 09:59:26PM +0530, Rakshith Venkatesh wrote: > Hi, > > I wanted to know if there is any library which does the job of libCURL in > FreeBSD kernel. I know libCURL is a user-space library but was looking for > something similar in kernel. Porting is one option but i think it surely > will not be a straight forward thing. > > Any leads on the above query would be great! > Well, libcurl provides a lot of features. I'm not aware of anything looking even like a simple http client even for Linux and I doubt someone created anything like it. The real question is why would you need such a feature. Handling it entirely in the kernel, while of course possible, likely has 0 benefits in your case. If you are not going to have a real root filesystem you can still fit a small http client on mdroot and use that. -- Mateusz Guzik From owner-freebsd-fs@freebsd.org Thu Oct 1 20:07:00 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23C8CA0DFEF for ; Thu, 1 Oct 2015 20:07:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 10C45128B for ; Thu, 1 Oct 2015 20:07:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t91K6xde074838 for ; Thu, 1 Oct 2015 20:06:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Thu, 01 Oct 2015 20:06:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: op@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 20:07:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #26 from Oliver Pinter --- http://permalink.gmane.org/gmane.os.freebsd.current/165824 #5 0xffffffff8039c391 in zfs_get_data (arg=, lr=, buf=, zio=0xfffff8019eeb1760) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1355 1355 ASSERT(error || lr->lr_length <= zp->z_blksz); (kgdb) l 1350 ASSERT(db->db_offset == offset); 1351 ASSERT(db->db_size == size); 1352 1353 error = dmu_sync(zio, lr->lr_common.lrc_txg, 1354 zfs_get_done, zgd); 1355 ASSERT(error || lr->lr_length <= zp->z_blksz); 1356 1357 /* 1358 * On success, we need to wait for the write I/O 1359 * initiated by dmu_sync() to complete before we can (kgdb) p *lr Cannot access memory at address 0xa5a5a5a5a5a5a5a5 (kgdb) p *zp Cannot access memory at address 0xa5a5a5a5a5a5a5a5 (kgdb) -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Thu Oct 1 20:12:54 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 890C7A0E3C6 for ; Thu, 1 Oct 2015 20:12:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7622F179F for ; Thu, 1 Oct 2015 20:12:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t91KCsk4086341 for ; Thu, 1 Oct 2015 20:12:54 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Thu, 01 Oct 2015 20:12:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gibbs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 20:12:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #27 from Justin T. Gibbs --- (In reply to Oliver Pinter from comment #26) Is there a reason you believe this crash is caused by this bug? -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Thu Oct 1 21:19:33 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E532BA0E036 for ; Thu, 1 Oct 2015 21:19:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D1FEF1982 for ; Thu, 1 Oct 2015 21:19:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t91LJX3Z045661 for ; Thu, 1 Oct 2015 21:19:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Thu, 01 Oct 2015 21:19:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: op@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 21:19:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #28 from Oliver Pinter --- The INVARIANTS implicates the newly added use-after-free checker in UMA. And this explains why this bug gets gone with disabled INVARIANTS. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Thu Oct 1 21:21:48 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CC865A0E33F for ; Thu, 1 Oct 2015 21:21:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B94551D1D for ; Thu, 1 Oct 2015 21:21:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t91LLmq6053704 for ; Thu, 1 Oct 2015 21:21:48 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Thu, 01 Oct 2015 21:21:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gibbs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 21:21:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #29 from Justin T. Gibbs --- (In reply to Oliver Pinter from comment #28) This bug is about a particular assert firing. It is not a catchall for all invariants that fire in ZFS. Please open another bug for your issue. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Thu Oct 1 21:26:06 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AC91BA0E604 for ; Thu, 1 Oct 2015 21:26:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 996DA1EEE for ; Thu, 1 Oct 2015 21:26:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t91LQ6pL058235 for ; Thu, 1 Oct 2015 21:26:06 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Thu, 01 Oct 2015 21:26:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gibbs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 21:26:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #30 from Justin T. Gibbs --- (In reply to Oliver Pinter from comment #28) This bug is about a particular assert firing. It is not a catchall for all invariants that fire in ZFS. Please open another bug for your issue. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Thu Oct 1 21:27:06 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 380CFA0E726 for ; Thu, 1 Oct 2015 21:27:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 24D721F95 for ; Thu, 1 Oct 2015 21:27:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t91LR6X2059172 for ; Thu, 1 Oct 2015 21:27:06 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 202607] [panic] Poudriere umounting file systems causes 'solaris assert: avl_is_empty(&dn->dn_dbufs)' panic Date: Thu, 01 Oct 2015 21:27:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: op@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 21:27:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=202607 --- Comment #31 from Oliver Pinter --- Ahh, sorry ignore my previous comment, here is a little late now. I referred an other ZFS related assert / bug. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Fri Oct 2 04:01:19 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 96C90A0D28B for ; Fri, 2 Oct 2015 04:01:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 82EF314E4 for ; Fri, 2 Oct 2015 04:01:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9241Jnj051705 for ; Fri, 2 Oct 2015 04:01:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 203492] mount_unionfs -o below causes panic Date: Fri, 02 Oct 2015 04:01:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: mfc-stable9? mfc-stable10? X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 04:01:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203492 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Fri Oct 2 04:24:46 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 06247A0E8E7; Fri, 2 Oct 2015 04:24:46 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D495D1100; Fri, 2 Oct 2015 04:24:45 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (ppp121-45-232-234.lns20.per1.internode.on.net [121.45.232.234]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id t924OXfk056783 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Thu, 1 Oct 2015 21:24:36 -0700 (PDT) (envelope-from julian@freebsd.org) Subject: Re: LibCURL in Kernel To: Rakshith Venkatesh , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org References: From: Julian Elischer Message-ID: <560E06FA.3020702@freebsd.org> Date: Fri, 2 Oct 2015 12:24:26 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 04:24:46 -0000 On 10/2/15 12:29 AM, Rakshith Venkatesh wrote: > Hi, > > I wanted to know if there is any library which does the job of libCURL in > FreeBSD kernel. I know libCURL is a user-space library but was looking for > something similar in kernel. Porting is one option but i think it surely > will not be a straight forward thing. > > Any leads on the above query would be great! there was work to write an http daemon using netgraph.. I know that's the opposite side of the same transfer but it does poitn to how it could be done. All the hooks are in place to allow one to write a netgraph node that can attach to netgraph socket nodes. what you would do with the data when you get it is a different thing.. tell us a bit more about your requirements. > > > Thanks, > > Rakshith > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-fs@freebsd.org Fri Oct 2 05:25:40 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6DF5AA0D17D; Fri, 2 Oct 2015 05:25:40 +0000 (UTC) (envelope-from vrock28@gmail.com) Received: from mail-ob0-x231.google.com (mail-ob0-x231.google.com [IPv6:2607:f8b0:4003:c01::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 35A421F2F; Fri, 2 Oct 2015 05:25:40 +0000 (UTC) (envelope-from vrock28@gmail.com) Received: by obbzf10 with SMTP id zf10so74746747obb.2; Thu, 01 Oct 2015 22:25:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ESU6yZo/+5zPif7aSHY8ap5OqtYcaDUVgtBBFeTKk7A=; b=NUAJOgH4SbOTEDPQtjEkIyH/hQj/HK+eNwpLQG/VnCFbM3K4oeD9Dl7ISk7nNkhZFZ 13cPpvDdbTpbKoghV/nGVxim+EWgcA4GGfvhMYigYRG+sbN3VsS+24Zkg/vnuq56YhFl oO3m6+5KA1KtpzYVXDjbTwVJSQ/Qj1FkxaW4Lwm5z7LmEgd9uripBSIOl6ad8plJydom YqvXJy+TfryjbSQZvawKm4Svn8SZ0iD3BCnIf0TIzPpS9MRWjF1lAuaMWjMhnXnB87o4 9G2FG7seJIhVYYXu+QpXvLlW/PWJJLv8+4w/Nxb6qlFtvWDYFqMMaUq/aR1+GskLdWaO ifyg== MIME-Version: 1.0 X-Received: by 10.60.79.193 with SMTP id l1mr8079509oex.60.1443763539546; Thu, 01 Oct 2015 22:25:39 -0700 (PDT) Received: by 10.202.197.147 with HTTP; Thu, 1 Oct 2015 22:25:39 -0700 (PDT) Received: by 10.202.197.147 with HTTP; Thu, 1 Oct 2015 22:25:39 -0700 (PDT) In-Reply-To: <560E06FA.3020702@freebsd.org> References: <560E06FA.3020702@freebsd.org> Date: Fri, 2 Oct 2015 10:55:39 +0530 Message-ID: Subject: Re: LibCURL in Kernel From: Rakshith Venkatesh To: Julian Elischer Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 05:25:40 -0000 I am actually not looking for full curl functionality. My aim is to back up data from native file system to a s3 backend from kernel. I have a very thin userspace where its not straight forward to deploy apps.I saw libs3 and most of the already existing utilities use libcurl library to send Http requests. On 02-Oct-2015 9:54 am, "Julian Elischer" wrote: > On 10/2/15 12:29 AM, Rakshith Venkatesh wrote: > >> Hi, >> >> I wanted to know if there is any library which does the job of libCURL in >> FreeBSD kernel. I know libCURL is a user-space library but was looking for >> something similar in kernel. Porting is one option but i think it surely >> will not be a straight forward thing. >> >> Any leads on the above query would be great! >> > > there was work to write an http daemon using netgraph.. > I know that's the opposite side of the same transfer but it does poitn to > how it could be done. > All the hooks are in place to allow one to write a netgraph node that can > attach to netgraph socket nodes. > what you would do with the data when you get it is a different thing.. > > tell us a bit more about your requirements. > > >> >> Thanks, >> >> Rakshith >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org >> " >> >> > From owner-freebsd-fs@freebsd.org Fri Oct 2 08:24:46 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2DE7AA0C915 for ; Fri, 2 Oct 2015 08:24:46 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B9D0B1EF0 for ; Fri, 2 Oct 2015 08:24:45 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id A8F11153401; Fri, 2 Oct 2015 10:24:39 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VPYAWYzBlj38; Fri, 2 Oct 2015 10:24:18 +0200 (CEST) Received: from [IPv6:2001:4cb8:3:1:f855:6c07:100f:17f4] (unknown [IPv6:2001:4cb8:3:1:f855:6c07:100f:17f4]) by smtp.digiware.nl (Postfix) with ESMTP id 92FDC153465; Fri, 2 Oct 2015 10:24:18 +0200 (CEST) Subject: Re: ZFS, Zvol, iSCSI and windows To: Tom Curry References: <56050EFC.1000303@digiware.nl> <1443179614.5271.42.camel@data-b104.adm.slu.se> <5606EBEA.2090103@digiware.nl> Cc: "freebsd-fs@freebsd.org" From: Willem Jan Withagen Organization: Digiware Management b.v. Message-ID: <560E3F32.5060600@digiware.nl> Date: Fri, 2 Oct 2015 10:24:18 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <5606EBEA.2090103@digiware.nl> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 08:24:46 -0000 On 26-9-2015 21:03, Willem Jan Withagen wrote: > On 25-9-2015 16:05, Tom Curry wrote: >> On Fri, Sep 25, 2015 at 7:13 AM, Karli Sjöberg > > wrote: >> >> fre 2015-09-25 klockan 11:08 +0200 skrev Willem Jan Withagen: >> > Hi, >> > >> > Because of the Network Video Recorder (on windows) we use only likes >> > "real" disks, and not SMB disks. We started using ZVOLs which are >> > exported thru iSCSI/ctld.... >> > >> > And that works really well, so there all thumbs up for this combo. >> > >> > However..... (you knew that was coming) >> > I do have some questions, and hope somebody can share some insights. >> > >> > 1) >> > This is a ZFS question. >> > >> > I have created a ZVOL with: >> > zfs create -s -V 5T zfsraid/nvr2 >> > >> > Looking at the disk usage in 'zfs get all': >> > NAME PROPERTY VALUE SOURCE >> > zfsraid/nvr2 used 9.97T - >> > zfsraid/nvr2 available 438G - >> > zfsraid/nvr2 referenced 9.97T - >> > zfsraid/nvr2 compressratio 1.00x - >> > zfsraid/nvr2 reservation none default >> > zfsraid/nvr2 volsize 5T local >> > zfsraid/nvr2 volblocksize 8K - >> > zfsraid/nvr2 checksum on default >> > zfsraid/nvr2 compression lz4 default >> > zfsraid/nvr2 primarycache all default >> > zfsraid/nvr2 secondarycache all default >> > zfsraid/nvr2 usedbysnapshots 0 - >> > zfsraid/nvr2 usedbydataset 9.97T - >> > zfsraid/nvr2 usedbychildren 0 - >> > zfsraid/nvr2 usedbyrefreservation 0 - >> > zfsraid/nvr2 sync standard default >> > zfsraid/nvr2 written 9.97T - >> > zfsraid/nvr2 logicalused 4.97T - >> > zfsraid/nvr2 logicalreferenced 4.97T - >> > zfsraid/nvr2 volmode default default >> > >> > And what sort of "worries" me is that it seems that this volume is >> using >> > twice the amount of diskspace it is offering as ZVOL? >> > >> > a) Is this really true? >> > b) Should I have done something different to not waste so much >> overhead? >> > >> > Note that the compression rate is 1.00x, which is of course due to >> > writing h264 media streams that do not compress at all. But is the >> > parents default, and I haven't turned it off. >> > >> > 2) >> > The second one might be more a Windows question, but anyways. >> > >> > The export is that same 5T ZVOL, plain create with >> > zfs create -s -V 5T zfsraid/nvr2 >> > Under Windows I used the regular stuff to format the dis with GPT and >> > NTFS with 8k segments. (matching the ZVOL blocksize) >> > >> > Upon reboot FreeBSD notices the following: >> > GEOM_PART: partition 1 on (zvol/zfsraid/nvr2, GPT) is not aligned on >> > 8192 bytes >> > By itself not technical problem. But the warning does hint that the >> > alignment is thus, that performance might suffer. the backing >> disks are >> > WD REDs which are 4K sectors.... So the misalignment could cause too >> > many read/writes for writing. >> > >> > Does anybody have a clue as how to get Windows to do the aligning >> correctly? >> >> >> Is it this effect you are seeing: >> https://forums.freebsd.org/threads/mitigating-4k-disk-issues-on-raidz.37365/ > > The article attributes certain issues to using 4k blocks zvols in zraid. > It could very well be on the money. But it seems testing is the best way > to find out. > >> >> I ran into the same problem, the solution was to create the zvol with a >> larger volblocksize like 32k. If space efficiency is the primary concern >> I believe you need to choose a blocksize that is greater than or equal >> to the number of non parity drives multiplied by their sector size. >> Judging by your overhead I'm going to assume you have a 6 disk raidz2, >> so 4 * 4k = 16k at least. Try creating another zvol with "-o >> volblocksize=16k" and see how that treats you. > > Right guess, > > Actually the it is a 2* 6 vol raidz2 > > THe article seems to show that the overhead gets less and less when the > blocksize increases. > In which case I start worrying about the performance, because writting > smaller blocks will require a read/wite cycle. > > In my specific case I'm writing large video files (5Gb) in streaming > mode, so the read/write effect will be mitigated due to streaming. > > I'll go and make a few ZVOLS and see what happens with the overhead when > they start filling up. But it looks like the windows blocksize should > certainly not match zvol blocksize. > >> As to your second question, modern versions of windows should align >> partitions correctly, what version are you using? You may wish to open >> an elevated command prompt and sanity check the output of "fsutil fsinfo >> ntfsinfo x:" > > I'm just loading the disk in explorer, rightclick it, and then format. > Just as basic as that. > Not sure what to make of it, but this gives: > > C:\WINDOWS\system32>fsutil fsinfo ntfsinfo m: > NTFS Volume Serial Number : 0x2aaa50b8aa50826d > NTFS Version : 3.1 > LFS Version : 2.0 > Number Sectors : 0x000000027ffbefff > Total Clusters : 0x0000000027ffbeff > Free Clusters : 0x00000000008497fc > Total Reserved : 0x00000000000a8ec0 > Bytes Per Sector : 512 > Bytes Per Physical Sector : 4096 > Bytes Per Cluster : 8192 > Bytes Per FileRecord Segment : 1024 > Clusters Per FileRecord Segment : 0 > Mft Valid Data Length : 0x0000000000140000 > Mft Start Lcn : 0x0000000000060000 > Mft2 Start Lcn : 0x0000000000000001 > Mft Zone Start : 0x00000000000600a0 > Mft Zone End : 0x0000000000066420 > Max Device Trim Extent Count : 4294967295 > Max Device Trim Byte Count : 0xffffffff > Max Volume Trim Extent Count : 62 > Max Volume Trim Byte Count : 0x40000000 > Resource Manager Identifier : FD836E1F-1372-11E5-825F-000272131F3C > > The gpart info in the zvol is reported as unaligned when booting > FreeBSD, but that would be because windows put it in there in an > unaligned postition. Something like at 63 * 512 bytes...?? > > Any commandline incarnation that allows me to put it a a different offset? > >> > >> Finally, from my own experience with using iscsi under windows I >> found I had a random 4k iops increase from ~10,000 to ~90,000 (which >> is close to my pools real speed) by adjusting the following registry >> key > > >> Create this DWORD key with a value of 1: >> HKLM\SYSTEM\CurrentControlSet\Control\Class\{4D36E97B-E325-11CE-BFC1-08002BE10318}\> Number>\Parameters\iSCSIDisableNagle > > Very usefull hint, thanx for that. And as a followup, I created a new ZVOL: zfs create -V 2T -b 128k -o compression=off zfsraid/nvr That gives: NAME PROPERTY VALUE SOURCE zfsraid/nvr used 2.00T - zfsraid/nvr referenced 1.86T - zfsraid/nvr compressratio 1.00x - zfsraid/nvr reservation none default zfsraid/nvr volsize 2T local zfsraid/nvr volblocksize 128K - zfsraid/nvr checksum on default zfsraid/nvr compression off local zfsraid/nvr refreservation 2.00T local zfsraid/nvr usedbysnapshots 0 - zfsraid/nvr usedbydataset 1.86T - zfsraid/nvr usedbychildren 0 - zfsraid/nvr usedbyrefreservation 150G - zfsraid/nvr written 1.86T - zfsraid/nvr logicalused 1.86T - zfsraid/nvr logicalreferenced 1.86T - And if there is any overhead, it does not really show here. So the moral of the story: It is not always wise to match NTFS blocksize with the ZVOL blocksize. As for possible performance penalties on the Windows side.... It is hard to find a niche and sensible disk tester. Using the error scanner from HDtune, performance has dropped a tiny bit. I'm seeing a 1000 IOPS and 30Mbyte/sec of throuput. This is on a 2* vdev 6* disk raidz2 volume. --WjW From owner-freebsd-fs@freebsd.org Fri Oct 2 12:46:58 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A3504A0C76D for ; Fri, 2 Oct 2015 12:46:58 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 667AC1C23 for ; Fri, 2 Oct 2015 12:46:58 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 382B8153416; Fri, 2 Oct 2015 14:46:52 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5NgJxQs3ZRhw; Fri, 2 Oct 2015 14:46:51 +0200 (CEST) Received: from [IPv6:2001:4cb8:3:1:f855:6c07:100f:17f4] (unknown [IPv6:2001:4cb8:3:1:f855:6c07:100f:17f4]) by smtp.digiware.nl (Postfix) with ESMTP id 42634153418; Fri, 2 Oct 2015 14:46:51 +0200 (CEST) Subject: Re: ZFS, Zvol, iSCSI and windows and mostly readonly To: Tom Curry References: <56050EFC.1000303@digiware.nl> <1443179614.5271.42.camel@data-b104.adm.slu.se> <5606EBEA.2090103@digiware.nl> Cc: "freebsd-fs@freebsd.org" From: Willem Jan Withagen Organization: Digiware Management b.v. Message-ID: <560E7CBA.7080807@digiware.nl> Date: Fri, 2 Oct 2015 14:46:50 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <5606EBEA.2090103@digiware.nl> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 12:46:58 -0000 On 26-9-2015 21:03, Willem Jan Withagen wrote: > On 25-9-2015 16:05, Tom Curry wrote: >> On Fri, Sep 25, 2015 at 7:13 AM, Karli Sjöberg > > wrote: >> >> fre 2015-09-25 klockan 11:08 +0200 skrev Willem Jan Withagen: >> > Hi, >> > >> > Because of the Network Video Recorder (on windows) we use only likes >> > "real" disks, and not SMB disks. We started using ZVOLs which are >> > exported thru iSCSI/ctld.... >> > >> > And that works really well, so there all thumbs up for this combo. Since this data is mainly write-only, and only to be read when old data needs to be reviewed. Which is hardly ever.... Do I, can I do, or should I do, something about that data going into ARC or cache? zfsraid/nvr primarycache all default zfsraid/nvr secondarycache all default With that I mean it only needs to go to disk, until it is deleted about 30 days later, in the time in between the data is not accessed. Now I have the idea that it goes into ARC and puts presure on memory that could be used for other things? --WjW From owner-freebsd-fs@freebsd.org Fri Oct 2 16:32:26 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA801A0EAEE; Fri, 2 Oct 2015 16:32:26 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x22a.google.com (mail-io0-x22a.google.com [IPv6:2607:f8b0:4001:c06::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 88DAC1C67; Fri, 2 Oct 2015 16:32:26 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iofh134 with SMTP id h134so126067102iof.0; Fri, 02 Oct 2015 09:32:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=HDSgyYvcM5zEyW+SKp9k5CKXsps2qBaVBnM8Dwj7cBM=; b=FYbsF1B7BZyAH+hTnCILfgNVllil/L3a+EjgA1BmrbWOMV95u+xcByJb+nZCtYbVPY vWVCn/hvXL8ApccbGy7YtIBupW2qUUDVutWWr3qeLQ7RselfYLpsEv/SkxzuuZy7+jrE ke2EGnhtoW9T/3Py7jRUJ47Hk/jkxP/e2GcJcThsZKcu8kfGZNDdrJWIgkEeMyUq6VOF 29RKzMIeqKnSBaoYfbIKxs5KppuSsaiQ3v5anXPJKjFn27Q49kAfAd1N/aqlYE+a7ASu fuGBP7rsoRDapg5s2U/kzqulkzw3NMB6z9kcxvRwUqtJP45OX5XOpOyXGh00lZkIhzqx u0Dg== MIME-Version: 1.0 X-Received: by 10.107.35.78 with SMTP id j75mr16744916ioj.123.1443803545994; Fri, 02 Oct 2015 09:32:25 -0700 (PDT) Received: by 10.36.46.15 with HTTP; Fri, 2 Oct 2015 09:32:25 -0700 (PDT) In-Reply-To: References: <560E06FA.3020702@freebsd.org> Date: Fri, 2 Oct 2015 09:32:25 -0700 Message-ID: Subject: Re: LibCURL in Kernel From: Adrian Chadd To: Rakshith Venkatesh Cc: Julian Elischer , FreeBSD Filesystems , "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 16:32:26 -0000 I tried this a long time ago (don't ask.) The biggest gotchas: * the socket code wasn't as nice to use from kernel land as it is today; and * the existing http libraries out there mostly expect you have infinite stack space, which in kernel land you don't. :( I eventually had the company allow me to write my own thin HTTP client layer in kernel space to do it, because trying to leverage an existing one ended up causing constant panics due to the stack space thing. -adrian On 1 October 2015 at 22:25, Rakshith Venkatesh wrote: > I am actually not looking for full curl functionality. My aim is to back up > data from native file system to a s3 backend from kernel. I have a very > thin userspace where its not straight forward to deploy apps.I saw libs3 > and most of the already existing utilities use libcurl library to send Http > requests. > On 02-Oct-2015 9:54 am, "Julian Elischer" wrote: > >> On 10/2/15 12:29 AM, Rakshith Venkatesh wrote: >> >>> Hi, >>> >>> I wanted to know if there is any library which does the job of libCURL in >>> FreeBSD kernel. I know libCURL is a user-space library but was looking for >>> something similar in kernel. Porting is one option but i think it surely >>> will not be a straight forward thing. >>> >>> Any leads on the above query would be great! >>> >> >> there was work to write an http daemon using netgraph.. >> I know that's the opposite side of the same transfer but it does poitn to >> how it could be done. >> All the hooks are in place to allow one to write a netgraph node that can >> attach to netgraph socket nodes. >> what you would do with the data when you get it is a different thing.. >> >> tell us a bit more about your requirements. >> >> >>> >>> Thanks, >>> >>> Rakshith >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org >>> " >>> >>> >> > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Fri Oct 2 16:47:19 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 66753A0D6E2 for ; Fri, 2 Oct 2015 16:47:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5222D1DC5 for ; Fri, 2 Oct 2015 16:47:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t92GlJol022609 for ; Fri, 2 Oct 2015 16:47:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 203492] mount_unionfs -o below causes panic Date: Fri, 02 Oct 2015 16:47:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mwlucas@michaelwlucas.com X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: mfc-stable9? mfc-stable10? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Oct 2015 16:47:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203492 --- Comment #1 from mwlucas@michaelwlucas.com --- Just tried this on 10.1-R. Cannot reproduce there. Apparently a current-only thing. But I say this book targets 10+, and there is no 11.0-R, so at least I can keep writing. ;-) -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Sat Oct 3 11:10:54 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F5E6A0E6F5 for ; Sat, 3 Oct 2015 11:10:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8C5A918E0 for ; Sat, 3 Oct 2015 11:10:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t93BAsdc013269 for ; Sat, 3 Oct 2015 11:10:54 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 193803] fix zvol rename failing due to out of order locking Date: Sat, 03 Oct 2015 11:10:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: krichy@cflinux.hu X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Oct 2015 11:10:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193803 krichy@cflinux.hu changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |krichy@cflinux.hu --- Comment #36 from krichy@cflinux.hu --- Created attachment 161674 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=161674&action=edit deadlocking testcase -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Sat Oct 3 11:11:46 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C53C0A0E919 for ; Sat, 3 Oct 2015 11:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B29641C32 for ; Sat, 3 Oct 2015 11:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t93BBk2F016522 for ; Sat, 3 Oct 2015 11:11:46 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 193803] fix zvol rename failing due to out of order locking Date: Sat, 03 Oct 2015 11:11:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: krichy@cflinux.hu X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Oct 2015 11:11:46 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193803 --- Comment #37 from krichy@cflinux.hu --- Unfortunately deadlock can still occur running the attached deadlocking testcase script. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-fs@freebsd.org Sat Oct 3 23:49:25 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23060A0EF03 for ; Sat, 3 Oct 2015 23:49:25 +0000 (UTC) (envelope-from thomasrcurry@gmail.com) Received: from mail-ig0-x229.google.com (mail-ig0-x229.google.com [IPv6:2607:f8b0:4001:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E1F5B1D4B for ; Sat, 3 Oct 2015 23:49:24 +0000 (UTC) (envelope-from thomasrcurry@gmail.com) Received: by igcrk20 with SMTP id rk20so39679138igc.1 for ; Sat, 03 Oct 2015 16:49:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=EnPeJjIqapDULhg3XJYkFOv0VInaqE2lGms1VKw3eXg=; b=0vPH9FoN0OPRdiP/BYeGqotdclFmuILoMHiRc/6RRwEuU5KUGpdofyhjfTpyANt5fy 28zNQk7TH2oQ1Fs5povx2Q0kkcYKfrx/JUtQMqAxOa7S6DyJJilg5/CdgdWAQzMEAUMO +VAJSBbLqMVc7uPU5Y13BUwa1ZN89LxN6BjrujRxPebLNRubOedoEMKrxYOaIL8++hxg m50vm0VPPTyFPYbeZaK5zknj0Yxby81VDFTMO1KI9KrTqPVREd7hJbg0xKmoA/znqpk8 ztM/eL3406LaBHM/b3B14vN6olgtiWiuoVSvJZUI+vvXonclFvpvg9qOPJIO4k8KGXYs 9Dxw== MIME-Version: 1.0 X-Received: by 10.50.62.46 with SMTP id v14mr3761202igr.79.1443916163687; Sat, 03 Oct 2015 16:49:23 -0700 (PDT) Received: by 10.107.4.72 with HTTP; Sat, 3 Oct 2015 16:49:23 -0700 (PDT) In-Reply-To: <560E3F32.5060600@digiware.nl> References: <56050EFC.1000303@digiware.nl> <1443179614.5271.42.camel@data-b104.adm.slu.se> <5606EBEA.2090103@digiware.nl> <560E3F32.5060600@digiware.nl> Date: Sat, 3 Oct 2015 19:49:23 -0400 Message-ID: Subject: Re: ZFS, Zvol, iSCSI and windows From: Tom Curry To: Willem Jan Withagen Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Oct 2015 23:49:25 -0000 On Fri, Oct 2, 2015 at 4:24 AM, Willem Jan Withagen wrote: > > So the moral of the story: > It is not always wise to match NTFS blocksize with the ZVOL blocksize. > > As for possible performance penalties on the Windows side.... > It is hard to find a niche and sensible disk tester. > > Using the error scanner from HDtune, performance has dropped a tiny bit. > I'm seeing a 1000 IOPS and 30Mbyte/sec of throuput. > This is on a 2* vdev 6* disk raidz2 volume. > > --WjW > Well if space efficiency is the goal then the moral of the story should be when using a fixed block/stripe size (as is the case with a zvol) make sure the size is at least as large as the sum of all non parity/mirror disks in a vdev. I think this holds true for any vdev configuration, be it a stripe, mirror or parity. As for the NTFS cluster size, in my travels I haven't been able to notice any real performance or efficiency difference when changing the cluster size. Perhaps a little variance at extremes, but nothing worth getting excited over.