From owner-freebsd-stable@FreeBSD.ORG Tue Mar 29 22:52:39 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC9CA106564A for ; Tue, 29 Mar 2011 22:52:39 +0000 (UTC) (envelope-from telbizov@gmail.com) Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id 889C28FC13 for ; Tue, 29 Mar 2011 22:52:39 +0000 (UTC) Received: by qyk27 with SMTP id 27so620965qyk.13 for ; Tue, 29 Mar 2011 15:52:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=oobO/jDJeGIpbUmb043T99ciGL8ZB6Di6OuMiaoDaOU=; b=YPURDzqrlOBL+XGDemIEGqeX56OKUDLqcoPUSFoKCiCWMhIw8HDO6XJUBflYZ3NVvv LL2wmUbUxoKhGsQJuOb2mOvCsmVCuUePvIrOC1NYLKlS5ia5LM9EXKWAbNDr55HkOElK alGebl6x8Ho3rUg1RcJmpCQn4lCFoYO7etzoo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=saDCv85ZwIesTz8ucifwHM4MEI7oUqbuNkkgAuXS63uL2QgvSKHq2SX6S7eEFM2xEq KSKQsfli7+b5ImwfIvb8NP8CbNiv/ffugHSiQvPSPBmoAxMFHvMaZuQvqGIEVPaWndGq M+qKXy2WYwXY9xPM6LzIxM28xDzgu8K1wfHl4= MIME-Version: 1.0 Received: by 10.229.71.77 with SMTP id g13mr386213qcj.116.1301437469795; Tue, 29 Mar 2011 15:24:29 -0700 (PDT) Received: by 10.229.225.4 with HTTP; Tue, 29 Mar 2011 15:24:29 -0700 (PDT) In-Reply-To: <1301397421.11113.250.camel@pcdenny> References: <1301397421.11113.250.camel@pcdenny> Date: Tue, 29 Mar 2011 15:24:29 -0700 Message-ID: From: Rumen Telbizov To: Denny Schierz Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: stable@freebsd.org Subject: Re: way for failover zpool (no HAST needed) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Mar 2011 22:52:39 -0000 Hi Denny, Although I haven't fully implemented this yet I was thinking of a failover system based on carp + ifstated (/usr/ports/net/ifstated). ifstated will allow you to execute stuff on events like the carp interface becoming the master/backup. As a side note I'd suggest that you consider using something like IPMI to shutdown power on the remote node when you take over/import the zpool. At least this was my biggest fear - getting into a splitbrain and both nodes using the pool. I was even thinking of telneting to the APC PDUs and shutting down ports ;) Anyway I hope this is a useful idea. Very interested of what others have done to implement a redundant/failover ZFS solution. Cheers, Rumen Telbizov On Tue, Mar 29, 2011 at 4:17 AM, Denny Schierz wrote: > hi, > > my two nodes are running fine with 8.2-stable and the LSI 9200-8e and > now, I want to build a failover for the Zpool (and later ISCSI target) > > Both nodes are connected to the same disks (jbod) and now I need a way, > to get the zpool(s) running on the node with the CARP public IP. > > I found something about carp, hooks, devd etc. pp. My first thought was: > > carp -> hook -> zpool import -> devd -> ISCSI target up > > Problem HostA: no network: > > carp -> hook -> zpool export -> devd -> ISCSI target down -> OK > > Back to master shouldn't be a problem, I think ... > > > Problem HostA: power off: > > carp -> hook -> zpool import -> devd -> ISCSI target up -> OK > > But a bad problem could be: > > Problem HostA: SAS Cntrl/cabel problem: > > carp is up and running ..., no reason to failover to slave ... -> bad > > So, I mean, I have to use devd who takes notes, that the /dev/da* disks > are gone or inaccessible and inform carp or shutdown the network > interface to force carp switching over to slave. > > So any hints are welcome :-) > > If it works, I will write a howto for that one :-) > > cu denny > > > -- Rumen Telbizov http://telbizov.com