From owner-freebsd-fs@freebsd.org Mon Apr 23 18:55:02 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7E1AFFA95A2 for ; Mon, 23 Apr 2018 18:55:02 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D74968DA2 for ; Mon, 23 Apr 2018 18:55:02 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w3NIt1AD030173 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Mon, 23 Apr 2018 14:55:01 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w3NIsxcW054940; Mon, 23 Apr 2018 14:54:59 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: ctl_isc_lun_sync: Received conflicting HA LUN To: Mikhail Zakharov Cc: "freebsd-fs@freebsd.org" References: <4cb4aa83-bd49-0c20-4e41-c11c682b0570@sentex.net> <1e1e7cd5-0797-c168-fbce-a36edc6a432e@sentex.net> <14CC6AF1-C1AB-48D2-925D-A46989AD7B3C@yahoo.com> From: Mike Tancsa Openpgp: preference=signencrypt Organization: Sentex Communications Message-ID: <1d4a2171-d083-9e37-954c-cf58ed2c2982@sentex.net> Date: Mon, 23 Apr 2018 14:54:59 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <14CC6AF1-C1AB-48D2-925D-A46989AD7B3C@yahoo.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2018 18:55:02 -0000 On 4/23/2018 1:41 PM, Mikhail Zakharov wrote: > > You have different Lun0 definitions in ctl.conf: check path > /dev/zvol/tank1/v1 vs path /dev/zvol/zroot/v1 as well as different > device-ids. These values should describe the same “drive” in both > configuration, are you sure if it’s the same disk? :) Hi, I guess I am misunderstanding it. The ctl.conf is on 2 different servers, so they are two different disks. What I am hoping to achieve is sort of like a HAST setup. So that if server-a dies, server-b takes over So on server a) I did zfs create -V 80G zroot/v1 and on server b) I did zfs create -V 80G tank1/v1 However, in order for the files to be identical, I used the slower disks on b) so that the path statement is identical. But should this matter ? a) # cat /etc/ctl.conf debug 1 portal-group pg0 { discovery-auth-group no-authentication listen 192.168.242.6 listen 192.168.79.1 } target iqn.2018-01.ca.sentexcloud1:target0 { auth-group no-authentication portal-group pg0 lun 1 { backend block path /dev/zvol/tank1/v2 blocksize 4096 device-id MULTI serial 20180423 } } b) # cat /etc/ctl.conf debug 1 portal-group pg0 { discovery-auth-group no-authentication listen 192.168.79.2 listen 192.168.242.11 } target iqn.2018-01.ca.sentexcloud1:target0 { auth-group no-authentication portal-group pg0 lun 1 { backend block path /dev/zvol/zroot/v2 blocksize 4096 device-id MULTI serial 20180423 } } > > WBR, > Mike > > 23 апр. 2018 г., в 20:11, Mike Tancsa > написал(а): > >> On 4/23/2018 12:59 PM, Mikhail Zakharov wrote: >>> Hello Mike, >>> >>> Thank you for your interest to my paper. I appreciate it very much! >>> Your error may be a consequence of the initial HA misconfiguration. >>> What is in your /boot/loader.conf? Although the described config is >>> quite simple, I can recheck the instruction in my paper in a couple >>> of weeks only, unfortunately I’m on vacation right now. >> >> Hi, >>    Config is pretty well copied from your article. Thanks for responding, >> and have a good holiday! >> >> a) >> kern.geom.label.disk_ident.enable="0" >> kern.geom.label.gptid.enable="0" >> vfs.zfs.min_auto_ashift=12 >> zfs_load="YES" >> t5fw_cfg_load="YES" >> if_cxgbe_load="YES" >> vm.pmap.pti=0 >> vfs.zfs.arc_max=22161185792 >> ctl_load="YES" >> iscsi_load="YES" >> cfiscsi_load="YES" >> kern.cam.ctl.ha_id=1 >> kern.cam.ctl.ha_mode=2 >> kern.cam.ctl.ha_role=0 >> >> b) >> kern.geom.label.disk_ident.enable="0" >> kern.geom.label.gptid.enable="0" >> vfs.zfs.min_auto_ashift=12 >> zfs_load="YES" >> console="comconsole,vidconsole" >> comconsole_speed="115200"       # Set the current serial console speed >> comconsole_port="0x2f8" >> ipmi_load="YES" >> ctl_load="YES" >> cfiscsi_load="YES" >> iscsi_load="YES" >> kern.cam.ctl.ha_id=2 >> kern.cam.ctl.ha_mode=2 >> kern.cam.ctl.ha_role=1 >> >> >> >> >> >> a) >> # cat /etc/ctl.conf >> debug 1 >> portal-group pg0 { >>    discovery-auth-group no-authentication >>    listen 192.168.242.6 >>    listen 192.168.79.1 >> } >> >> target iqn.2018-01.ca.sentexcloud1:target0 { >>    auth-group no-authentication >>    portal-group pg0 >> >>    lun 0 { >>            backend block >>            path /dev/zvol/tank1/v1 >>            blocksize 4096 >>            device-id MULTI >>            serial 20180423 >>    } >> } >> >> b) >> }# cat /etc/ctl.conf >>    debug 1 >> portal-group pg0 { >>    discovery-auth-group no-authentication >>    listen 192.168.79.2 >>    listen 192.168.242.11 >> } >> >> target iqn.2018-01.ca.sentexcloud1:target0 { >>    auth-group no-authentication >>    portal-group pg0 >> >>    lun 0 { >>            backend block >>            path /dev/zvol/zroot/v1 >>            blocksize 4096 >>            device-id FBSDMULTI >>            serial 20180423 >>    } >> } >> >> a) >> # cat start.sh >> sysctl -w kern.cam.ctl.ha_peer="listen 192.168.79.1:7777" >> sysctl -w kern.iscsi.fail_on_disconnection=1 >> /etc/rc.d/ctld onestart >> >> b) >> # cat start.sh >> sysctl -w kern.cam.ctl.ha_peer="connect 192.168.79.1:7777" >> sysctl -w kern.iscsi.fail_on_disconnection=1 >> /etc/rc.d/ctld onestart >> >> -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada