From owner-freebsd-scsi@freebsd.org Sun Aug 7 14:51:00 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3720ABB1F0D for ; Sun, 7 Aug 2016 14:51:00 +0000 (UTC) (envelope-from armando.goff@creb.com.br) Received: from hm4319.locaweb.com.br (hm4319.locaweb.com.br [186.202.9.66]) by mx1.freebsd.org (Postfix) with ESMTP id 87AC21910 for ; Sun, 7 Aug 2016 14:50:57 +0000 (UTC) (envelope-from armando.goff@creb.com.br) x-locaweb-id: 4fShvlag2LjyRl6kjDccqOGOAKF_juuB9A6NVAanf2KYB0xjiAllKAJMOjuuobMqT7dpuxhuWHu8HJspcs14CF_s_MwCXDUI-iJ3ZWvPrhsPhz9FXb0s5WPyqnm2ORieDYz4fSkmXg_N0orW8_t26TpJxu51Y4Q4xBLo-ILsO7qgSPg6r8LG3c-Yv8wvxdepuL__U9jdLal47DJA7efZNw== NjE3MjZkNjE2ZTY0NmYyZTY3NmY2NjY2NDA2MzcyNjU2MjJlNjM2ZjZkMmU2Mjcy Received: from hm2820.locaweb.com.br (hm2820.locaweb.com.br [187.45.193.229]) by hm4319.locaweb.com.br (Postfix) with ESMTP id 7900B50601670 for ; Sun, 7 Aug 2016 11:50:50 -0300 (BRT) Received: by hm2820.locaweb.com.br (Postfix, from userid 61384) id 6F7BE788108; Sun, 7 Aug 2016 11:50:50 -0300 (BRT) X-Locaweb-ID: 63325679646D56794F69426F625449344D6A41734948567A5A584A755957316C4F69426A636D56694D513D3D To: freebsd-scsi@freebsd.org Subject: Courier was unable to deliver the parcel, ID00619474 X-PHP-Script: creb.com.br/post.php for 213.251.184.93, 213.251.184.93 Date: Sun, 7 Aug 2016 11:50:50 -0300 From: "FedEx International Next Flight" Reply-To: "FedEx International Next Flight" Message-ID: <9c5b1fdcfa1dde265e04aebe3956a6f2@creb.com.br> X-Priority: 3 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Aug 2016 14:51:00 -0000 Dear Customer, Courier was unable to deliver the parcel to you. You can review complete details of your order in the find attached. Sincerely, Armando Goff, Sr. Operation Manager. From owner-freebsd-scsi@freebsd.org Mon Aug 8 12:45:02 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3494ABA9B9B for ; Mon, 8 Aug 2016 12:45:02 +0000 (UTC) (envelope-from rboro350@res192.servconfig.com) Received: from res192.servconfig.com (res192.servconfig.com [23.235.211.167]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1EC531458 for ; Mon, 8 Aug 2016 12:45:01 +0000 (UTC) (envelope-from rboro350@res192.servconfig.com) Received: from rboro350 by res192.servconfig.com with local (Exim 4.86_1) (envelope-from ) id 1bWjdr-0001jt-GW for freebsd-scsi@freebsd.org; Mon, 08 Aug 2016 05:26:51 -0700 To: freebsd-scsi@freebsd.org Subject: Unable to deliver your item, #0000610532 X-PHP-Script: rboro.org/post.php for 24.213.181.170 Date: Mon, 8 Aug 2016 05:26:51 -0700 From: "FedEx International Economy" Reply-To: "FedEx International Economy" Message-ID: X-Priority: 3 MIME-Version: 1.0 X-OutGoing-Spam-Status: No, score=0.0 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - res192.servconfig.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [4515 498] / [47 12] X-AntiAbuse: Sender Address Domain - res192.servconfig.com X-Get-Message-Sender-Via: res192.servconfig.com: authenticated_id: rboro350/from_h X-Authenticated-Sender: res192.servconfig.com: justin.ellis@rboro.org X-Source: X-Source-Args: X-Source-Dir: Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Aug 2016 12:45:02 -0000 Dear Customer, We could not deliver your item. Shipment Label is attached to this email. Sincerely, Justin Ellis, Sr. Station Agent. From owner-freebsd-scsi@freebsd.org Wed Aug 10 17:13:29 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91D8FBB5B4B for ; Wed, 10 Aug 2016 17:13:29 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x242.google.com (mail-wm0-x242.google.com [IPv6:2a00:1450:400c:c09::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 287F718D8 for ; Wed, 10 Aug 2016 17:13:29 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x242.google.com with SMTP id i138so10768160wmf.3 for ; Wed, 10 Aug 2016 10:13:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-transfer-encoding:subject:message-id:date:to :mime-version; bh=g2IHwpYiS0admtHqMsHI1feCD6TiUsGq+w4flhbyJEk=; b=ZGFu3fYECaYLzhQJDsiw1/pFAlIy58E4zxDWYlWCCX70fDiRSeuKsyyCojfF7tZECc ED33MLn226PmmiPp9SOYNFCFE8N0vJvlQA91CP5B/+t+nYnPeUYnyS+xmB0sOjDuEZpO wPTBYrozLzO4rzcZqRwt2xpIuz8rc45CNYRZBn4Lzn1nEcqLha+rrpAu4NjakVd0XIXw jyu1eHwgNElXUsFa5AW4lTgcpOSnhq/SF3I8WL4UvPLYFyOjWDMVdz6riwcHBUrwZ/VC bH/r6tUN3IPlbXYRiJ/V2GpCxBCQHmaTHDVCDvrwfw+LznhT2Ah3mYakr+7JGTWI+qx/ qUNQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:content-transfer-encoding:subject :message-id:date:to:mime-version; bh=g2IHwpYiS0admtHqMsHI1feCD6TiUsGq+w4flhbyJEk=; b=i/J8G6xeyyxsfrsiKY2SQwvSY5c22rLGKyY9Ec7EWdGLtGXCk7ERQoPUmLX6brXwFb erNPnGav7C5aWlimmRS3NAani1f4I0nJxltbJZiR0KYtZX+hno0RKrFBfJaDhXMNA0Rk gMi3Km4N1iN96b7TfvCtisfsv6F/m1helIA0CovOxamqBTe6LHcHdXH2uyjW0zrMQ1ix 3CuUsVtj3kUzSrF/+FIU/379Hc3iruemll1Qqc2azAPfnVqQEpUZB6Z6Db9y16od8lkH pwJHTehca6Z71i3zEA7VKj9JYpsCX30q2WuEt4AEhRkTedfTewrgK90IF+d9P9racwXc b6PA== X-Gm-Message-State: AEkoouvz05VUEc6202hxgYULob7XpRkcTnYlWD0jcoO/Gm6XJ3F74oaALTZyBQPBA4uOEA== X-Received: by 10.28.37.71 with SMTP id l68mr4691193wml.50.1470849207502; Wed, 10 Aug 2016 10:13:27 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id f10sm43891040wje.14.2016.08.10.10.13.26 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 10 Aug 2016 10:13:26 -0700 (PDT) From: Ben RUBSON Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Help to make iSER working Message-Id: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> Date: Wed, 10 Aug 2016 19:13:25 +0200 To: freebsd-scsi@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Aug 2016 17:13:29 -0000 Hello, I have some difficulties to make iSER (FreeBSD 11 BETA3) working. ### My configuration : 2 servers with Mellanox ConnectX-3 NICs. ### What I did : I rebuilt kernel adding the following to GENERIC : options OFED device mlxen options COMPAT_LINUXKPI I built iser : cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser (I saw later-on that I could have used "device iser" in kernel = configuration) My /etc/ctl.conf : portal-group pg0 { discovery-auth-group no-authentication listen 192.168.2.2 offload iser } target iqn.2012-06.com.test:target1 { auth-group no-authentication portal-group pg0 alias my-iser-disk lun 0 { path /dev/da8 } } ### Error : As soon as I do the following : iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 I get this error : iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument iscsid[655]: child process 1187 terminated with exit status 1 "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet is = sent at all when trying to connect. Did I miss something ? Many thanks ! Ben From owner-freebsd-scsi@freebsd.org Wed Aug 10 21:07:00 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13A46BB5542 for ; Wed, 10 Aug 2016 21:07:00 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x242.google.com (mail-wm0-x242.google.com [IPv6:2a00:1450:400c:c09::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9B3911A33 for ; Wed, 10 Aug 2016 21:06:59 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x242.google.com with SMTP id i138so11950546wmf.3 for ; Wed, 10 Aug 2016 14:06:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=h7h6yZb3ZyArsdrKg0jZlLGkAf4dHz//bFh0u0gN5+M=; b=zuILChX7CGC4bgI4gJYsKuzhC7unZ791XD3QCv50ckzul8b+aeYJBwD6oHymBLJpst tOs/ev1Fs4cDfJTiLQRqweSj1VneYRxRFYhDXrKvusmUBPbKop0WcAykVKF5IAhqcFjA iiy9pJBAur/1tLo21aXAaLo4G01t733yTN4lb5IXxk9xut24dyAjctfhai8rR8k6UJwU rJVgr4TN8QH7Ot1D05n6kfN7dkrv1l8Dfk84flPIQQw0uN3lSsqc1z0ccWvDaGfuKQuP a+Oz11xAvUVov0jt/Sq+EU5Klf9dEvOPFAZJc/TWZ8ay+P+6MuuYnB9DrwusSsqO3kr/ w/pg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=h7h6yZb3ZyArsdrKg0jZlLGkAf4dHz//bFh0u0gN5+M=; b=nIQO1kUUbvEvbW3enbJswXM5/E9BcNLce+xr+7UfWDejniU1UIM2V+OFvIaHUrgGGj ekwfB1trX8/KFobzOn2ueWmlxNB+5S0pPHugLQIBE6pQyv1/g61L777sZIPuwyV22RCY umMbMYLfPvBjr5AOPWRZ0pmZYXbZi/v/s10cJ0hi44NaDIeUkbv3+bKPAk0VqJvUBop2 qKw2jFpFRUDmffxdPr7chxRExBmU5zbme/jD+cCx8XIuGZKEqwUVZ8+u3o6AHgLFi4dL XNc/eBPpn6T42E32sIysX6HwzeVbS0QHeahOmvCM58uZyksD78fU/IwM+50HjAUPFR6Y 4Lqw== X-Gm-Message-State: AEkoouvlB5gCtp3owPW/8FuwzjBRZrTxqXYKcDpdPOVsjGMtNDUXO40118o/m+m5rfSZpw== X-Received: by 10.194.110.229 with SMTP id id5mr6854688wjb.23.1470863217590; Wed, 10 Aug 2016 14:06:57 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id p4sm44743737wjq.27.2016.08.10.14.06.56 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 10 Aug 2016 14:06:56 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> Date: Wed, 10 Aug 2016 23:06:56 +0200 Cc: Oren Duer , Roy Shterman Content-Transfer-Encoding: quoted-printable Message-Id: <60159AE3-202A-4B42-85DC-CE211234020C@gmail.com> References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Aug 2016 21:07:00 -0000 Hi Max, Thank you very much for your answer. Is there any plan to add iSER target to FreeBSD ? Thank you again, Ben > On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >=20 > Hi Ben, >=20 > iSER initiator is supported in FreeBSD-11 but not the iser target. > for the target you should use Linux target such as TGT (user space), > Lio or SCST. >=20 > thanks, > Max. >=20 >=20 > On 8/10/2016 8:13 PM, Ben RUBSON wrote: >> Hello, >>=20 >> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>=20 >>=20 >>=20 >> ### My configuration : >>=20 >> 2 servers with Mellanox ConnectX-3 NICs. >>=20 >>=20 >>=20 >> ### What I did : >>=20 >> I rebuilt kernel adding the following to GENERIC : >> options OFED >> device mlxen >> options COMPAT_LINUXKPI >>=20 >> I built iser : >> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >> (I saw later-on that I could have used "device iser" in kernel = configuration) >>=20 >> My /etc/ctl.conf : >> portal-group pg0 { >> discovery-auth-group no-authentication >> listen 192.168.2.2 >> offload iser >> } >> target iqn.2012-06.com.test:target1 { >> auth-group no-authentication >> portal-group pg0 >> alias my-iser-disk >> lun 0 { >> path /dev/da8 >> } >> } >>=20 >>=20 >>=20 >> ### Error : >>=20 >> As soon as I do the following : >> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >> I get this error : >> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >> iscsid[655]: child process 1187 terminated with exit status 1 >>=20 >> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet = is sent at all when trying to connect. >>=20 >> Did I miss something ? >>=20 >> Many thanks ! >>=20 >> Ben >>=20 >> _______________________________________________ >> freebsd-scsi@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" >>=20 From owner-freebsd-scsi@freebsd.org Wed Aug 10 22:25:01 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C3255BB551F for ; Wed, 10 Aug 2016 22:25:01 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from EUR02-VE1-obe.outbound.protection.outlook.com (mail-eopbgr20050.outbound.protection.outlook.com [40.107.2.50]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C60021F58 for ; Wed, 10 Aug 2016 22:24:59 +0000 (UTC) (envelope-from maxg@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=u4GGEhD378g9Rg0jDgNBw1Eea5ME7sLQqgvzXjlHOzg=; b=c1GbdkbCjtE7WYOS5ScP0WHPHwVaji0yz5zOkvHyzlWBqvPNhvZN292K+1bS3ZoQK5MDsHpvfKpNk/g+dd/9QMxu9F0w1/9zMgse9rRukpt1jT039Pv0encPR3pTkQukXe/xnw8lsiSA/MMXuKd4HxqMA/Db5jExAfVcHcMEdNA= Received: from HE1PR0501CA0026.eurprd05.prod.outlook.com (10.168.27.164) by DB5PR05MB1208.eurprd05.prod.outlook.com (10.161.244.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Wed, 10 Aug 2016 20:51:09 +0000 Received: from DB3FFO11FD019.protection.gbl (2a01:111:f400:7e04::109) by HE1PR0501CA0026.outlook.office365.com (2603:10a6:3:1a::36) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.549.15 via Frontend Transport; Wed, 10 Aug 2016 20:51:08 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by DB3FFO11FD019.mail.protection.outlook.com (10.47.217.50) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.567.7 via Frontend Transport; Wed, 10 Aug 2016 20:51:09 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Wed, 10 Aug 2016 23:51:08 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Wed, 10 Aug 2016 23:51:08 +0300 Received: from [172.16.1.155] (172.16.1.155) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Wed, 10 Aug 2016 23:51:07 +0300 Subject: Re: Help to make iSER working To: Ben RUBSON , , Oren Duer , Roy Shterman References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> From: Max Gurtovoy Message-ID: <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> Date: Wed, 10 Aug 2016 23:51:15 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [172.16.1.155] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134; IPV:NLI; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(189002)(66654002)(199003)(377454003)(24454002)(33646002)(106466001)(86362001)(4001350100001)(305945005)(2906002)(64126003)(107886002)(189998001)(7736002)(8936002)(87936001)(5001770100001)(50466002)(356003)(7846002)(81156014)(8676002)(81166006)(6116002)(586003)(76176999)(2950100001)(19580405001)(31696002)(15975445007)(36756003)(92566002)(19580395003)(77096005)(47776003)(50986999)(230700001)(11100500001)(31686004)(3846002)(23746002)(65956001)(4001450100002)(65806001)(83506001)(54356999)(626004)(65826006)(3940600001); DIR:OUT; SFP:1101; SCL:1; SRVR:DB5PR05MB1208; H:mtlcas13.mtl.com; FPR:; SPF:Pass; PTR:mail13.mellanox.com; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; DB3FFO11FD019; 1:J5+X290164RcRjiu6uu220kcT2elsYTyPAH5LfvWksZ+E1G0HrWi9vUylZMtk/DUKHMz0yV8X3SsKt6f3ddvx0tPgF3cWLll7d9zv2Vj6OoYPB/FlZWJwQkjRWTpkFhMo9+D48eKC7WkQzcuuVud2gtfTLmTLvAw+OkMahTecA56dRd9I9RWGRcOG43x77cuX+LtvH079dzmj/5hb0b7oqukKSl4PANlMEa3a1AN6PpURQGd/b7xse5JnIhAe4/liQN1o7a+X7uzL+Rj+zs7Anls9lQwBmiNbxi/VLj1k+gBJB8gZQwkqtuJJ35mJCWNYPxIzlpJBp+0f40bCCM17JzN0gsNSXWmZBdxGnap7Eczuc9CemUd5TnnF1CZrsnPdq6cyK/OX4m1KOrmbmfPFay0wuMykR9cNBe9RGddSqaVbJtK7nkIm1PS2eMUpXibAZPAHFaZzGKhRfL6j7ufpjl3/UC9ViYmAh9XROadVhNdcCzzFbvzqCn01oMkVDgfvJF9jDOyiS/lUFyzwr5x9iLSvCFjBLQj44fA/gxyaD0= X-MS-Office365-Filtering-Correlation-Id: 227f404b-25d3-4ad4-a800-08d3c1600e73 X-Microsoft-Exchange-Diagnostics: 1; DB5PR05MB1208; 2:OWuYNpMthzibczsxSzT8VAs5JHX1mJ1etMzS9hfqcTjpf39AjK194JESpBPLntC7oRfJzlILVjrSTvgmvffmAUewowF41sJu2VsoHMcxrTeFvpaGU3bKVzl56HE7ErwgotXuter8Q2LQH7nPsGxtnsCi3DKWACF9tEPS2H4+DBsg29sB6d5oI0k8bxAOv1wu; 3:Oj6bBPyGqIfyYuRIVnjPMTZq4YUE5MWf+ZkoDIVvLZnp/M/Z1wmCgl+xlj4IPRGttyOm4SxKKyUBDMZcf/H+1+EP+Ct5wCO9OM0klyBAJjbyb08mPkZOQlafcLa0F77jF8s7cQ58rLCOqm6v5bKs9LhPotiIYUC7RemFxEBjiV8Wah6iT4Y3MjQVF8QOxkc4fTUNQEBClR0xBiIkG949MLxo3FqmVXeL7nOQoIdqpN33vpOgtBgotLAkOPjo7Rv5lmAz+/TwRiNtVtMgbo2b2Q== X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(8251501002); SRVR:DB5PR05MB1208; X-Microsoft-Exchange-Diagnostics: 1; DB5PR05MB1208; 25:eb6Fs5fGhqDm1bp0XQgUTIekHf+OSZVG2M1wPOACSxIOL5uMj4iOsSZI3Tcp9KNhhNNnQoRQT7i10yh8ICAID0upkRMQiabRW8zUN54/wXtJsYpQx6E9G01vU2i9DotUHYpdtPXUrjgR/GGSfbQn1XVVJ79bi95dRx580+cCcb8BFW+ctlfYIc1IU3X/XGrXZfnT+Qne+HBEvHYVH8IaeaENwkkZdyvuKdM6DKn9W+c/NnqiUhS0+9YqFMeBA6KJpW+P4WA9imaEPU0A1N39musFZ9Mn9pnhRrZY0vrTAfTXojQ6VF9nRMHtTHFXUWxLjWDAxD0TwYSw/wLIjZN3W7F1OWxO6TzGLdqxIKABYbRukOnSwammZ9D2/wVAOfJKXbMxt25pLOkll0rA7TtVeL4QzXeIsRBp0IKkaIhmOZbkx6xGIBl3nMLpJ7t1y/hIVjQ4UU1ffv3r2wRs/HEV1OU2V5hhmcEY3QLfwfhXQ3MSD/STIbOqwUgNZ90hYup3gyorn7EMjlkRM154Mnulwc+uuYIh3Lot4Ib1jD/G+9WamE+T8/pLQkXmAMgaQXgBHbH6xo9o/VXXM2shpYAQmKGJNbmA7SbSZwWcXhTdmM1NZNLji2zi1lUzKTPCBTlr1RazUi29z/64ax9RkZduGw4vIQq+5j1//rE04YxTs6/Hu7XswWzBJ1zMpENdhdU16i8KvQBmgZE8X4CKMdlLuMnqmYy3z9Zx/l4WZ+z0dY89NoiBsOSVku08w5+E346NCmu3tXQ7ckFd6IjQwvpJv8YcxluqEAG60wgSZXjlGUl6Yt5mxQrK4FPlkjcUbYskRBIiVTBTrikK1dNibQbTKw== X-Microsoft-Exchange-Diagnostics: 1; DB5PR05MB1208; 31:q6+Klcdt2I9LIC4XXb7MoQHg/CkgLCBNSBO++LUJvKSJYqFYxRZvStasWgavcfLMIwpc2ROiN40qmB3Hy8vm9K9g1izcXxSHUnGwZGElVVE6z/J+f3rYWIvuCQL9kYNWgnxB9XKV2CDZbTWJRY6rjJNJynNRWX1dmDjZPWM1JoAuQ3UdpslQDNEF5jnivSJwovfRVxeHyXd4/nteboQtZZRQZ1sTVVmbTdn8Lh3XwWM=; 20:eMfc3ZBKTYHCu58sCvsfLyM2vPZaKT6wTdHXuzvFqIkpmnjfOJUOfStqXyDG+UPTci4dFjsdLo84Nfmc38EHgqT/4pcgkY+fe94ee67WmmixlYosATfLdF07VoJU8Nbzl002+A6em+GqXCEIW4da9NR8wcUMbXXLOtTE0Enj+QPls3IqvVXDYXWw0IS/FxBqWLccTTywpm/GW+B+drwVAe1sp/oM40e3x0SX7jpcu0+sjyHcad4aqmLZACZMizPEQoRHu48nHXHLOEBEWxh0vws6Hx/7CV+xJam58DvQuPQhQ4V1TFKFXAoiKxVMXZGncWdUwTSbAXPX2i3x8Yb0l1YyfIeBw/g0CntAkyJbpc9nIeTx+37P29AJNOS+Ror4cxdnQtZdzMjB05Z4fZMSBS6uNxwrls47hz6Y4Gtuyyku4kIuAxHoXm0ItBfbk+NtCujVfqU2+6wIwhwMIfIS+3FcwzkgE2wkOb+q0/9cF7gSHEtHX1rqidFuiC4jDhUo X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(258220229709018)(75325880899374)(21532816269658); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040168)(601004)(2401047)(13018025)(8121501046)(13016025)(5005006)(10201501046)(3002001)(6055026); SRVR:DB5PR05MB1208; BCL:0; PCL:0; RULEID:; SRVR:DB5PR05MB1208; X-Microsoft-Exchange-Diagnostics: 1; DB5PR05MB1208; 4:CQ+HdYiNBZ7Sc8TN7bCbIUeb3tM73Ot2LhJrBCIdcKTCjLIEAn10fvyR2/atgdv7tUhhvRdlx3Sy7JnGBxmRdK2TG5qBv7JpGwfBKjJ89kif6Z249J5lVOUcbg/hjI1f0OE7Ss3tWeiySq/gSwS6me4LLE+x6IgaXyWiXdFAGmus8alVPHujgsZruwejXf1D743QgcSyL3OYp4yNnpFHYw4+0G6zyCKVHXtev0/I8Tav4tN5kkUvo0xhUstUpfd1G/FmFQ0G7a516/JvG4Nj5J7+0HZ60EUcQVEaaOvTD3yC8YqGndm2nlrSwkOKLw9i3Q/alYq6y9ewuOC+RFC7xxWLJNYgKeFxfAUEspbXIo1XZwgPH5r63ptqTcqFIyNhKUcdkokNO9IxwEf37P4jRJTpdcn1OnBZN2VBcO8p6xk+icg2SVYLOU9lHmhal8AuxFnxLX8NuH9iTjBSML/LNGYqpov4Jrj6UsUX1Rr+zwhOOzphijIDiPFcbVruHnxqZDl0sg8TFR32Pded0u+NIFbJMtAPkuPjrrpmNnTm65c= X-Forefront-PRVS: 0030839EEE X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; DB5PR05MB1208; 23:sbj1wmBch83XjGW5Obg8C8wQzDqNUy/glkz9F?= =?Windows-1252?Q?HxoJqmVRBTDvFHrkhMMzqR6Glbnw8vlJHMWndXXqjzF2oOxdGN2X4G2m?= =?Windows-1252?Q?knVual03YMCFW5FIuLvJAOVSHcl76bD4GZtklfbsKiK5ttjsgwDQGb3G?= =?Windows-1252?Q?lbgBazD5oDhUxrROpianeAOJg3vqPNPe23TCRVoZsmDjqLHfqZmKd53c?= =?Windows-1252?Q?rIraviXVn3xgaCNbT69ThN08+1sMelaJZ7R2Kg0suT2P8P6BGfQp4HIa?= =?Windows-1252?Q?ssz/lxm0a0BlX7OmbBKA9VPoSY/lQwjHkKTr7zkduwUAXr9YfSklWOMO?= =?Windows-1252?Q?B70tuqEsoI7hzEtKhPWDONHxHwhIcsvZ9f7Ibth0KJ0hSEwG7UtaKsg6?= =?Windows-1252?Q?hc2OdCnoiB7iIegjffQfO9P60EZbVTYAs8+G846ppAFzzzAKHAUzBP7/?= =?Windows-1252?Q?YAABQgbYgFT/aHjWrUIzz8XnmwOerBkH0m6DazunJKpNY0MQWmwqeq2m?= =?Windows-1252?Q?3lqImDbFMFKEA/CiIdtNVcn93M93MhegogCAnSTwl1R0sMHEpXVh9/ML?= =?Windows-1252?Q?+EhubNtsTM7VCYP3rTC4TdCgf8AkRktlrkcKiJOXutut4Cofp0qWCK70?= =?Windows-1252?Q?vkd9NE7D+91zBTOEPzn0Q/wRmi981X9ysTRmD8zKQuPrRsdoCeIQ5f8C?= =?Windows-1252?Q?LWLmmY1JDt1ljiOXnF/zt1On6I4B8/RbjtWM0QLH35TXC+yJ1VgBWPWo?= =?Windows-1252?Q?Pqu/VDxYRfNMFv+scHSldTbVtO6KXqc9hgPtlP+5gBHGQYfFz70w3IvR?= =?Windows-1252?Q?fRroitpJcJg58GAWACYsEu9RU3hWKbocxk1rdVsyS568UOMXQWsBepZ2?= =?Windows-1252?Q?rHsxfp0aaBsu7DAmlB7n5gUXSJl8eMLFjqVs3db+iJbu+dSenJuHHBGv?= =?Windows-1252?Q?3pecbb2phbSzREhO0uJPKWO5Ky0PGGBUNcwALzda6RukelUQziCjoAjr?= =?Windows-1252?Q?/y97uCdI2cKCeGhW57Lb4q+brpmLAV2YiT3Y9k0gwzD12tFGein11e7X?= =?Windows-1252?Q?WCRkJ4g89Zg2ZivfqBX9/JidfQIxUZ12/eQwWENpxmWBpRcfXXOuLFw+?= =?Windows-1252?Q?ceSMwQVtyVx4qN76G+YjdjyF2ewql7j8IoRA8XfiELoozOY8yetKR6VF?= =?Windows-1252?Q?TWy7+J7EoACdaX6IcVyMi1wUbp55/K54a1M/wIEog3qzpgl6wU+wtjQk?= =?Windows-1252?Q?7JpDDrIWFOCPzolEZ0rqGlK6OOdeOPZfJZTeppXMIUpQ8M8t5MiD1FKk?= =?Windows-1252?Q?7EhziFudd9ULdRNSQHg/mRKaq3hK7zPdkWg2pIXyhv0m0nDadGVa9G6D?= =?Windows-1252?Q?ZwfLshD+F3jLsLmGCB0LT1A44ymUgC8DExdoEFuToGie9K88B4xLpSWP?= =?Windows-1252?Q?mcrR7Z/kAQ8flld+wHjpnu3yCjpeuZuMbnEkDL0Hg=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; DB5PR05MB1208; 6:lKESjDYH5CRsSXdoz+s/TiAEVeYLMAiTfe8bbPgTLHCc57F6yceeK89EyGxmhQoci2C7URijtXMB6smq9tp9ZuchRClX03FuVv/SGVQcseg6uR4OuDRNUM+9SRqLlWNemQWHPVLLcbOkOd5yt0NZwahx76MISuYzVoEAwC2A5q22fhkPNHjwbmXVT9hbBdYEPI0TfR9VjYXu1ZvE9IuNLTQNdBdexNM67GJcZxGoihXbMwPJJ1lr4sPQwjUUG76ONMFhDU2VUz7a5CH0J3EXoyWZOwJtpOwtD8L/6rgBXWE9kQ5TeEL2nGEdF+KCnKqfoQLlwCYmo9VDUsnjXFgk9g==; 5:7ZMr/gQzOOLAqW/SFsTntV48Ae4IxYJBk1hdgnbdEtZQeeh98LVFHuSB7HtBukUP0g6AuNpJquZT8P5fv8ihAwZ081rfkXVp/yhWX+4OAnfaSvRXbh1D2cAPNi9ZgWxujpkCvMLkuH3cvwUqdfUekQ==; 24:S4rAxtwaQvJv6T7bnoG/g6Ec1Gxs+8HP0yg1qI9H4l88DqQ9aUQsPjGzlX6jsg8n1ed/eXwW/F+dLCzYOPmi/OqPFcO30OND8YC3l/SP91w=; 7:MlOTseKXkLGTi5Bo83snZQhoPd1zmJWLLi6k96S3EIRWh82q/yx7e96r6bdomfOrXu4KPVj59CVPgbXPKWyXx+IhjvefQKVqUDgk+OKnHgZ2i4oFLSH9lTKmNHMv+Pb1VwNGuRBLEgDMJZWD7hx3fC6ESZC+kqwT46EYWSu3YRWNiTVuB/U46ekkPiBD0FqfGsDLcHfYIk2wjNUKv7fXb4RyS1Okp52nM0qOpcO8SQApRjMPCNI06zsPfdUBUWiX SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Aug 2016 20:51:09.0981 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR05MB1208 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Aug 2016 22:25:01 -0000 Hi Ben, iSER initiator is supported in FreeBSD-11 but not the iser target. for the target you should use Linux target such as TGT (user space), Lio or SCST. thanks, Max. On 8/10/2016 8:13 PM, Ben RUBSON wrote: > Hello, > > I have some difficulties to make iSER (FreeBSD 11 BETA3) working. > > > > ### My configuration : > > 2 servers with Mellanox ConnectX-3 NICs. > > > > ### What I did : > > I rebuilt kernel adding the following to GENERIC : > options OFED > device mlxen > options COMPAT_LINUXKPI > > I built iser : > cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser > (I saw later-on that I could have used "device iser" in kernel configuration) > > My /etc/ctl.conf : > portal-group pg0 { > discovery-auth-group no-authentication > listen 192.168.2.2 > offload iser > } > target iqn.2012-06.com.test:target1 { > auth-group no-authentication > portal-group pg0 > alias my-iser-disk > lun 0 { > path /dev/da8 > } > } > > > > ### Error : > > As soon as I do the following : > iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 > I get this error : > iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument > iscsid[655]: child process 1187 terminated with exit status 1 > > "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet is sent at all when trying to connect. > > Did I miss something ? > > Many thanks ! > > Ben > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From owner-freebsd-scsi@freebsd.org Wed Aug 10 23:47:54 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8063DBB5535 for ; Wed, 10 Aug 2016 23:47:54 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from EUR02-HE1-obe.outbound.protection.outlook.com (mail-eopbgr10062.outbound.protection.outlook.com [40.107.1.62]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 819251348 for ; Wed, 10 Aug 2016 23:47:52 +0000 (UTC) (envelope-from maxg@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=w31X5LzvTi5d8WQW8jrMJAmRqTZJKimq5vk8f1/6xd0=; b=l0yFgueADwyofGQPevopLfDDFglPMdUW4wNtFalgMi0NbUbEtkzbpQqQN1O1T5WEwpiQTzqlKWR8ckyZJN7A9ua2IageDeJ0Zk2hfiYMs3pJpkqwUsi3TSGPY5CdDFz16MOrUn+AuF67UhNWWEjqA2XNA7lHGqBE2KNLr44H/I4= Received: from DB3PR05CA0050.eurprd05.prod.outlook.com (10.160.41.178) by AM2PR05MB1202.eurprd05.prod.outlook.com (10.163.148.140) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Wed, 10 Aug 2016 23:14:00 +0000 Received: from AM1FFO11FD048.protection.gbl (2a01:111:f400:7e00::176) by DB3PR05CA0050.outlook.office365.com (2a01:111:e400:9428::50) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.549.15 via Frontend Transport; Wed, 10 Aug 2016 23:14:00 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by AM1FFO11FD048.mail.protection.outlook.com (10.174.65.211) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.567.7 via Frontend Transport; Wed, 10 Aug 2016 23:14:00 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Thu, 11 Aug 2016 02:14:00 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Thu, 11 Aug 2016 02:14:00 +0300 Received: from [172.16.1.155] (172.16.1.155) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Thu, 11 Aug 2016 02:13:59 +0300 Subject: Re: Help to make iSER working To: Ben RUBSON , References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <60159AE3-202A-4B42-85DC-CE211234020C@gmail.com> CC: Roy Shterman , Oren Duer From: Max Gurtovoy Message-ID: Date: Thu, 11 Aug 2016 02:13:58 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <60159AE3-202A-4B42-85DC-CE211234020C@gmail.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [172.16.1.155] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134; IPV:NLI; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(45984002)(66654002)(189002)(199003)(24454002)(377454003)(31696002)(8676002)(81166006)(2950100001)(81156014)(4326007)(2906002)(6116002)(87936001)(65956001)(31686004)(11100500001)(36756003)(3846002)(65806001)(33646002)(230700001)(305945005)(19580405001)(15975445007)(19580395003)(5001770100001)(83506001)(8936002)(189998001)(77096005)(7846002)(4001430100002)(76176999)(54356999)(7736002)(107886002)(92566002)(586003)(106466001)(47776003)(356003)(86362001)(50986999)(64126003)(4001350100001)(23746002)(50466002)(626004)(65826006)(3940600001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM2PR05MB1202; H:mtlcas13.mtl.com; FPR:; SPF:Pass; PTR:mail13.mellanox.com; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; AM1FFO11FD048; 1:wUQA+0UnYzMkW09Ilq3k9TS86Ivs+y6TKS7Gd+pEsLXEM8uF5a8c9+1dwTopZo6VDAZ9CRNhD4kyyS/jGpenMG2xcbBVo5Su/C5wO1gWFi0NJCGuCLbIjqZzlGzQ5DSv0rk8aL5KEv61/bhkG5i3LDjj+PihgIUf9Y+d8OtBe+EjTz7foovLBKqVj59TTLQ6ZFy9qF1lKeS6VBp2G99epZq1Rvzp/+I5ic/Ep2dN+DiPWTyGmR+uYfuoZPMuyKt4n/1RHo2PnR838fxBHYn6ZdN4y0tZC8AD7c4TNNF/N+B8bP5IiR22JTn5YG1Tkj+pLOOfahttvmEzaUUX7CSlw8bPT+L0vdMoBhXaSFhppaxv5fK6zwx7QzUNWeggYmSv20HvJ3e6YC4FjgSyxZRXg6wzB1K/PGS/+XkabfJBsaXStIdZwt46BxBsoVvklOavZG64gzYm7eKWKdoT+RLAD31tkPu+2nHGZ70VgVCQeZWtxlPzP5r4IUjTY9SFlm4h3H49+ttbyUCOoNlF5tqyvKCvo8la7CKRdaB4AF0zZgI= X-MS-Office365-Filtering-Correlation-Id: 8f83c40b-28db-4ec7-c398-08d3c17403b5 X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1202; 2:nu2Gs3mQk5WIMuxS6jd5LtzyfftqCnX6J/wbL4ydLzDYo2CrMdL9dkT7rZJQdFtNdPFDZMPcZK9G1PIQyTG4NQkT6+es6munVxK5Bln2rA2xIz/4XZoeFjlOtwjhsHbtR5GgTyJm0HAU/rNbJ72S7VtJ680iWdfdXlmQrzk9ASEhSq9NoCmVJPPAq2Jb9DFy; 3:6xbjATdHyZZbLvrdby2+5HSZq5T+z/Pu4OQTZ2Ssb2itUj9SKArcb/Z6JqlsWqeVECC9vk7D9m8mf+Ut8uJgM0WB9sHWNAlM47nYtKHsAOIbQyUos/2tiLAKoD5v3M5J4+eqhKISeTpGdZEywxObeo9lPJdxoCOZNkPOED9T/jxM6QQDAMp2IfjL6iWDfal7UVyLP05lCjhTb8rxmniVhyzPcmojk4x52p4fRD67or220r12g0+JkJ9rwAh3jJORSaSemczvKeIo6RDsVy2z3A== X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(8251501002); SRVR:AM2PR05MB1202; X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1202; 25:kY9NI7Z8nnH+eKj83FA37geh7726HAZsG8UbK2Lbp6UAc9j2eH8XGqYj0KlmxKsZL4DPvvmkTK9Wp9/pJZXw3PpyvdNZEL3LBwI72HCl+4b+B4I70ZjAjROT0iFn3HwqeMR8YOwC+Kf9kxE+tlwj71mQdCUUHiAwjY1ICpaN5Pz5Y26UD1HXCspXzikDPi7IeGJuN91wzynN4a7zjlc0xN6zgl+989VtW+NHwtkJBpMjtW3sP72NxMtR/tcwZA8rYOehzZlr85zp6Fq6U7GsiqLv+aG0peAH3Ak3UAySFLSydrdj+T2N/pNrMPNP44Bhs2Wdxs4dbdpch4LAazwZOjZCnK0Ehm0CkRgwDJGSet2twoZw5xFtwS10o9dK8XLeKccwxdV4RZ5wxqZ7Dgtd2XcRAtmQfOq7E+hHs4Buvn7BwWfCF73l5e6uqubgluTdO797HpyftdSsesUSgx5paiDPZtnfjQNvZ8bZRzpwQhSGiwBdS5vFeMUuyfNNYGYeFA86frqier4zA1F/B+7UmWEVmTCuQtVuRt01T4rCNXdwuZBjb6R+8eN/BTKgod1LSYa1ZNWG+6PjEhX+TzL2pfBhDJ31TEDpRUFaaSxExwvIOWMTh79crfBuPyt1vIV5TllTgGiXNBM77bpEQVs2Y9zbAwQisSUFpA9gLMAMNwdKfi3V1Ot1kekXl+P6Tam2ZXXjMkXidaw9FdJw7vNNQ4yPAqr5GX2wkiRnyVE8DIthoLRb/E2/WNuBHljKVifK6LjP9wpHrOj0rR7MOTrUTZXzXCvRRVxd4KIFwCQvUbrNbp2vY4K2Ztobif+U0QRR8Lh6k16s3FdsrhVMVnaJT33ZHt5ZXHuAanasrwFBHXY= X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1202; 31:WQg2kNhADRv4xYy3ElKi3CLuH25x1V+UBoRsAv8dyLf2SUA+j6XnpsIGfWSp6Nf4LPgos+K3N+u39rw7TNp4yYwsPOtWkXKv96+vprNpU9ylECdm/InG9R8gO8cK4NfRpmcehxwBSwTf98N6nAgv8/9StbZ7F8o5/nwGZW1yIIFEAuUkivvOtH3qSpGH0w1JrQmKYTbeUF2ItGpAXjH/CWOQO8eCMmRFWO7toa+jhjo=; 20:zusZBhqk3MWzFp3iQ/xuzJZ3qj0HgKcxMusHMBC+Px9BtOwgnppQ5RA97V+hZIk6In13VXcpEoebpT73l4H3e0Zw7pjMmhDt6zSXHiz9Cp6x7cTy9S2QSApLF6gSeeOhoe7SBmzhcwmq8SB7j31iHTJadttl+ErsaEUVvbvcEwx0vKnz6wMsnisbtaVR0trQLkpXBTtl6BUvv7pAhJZvrIwHS6/yBk2Fhmhyxj3gJW3B/oe7iv6HRs/SQcfJcXzU0Sd6EJZgW9ujvpcjH6j5L17E5wKvaJd3SXZFFvedYnNzL6vNgEdMfkJcJMZRds8OBG0KoUdNdXWtSwGhOfoeity9vSTvFnvazyia7BiwtThr/z4EYD3XQm0FoWy2VLwdv49L61dzAyOIEwgeBHTgjv5aMZWwzu1oCUvveXglBmVmNDWsRVPmpU9R//akJ1tBz5HuIKtZhgNXNuObrjMA1tpvbamTJFHBJAbHTYHF4iQMJirFcEqOtRDnwU1lCES2 X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(258220229709018)(75325880899374)(21532816269658); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040169)(601004)(2401047)(8121501046)(13018025)(5005006)(13016025)(3002001)(10201501046)(6055026); SRVR:AM2PR05MB1202; BCL:0; PCL:0; RULEID:; SRVR:AM2PR05MB1202; X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1202; 4:VlPIR0oi+pB7UUzBJNrzLp2PGbHcmsgk9d0ZjC8rbvFGy90EShq2co7ZrCn454k2oThOuhxszs4CZ+N+1kU+JoCCkA4/NBC68g6Fl0hEwa3i30m8SihPjmWIzVzfY7IDFCAlpU+3hrbKmgBsSSNn+8I619AKnwgFiNW7eW3zGBZq8pRzwblO9nJC3/PBiu5DEnTbLV+hwXcEfxKUxvC44xvLcCGn/AG5z9mzBJJSx4Y9kBVi1r+u4fj8VAD3N3GlHksZ/wgJMmsVjCSutYjux6OvI6SAVIGTjYWH9RbJ//1PyfyVupjlhWxwLQ5yszFFY6IQNuFcnxTjFFg0swpnqc5u5gDNyP0tYj7K15ojnD/OJNKDU/4qkx8Au2C4dstECCSjvbQsJnyyh8M66NpBrNOQFC3Uk2Y8zCnm3hFAJRq2gawf22kMNT05ZpCzp/e7zKsPBAFnOpSdrKSEUMjj58qahYwrBlhrGqnCK5l1SOus14facJajE+K7eQl1bZlK34YzkNaJTt9kk0tJFMOavPwbg14WVVOvA7ocQGfVA+qhvuKsRGx5EkyzCMMQWNbF X-Forefront-PRVS: 0030839EEE X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; AM2PR05MB1202; 23:UhNdVA2Ziz3xEbf4JoQwwLl8YKc93vmWuXZCk?= =?Windows-1252?Q?0tsCSBbFUYvxQVVnPefPeCnO2FENz0surSkrU+/KYnli0a713GN1p6L7?= =?Windows-1252?Q?zhHwPk9NcAvSGahzXDWVS9UWxeaX6RXdofwISoWWfxMyaG2uE7cxWy2L?= =?Windows-1252?Q?b5S9OPA3FwPUnyhw94OREKB8EimCdrvbRWhQcWThkAH6fDXoayOrqyju?= =?Windows-1252?Q?/dhnKoN530APQuIAW8g7K8+YXA4WP7wadHxqtZ6bk6Uyi3bOq5Q0OK3T?= =?Windows-1252?Q?AD5qiTCMOCXJkVv5WByURQb1Ul2s9v+D9O9GHrdO+EbxCZTgSQ0Yl1yn?= =?Windows-1252?Q?x/OQfzCLuHZh2pkkDhJ7kW2dDXMCJoh0t92yufBAtLSSvzc7fig98v/L?= =?Windows-1252?Q?zXc/eFoH7akT9YxjSRyzoQLHWf9ouaBXgXZWTaX9cYUFBZud6OBgPHXh?= =?Windows-1252?Q?JqOUL2ga4mfI+P6u3qneRr7zwli5N/okcgK1E+zvIsFGjVYmX/RDdypg?= =?Windows-1252?Q?f+aZhdzXBnvoG/JYgmBil2FOTQvol3uatjzltkhZIqwqyxHhATmvsmzz?= =?Windows-1252?Q?ZYxD61yDVLLHDTMiefUfdpO5OXu4FuMAqNIFKOQEX2Ixtor53Do5BVWN?= =?Windows-1252?Q?m897Wt5q6w0sYL2xKa/TdJJ556LnH+D2bRxz6oaTE9ZytshpsIPIftIn?= =?Windows-1252?Q?O9zrZ1uIuq2ijoS+c1t1NN7GrPtty6XCgB4RO0nVFXmU82U3edY/NeR4?= =?Windows-1252?Q?rNB8qE4Mkrmxt3szFVVqrQOOVVGVfbe6Cy9lUnsTirMJngLr0ZfJ2xst?= =?Windows-1252?Q?rYIQrX3azIk1A977QVL6wM+j27IyUU57wxAUbveu47iN+JDFEjrKvFDx?= =?Windows-1252?Q?oV/jdUrpB4fPBRnypz5MDRtZ3suQome2a/4SfK6NQs8VyJbjBQlJw9A2?= =?Windows-1252?Q?vqiWyUx2PndI7bceVCv+UTwiE07IIyrcSa7WRIkM+rvTLDENvyAwoODh?= =?Windows-1252?Q?nn+Sadt96TMkgjA/SwsYNFZ5A1bKeQHQkfTfVJfa4VHDgDryWDRjbJUh?= =?Windows-1252?Q?Xa4dKkRmollNnHZ93o00oaXNvw+Y05959CcWJawMRZWMOFav9w6Hlomr?= =?Windows-1252?Q?0QQxSFiFZ622OVaH4d67iEFyvarxw7ig55foBmuxDuxt020e96GZjXZA?= =?Windows-1252?Q?ddnYcQljYKohWuSSGKqQ2cjjHX3iefD7EZ+/yce1o86GMv5E3hlnJ2Id?= =?Windows-1252?Q?m76ERVdfjGfQzah+AGNIgZFn5dh+bW54dq/O64CttBvGIt+MbeusymaJ?= =?Windows-1252?Q?8EjqVd+vgTrHqNRPAbvua4WOTiqrPSCMkXGekO2Cx7JmBsnAqIG+niBv?= =?Windows-1252?Q?rdQRry0vOef8t+tUPmBivfCwY/3t3N5LJiibK6c/kzpBF7KT18cr2ep+?= =?Windows-1252?Q?1mUlJZbBW7CKHSIN5HBmqrQZ0O+vmzXaFNizk+0WtqNni5tN6EizyI5L?= =?Windows-1252?Q?bI7WADGtc/tdcJu/+gc7MR5JH13?= X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1202; 6:uvlu5r4vFpGxdLi9uCZXSmHuzGDiM78Of9JNU29ZlovLPNuYEfrSAhRF30qieqQWFFbOBmsGylPuERusviTBW0WzbSZR1zChYK9iO6Mk3ZGzB6aETO1D2XuDoH+SovD+FS2++i4jAfTwMQCfjQ5veL4XdQBxM5ZWbCeDsCCEitttEq/gxpyocSJLu/m7XbIfkYygJRUnoKYTuwHvfsVOqdm7nhUl25LKoEF7zeF3RwkdktAJMQI7orGXpZMITmB/+2NQcZJxXBzi35om+jD11RvYTVKU1jrMkQtGLFRsUkMoqhhIwDsdba2OCamw7myS7voU16CusjOo+L/VNrVM+w==; 5:TGtH9zcs6+mAGf2+08radxGe4f+I/KlPgxAHwtTbBaLRQ0YyFrAt7qBAs1yZyoHFREf/d8H3o8slJyiOKFga1Z/0TPcjBQCQ4V/DfweK9xd7NmjwzvyE+AicGCZ18lVsOvteG4COLtuqbP40gcdkpg==; 24:08vk0CU60NrUIc+daGfKQtFI+79Ted4G7whXCC2ZQ4VkOytQ/FV/4sD9ZNB9PR4TYikSIkR6TUBL3iUbALVsqcRo4GLEC164QpWBs4+wqeM=; 7:nbMvbDWLqRndKtz6eJDkihnXcu5kYtuq9LYLn0ZpoPwV2ayVL+zIKhBcU9iaZsOBHnYqQkWZcwodhZMkmQQF4SC4ZJTxQHzS+7zXyY1+Xh2PSiGWI/T2gPj5tm06BBjkVCMMevhq07GwFP6nSoW5QO4I83mRnCanSvMMyGjl0wExt1eNt9KdUqq376wNaTMzLEfHDWdCMa4TWt96GBCoXAlUZTOSef+9qS8+8si3yYazk+jmhZd/2bhH5NyzcVnT SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Aug 2016 23:14:00.9642 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM2PR05MB1202 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Aug 2016 23:47:54 -0000 Hi Ben, Our initial goal was to push the initiator driver to FreeBSD and we accomplished it. You are welcome to report your benchmarks running iser and compare to tcp numbers. Regarding plans for the target side, it's not on my plate for the near future (but obviously can be later on :)). I'm not aware of other contributers plans. Thanks, Max. On 8/11/2016 12:06 AM, Ben RUBSON wrote: > Hi Max, > > Thank you very much for your answer. > Is there any plan to add iSER target to FreeBSD ? > > Thank you again, > > Ben > > > >> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >> >> Hi Ben, >> >> iSER initiator is supported in FreeBSD-11 but not the iser target. >> for the target you should use Linux target such as TGT (user space), >> Lio or SCST. >> >> thanks, >> Max. >> >> >> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>> Hello, >>> >>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>> >>> >>> >>> ### My configuration : >>> >>> 2 servers with Mellanox ConnectX-3 NICs. >>> >>> >>> >>> ### What I did : >>> >>> I rebuilt kernel adding the following to GENERIC : >>> options OFED >>> device mlxen >>> options COMPAT_LINUXKPI >>> >>> I built iser : >>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >>> (I saw later-on that I could have used "device iser" in kernel configuration) >>> >>> My /etc/ctl.conf : >>> portal-group pg0 { >>> discovery-auth-group no-authentication >>> listen 192.168.2.2 >>> offload iser >>> } >>> target iqn.2012-06.com.test:target1 { >>> auth-group no-authentication >>> portal-group pg0 >>> alias my-iser-disk >>> lun 0 { >>> path /dev/da8 >>> } >>> } >>> >>> >>> >>> ### Error : >>> >>> As soon as I do the following : >>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>> I get this error : >>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument >>> iscsid[655]: child process 1187 terminated with exit status 1 >>> >>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet is sent at all when trying to connect. >>> >>> Did I miss something ? >>> >>> Many thanks ! >>> >>> Ben >>> >>> _______________________________________________ >>> freebsd-scsi@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >>> > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From owner-freebsd-scsi@freebsd.org Thu Aug 11 01:17:59 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6E6C0BB0BE6 for ; Thu, 11 Aug 2016 01:17:59 +0000 (UTC) (envelope-from tigerspo@server.tigerspot.co) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 563F81656 for ; Thu, 11 Aug 2016 01:17:59 +0000 (UTC) (envelope-from tigerspo@server.tigerspot.co) Received: by mailman.ysv.freebsd.org (Postfix) id 51DF6BB0BE5; Thu, 11 Aug 2016 01:17:59 +0000 (UTC) Delivered-To: scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 517B5BB0BE4 for ; Thu, 11 Aug 2016 01:17:59 +0000 (UTC) (envelope-from tigerspo@server.tigerspot.co) Received: from server.tigerspot.co (server.tigerspot.co [192.163.237.101]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3421D1655 for ; Thu, 11 Aug 2016 01:17:58 +0000 (UTC) (envelope-from tigerspo@server.tigerspot.co) Received: from tigerspo by server.tigerspot.co with local (Exim 4.87) (envelope-from ) id 1bXdZc-00061H-BZ for scsi@freebsd.org; Thu, 11 Aug 2016 00:10:12 +0000 To: scsi@freebsd.org Subject: Courier was unable to deliver the parcel, ID0000431214 X-PHP-Script: woonani.com/post.php for 93.159.18.74, 192.163.237.101 Date: Wed, 10 Aug 2016 18:10:12 -0600 From: "FedEx International Next Flight" Reply-To: "FedEx International Next Flight" Message-ID: X-Priority: 3 MIME-Version: 1.0 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - server.tigerspot.co X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [500 500] / [47 12] X-AntiAbuse: Sender Address Domain - server.tigerspot.co X-Get-Message-Sender-Via: server.tigerspot.co: authenticated_id: tigerspo/from_h X-Authenticated-Sender: server.tigerspot.co: nathaniel.hall@woonani.com X-Source: X-Source-Args: X-Source-Dir: Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 01:17:59 -0000 Dear Customer, We could not deliver your item. Shipment Label is attached to email. Regards, Nathaniel Hall, FedEx Station Manager. From owner-freebsd-scsi@freebsd.org Thu Aug 11 05:58:04 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED384BB631F for ; Thu, 11 Aug 2016 05:58:04 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x22b.google.com (mail-wm0-x22b.google.com [IPv6:2a00:1450:400c:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8225A19BE for ; Thu, 11 Aug 2016 05:58:04 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x22b.google.com with SMTP id i5so10876003wmg.0 for ; Wed, 10 Aug 2016 22:58:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=d6ooyAqbVjii8LfQTgBJjPPgOgj3VY3r4RIxYsUhRUY=; b=KmMGZWo/PW6qrvqzN3ItjjFfu4bkt5faJVnjcxBmWsGqy5DCnYmha8oWhV3vOkkX/4 FUxkqV8DYU3oHopxw6RVy9E3neGT4jaZhHpkIggTE5wrOR7JS1RIDV/PTCKypA4c7+wJ pnItHE0+gJ7oVwx5vWbf06cKtX4XZIoU3bVQcrmRcXYDw9LpZCxvQoU4iDk8ZubvUiTc mj1Y0gp5OSR+1+rpY6MyhoPm6s7Oa84D0G8ajWMG9g/kVP80A4T2K++Oxv4kIcZazgGN U29afm381l/KWQTtlvMrkwsG5LDrZJBoHxK4omNlIiZSzFawVgM92y65LbJ67SIagPhK 1Lxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=d6ooyAqbVjii8LfQTgBJjPPgOgj3VY3r4RIxYsUhRUY=; b=FfRoU8NvYvFpogfpCmO3gBESUqQcQVl36kTXbTK3ao9j6XUm1upCIBSzq7Afokjd04 6F2jlvmeIo9EzApWTajtxhcapDAyb1nbbOwBUjAaaasGduCVyjXrJnMugf57L00QTJi4 3onkCIodleudIUCvrHcwQDLRBS79ORLc5thWYBKbxMCG5Bdgf9U9G1WXBR7xlNxpmUbs Xr+P9KG9jy8PrZBKOBuZcW3yLeoglWHsCISr0Ntt9a7VpmoembYiBxaeUgV2MdwuY5yk 0ASLeDpTRB2acFbrEalp7ZEb2NsDBcR2bUUoWVmMLDHESmonI2bJaUsPxD1ZfuJdMlpt XVGQ== X-Gm-Message-State: AEkoouuz403fYpVJhihG84jlC35KEZ1sLjetF0GjPooYOzLShs2qNQkJ+3Vci3scK41UUg== X-Received: by 10.28.48.71 with SMTP id w68mr6635279wmw.4.1470895082124; Wed, 10 Aug 2016 22:58:02 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id a21sm1399476wma.10.2016.08.10.22.58.01 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 10 Aug 2016 22:58:01 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> Date: Thu, 11 Aug 2016 07:58:00 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <9463648A-149C-424B-9140-4F20842FC01E@gmail.com> References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 05:58:05 -0000 > On 10 Aug 2016, at 19:13, Ben RUBSON wrote: >=20 > I built iser : > cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser > (I saw later-on that I could have used "device iser" in kernel = configuration) I tested the "device iser" in kernel configuration, compilation then = fails with an "unknown iser device". "device iser" can be found in "man iser", but does not seem to be = understood by the kernel itself. Ben= From owner-freebsd-scsi@freebsd.org Thu Aug 11 06:04:13 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 77DDABB6560 for ; Thu, 11 Aug 2016 06:04:13 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0C69F1EA0 for ; Thu, 11 Aug 2016 06:04:13 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x232.google.com with SMTP id i5so11132675wmg.0 for ; Wed, 10 Aug 2016 23:04:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=O7clF0OfVNlKQ9z66yE9bcmZMKHK/5Uw+KUzaocI6Bw=; b=vwV+lPE0PCg0KXR7sle7Qw2oT3/HXzJhGYBVuLGJNkhMKnLhGrXMPB78BpUigbp+9b uHGXFYbPcBjZhSaMcILf643AIsdBGgZBTh0L1BDxG73Hen7jDJAsH5LZTRgNAe29nBQr ndPX1+ibxIdDTpg7MYify1NkBM9D7b3/81TMPwbXgEDc3Td/fq7zQ1oYxupyykzkms81 fGnNgUNEhkuxsJqyCeYe9sbiY3iLukkcV1VBNuWfUG61EVU2hlpx4UGqotJyCmYER3qL Sy7k+HULQ6qKYwCctogudi6mo5nB2SVvgLHqv0TU2Y8+ntRzlbG1wavUI7bF4dd4XPjG srdw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=O7clF0OfVNlKQ9z66yE9bcmZMKHK/5Uw+KUzaocI6Bw=; b=ir/EcmlBY8bfrBhjdXd8uH9rlBpGuTw08517EUycw3sbn/GUFQpF7DcflKgpQB+t2w uTH1EP45QaxCDit6jPsRVPPp8b+JuFTEU8LcTOUhu/upliDluPaZxmxjPTXgzYa3g4CE MmUu5gl2Wn20IprrZ/d/ume6d2jSemVR4KCtk8HYIyOL2xe1b7PeAQB6NGyxf8y7+4S+ 7nqtRWhC62QXSdKvPIPYq2/GM918JOGSoO9tv4MwA1UOZ2x+aFFI8IuicYD/QAc7YS/O EYsG70iycCNhzjL0r4dSDEOfdyUZRQp8HqECChrXECmifGivHWQdn3j9NcmjrPFTeC9X uVmw== X-Gm-Message-State: AEkoouuG24MjacK0hL1ulLxkztm5f8N0G04GjXV/814STgar1ZKCVGC2H19GfgMcBbYoCg== X-Received: by 10.194.221.134 with SMTP id qe6mr7634648wjc.165.1470895451378; Wed, 10 Aug 2016 23:04:11 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id c16sm1432144wme.4.2016.08.10.23.04.10 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 10 Aug 2016 23:04:10 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> Date: Thu, 11 Aug 2016 08:04:09 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 06:04:13 -0000 > On 10 Aug 2016, at 19:13, Ben RUBSON wrote: >=20 > As soon as I do the following : > iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 > I get this error : > iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument I also get this error (invalid argument) whatever the IP address I give = to the command, as if my initiator did not understand the iSER command = "ISCSIDCONNECT". How to be sure everything is correctly compiled with ICL_KERNEL_PROXY = enabled ? Thank you, Ben= From owner-freebsd-scsi@freebsd.org Thu Aug 11 07:47:39 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86507BB6BE0 for ; Thu, 11 Aug 2016 07:47:39 +0000 (UTC) (envelope-from honzhan@microsoft.com) Received: from NAM01-SN1-obe.outbound.protection.outlook.com (mail-sn1nam01on0132.outbound.protection.outlook.com [104.47.32.132]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3FD4A13F0 for ; Thu, 11 Aug 2016 07:47:38 +0000 (UTC) (envelope-from honzhan@microsoft.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=AHk6bd3rhxl+CUzk9x9ryVBQAbL6pjffinuHzUIy8JQ=; b=js+vSBRIpeKhDzuNSQHlT1kJc5uVwt6vGzHlqxVsQ9HMU17A/x3Mou2kGv1jyjh2iRlyT3tVtdEQ/yPschijUhCnVgwDOIUWmP2psjPrxtrTfcoflhtlKD4B6VyIleZ35sdMj+/f+rr9ENEfIHVfBtuk+Qb1FiGyxnAPQIzdaPw= Received: from SN2PR03MB2224.namprd03.prod.outlook.com (10.166.209.155) by SN2PR03MB2221.namprd03.prod.outlook.com (10.166.209.152) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Thu, 11 Aug 2016 07:47:30 +0000 Received: from SN2PR03MB2224.namprd03.prod.outlook.com ([10.166.209.155]) by SN2PR03MB2224.namprd03.prod.outlook.com ([10.166.209.155]) with mapi id 15.01.0549.025; Thu, 11 Aug 2016 07:47:30 +0000 From: Hongjiang Zhang To: "freebsd-scsi@freebsd.org" Subject: How to ask XPT/CAM to ignore invalid LUN devices Thread-Topic: How to ask XPT/CAM to ignore invalid LUN devices Thread-Index: AdHzov/N0Bvg/5XwRLmUlN5VZ1j12w== Date: Thu, 11 Aug 2016 07:47:30 +0000 Message-ID: Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=honzhan@microsoft.com; x-originating-ip: [167.220.255.25] x-ms-office365-filtering-correlation-id: 431dbfd0-0ad4-40f3-0936-08d3c1bbbf7d x-microsoft-exchange-diagnostics: 1; SN2PR03MB2221; 6:ZHha685w8V2cLAlZqLJuFaShIOj+YDhWtmaMlQ2MebTPmxS1PaqxaAbCpjhZ5Oz0CGM/UCa4nQLEHmW5gr3PMi3JRbSsV7UsfY0c0ITlNWbi7w6ZD1B46SIuWvD28FEH99obxxQuJJwBTa1zRFaTyRGdXAvKpE7NM1eYNHYaxKyckTn8XotSvu0xxLGVKI+8HOqTndDWWwtcH94in4QfzhUR6p18bTFjGSb4Ius9KvZk4jsdRn0z9qfQzDcboRTV89ODrXQ8xbCKs9GRzbt0WUXjhh1fXx4KlJQzooYNfdo+bnCbcRDyFVtaD+/RREoavUpFNryZ5VuVX+KiFg4NcQ==; 5:+Jdvo5uEEXGwyQVKGkPxiKCqQZ0zc0B2qnOopIEPZugI24fNZ041JRgzZEJJVZPBWCEqjgI7lZkLg5dto9csWR5K4BXCLL38E7Qb1uOXvX6dOn9YDlEa1wDfnx7+RAYMJt0MbZCQlyI19EZh2fwlSA==; 24:NpRoJyXEeKHPTZaXtATc67CQRV2q4oOyDxckGjwRB0VuW6lAtwWnFvJmj10i2qEm4axd0zK5btH9ZOMOmoOm6ywSnKyuyauyIQyTY6j9kqQ=; 7:q5D1cmxiajP6AT1HpYC/od+/Evxord8ZRB4OCDNLKHx5lRwXrmgmAxsiQgPJCAGft2f0Bhunm9O9/29kUdl6XP0gjZ8xEkLB9ckZkFXl/YgBfHIFkHW2WhGOAaHzufXBA/SgWkMLrCl/kkH6KjL78xKCIBfKBaO0NmKUWIJipRuPTdQxaSDfhUF2NUbjoOwFo3BHQdD/H5aDbf9FTJPlwP7BUnTeNOUAB65bPkzBzapaO45MBWVvcPkOKKjtavE8 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:SN2PR03MB2221; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(61425038)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6055026)(61426038)(61427038); SRVR:SN2PR03MB2221; BCL:0; PCL:0; RULEID:; SRVR:SN2PR03MB2221; x-forefront-prvs: 0031A0FFAF x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(7916002)(189002)(53754006)(199003)(50986999)(229853001)(3280700002)(33656002)(5640700001)(586003)(5002640100001)(86362001)(54356999)(2351001)(450100001)(7696003)(189998001)(110136002)(7736002)(2501003)(3660700001)(2900100001)(97736004)(16236675004)(77096005)(74316002)(15975445007)(106356001)(105586002)(7846002)(99286002)(11100500001)(5630700001)(86612001)(8990500004)(10290500002)(2906002)(76576001)(3846002)(9686002)(19580395003)(8936002)(101416001)(122556002)(10400500002)(10090500001)(87936001)(66066001)(92566002)(81166006)(19625215002)(81156014)(107886002)(8676002)(19580405001)(102836003)(19300405004)(790700001)(68736007)(5005710100001)(6116002); DIR:OUT; SFP:1102; SCL:1; SRVR:SN2PR03MB2221; H:SN2PR03MB2224.namprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Aug 2016 07:47:30.3918 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN2PR03MB2221 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 07:47:39 -0000 Hi all, I'm developing the SCSI storage driver for FreeBSD on Hyper-V. During lun scan, if the specified lun does not have a device, the Hyper-V h= ost responses the FreeBSD VM with INQURY data: "0x3f 0x0 0x5 0x2 0x0 ...". The "0x3f" has already indicates FreeBSD VM that the device on this lun is = offline, but why there are so many /dev/passXX were created? root@hz_BSD11:/usr/home/honzhan/clovetrail_freebsd # camcontrol devlist at scbus0 target 0 lun 0 (cd0,pass0) at scbus1 target 0 lun 0 (pass1,da0) < > at scbus1 target 1 lun 1 (pass2) at scbus2 target 0 lun 0 (pass131,da1) < > at scbus2 target 0 lun 1 (pass3) < > at scbus2 target 0 lun 2 (pass5) < > at scbus2 target 0 lun 3 (pass7) < > at scbus2 target 0 lun 4 (pass9) < > at scbus2 target 0 lun 5 (pass11) < > at scbus2 target 0 lun 6 (pass13) < > at scbus2 target 0 lun 7 (pass15) < > at scbus2 target 0 lun 8 (pass17) at scbus2 target 0 lun 9 (pass19) < > at scbus2 target 0 lun a (pass21) < > at scbus2 target 0 lun b (pass23) < > at scbus2 target 0 lun c (pass25) < > at scbus2 target 0 lun d (pass27) ...... Thanks Hongjiang Zhang From owner-freebsd-scsi@freebsd.org Thu Aug 11 13:22:30 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54AAABB4F2D for ; Thu, 11 Aug 2016 13:22:30 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x241.google.com (mail-wm0-x241.google.com [IPv6:2a00:1450:400c:c09::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DD0521290 for ; Thu, 11 Aug 2016 13:22:29 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x241.google.com with SMTP id i138so1360598wmf.3 for ; Thu, 11 Aug 2016 06:22:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=SmEQmd++VuR+chkrvSeolsgViqtH4iHyCsqruvf4IEQ=; b=0XTZjsUKcGmWTudLzNHJW77nLepzYPD8NqHBdwPiIRh5adp+5h5HpbGioDv2UQqEUC y1rYP7MEQXYKL9rVbxrHv7gQI1NG/QM7bEPp5v3UxGustvdwxW5LjBq33BzB0oO5whlw VCvJn2PWflJWrl+U0JuIY+OcIuMgcOdBcreqIVvpIz3BrPxLsd7nGCL7lFP1lqliCdlP KZ6r1kqqMRT+LvyXhE9CmOEP9PoW9rPkjYJQwgX2/aKNtPNgsz2TE+2Smo6aL/0Jqf5g A+EW1qpVuR3yHDh6f32Ou1vQEtNGVVhmo0U2oMSqluLQ4Ogg+8F1kLVb8ZCR+Fwirq7H vb7g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=SmEQmd++VuR+chkrvSeolsgViqtH4iHyCsqruvf4IEQ=; b=jKwpvVKSbpkojd515G+TSTfLLFYtWIIKfQ2aMCLhKSvwA2BVVgHg0ZmnLecR85PSrX JexqT55bBWuCaCZJ5O+MaZND9E4YomJzHqR/pPUwE6ommws8FQhLkzt9vdok43WwjUVU Y7kDcE66V0omqkZ8EP35u+L/bh4cdc3BKTsv8/6jajJBzXZ0HKjsImQA03Ro7NeEWUgw X840utLnmrRdR1AlNGqu5dH2YX9EDge3eeT+lPjEZ1z9dbc4iJwLiVZb2iKli0QNdSlq abH27HfpZ9udUFnlpKqNhGsDM8ZLFXJfBe6us0adPIR2KbjTZUdE6Z9tH+D65fGOwXKc h98Q== X-Gm-Message-State: AEkoouvarF4ZI98AVW2SiUMnvcUP4LG3WUaIkbcYbqrgrRupFvok60F5e5dpH9+fBBtaTg== X-Received: by 10.28.215.81 with SMTP id o78mr9768681wmg.42.1470921748362; Thu, 11 Aug 2016 06:22:28 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id 190sm3205231wmk.13.2016.08.11.06.22.27 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 11 Aug 2016 06:22:27 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> Date: Thu, 11 Aug 2016 15:22:26 +0200 Cc: Oren Duer , Roy Shterman Content-Transfer-Encoding: quoted-printable Message-Id: <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 13:22:30 -0000 I just tested to connect to a Linux iSER enabled target, but I still get = this error message at initiator side : iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument > as if my initiator did not understand the iSER command = "ISCSIDCONNECT". > How to be sure everything is correctly compiled with ICL_KERNEL_PROXY = enabled ? Ben > On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >=20 > Hi Ben, >=20 > iSER initiator is supported in FreeBSD-11 but not the iser target. > for the target you should use Linux target such as TGT (user space), > Lio or SCST. >=20 > thanks, > Max. >=20 >=20 > On 8/10/2016 8:13 PM, Ben RUBSON wrote: >> Hello, >>=20 >> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>=20 >>=20 >>=20 >> ### My configuration : >>=20 >> 2 servers with Mellanox ConnectX-3 NICs. >>=20 >>=20 >>=20 >> ### What I did : >>=20 >> I rebuilt kernel adding the following to GENERIC : >> options OFED >> device mlxen >> options COMPAT_LINUXKPI >>=20 >> I built iser : >> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >> (I saw later-on that I could have used "device iser" in kernel = configuration) >>=20 >> My /etc/ctl.conf : >> portal-group pg0 { >> discovery-auth-group no-authentication >> listen 192.168.2.2 >> offload iser >> } >> target iqn.2012-06.com.test:target1 { >> auth-group no-authentication >> portal-group pg0 >> alias my-iser-disk >> lun 0 { >> path /dev/da8 >> } >> } >>=20 >>=20 >>=20 >> ### Error : >>=20 >> As soon as I do the following : >> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >> I get this error : >> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >> iscsid[655]: child process 1187 terminated with exit status 1 >>=20 >> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet = is sent at all when trying to connect. >>=20 >> Did I miss something ? >>=20 >> Many thanks ! >>=20 >> Ben >>=20 >> _______________________________________________ >> freebsd-scsi@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" >>=20 From owner-freebsd-scsi@freebsd.org Thu Aug 11 13:45:47 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA842BB59F5 for ; Thu, 11 Aug 2016 13:45:47 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30071.outbound.protection.outlook.com [40.107.3.71]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 330D41645 for ; Thu, 11 Aug 2016 13:45:46 +0000 (UTC) (envelope-from maxg@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=+KkWESNawUqAcCa1OmYb06Tq3dh4SXZHAu3LRUKcoZ0=; b=qwwLhMB+NzCEDkj9X2fl89b8TwuLws2IZlZFuStLt4XcwWxzLr4dIvxjIpOVzMQnXI52ox7wBbXcODh5PNu+CVTQ8JRcSI/Op/vqiwWg7aWRx1TN0eCXOc3uxH+Hzzmolupk+f9iNe18AMmrLs5lBDO5xYzWd6M9QPoOD87jBeU= Received: from AMSPR05CA0048.eurprd05.prod.outlook.com (2a01:111:e400:8000::48) by AM3PR05MB0773.eurprd05.prod.outlook.com (2a01:111:e400:8849::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Thu, 11 Aug 2016 13:45:37 +0000 Received: from AM1FFO11FD005.protection.gbl (2a01:111:f400:7e00::198) by AMSPR05CA0048.outlook.office365.com (2a01:111:e400:8000::48) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.549.15 via Frontend Transport; Thu, 11 Aug 2016 13:45:37 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by AM1FFO11FD005.mail.protection.outlook.com (10.174.64.87) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.567.7 via Frontend Transport; Thu, 11 Aug 2016 13:45:38 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Thu, 11 Aug 2016 16:45:13 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Thu, 11 Aug 2016 16:45:13 +0300 Received: from [10.223.3.133] (10.223.3.133) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Thu, 11 Aug 2016 16:44:35 +0300 Subject: Re: Help to make iSER working To: Ben RUBSON , References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> CC: Roy Shterman , Oren Duer , "Oded Shanoon" , Hans Petter Selasky , Meny Yossefi From: Max Gurtovoy Message-ID: <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> Date: Thu, 11 Aug 2016 16:44:34 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.223.3.133] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134; IPV:NLI; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(199003)(189002)(66654002)(377454003)(24454002)(5001770100001)(107886002)(7846002)(7736002)(4001350100001)(3846002)(83506001)(6116002)(586003)(189998001)(31686004)(2950100001)(626004)(23746002)(356003)(87936001)(65806001)(36756003)(65956001)(15975445007)(2906002)(54356999)(81156014)(4001430100002)(11100500001)(8676002)(86362001)(47776003)(8936002)(50986999)(76176999)(81166006)(4326007)(64126003)(230700001)(19580405001)(106466001)(92566002)(33646002)(31696002)(19580395003)(305945005)(77096005)(50466002)(65826006)(3940600001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM3PR05MB0773; H:mtlcas13.mtl.com; FPR:; SPF:Pass; PTR:mail13.mellanox.com; A:1; MX:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; AM1FFO11FD005; 1:u3a/PwsbZMqfDNzCic4LjCqgTiSeGLluI+c3cuEh/VSLmlWZ4v4sa8p8AiF8tCDkGEnccFGQxwtov3ixSNv7UWEYoAAPSKt4kILRhS6Fqia4XDsNxM0wGOVcxcoSwP62IFWMb5SBUv8ACIdqj0YTTSnXG+cuxr/d4cZvZy4fj6UUOMOB1tHS0gJMVOhPtQyQ8PmdzbVtVGfbd69uUCvvcx3BzCEutK2BPUwyC8zCg0orcUYCyLAV/vP5rt9XXWa9Go/trzsTx61avD7BlzY7A7GXgVQn0/7VIMBWe1UsNZ2+7XvLJdnGKTaiOCbKitNKlRtHGfQwFu/K/B1Es1Yba2Y3aGalACJDMq1JvNro7ocuIt6LAdXk0fNutt8QH/WVrdXsxjpoQNs7ro+gW2TJEYNmFQLFHF4Yf0QyLamsCYLCHI5SlL1Maa6nLaA/koyINPHfNQhMeB78irz+hheW5hydIFs5XM7TUsL01MoihahxHGnJn8KEtlbMJrTwPPYW2gMEoZX6cMk0j1GKM1yiJ06Dvtd8c7QQJy1xN3qFUjk= X-MS-Office365-Filtering-Correlation-Id: 3d90222b-1f7b-406f-c1fc-08d3c1edc772 X-Microsoft-Exchange-Diagnostics: 1; AM3PR05MB0773; 2:0cqVdiqII/lt5uttgld1fm1qd9zG1nfHRX1AC02h88CQT8E/yF+DATWF1ZLK+6QiPZBy6UcUQORVrxBD/yZWU2+JY3quKz1hQqNTZP3h9xM+pViSO6oDyo+Tk8DcwZAtPQD5NRP0AgTz6TNAQJkIluV4mnMrd6Gpi1lAjNy2hZb73aInMM9UdJW58vHUqD8g; 3:3+9QmJNKtf7Z4vnG1ukCzZ3ENLwmE+XlEbOXP0ZHJHyR5pSRqbaxmjgqTRKUer0q27QpAngZ14JqGjnmm9wm/ItkTrG9fAh8vd7mb/em4rwwK0dZfkh6CARbmfCdBqcpJdSwQfHiHJxMh93cVRM6J15zjNeqvwUixX9Ih56BiEELT9RI+C8V4a7CkZujWxBZ4N5NgxdR6ihcBpIPa3PcMaq3EViyNk7aIxSHKdwTO7MD2eyHBs1DG/VGxFgrekbOf6bA8LMtVdcj7vbj3t20cQ==; 25:isUxd+sR+7WlbC9uomHONfrJ4UuKwkGurkqD8Wk3zoLVwa258eGMRCDcHT8tm+5KxxwzFuAuTnFW70mRApY/CNbUejhOhLCxIRFWOf26id167vMpjYOwwxMxE2t5hdOVqm608+RhVO91+SY+Rpbk0sRodN2N+QuOAI8qGd3el9Ynfa76tvX7DfUta5on50SqQt+lua7YoHcZrIQ8vKdfcAMr6GBkaD79LwEys1FidSgE04tsTs/yjC2/iryP2861UNFQgzPfR2m5shI6z4c9Mly1ddlOWaM+JM3aEs6lTTAD95tMRSCT7Zb0EgaQ7Mv46/X6jgCYuPShm3lecIVLIAFJak/i/NBrUyAD6oL8ZIb6adg+A7AbA8Lc6D03P6jelcvUxk8ZJW8y5WQZI7xUq05HEXPRJmoFIgErcpGluBo= X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(8251501002); SRVR:AM3PR05MB0773; X-Microsoft-Exchange-Diagnostics: 1; AM3PR05MB0773; 31:22NpVYtpCIZ0615UwtcPtQWbEKpByB/P3cqpqKyx6QBPYpvFefLATBPiJZ2Kw6x22BM6LzbIdWpCY0rbf/eGPejraSmxenWkaK2yvr6Mmm7m2a1VcCHlWNJrDc3Nny2Z+bbLNJZRc86vl3Z0e+r4xNybL4kq0nWxdlJ/Db2lkV8I+Gia1TNOCVwork5OY4CD857JPtjYNZScaSwBBubgsO3SUdoEJySv2V3KaMd7zCA=; 20:9A9ohcwd69L5Z1h92zCqNLi+grdUGoX3vSWRYJZqqD1sbtBGx4m1cYg+YdeIq2khF+R1/qRSCFAQ9Cig0TlEzGyQ4C3s4WTqEEgZQknVaUR2iwTZAx+qA7lvczbELNAEVPB6EBFom/pPZIoBfsjLuaeVV4Ia+ig+8KjtSJx1jux2hJLvD2dQbhLpovK23qZSwp+/62JCAdgYu58sxF+NzNz1m5bC0wnhQ46/8urSKKpkQ2iYh5mJY+2HbrNwzgB29wksjsJyzC5fqLb0qK+7JLdPJ3HPY6yjSyJKOlN/HyksryBtxBMctGVBSTRWPgBmnJmmB9G1JOw1zIUu/wrShfCtyv/iJ7/LrpwP8A/hwxEm3LpsOMnHu1psqiLCg2GncW6W0fIPEjz6Pg8ExfNcoi6FYmP1FQcfyilbohUKBFvcDjBIoAByWYiteol34A3QaH4IvVOQ3fBH4Ud+aNYf/mjJkvV71j+QJ3byge9OoQufvyNETnzQ/lPlx479ASRR X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(258220229709018)(75325880899374)(21532816269658); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(5005006)(13018025)(13016025)(3002001)(10201501046)(6055026); SRVR:AM3PR05MB0773; BCL:0; PCL:0; RULEID:; SRVR:AM3PR05MB0773; X-Microsoft-Exchange-Diagnostics: 1; AM3PR05MB0773; 4:4MpeK96UNRmTcqNoCT7E+UjQ37NgtOcpuhixoLUP4fmPCXIrplrK6K4DN5/iRx2rwlglsvCNWm2YXxEtxcRjVpi5jiWCRiB3uyPULmJTKOcwF8I3kDU5oy8Q/EY08vFEjBPi6AlHvcRluB2I9im0S5XQUVB+dSbNQvqvQAghPmf2heXfJd1kDfsqQyPwvfnEh8x4jNE/NTnirU0Kq9m8NWEg8CqRRymQQfGPPHbEYnddFJONM+2UPT4MDGJzW4FQ2ibaDm5LxzMEVN38vjGIPA359cxo0oBZsTi7vGNaoz0MuBaF4rEvt8B3msxOL+B9xcjqAFMv7eni4ILK/54oBWK4zXtlGETfJrRaVrcXEmpQdl4aV/VTTuVVRp8ZB/OGqnSpqSiAdymzHnNbq8fbN80NWkWnz7y9XszhErkUnIK0rbcrsreRqhS7tGZvk+aB7psLxr4crHpwoC5s59G/tFNHPUFDxi8WgOExQordMgnshhUuLu37EIyX5mCzFSnqMxPelhh8e1y67lnet4qM2MKqCnycXVsUhXaQmg5beQY= X-Forefront-PRVS: 0031A0FFAF X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; AM3PR05MB0773; 23:C6E4MVq/1a3tqcXgytGcBvn5jCMT4dBYoHV0o?= =?Windows-1252?Q?4o9HOpWeJMdV4vLNbguYW+tBVGcAY6ZGtIFSESHxUMMdjgScksWZAbnV?= =?Windows-1252?Q?XbAgOOo/6hHq0zypS26kOmNvisgMSLWjSj1TAwqnvdjK2ZfNUvpIWXUb?= =?Windows-1252?Q?ar9cFf0AoNBZlN+uwxflSoSTkWB31gNZCQNHGlhPJkp+HYnbl3oQxX1D?= =?Windows-1252?Q?Xl8MOLYddZeUH2eevJY4TesitIEYFyrzOVKCveTtAqH/E1RIYve1G+z0?= =?Windows-1252?Q?av3V/NTB/Mtd+5rhNLGQd/ao/vHtNmAPMvQuounQPJJz9SnGkZBF7W8e?= =?Windows-1252?Q?Wo6F8Xyhc8NCzjzm1WUmIDGnVoUNLaEN8+IcwquIAo5WVv05cyfCaj8B?= =?Windows-1252?Q?zII5uggP2QMuaZO50MIUp0rq6bWOfQ2XwCVdWwOOgqprqlBJ/A+/Vpa/?= =?Windows-1252?Q?ChFWCK2VWMnR7/iAZDpguaHvXGa7EI+Mc4jZdqw1sWnqvJIkxlxoU9On?= =?Windows-1252?Q?2kYTR9d/dImi01pEsvnRFlARqI0qjWuSTQS8YU2aMkw+HJs0+oFvhHOp?= =?Windows-1252?Q?mtEF5djwQUL74A70Yf86nlvglMA5bz2N89TafAhiyD63ENFHFm66mYrN?= =?Windows-1252?Q?dFEtIZJ/2C8VdK2K5seJmreuJBiFkvV+88EjKXVZ7YTV/RacRJi45tQ4?= =?Windows-1252?Q?NFxR0E0o/Xxd0/Ndw0Cn1jCfwKnqb99qJK3W2hRBDyuVejPRa01jKZk7?= =?Windows-1252?Q?BnV84lvNv1wu7KN6Fe/9UxPPRUQG1SJ+wZMXLbzsthIeoZCx1+oIcEzV?= =?Windows-1252?Q?jfC7kSX7ujnyjDYvGZU0ssOFiVzjAsgT42tswi1xbkf1ZJ+x4YchX8FI?= =?Windows-1252?Q?yuvdrdUsnm1FseH7Kb+ClBiMtMHouRxiu8xdkofU/pm0U1YGYtOzt+eZ?= =?Windows-1252?Q?W0uy/ee89rCC3guc96WSQVuMZKJK1OTgg8cwPgRDLT7GM5DI+ciaewiW?= =?Windows-1252?Q?TKE9CmTY3Gk7FlLWT60DTX048TpkvWSGYH6ujoK+t0Dj4cxMWeOxWPWZ?= =?Windows-1252?Q?gjlhGrue+u2JbK1inb8yvzjEKE9U7dYVbtcPa5B6NwMgQ4/nbV5b70nf?= =?Windows-1252?Q?A7Xvn57vVU+QQ0vD/GoMYO6OtCx2NZN9KuhsltrGmTCVqpuJg5fOnZzR?= =?Windows-1252?Q?9vPrDTj/ht8SwmZv87HZ9n2JTn/S5vFT88tiAwJUv9fzaIahGP0bAQV/?= =?Windows-1252?Q?hDFTyDabtBUlNcG6lpxsQ85RuVDk0rYOLNFdkD14ZRBcw6uydxbPKMSC?= =?Windows-1252?Q?ADKc0h/ifd2ZL5hTstiV+lHzjXathyTyBW9qgfRD7CpPOFMJvLniB1He?= =?Windows-1252?Q?WM2lFNEF0h4euzruim4UoPB2L9UW/GkxJJooqF4YJruHDeMcWR4CjSzG?= =?Windows-1252?Q?aSwUmjgCmWIkWFrRrslL4aL+DpuZIVn24dwGqZFSg=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; AM3PR05MB0773; 6:RwVKa32vxJLQgJX5EYfgYwGtWfCFPJRE7Qs6/O3uwf2Hp6ElmW9YULjkZk1nRQ21rfuqNJSqL6GLWUzwojN3+24kWe1nHQeRGoTnCGgzavJtKwKCkA8uk4F20hdOpWBlq6g8kP+zQwBMnZMAsmqPH6TP7LdMfJK4kn+Nk0ErOcOMXbqRZpBFINRNvyQUoA6gZurqLC7+WzkM92+MJrUMJDpBEwvmS9eJpwNJQX3GGpDl3ub4pQGdu20RlmydAUTh6E5mqkTwiaeqjz8qH+tSM+tKSxUJQTEGYReQsjWNtgq+B6UpB3wIuPpTvTRfwFapenwSEVC6vDgAmjO0UKsb/Q==; 5:0+cpsWBJWua3KvU+m+jvz3rnZCP2Qe8LU9oUMsGCXhDHC02HfeuaEYjST2wgjDrOmjf3sXvKwQjc/nNB84BTJm5+sy6vWHa5XBNmD0GbADJmhoIggObd0IHODN6AdcNWDnUXzW3JB1lheWxts+S2vw==; 24:+jbY/l+79wjCAvSthjPWP327XADapyrexAR2ol42l+NNO2riaq9Jj1+Wx2m1HSxPBChNM8CKjMCfEZd+2bCacoOLIB/MWITb8DJ6I+JOs3Q=; 7:PnCCPCe/4nUO0I1o+EBk8PLIfzZWANKJx2hpgezpGhVp0qIb76hYXOc1I2X56Krz9anlx714FTIsvFXua/7BsuPGjTix2gFs+Rmm3Yn6qB99LKIWHOxekJ/aLbqyPRat5DrRss/YdwJtmuxhPvBYUY2gPD5GSeVwVAeeUad/7/2VwKhtCo2N3Qhmc81vDgOHQwnLwl4ygtX95MhyahGsxegLvBQ0nY5JX0qrkDTNe4jX6a+VQ8wx7ZdjjKBcFUVE SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Aug 2016 13:45:38.5408 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM3PR05MB0773 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 13:45:48 -0000 These are the instructions I get from iscsi maintainer that merged our code to FreeBSD-11: 1. set WITH_OFED=yes in /etc/make.conf 2. "make buildkernel buildworld installkernel installworld" 3. reboot 4. kldload iser After that, make sure you configured all the interfaces correctly and that you have ping between the 2 servers. later you need to check basic RDMA stuff on your servers (Added Hans/Oded/Meny to help you if needed). Only if the above are working you can proceed to check iser. Max. On 8/11/2016 4:22 PM, Ben RUBSON wrote: > I just tested to connect to a Linux iSER enabled target, but I still get this error message at initiator side : > iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument > >> as if my initiator did not understand the iSER command "ISCSIDCONNECT". >> How to be sure everything is correctly compiled with ICL_KERNEL_PROXY enabled ? > > Ben > > >> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >> >> Hi Ben, >> >> iSER initiator is supported in FreeBSD-11 but not the iser target. >> for the target you should use Linux target such as TGT (user space), >> Lio or SCST. >> >> thanks, >> Max. >> >> >> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>> Hello, >>> >>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>> >>> >>> >>> ### My configuration : >>> >>> 2 servers with Mellanox ConnectX-3 NICs. >>> >>> >>> >>> ### What I did : >>> >>> I rebuilt kernel adding the following to GENERIC : >>> options OFED >>> device mlxen >>> options COMPAT_LINUXKPI >>> >>> I built iser : >>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >>> (I saw later-on that I could have used "device iser" in kernel configuration) >>> >>> My /etc/ctl.conf : >>> portal-group pg0 { >>> discovery-auth-group no-authentication >>> listen 192.168.2.2 >>> offload iser >>> } >>> target iqn.2012-06.com.test:target1 { >>> auth-group no-authentication >>> portal-group pg0 >>> alias my-iser-disk >>> lun 0 { >>> path /dev/da8 >>> } >>> } >>> >>> >>> >>> ### Error : >>> >>> As soon as I do the following : >>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>> I get this error : >>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument >>> iscsid[655]: child process 1187 terminated with exit status 1 >>> >>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet is sent at all when trying to connect. >>> >>> Did I miss something ? >>> >>> Many thanks ! >>> >>> Ben >>> >>> _______________________________________________ >>> freebsd-scsi@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >>> > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From owner-freebsd-scsi@freebsd.org Thu Aug 11 15:33:52 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1D04DBB5EE0 for ; Thu, 11 Aug 2016 15:33:52 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9BC4C1C27 for ; Thu, 11 Aug 2016 15:33:51 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x232.google.com with SMTP id o80so3705525wme.1 for ; Thu, 11 Aug 2016 08:33:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=aqMf4i3111HSw+umlUyM1UI7FdDRnPfYbmHW4p0U3T0=; b=yB2VjnSsLrouhCkhRjiOvy3uLz+ajp+4hpOjYwWZE1cokUt9X/hzyXSGwwF8vKBW1K gH8/HdGNZ5Gzvx4V47z5Oh5JJ1nsU4FrnBpVYa1izsbJjqw2FPpG3g4/KGMtcdUzFkfm +ePt5uZLX0IYLqwQFBLukT7S/W2D2SqUOu62js45uZqCeFtBw/4eNQwHheKhdVkxkn/X aHB/ARN96xz+fm0Sa1QKKEzYS4/jvM0Ma41mMZUs7dL1/hmnLoTf2uR78PQT+yUnyDdi kVD4IHEq0mXsVQPHbZi5FL6oWt7+YkTGCyziIASUMGrBhlBZ6DzzAzUk9Og+hm5ix+1p ZTpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=aqMf4i3111HSw+umlUyM1UI7FdDRnPfYbmHW4p0U3T0=; b=RbA0s6TiLs0vcotNMS369UKB4zOSOzbRVDtS9Gu9YMAEzx8iqBLCOeZuto/VZFCkw2 qhrMKZZcnaB+25pJM9lEf4/aXaxYZ3IGoVy3xAll0Nwf2kLZyWSj+26zCnQPTJt7YGBY zdAtGhmW3KICgHEFG3LCH7vgflwFWn6N6GiLEsfzpIH+mxdgHdLZdbzTajK0UnqWup5X 56Yaf2Hle5mkT/TaIrWm3ltJdzkFWSyA/JAZ320ZOF+1DzSQKNWU4rDqkj48WqSKm0mp jSTPLo3l62DUmzILPHtpf+cABSoFk8lF/ltfm4sWZTZPTw7nkBA44wXugBYrnv+QsysY 2yGA== X-Gm-Message-State: AEkoousinpqwowxNHuSlGWy+gQTIp1EP4B8JAuBjCN9wadP5T/ysz4ID9OjClkSvy8bJYQ== X-Received: by 10.194.176.165 with SMTP id cj5mr12489288wjc.82.1470929629359; Thu, 11 Aug 2016 08:33:49 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id r67sm337186wmb.14.2016.08.11.08.33.48 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 11 Aug 2016 08:33:48 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> Date: Thu, 11 Aug 2016 17:33:47 +0200 Cc: Roy Shterman , Oren Duer , Oded Shanoon , Hans Petter Selasky , Meny Yossefi Content-Transfer-Encoding: quoted-printable Message-Id: References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 15:33:52 -0000 Thank you very much Max for your help. I managed to compile the kernel with iSER support doing the 3 = modifications below. I added the following to /usr/src/sys/conf/options : ICL_KERNEL_PROXY opt_global.h And I added "options ICL_KERNEL_PROXY" to my kernel configuration file. I then faced this compilation error : /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: = error: implicit declaration of function 'icl_conn_handoff_sock' icl_conn_handoff_sock(cs->cs_conn, so); /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: = note: did you mean 'icl_soft_handoff_sock'? /usr/src/sys/dev/iscsi/icl.h:158:7: note: 'icl_soft_handoff_sock' = declared here int icl_soft_handoff_sock(struct icl_conn *ic, struct socket *so); So I replaced icl_conn_handoff_sock by icl_soft_handoff_sock (sounds = like it is the needed correction). iscsictl -r now does not produce previous "invalid argument" error. @trasz : perhaps these modifications should be done in FreeBSD 11 source = tree ? Now I'm facing the following issue : # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 iscsid[8743]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: = Input/output error kernel: ERROR: iser_connect_error: conn 0xfffff8096786f000 iscsid[1078]: child process 8743 terminated with exit status 1 If I remove the "-r" option from the iscsictl command, it correctly = connects to the target. On target side, Lio, targetcli : /> ls iscsi/ o- iscsi ............................................. [1 Target] o- iqn.2012-06.com.test:target1 ....................... [1 TPG] o- tpg1 ........................................... [enabled] o- acls .......................................... [0 ACLs] o- luns ........................................... [1 LUN] | o- lun0 ..................... [iblock/block1 (/dev/sdc7)] o- portals ..................................... [1 Portal] o- 192.168.2.2:3260 .................. [OK, iser enabled] I wanted to make some RDMA connection tests with udaddy for example, but = I did not found the FreeBSD version. Any advice ? Many thanks ! Ben > On 11 Aug 2016, at 15:44, Max Gurtovoy wrote: >=20 > These are the instructions I get from iscsi maintainer that merged our = code to FreeBSD-11: > 1. set WITH_OFED=3Dyes in /etc/make.conf > 2. "make buildkernel buildworld installkernel installworld" > 3. reboot > 4. kldload iser >=20 > After that, make sure you configured all the interfaces correctly and = that you have ping between the 2 servers. > later you need to check basic RDMA stuff on your servers (Added = Hans/Oded/Meny to help you if needed). >=20 > Only if the above are working you can proceed to check iser. >=20 > Max. >=20 > On 8/11/2016 4:22 PM, Ben RUBSON wrote: >> I just tested to connect to a Linux iSER enabled target, but I still = get this error message at initiator side : >> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >>=20 >>> as if my initiator did not understand the iSER command = "ISCSIDCONNECT". >>> How to be sure everything is correctly compiled with = ICL_KERNEL_PROXY enabled ? >>=20 >> Ben >>=20 >>=20 >>> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >>>=20 >>> Hi Ben, >>>=20 >>> iSER initiator is supported in FreeBSD-11 but not the iser target. >>> for the target you should use Linux target such as TGT (user space), >>> Lio or SCST. >>>=20 >>> thanks, >>> Max. >>>=20 >>>=20 >>> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>>> Hello, >>>>=20 >>>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>>>=20 >>>>=20 >>>>=20 >>>> ### My configuration : >>>>=20 >>>> 2 servers with Mellanox ConnectX-3 NICs. >>>>=20 >>>>=20 >>>>=20 >>>> ### What I did : >>>>=20 >>>> I rebuilt kernel adding the following to GENERIC : >>>> options OFED >>>> device mlxen >>>> options COMPAT_LINUXKPI >>>>=20 >>>> I built iser : >>>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >>>> (I saw later-on that I could have used "device iser" in kernel = configuration) >>>>=20 >>>> My /etc/ctl.conf : >>>> portal-group pg0 { >>>> discovery-auth-group no-authentication >>>> listen 192.168.2.2 >>>> offload iser >>>> } >>>> target iqn.2012-06.com.test:target1 { >>>> auth-group no-authentication >>>> portal-group pg0 >>>> alias my-iser-disk >>>> lun 0 { >>>> path /dev/da8 >>>> } >>>> } >>>>=20 >>>>=20 >>>>=20 >>>> ### Error : >>>>=20 >>>> As soon as I do the following : >>>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>> I get this error : >>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >>>> iscsid[655]: child process 1187 terminated with exit status 1 >>>>=20 >>>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no = packet is sent at all when trying to connect. >>>>=20 >>>> Did I miss something ? >>>>=20 >>>> Many thanks ! >>>>=20 >>>> Ben >>>>=20 >>>> _______________________________________________ >>>> freebsd-scsi@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>>> To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" >>>>=20 >>=20 >> _______________________________________________ >> freebsd-scsi@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" >>=20 From owner-freebsd-scsi@freebsd.org Thu Aug 11 16:26:55 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 586A4BB6DE0 for ; Thu, 11 Aug 2016 16:26:55 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30055.outbound.protection.outlook.com [40.107.3.55]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 63C601C3F for ; Thu, 11 Aug 2016 16:26:53 +0000 (UTC) (envelope-from maxg@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=FjxECiLNKobdoiErtuzcmVCUkS5GH40EgshxIHgDRt4=; b=eVhwHtUZVe/5iHxlY/b1WlTSVgJYZAH+KACCjvrdv0qINbhNg5e3NGn/qIBV7zv4Z5LopX763SZMnlv+uPUaxq/e6VPXKA/uPcQnl1zKmMm+eIfrkTXopBz7zaVR+L0ex2Eg67Ljx9MIqwiEhsj/4099dTcTJXFT0huskyZdi1g= Received: from AMSPR05CA0015.eurprd05.prod.outlook.com (10.242.77.143) by AM2PR05MB1203.eurprd05.prod.outlook.com (10.163.148.141) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.544.10; Thu, 11 Aug 2016 16:11:48 +0000 Received: from DB3FFO11FD032.protection.gbl (2a01:111:f400:7e04::143) by AMSPR05CA0015.outlook.office365.com (2a01:111:e400:8000::15) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.549.15 via Frontend Transport; Thu, 11 Aug 2016 16:11:48 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by DB3FFO11FD032.mail.protection.outlook.com (10.47.217.63) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.567.7 via Frontend Transport; Thu, 11 Aug 2016 16:11:48 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Thu, 11 Aug 2016 19:11:26 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Thu, 11 Aug 2016 19:11:26 +0300 Received: from [10.223.3.133] (10.223.3.133) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Thu, 11 Aug 2016 19:10:59 +0300 Subject: Re: Help to make iSER working To: Ben RUBSON , References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> CC: Hans Petter Selasky , Oren Duer , Oded Shanoon , Meny Yossefi , "Roy Shterman" From: Max Gurtovoy Message-ID: Date: Thu, 11 Aug 2016 19:10:58 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.223.3.133] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134; IPV:NLI; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(189002)(45984002)(24454002)(66654002)(377454003)(199003)(31686004)(305945005)(76176999)(54356999)(50986999)(33646002)(87936001)(19580395003)(93886004)(65806001)(65956001)(36756003)(92566002)(189998001)(6116002)(19580405001)(8676002)(2906002)(4001430100002)(3846002)(230700001)(83506001)(81166006)(106466001)(4326007)(81156014)(586003)(64126003)(50466002)(2950100001)(356003)(4001350100001)(23746002)(5001770100001)(31696002)(47776003)(7846002)(11100500001)(86362001)(77096005)(15975445007)(7736002)(107886002)(626004)(8936002)(65826006)(3940600001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM2PR05MB1203; H:mtlcas13.mtl.com; FPR:; SPF:Pass; PTR:mail13.mellanox.com; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; DB3FFO11FD032; 1:KdAasFyLQ7YqagUv9QkcQhF4ByWOa9ONTdkgdD2ufcdm55IVkcWKigOanrvWYpIyZMtZ/eZJIXtBBOnFRfFPWOwly7LbukUSQ3elifKHWkjsY/dILsjNhohSg6sHQHtXnflbCZrZw667pm+asoTCP/l+9I9gNdsYRa7gWAx1Q0k4UC9rgZTyITwIq0CDKkX9KNR1fzxqSvnOlsUWBJ4NVAcb1AABes4bkPM2Z98bDz4YIUDW00R3EV+O2AbsR34vxR55caB6GxZmEvh0On/poKTuuV9yOt4qx9PryPyJ1MVtfmezJoLUABHcvjiCL8OGyy0ANCwqKJ4RQFB3o3mUqXCzKkMz9/oWFoSx4x58dZGCw9N3FSJ0S4FpdRb7cTi9gbyZnRuWPSdF3z9XC5w8IZNPz0hinu9xxatZYwxns4DO2F31BbUP++x6Ic0qcWshPt/5KIXL3V2ojNPgfcae/1I7vg7b5OFZM/xgDT06Wh63H5fNVl+QHWtnhGRrNYagQBXt3mcYGKr1Kk6OSdWKzXQlNNK0OTMe3L3HKpSKIXM= X-MS-Office365-Filtering-Correlation-Id: 98da05ff-f3c1-468c-7e7c-08d3c2023306 X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1203; 2:DY6sAzxbAsnmK7/l3WOo6UM9CxGtqBZGu7y7jxFsn1ZcS8JYkuYcUTItnnJwRZ3IbS7m4RXUA1WxqUbRrPz3LfqJtKeVsdeRwkvzw8Z4uM8cYwk1gXviznKjfQB1vKYqSgz+o/BUrBs/IgCcQJ0eUodZ9V+Pa12XVmds5PZjuwVEidFd7LiZPGL8HVUXYrW6; 3:05ib+qdeHDHOHhn3IxtB8HgdF9cXn27DxY23HdbZYTCOSMz4HX4M2zdu4dE5DfEJXYtTKiIAjeKlC0mXc8zDB1u4UwRgmFyJC5B9Ri0Y4D7e2B48h/nlnGSNZsNE/JrKoN2KBbpg+8Qv2dd3fXEw6tNWymbkI8s7815ZTgStf3aCEhTBkrGX75d6XSqWGMrFvgOU49YiTrPfqiKRbG8TUQ1YIxBloXUkBgsX+p6agvYMeccY+ruX6eD7SsFVrFjOVS2nSNTkyeU8kZjQYGBZ6A==; 25:wgFYtQaOCOs/WEz9y+svY4ZAISNwf78Z/+j9xuVLRX23aJyMrFtO4BnFOTO+AjmJ/oebDTYsbqSYSCIlEiCla2QhOg78p4MfXeI/OimfqhmRLspPeuTkLV3VnPvxZuW7HQZEgoQcwk1mof9shgYdzXGsTYCYFd7QFdr3j1qfGlzFUs48BQ5o5cDj0IX6pRYzGNMR3RKpMl5jdrCyynHW+T4nUE8dlLI5CO9vn5UqNTOl5JFhq6v8I0xNcZW1yuPn9QcoqaFAJhU9y7V2jCTe54iJ3AhgBdjrwZiVAalPWoMGN97MCM5da5w+haWb9OP6l+bwORu0dH80rc2qcPfv+Kn1LN812yQ8oXHrw4jLwpBq/CahaVlOlg6crLg3nF4onQalyzD5AyQRtxsrMhj7+289tdOGMyNj9TPKkdJNMmg= X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(8251501002); SRVR:AM2PR05MB1203; X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1203; 31:TMzLqqANq0qxWDdmMMNncAZRJC+eRgzMVvywzwY3wNE7ZcsUrwexqa7ckjQLVZm+W2viEIa3+NBBqKih+8hJHtJjNraCxTZxPfNCA6y6j5tYvtz4/zsYvdBG+plcFbTevcUhPOXlQrLbw8DdvBG7fAfgjRH8TV7yiY9mr9q91Ctm6S0WEK1jMlAoT4Fcp+Nnxt6lo5SBm1lvhbmrfF7SYmYWVHH0WUnR+7KDCCVMc+E=; 20:K96B/0Ctgbh1YCTrS94OZlyJnncZLHBUSe5nJ0z5uyF8qrNy2tVgHoTXm8Ue+/zm6wN0i26wE8E4Grpm35mSmPBZ1q+BZVX9e3e/pnsFZ8jvxHJYRXyeu3r7CDhhET/V84onSoYwJI/WrJrOKyQW40LV2rCl/4i4MLO3Urd0xigX3TEBWHkHjoK+Xdx9H8fHgaYmi9zyBWehUSRspXlJZJA+ypen+JHJhjyY34xHj67Bpax0xsC0d8cYm2jrEJJy28WqgOh3DbR6PTb+uMG1784zlPXcTHr5OFwe7vOwF/mRkhurQ+Zp9N0O8tpX/sF9zUBou6Rdk38hIBiYiyTg9/kurXQWq7DMry91klw0fD+FEh0lQl0h++if+iLGKm2H7HNDIdASp8mX36o4tEio5NOFND8WNuXgAKlXjujW/Ix8c8pWqsaLYHOPI401k27hsWUDFscqf4SFqjqOr5cnaJJRju53w/YCY3y+5E1I68dx/SqGTLI2j10W2vv++CHL X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(258220229709018)(227817650892897)(75325880899374)(275809806118684)(21532816269658); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(5005006)(13018025)(13016025)(3002001)(10201501046)(6055026); SRVR:AM2PR05MB1203; BCL:0; PCL:0; RULEID:; SRVR:AM2PR05MB1203; X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1203; 4:UVig+I1hSHa8uCEa3+hBa3D2yy+FfNUlyh7B0kkxSnTv843TYsX0XEc+miceniAWv2SezSirjtKHrQ8FdN5tJEEQ4Aiv+YSCs2Zpl9Vs+KjbnlCC8L38wtnO2feVAGU5QW7F0EDXbIfL8MUIKn6xNJyCQ2wcAWVMo4tzdD1Srs8OQv4JW4MBAeCeT6i9C++99ojaiDXj03jlmfi0qJ39KauCb+EzKbWvsa3Ml8fawf5Oa7eqTywOutY6Ufb9QSpEx4aYwb2s6KPwPS+O3YE69Q7kr1Yo9Zwq93RI1PKkcF//UL1Mt1o4tGj0BQJVn9Bmr8Nne/eh1LnwcyUtb2pir9ffkWASiIlVDsUnjUBm07g7Bd/3n1P/7s2bZ/fLgdB+wK7356YzmKBEAts8tIViNceZXMODOABO6HS4bkl5gd8A4Mo1m+lfBj9gHGfOG2S3HulpzSLmVfj8hkXqHDSERwCrwb34kfin/8CxTW3tWXks3y6zu2kn2JpEe0xfe6YpPFkPf1QKABqTIvrNrlyeO0rWg/GHNEhG3lbBfS/KWvxYE7xDBvWJHcJFh1G8Ld1/uGhgidOBNkXw8WA7tyyIhtT1/lB4E11PZiWqLRu0jgU= X-Forefront-PRVS: 0031A0FFAF X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; AM2PR05MB1203; 23:HwK8kuROizvsC6M+kMEpwNjmFknadRJ7fXPEs?= =?Windows-1252?Q?3ZIbPrp1fwk9DIAJ1eTgnCEzx00Eu5FFPgJot/5jVeKzmGYjaPx9BVtf?= =?Windows-1252?Q?I/FXOMNDIB0ZPHenjjpSJSGPc1YwOnpSmDAWrqZCHzIzehRrtXdCdbmQ?= =?Windows-1252?Q?1n0K95fSnvbeAo51ZCO/bDzkS14CuotcM9P+BxxEXeVz/SOnF3+luEP1?= =?Windows-1252?Q?oGiwCQ+kn2LjtNGixk2g7pABhdonMmZgiuj1rvsIRMQddj24RUFwj0L0?= =?Windows-1252?Q?/6gH8XRCw4bQReOUeNnXtBMPaYxREWdC5WCJn6f1PiMck0j0UfnMB9Sm?= =?Windows-1252?Q?pPlrwoCpct3cDHxZiqRJadqNOXt7Op80bOixq4MMNoAqP7ozvadStoSm?= =?Windows-1252?Q?dGcWM9zeX6SxHkbh9UYdUMNvQs3BZjF698PBtHKzPCJC68Uc8fx/UViJ?= =?Windows-1252?Q?UrufITQRY9I2nhGINeJt0lRts/mc7HP9JoqiUiBAY1mUcZj+CKbpBhi5?= =?Windows-1252?Q?hvnSlKbDk8HQZq/ow5iIYmIqr4l6tVPFb9PWM8zU3ubdSUN2lehRwG13?= =?Windows-1252?Q?qrItckE2zCs26P7sdZJC8cD9MaLuBr0diwP+S2q9nYeZj8SGY5Z1hKN2?= =?Windows-1252?Q?swT+410kP5sYD+WjFKfJJfkQDEBP5ZwnHHhknMbHGygARoXEhMSKSftf?= =?Windows-1252?Q?oc2jFkVIpzVNN9HJtOeOE6bGwXEfmE2fGKbIxj7nZPbqCvzsvnFdKwCu?= =?Windows-1252?Q?IGnm9LHIfXcG31Q7JG+szgyhCAed+H/l5gvgOMiQf53oaV8m4EX5Pryc?= =?Windows-1252?Q?I8dg/9XTR1nEJcgYQ4yGpSJLGQnuwoUeoDxBiAir7Oji0hXDSnxZtfUm?= =?Windows-1252?Q?q2CwDWQO1eJhQU2E0AkPkGvm6jkXyVIWvlVxQZEDr17pWgi622jhLDNJ?= =?Windows-1252?Q?XEoeN14mQ6FsUaBGLRZ9Rs1HUjXupZi+cIG5IRI84KqQzZeRsYIu3/6f?= =?Windows-1252?Q?axgM55ElvTrWnFKTHvskiQWc//oyThmldPJDzqP9A6mG8wLAzwchZWdL?= =?Windows-1252?Q?JRFujaosiqS5a6vF/3JQqQwTrl+iPoqgX8IqfST+3anu8y8NmblDNyGE?= =?Windows-1252?Q?OxGUw8rCDquHSPLWc1697EfhIjjMDeqED4JM/tJjr0YupQ+8L3yVRHIo?= =?Windows-1252?Q?bAwR6K6oaBN2qTr58k6me2SucfyTFho2fMPgh7VlOUpFZ1m50igDFJDp?= =?Windows-1252?Q?wVVGYOxOJgK34u544BNxaSs2S8clRRcH/zM4lsCSekA+LMvW5FzQggvq?= =?Windows-1252?Q?+j2rEp29Dqns6JAu5/zEpgQ5u7zS/GmwcCYssfM7QgIIVrHomyfX/iO2?= =?Windows-1252?Q?nOmkrOg+0ZrGEv88Kxx768JmO3SxUeKNHCW32I5jxhq6PC/uMRfXRz0F?= =?Windows-1252?Q?E3pfhMrXhWnULJBAd7QbIucgwplArvlSSV4imdyuTRvc7VX6dS6iZ1pc?= =?Windows-1252?Q?N2M7wTyCRyN0lkoegBXodtfZwwmdno9KT1MfphIppBXCmF/uw=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; AM2PR05MB1203; 6:fNErqW94w8zlalpmyYa+BvPlGEWFvGyzvTIGWa83CduN2TLeArKd6anXYtwuoQZa8xtcdu21wqr3j0aO9s2fnfPUgVk2rTpFHeK983n3Q8Dl7cgFKb6gYnrds0CbNTMNdkAFKAXXA+eShCQbkeyRXHWHfuq/yQLIv5yjsvTBD5+fOO4gDA9ZfFMBkYxGxexNk/eaDI5EVD2o3bfxcuw6XRzTE/bhpQgLZX3cDTLldzNd9towthBfZPmxV6TISpIRhisKHhga04XKmK5ItTMM8kb9JgmSYJ1dkEkGAVgtmt9E+uGbvioGsAam5p9uc8GHX0+ei8DA7lHDKeyw6cIp8A==; 5:KZI67lTY8eTXiPVV/SVkuuEewq/YHitj6VvD5nhIH0KW5JTHqieKV3rz3bjtVsH/1ELCxy3riSM6v8MusacSV1VoPUXww3n5PpnQFEcpLDTyFlWQlZ3fBsSfzTqmbk0fomMhd+VCeamWkQ22xDANpQ==; 24:jg8XOeggoY4N6O+e8b3SQxn/uAhfaW6Xvxdbw5cskNDCIykoJiZwqgAZmFEfFxgCSprtIgXeN0BpNANMO3sEg2bfwF62pVtmwIByBgnblsY=; 7:Zb7VUoz/bqX+HTvqlIL3U93cWwoauoxpq5hRR7SqDy57J0W/mPiSrcfEOlnj5kY9uQnrBbt7EAsr20ACOvm5PsHIL15gmKew2W4q/5BOuPO8sNWJJ7W2QvIj4XNThZz+LswSl0pUOhmthOibf0yRMgxVk8i4Z3syPbpedS4k+b83aJfSRZFX6dqBmNxv7PH/CXJ7NvIkjcmFX8ldUXRNrvUniKi1ikfDnLhgv2lQXwKXtEXGM6t0L0kPwKc7hyXi SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Aug 2016 16:11:48.9130 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM2PR05MB1203 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 16:26:55 -0000 Hi, On 8/11/2016 6:33 PM, Ben RUBSON wrote: > Thank you very much Max for your help. > > > > I managed to compile the kernel with iSER support doing the 3 modifications below. > > I added the following to /usr/src/sys/conf/options : > ICL_KERNEL_PROXY opt_global.h > > And I added "options ICL_KERNEL_PROXY" to my kernel configuration file. > > I then faced this compilation error : > /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: error: implicit declaration of function 'icl_conn_handoff_sock' > icl_conn_handoff_sock(cs->cs_conn, so); > /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: note: did you mean 'icl_soft_handoff_sock'? > /usr/src/sys/dev/iscsi/icl.h:158:7: note: 'icl_soft_handoff_sock' declared here > int icl_soft_handoff_sock(struct icl_conn *ic, struct socket *so); > > So I replaced icl_conn_handoff_sock by icl_soft_handoff_sock (sounds like it is the needed correction). > > iscsictl -r now does not produce previous "invalid argument" error. > > @trasz : perhaps these modifications should be done in FreeBSD 11 source tree ? > > > > Now I'm facing the following issue : > > # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 > iscsid[8743]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Input/output error > kernel: ERROR: iser_connect_error: conn 0xfffff8096786f000 > iscsid[1078]: child process 8743 terminated with exit status 1 please increase the debug level in both initiator and target and sent it out. From first look I think you need to configure the LIO target to work with demo mode. Another thing you can try is the user space tgt target (compile with make ISCSI_RDMA=1) that I work with mostly. > > If I remove the "-r" option from the iscsictl command, it correctly connects to the target. > > On target side, Lio, targetcli : > /> ls iscsi/ > o- iscsi ............................................. [1 Target] > o- iqn.2012-06.com.test:target1 ....................... [1 TPG] > o- tpg1 ........................................... [enabled] > o- acls .......................................... [0 ACLs] > o- luns ........................................... [1 LUN] > | o- lun0 ..................... [iblock/block1 (/dev/sdc7)] > o- portals ..................................... [1 Portal] > o- 192.168.2.2:3260 .................. [OK, iser enabled] > > I wanted to make some RDMA connection tests with udaddy for example, but I did not found the FreeBSD version. > > Any advice ? > > Many thanks ! > > Ben > > > >> On 11 Aug 2016, at 15:44, Max Gurtovoy wrote: >> >> These are the instructions I get from iscsi maintainer that merged our code to FreeBSD-11: >> 1. set WITH_OFED=yes in /etc/make.conf >> 2. "make buildkernel buildworld installkernel installworld" >> 3. reboot >> 4. kldload iser >> >> After that, make sure you configured all the interfaces correctly and that you have ping between the 2 servers. >> later you need to check basic RDMA stuff on your servers (Added Hans/Oded/Meny to help you if needed). >> >> Only if the above are working you can proceed to check iser. >> >> Max. >> >> On 8/11/2016 4:22 PM, Ben RUBSON wrote: >>> I just tested to connect to a Linux iSER enabled target, but I still get this error message at initiator side : >>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument >>> >>>> as if my initiator did not understand the iSER command "ISCSIDCONNECT". >>>> How to be sure everything is correctly compiled with ICL_KERNEL_PROXY enabled ? >>> >>> Ben >>> >>> >>>> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >>>> >>>> Hi Ben, >>>> >>>> iSER initiator is supported in FreeBSD-11 but not the iser target. >>>> for the target you should use Linux target such as TGT (user space), >>>> Lio or SCST. >>>> >>>> thanks, >>>> Max. >>>> >>>> >>>> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>>>> Hello, >>>>> >>>>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>>>> >>>>> >>>>> >>>>> ### My configuration : >>>>> >>>>> 2 servers with Mellanox ConnectX-3 NICs. >>>>> >>>>> >>>>> >>>>> ### What I did : >>>>> >>>>> I rebuilt kernel adding the following to GENERIC : >>>>> options OFED >>>>> device mlxen >>>>> options COMPAT_LINUXKPI >>>>> >>>>> I built iser : >>>>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >>>>> (I saw later-on that I could have used "device iser" in kernel configuration) >>>>> >>>>> My /etc/ctl.conf : >>>>> portal-group pg0 { >>>>> discovery-auth-group no-authentication >>>>> listen 192.168.2.2 >>>>> offload iser >>>>> } >>>>> target iqn.2012-06.com.test:target1 { >>>>> auth-group no-authentication >>>>> portal-group pg0 >>>>> alias my-iser-disk >>>>> lun 0 { >>>>> path /dev/da8 >>>>> } >>>>> } >>>>> >>>>> >>>>> >>>>> ### Error : >>>>> >>>>> As soon as I do the following : >>>>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>>> I get this error : >>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument >>>>> iscsid[655]: child process 1187 terminated with exit status 1 >>>>> >>>>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet is sent at all when trying to connect. >>>>> >>>>> Did I miss something ? >>>>> >>>>> Many thanks ! >>>>> >>>>> Ben >>>>> >>>>> _______________________________________________ >>>>> freebsd-scsi@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>>>> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >>>>> >>> >>> _______________________________________________ >>> freebsd-scsi@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >>> > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From owner-freebsd-scsi@freebsd.org Thu Aug 11 16:59:41 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AE568BB68AF for ; Thu, 11 Aug 2016 16:59:41 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x22c.google.com (mail-wm0-x22c.google.com [IPv6:2a00:1450:400c:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3AF3A17C8 for ; Thu, 11 Aug 2016 16:59:41 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x22c.google.com with SMTP id i5so3636158wmg.0 for ; Thu, 11 Aug 2016 09:59:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=fCRk9WHkdg9U/HrRR8g2US8RNggrHk8tKS4Qk98ryDY=; b=m+uKAIy4uPKke8E5qCKv8t3Ub3m4+H/nMRMCbsoIvXcd5FFRgpaR5l+5av5xgHM3X7 HkPL8Wts0qGVQb10y5fu4IZy7bHrLJYAWod0FwpLJAfgYkDpIteRoV0oxy+G/QA2GZDM 5g22/cnSek/KozMFDxXZGphjOt8teVlL6UauThnELB4MPzPUGGc2FEIKuTVM5NY1E+B0 UR+jUGfSaQFmbsLEBBbSNjRU3GP/HqsJB09WY6DHa2aBkIzQlsPlcDFRhiC+nOxIw0Hi TqJ9g85c5wfoXu+Qis2JPgfghlEaNzklDeaMvjBn7kuGDPtPSENTFKo+SY9PQ6cWZ2Zr YO5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=fCRk9WHkdg9U/HrRR8g2US8RNggrHk8tKS4Qk98ryDY=; b=KoMKhJWftjs9aI2T9Vl+mPpBWtfkPbdxkfwk8KVhlwNq0WQBEOJCWwecqbkSL3Bow2 cny98+lohWz3zJUqrfX6ifuIafKdCyuoC+MJlCZbvTaXUfU9LmlnxDapAixhUyhhUn7D wfgYd2uLj7cOfQj+irxI2glh/0Fk1ZSaPkRYpr9eGe/Rocr3pNJiPrjhCZplaviAwGVL jlXfeR5gfrChfVLZ3B+O6jC9xZRh9G+zq2cL3qdqNWJRgRrxYylJRYy6kjrAJV5tM9Ct BUmmqGhveqFxTHzFA4C2vfHUnMe/3N+rCxMc82PP6LTvkR4t4BfwuZzFqPcMQ2PhViK0 C/Kg== X-Gm-Message-State: AEkoouvFzvNzxQrEyXx0ZxR8nTFXxX8Eg+XTMhFXg3ub3xQdiYib1kNVAVN2XSKVJGPksw== X-Received: by 10.28.170.5 with SMTP id t5mr9780174wme.70.1470934778744; Thu, 11 Aug 2016 09:59:38 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id f187sm666076wmf.15.2016.08.11.09.59.37 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 11 Aug 2016 09:59:38 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: Date: Thu, 11 Aug 2016 18:59:36 +0200 Cc: Hans Petter Selasky , Oren Duer , Oded Shanoon , Meny Yossefi , Roy Shterman Content-Transfer-Encoding: quoted-printable Message-Id: <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 16:59:41 -0000 > On 11 Aug 2016, at 18:10, Max Gurtovoy wrote: >=20 > On 8/11/2016 6:33 PM, Ben RUBSON wrote: >> Thank you very much Max for your help. >>=20 >>=20 >>=20 >> I managed to compile the kernel with iSER support doing the 3 = modifications below. >>=20 >> I added the following to /usr/src/sys/conf/options : >> ICL_KERNEL_PROXY opt_global.h >>=20 >> And I added "options ICL_KERNEL_PROXY" to my kernel configuration = file. >>=20 >> I then faced this compilation error : >> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: = error: implicit declaration of function 'icl_conn_handoff_sock' >> icl_conn_handoff_sock(cs->cs_conn, so); >> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: = note: did you mean 'icl_soft_handoff_sock'? >> /usr/src/sys/dev/iscsi/icl.h:158:7: note: 'icl_soft_handoff_sock' = declared here >> int icl_soft_handoff_sock(struct icl_conn *ic, struct socket *so); >>=20 >> So I replaced icl_conn_handoff_sock by icl_soft_handoff_sock (sounds = like it is the needed correction). >>=20 >> iscsictl -r now does not produce previous "invalid argument" error. >>=20 >> @trasz : perhaps these modifications should be done in FreeBSD 11 = source tree ? I'm also rebuilding world with the following to see if it can help : # cat /etc/src.conf=20 WITH_ICL_KERNEL_PROXY=3D"YES" WITH_OFED=3D"YES" >> Now I'm facing the following issue : >>=20 >> # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >> iscsid[8743]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: = Input/output error >> kernel: ERROR: iser_connect_error: conn 0xfffff8096786f000 >> iscsid[1078]: child process 8743 terminated with exit status 1 >=20 > please increase the debug level in both initiator and target and sent = it out. Logs from the initiator : iscsid[39668]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: = Input/output error kernel: INFO: iser_free_ib_conn_res: freeing conn 0xfffff8048d276000 = cma_id 0 qp 0 kernel: DEBUG: iser_conn_connect: before cv_wait: 0xfffff8048d276000 kernel: INFO: iser_cma_handler: event 1 status -19 conn = 0xfffff8048d276000 id 0xfffff80880606800 kernel: ERROR: iser_connect_error: conn 0xfffff8048d276000 kernel: DEBUG: iser_conn_connect: after cv_wait: 0xfffff8048d276000 iscsid[1078]: child process 39668 terminated with exit status 1 Logs from the target (here I tried TGT) : No logs, as if TGT did not receive anything. If I try to connect without the "-r", here is what I get : tgtd: login_start(502) Target iqn.2012-06.com.test:target1 is RDMA, but = conn cid:0 from iqn.1994-09.org.freebsd:srv1 is TCP So target is correctly iSER configured. I tried without iSER on both sides, of course it works. > =46rom first look I think you need to configure the LIO target to work = with demo mode. I double-checked, LIO was in demo mode, I followed this guideline : https://community.mellanox.com/docs/DOC-1468 One strange thing, on initiator, sounds like no packet goes through the = interface when trying to connect : # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets hw.mlxen1.stat.rx_packets: 386 hw.mlxen1.stat.tx_packets: 409 # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets hw.mlxen1.stat.rx_packets: 386 hw.mlxen1.stat.tx_packets: 409 > Another thing you can try is the user space tgt target (compile with = make ISCSI_RDMA=3D1) that I work with mostly. >=20 >>=20 >> If I remove the "-r" option from the iscsictl command, it correctly = connects to the target. >>=20 >> On target side, Lio, targetcli : >> /> ls iscsi/ >> o- iscsi ............................................. [1 Target] >> o- iqn.2012-06.com.test:target1 ....................... [1 TPG] >> o- tpg1 ........................................... [enabled] >> o- acls .......................................... [0 ACLs] >> o- luns ........................................... [1 LUN] >> | o- lun0 ..................... [iblock/block1 (/dev/sdc7)] >> o- portals ..................................... [1 Portal] >> o- 192.168.2.2:3260 .................. [OK, iser enabled] >>=20 >> I wanted to make some RDMA connection tests with udaddy for example, = but I did not found the FreeBSD version. >>=20 >> Any advice ? >>=20 >> Many thanks ! >>=20 >> Ben >>=20 >>=20 >>=20 >>> On 11 Aug 2016, at 15:44, Max Gurtovoy wrote: >>>=20 >>> These are the instructions I get from iscsi maintainer that merged = our code to FreeBSD-11: >>> 1. set WITH_OFED=3Dyes in /etc/make.conf >>> 2. "make buildkernel buildworld installkernel installworld" >>> 3. reboot >>> 4. kldload iser >>>=20 >>> After that, make sure you configured all the interfaces correctly = and that you have ping between the 2 servers. >>> later you need to check basic RDMA stuff on your servers (Added = Hans/Oded/Meny to help you if needed). >>>=20 >>> Only if the above are working you can proceed to check iser. >>>=20 >>> Max. >>>=20 >>> On 8/11/2016 4:22 PM, Ben RUBSON wrote: >>>> I just tested to connect to a Linux iSER enabled target, but I = still get this error message at initiator side : >>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >>>>=20 >>>>> as if my initiator did not understand the iSER command = "ISCSIDCONNECT". >>>>> How to be sure everything is correctly compiled with = ICL_KERNEL_PROXY enabled ? >>>>=20 >>>> Ben >>>>=20 >>>>=20 >>>>> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >>>>>=20 >>>>> Hi Ben, >>>>>=20 >>>>> iSER initiator is supported in FreeBSD-11 but not the iser target. >>>>> for the target you should use Linux target such as TGT (user = space), >>>>> Lio or SCST. >>>>>=20 >>>>> thanks, >>>>> Max. >>>>>=20 >>>>>=20 >>>>> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>>>>> Hello, >>>>>>=20 >>>>>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> ### My configuration : >>>>>>=20 >>>>>> 2 servers with Mellanox ConnectX-3 NICs. >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> ### What I did : >>>>>>=20 >>>>>> I rebuilt kernel adding the following to GENERIC : >>>>>> options OFED >>>>>> device mlxen >>>>>> options COMPAT_LINUXKPI >>>>>>=20 >>>>>> I built iser : >>>>>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload = iser >>>>>> (I saw later-on that I could have used "device iser" in kernel = configuration) >>>>>>=20 >>>>>> My /etc/ctl.conf : >>>>>> portal-group pg0 { >>>>>> discovery-auth-group no-authentication >>>>>> listen 192.168.2.2 >>>>>> offload iser >>>>>> } >>>>>> target iqn.2012-06.com.test:target1 { >>>>>> auth-group no-authentication >>>>>> portal-group pg0 >>>>>> alias my-iser-disk >>>>>> lun 0 { >>>>>> path /dev/da8 >>>>>> } >>>>>> } >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> ### Error : >>>>>>=20 >>>>>> As soon as I do the following : >>>>>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>>>> I get this error : >>>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed = to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >>>>>> iscsid[655]: child process 1187 terminated with exit status 1 >>>>>>=20 >>>>>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no = packet is sent at all when trying to connect. >>>>>>=20 >>>>>> Did I miss something ? >>>>>>=20 >>>>>> Many thanks ! >>>>>>=20 >>>>>> Ben From owner-freebsd-scsi@freebsd.org Thu Aug 11 20:43:21 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D2DD6BB6CBD for ; Thu, 11 Aug 2016 20:43:21 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x22f.google.com (mail-wm0-x22f.google.com [IPv6:2a00:1450:400c:c09::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6542C1B17 for ; Thu, 11 Aug 2016 20:43:21 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x22f.google.com with SMTP id i5so15468477wmg.0 for ; Thu, 11 Aug 2016 13:43:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=3JrPnpun1e89a3z5LpAXBrX6WWSaEbMHShO+VolcqbI=; b=l85dnTXeAB/RPkpA6B7yjPBPQkCToB97mGp/vcU4eAp3JyCStSQ9mey5L06pCrihs4 zl+bvV5MH+XqPzYZHhQKJvN6HlJLVYGpabSCbbsDuD+StwLU+620GM5XXGhCsA+bhfsL 0JmZP4d1Vx8lWV08C5bA/ACoD5gY4cN1N8QqY5jiks7uB2zUfdaxkpryTEAExMTZTMj0 iV03cm3M6zg0st7ZuJvhvyfC6QPnrn4h1dhTZS7BeTuWts+TkChmpTIw9aBoBwAtWnVJ xi/6Rdw3A9CD6HEvOFNVWmeRmpAqxnVc5nfQA+IM2ZNbGBJlotzNVduDZoJlwT3sb4oS Ambg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=3JrPnpun1e89a3z5LpAXBrX6WWSaEbMHShO+VolcqbI=; b=BOwhLlXw/MReoKU7Euko0v5QTh8XIoh1CBnF8vGb5zcSLBxxgV93MlrugbyWk0+YSk f9/LwBGfYO5fT1ZE4VuR0WktJK6NVaM00v757BiG8nxeHGB4/1Tu/yqOP7PF9NvAMcfR OAl9OfMdZkHwP4F+LjYW2UMacWpVcRR2gbpo3JNKieyuPTH70oXfFtO7t+bXqsTBhND1 XSJeXpfQobwqUB+l7yhRkyUgzpAHq5oE9buseBMten7eoYU2nxiMQVVIVL5QbUDda7Da Q+Uta030Oz5F7Ii2g3NazAPDZi09IgAPQNh16HO3BUJGM+p8YXSx3zhym5uZa+KyZwIt 8hqg== X-Gm-Message-State: AEkoous7VNaJNOPi0M+lF7c54UzkoVcHeUuZULbvMPgU62r9RCXWrn3aIJ24f5as0S+T1g== X-Received: by 10.28.29.211 with SMTP id d202mr10726004wmd.64.1470948199512; Thu, 11 Aug 2016 13:43:19 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id v203sm1471518wmv.2.2016.08.11.13.43.18 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 11 Aug 2016 13:43:18 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> Date: Thu, 11 Aug 2016 22:43:17 +0200 Cc: Hans Petter Selasky , Oren Duer , Oded Shanoon , Meny Yossefi , Roy Shterman Content-Transfer-Encoding: quoted-printable Message-Id: <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> To: freebsd-scsi@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 20:43:21 -0000 Here are the tests with udaddy from FreeBSD, trying to connect to Linux = : # udaddy -s 192.168.2.2 libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. udaddy: starting client udaddy: connecting libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. udaddy: event: RDMA_CM_EVENT_ADDR_ERROR, error: -19 test complete return status -19 Sounds like the issue is with FreeBSD itself. Ben > On 11 Aug 2016, at 18:59, Ben RUBSON wrote: >=20 >=20 >> On 11 Aug 2016, at 18:10, Max Gurtovoy wrote: >>=20 >> On 8/11/2016 6:33 PM, Ben RUBSON wrote: >>> Thank you very much Max for your help. >>>=20 >>>=20 >>>=20 >>> I managed to compile the kernel with iSER support doing the 3 = modifications below. >>>=20 >>> I added the following to /usr/src/sys/conf/options : >>> ICL_KERNEL_PROXY opt_global.h >>>=20 >>> And I added "options ICL_KERNEL_PROXY" to my kernel configuration = file. >>>=20 >>> I then faced this compilation error : >>> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: = error: implicit declaration of function 'icl_conn_handoff_sock' >>> icl_conn_handoff_sock(cs->cs_conn, so); >>> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: = note: did you mean 'icl_soft_handoff_sock'? >>> /usr/src/sys/dev/iscsi/icl.h:158:7: note: 'icl_soft_handoff_sock' = declared here >>> int icl_soft_handoff_sock(struct icl_conn *ic, struct socket *so); >>>=20 >>> So I replaced icl_conn_handoff_sock by icl_soft_handoff_sock (sounds = like it is the needed correction). >>>=20 >>> iscsictl -r now does not produce previous "invalid argument" error. >>>=20 >>> @trasz : perhaps these modifications should be done in FreeBSD 11 = source tree ? >=20 > I'm also rebuilding world with the following to see if it can help : > # cat /etc/src.conf=20 > WITH_ICL_KERNEL_PROXY=3D"YES" > WITH_OFED=3D"YES" >=20 >>> Now I'm facing the following issue : >>>=20 >>> # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>> iscsid[8743]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: = Input/output error >>> kernel: ERROR: iser_connect_error: conn 0xfffff8096786f000 >>> iscsid[1078]: child process 8743 terminated with exit status 1 >>=20 >> please increase the debug level in both initiator and target and sent = it out. >=20 > Logs from the initiator : > iscsid[39668]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: = Input/output error > kernel: INFO: iser_free_ib_conn_res: freeing conn 0xfffff8048d276000 = cma_id 0 qp 0 > kernel: DEBUG: iser_conn_connect: before cv_wait: 0xfffff8048d276000 > kernel: INFO: iser_cma_handler: event 1 status -19 conn = 0xfffff8048d276000 id 0xfffff80880606800 > kernel: ERROR: iser_connect_error: conn 0xfffff8048d276000 > kernel: DEBUG: iser_conn_connect: after cv_wait: 0xfffff8048d276000 > iscsid[1078]: child process 39668 terminated with exit status 1 >=20 > Logs from the target (here I tried TGT) : > No logs, as if TGT did not receive anything. > If I try to connect without the "-r", here is what I get : > tgtd: login_start(502) Target iqn.2012-06.com.test:target1 is RDMA, = but conn cid:0 from iqn.1994-09.org.freebsd:srv1 is TCP > So target is correctly iSER configured. > I tried without iSER on both sides, of course it works. >=20 >> =46rom first look I think you need to configure the LIO target to = work with demo mode. >=20 > I double-checked, LIO was in demo mode, I followed this guideline : > https://community.mellanox.com/docs/DOC-1468 >=20 > One strange thing, on initiator, sounds like no packet goes through = the interface when trying to connect : > # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets > hw.mlxen1.stat.rx_packets: 386 > hw.mlxen1.stat.tx_packets: 409 > # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 > # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets > hw.mlxen1.stat.rx_packets: 386 > hw.mlxen1.stat.tx_packets: 409 >=20 >> Another thing you can try is the user space tgt target (compile with = make ISCSI_RDMA=3D1) that I work with mostly. >>=20 >>>=20 >>> If I remove the "-r" option from the iscsictl command, it correctly = connects to the target. >>>=20 >>> On target side, Lio, targetcli : >>> /> ls iscsi/ >>> o- iscsi ............................................. [1 Target] >>> o- iqn.2012-06.com.test:target1 ....................... [1 TPG] >>> o- tpg1 ........................................... [enabled] >>> o- acls .......................................... [0 ACLs] >>> o- luns ........................................... [1 LUN] >>> | o- lun0 ..................... [iblock/block1 (/dev/sdc7)] >>> o- portals ..................................... [1 Portal] >>> o- 192.168.2.2:3260 .................. [OK, iser enabled] >>>=20 >>> I wanted to make some RDMA connection tests with udaddy for example, = but I did not found the FreeBSD version. >>>=20 >>> Any advice ? >>>=20 >>> Many thanks ! >>>=20 >>> Ben >>>=20 >>>=20 >>>=20 >>>> On 11 Aug 2016, at 15:44, Max Gurtovoy wrote: >>>>=20 >>>> These are the instructions I get from iscsi maintainer that merged = our code to FreeBSD-11: >>>> 1. set WITH_OFED=3Dyes in /etc/make.conf >>>> 2. "make buildkernel buildworld installkernel installworld" >>>> 3. reboot >>>> 4. kldload iser >>>>=20 >>>> After that, make sure you configured all the interfaces correctly = and that you have ping between the 2 servers. >>>> later you need to check basic RDMA stuff on your servers (Added = Hans/Oded/Meny to help you if needed). >>>>=20 >>>> Only if the above are working you can proceed to check iser. >>>>=20 >>>> Max. >>>>=20 >>>> On 8/11/2016 4:22 PM, Ben RUBSON wrote: >>>>> I just tested to connect to a Linux iSER enabled target, but I = still get this error message at initiator side : >>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed = to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >>>>>=20 >>>>>> as if my initiator did not understand the iSER command = "ISCSIDCONNECT". >>>>>> How to be sure everything is correctly compiled with = ICL_KERNEL_PROXY enabled ? >>>>>=20 >>>>> Ben >>>>>=20 >>>>>=20 >>>>>> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >>>>>>=20 >>>>>> Hi Ben, >>>>>>=20 >>>>>> iSER initiator is supported in FreeBSD-11 but not the iser = target. >>>>>> for the target you should use Linux target such as TGT (user = space), >>>>>> Lio or SCST. >>>>>>=20 >>>>>> thanks, >>>>>> Max. >>>>>>=20 >>>>>>=20 >>>>>> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>>>>>> Hello, >>>>>>>=20 >>>>>>> I have some difficulties to make iSER (FreeBSD 11 BETA3) = working. >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>> ### My configuration : >>>>>>>=20 >>>>>>> 2 servers with Mellanox ConnectX-3 NICs. >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>> ### What I did : >>>>>>>=20 >>>>>>> I rebuilt kernel adding the following to GENERIC : >>>>>>> options OFED >>>>>>> device mlxen >>>>>>> options COMPAT_LINUXKPI >>>>>>>=20 >>>>>>> I built iser : >>>>>>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload = iser >>>>>>> (I saw later-on that I could have used "device iser" in kernel = configuration) >>>>>>>=20 >>>>>>> My /etc/ctl.conf : >>>>>>> portal-group pg0 { >>>>>>> discovery-auth-group no-authentication >>>>>>> listen 192.168.2.2 >>>>>>> offload iser >>>>>>> } >>>>>>> target iqn.2012-06.com.test:target1 { >>>>>>> auth-group no-authentication >>>>>>> portal-group pg0 >>>>>>> alias my-iser-disk >>>>>>> lun 0 { >>>>>>> path /dev/da8 >>>>>>> } >>>>>>> } >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>> ### Error : >>>>>>>=20 >>>>>>> As soon as I do the following : >>>>>>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>>>>> I get this error : >>>>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed = to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid = argument >>>>>>> iscsid[655]: child process 1187 terminated with exit status 1 >>>>>>>=20 >>>>>>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no = packet is sent at all when trying to connect. >>>>>>>=20 >>>>>>> Did I miss something ? >>>>>>>=20 >>>>>>> Many thanks ! >>>>>>>=20 >>>>>>> Ben From owner-freebsd-scsi@freebsd.org Thu Aug 11 23:07:52 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 345CDBB6070 for ; Thu, 11 Aug 2016 23:07:52 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0065.outbound.protection.outlook.com [104.47.2.65]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 541301FA1 for ; Thu, 11 Aug 2016 23:07:50 +0000 (UTC) (envelope-from maxg@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=hWKchZm8hRn+o01f6kLyM0yAYfHsKELJGu3oaOItpDE=; b=JWOju+LvQ9tIZ3NQcbMnV4YH2RPQmrs+jUpS5FzuQ6NuuvIj8wAk0mVk3MWlAfGYmXX7A1UhlxS9L91+fWOQATjevj0VXZVo82KCN0zNkGllUYcCaGE/a+Ot3YtyQiZal2NXtN4jpw3RO0M95S3Um7h3YQMRqyWk9Vo/bPMyH5o= Received: from AM5PR0501CA0025.eurprd05.prod.outlook.com (10.164.187.35) by DB3PR05MB0921.eurprd05.prod.outlook.com (10.161.59.141) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Thu, 11 Aug 2016 22:51:37 +0000 Received: from DB3FFO11FD004.protection.gbl (2a01:111:f400:7e04::165) by AM5PR0501CA0025.outlook.office365.com (2603:10a6:203:17::35) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.549.15 via Frontend Transport; Thu, 11 Aug 2016 22:51:24 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by DB3FFO11FD004.mail.protection.outlook.com (10.47.216.93) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.567.7 via Frontend Transport; Thu, 11 Aug 2016 22:51:25 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Fri, 12 Aug 2016 01:51:24 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Fri, 12 Aug 2016 01:51:24 +0300 Received: from [172.16.0.92] (172.16.0.92) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Fri, 12 Aug 2016 01:51:22 +0300 Subject: Re: Help to make iSER working To: Ben RUBSON , References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> CC: Oren Duer , Oded Shanoon , "Meny Yossefi" , Hans Petter Selasky , "Roy Shterman" From: Max Gurtovoy Message-ID: Date: Fri, 12 Aug 2016 01:51:22 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [172.16.0.92] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134; IPV:NLI; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(199003)(24454002)(189002)(377454003)(45984002)(66654002)(64126003)(106466001)(19580395003)(83506001)(4001430100002)(31686004)(50466002)(305945005)(76176999)(54356999)(356003)(2906002)(31696002)(86362001)(19580405001)(4326007)(87936001)(50986999)(11100500001)(65956001)(230700001)(36756003)(33646002)(8936002)(107886002)(5001770100001)(7736002)(7846002)(81156014)(81166006)(8676002)(93886004)(189998001)(586003)(6116002)(77096005)(2950100001)(4001350100001)(15975445007)(65806001)(3846002)(47776003)(626004)(23746002)(92566002)(65826006)(3940600001); DIR:OUT; SFP:1101; SCL:1; SRVR:DB3PR05MB0921; H:mtlcas13.mtl.com; FPR:; SPF:Pass; PTR:mail13.mellanox.com; A:1; MX:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; DB3FFO11FD004; 1:khtnRcNAiGQQtxzmr2w3EFuC5IlgCYMaR10ic484Ak3e7pBi+bX7G5M4aybsSodVDkkbxA55AwMOgzP4XCNlhjP6X/kL/7pbxYe/14/w2OlBa3WhiivY9qVeccrKi4eEGHkubj/IRUmeRu788toHKAIkvqJSTCv5w5Rsu2nbTnPCQgY7jr1yV1SLOeQwKGevPSKl9fXeLxLsSAjwLan3PDEvZrBbzwAS8d7K+UxUgFiftFZiJRvqMAq2/AAwETKcHt0xSBpBYWvxcRk+giEJQjf5N38UejnUQq7XM/Q3Ov+WVgcOpB49tH4nvYa1mGJjXtcYLP5Hl2WjMEwR1/MBKmVd+tzW7vFPmGg4qYJt5nPWHnHoxTOnO50aD1gkxooQ6OKH6NX14EDfzJqV3Jfopifldd+JQgK6vqBcT5VPak8SeczHq28tLmENQ3JlQhaSGr6g0u0/Ae2Ze6zlP63axTA/An4Ev6BpEkXknzAI+98t8O4z9Kp31+buQ903NnS5g7DUFPNEp95w8SN2NHNO9gWwb2cz5ohtlpYUi3JQqLQ= X-MS-Office365-Filtering-Correlation-Id: 5606362a-3cbd-4de8-d672-08d3c23a05ff X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB0921; 2:/Pyzyn0Xnh1uHN1gbkv2ClRjo61rgiT9zofJwldslQLO5OrkcRyUbTLH9RtSAtwCoj/xYci1X1Vzb493Lhn/YaHbFC2HTHfVQ2t200GOHJXmUA/ZTERIzzoy8fcVwvP2KqP1jux8HutopIjUorasl1uotES0DGI4xA5sIbOtU8LcTztmZM2amhoRxlOkVWH7; 3:UFEDG3nQBdKctDZ39WvjoRQXjWpQPCn/DPbwfWVD04bWHXl2kFq5GjtfOtfQU+FaJBgElhNabzxWee6HtmvZNjNjCkRgV1ntOoUJucNn57n2CTrO65zrVgMllD+qywcbi37z+AvrTFLlM8dB5jeoQ5p5dDWquvG0xtvhh2kt0ijE9lhD5IvZilKgcFXJrCPq2fIHhzzubcGDP6rLyS/cHwT9XDqdEpeBZAdeDGCs4GeZx0UrUev0cUyLFyS2EIkok7/cvWjwoK5EtSunhte/Fw== X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(8251501002); SRVR:DB3PR05MB0921; X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB0921; 25:ziJokv8VWvoQm7y7DifdEucgIGL1KXLrgCfknbVPfDoMaQTpS8zR2FxbeDN7jfcFk6ItHObAGX52svZRk3SP5jeeKL3ydUzFo3/OIzo4r9nSWfRJBlHjY3qJmxAtZE7mmcdojEvjPn3P7/yzZjc9w4K2Uc8M9ROv6AdbW5ZbcCLPqaPS7qIWOjjImJv/lR8sLdHCmxDj0LBm/l3ixi5nNgSDsjrfIY5j/AZIAD6C+4UhcvxaaUKyo8nf8wRP5IBfIv0bXiZtu0dNDZxZn8fxGnzh81a6QcHWJ7rl+0n7Rip7qEFUh7/rDAdboKu01VuOkJjtfIxIO5R2cGu8+uesAwYI3SM7gYN/7Zr8q1N//ODETGjiENC86JGxBaSRRbaw6ogedJcaqlzbIE5DiS1bn3v3xg6BCaSFs3a9RhJoDL7ZZyqoF9yuyVd1nTGXGO2ZNl0zdH17PVeFkyoaEBMOcx5UHXy6DjCNn8z6W6fAQMrp6hKZkNoP/ytcNvZ99HliI80pVcpXZlmGHL5ZP7F2TtXMgTT8aVZgPgjpzevTdwDLGadgWWzP4Eydi8X+QifJGoGzi+tXWoC+gY3MC7IqEkK36oLoRBNp0vWkDnnempyvBy3exPuvWdpcPENs3FlV2DAPlOUbXGbe+wdQa3gjb7na4vBAV44vxCvwp41iw7NdZd4m3LyIKHE8Kovy+q8FJrv83MSPizFIZa90tZPYvXIwIW7wDRhhXLWV0+WRB0jCYZpbJNVHDfQzo0/sdepcVfCjXQWKOEitBjTUveubAYaALPWNWpT5OR2Ymrhzu7V+5yIKEpi0kHjZsx9UhwjhZuTsy+H1OEiGzx82ZQxBQqBOEjU0MhMD3h/b/CQx1fx65slYbXd8vF7Zjk/kuZIR X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB0921; 31:9sDrd7710k4tRYzeqWEbf1IEMsRCKR3qwDkMlknvdru0w3u93sgMHwlaAPHhoHzz4COACNiNqLVUQcvr1NE3PQUuucBdzcsNCNhK4FGtY/mvQRLX5APEtSr8RJc3ac7JnfeF1Fq8w9Sn6PBY6tbt3JUsV+uj+n5EymQbLtkoCiUe/xgaNEkppnI/mKO0V9bMvJJuy6QSIuP3H16t3xvLPW86kG0EMm5doY6Iw/3jhag=; 20:dmeG6HKEt2EBBzec/Vfjz0Lp16hFx39ap1Wlw8QqdZr4KcyLNcJZIRzDWkgzZ6aHHjFUXq6fGKQ5pffBMM+O2bfg/D2Um2C0iOBy4VjzGFZSdJ21AvnMTtI3qld4DpBqCqEAW/X5OA90JK/3BqwKPnzBQhupMF7rFqVL7LGIlMAuvka4D1LiPt3tsuzCy//Yhlb+TSOIbNwyFeJDBY+NNARUpQV3KzVcWBcWxvhJgehZUAreJPSqeHFWOGabppfEm03nw0yk/Fmup7qZsH+/4d24VqSAsVWBH4w5sNJ4AYJJDeLEUvhBn4j7DT8VE8V0a32eqtKmHnYERGqJx55vQ0uSXqgfrKrB5DARocZ+UJ/TbCCZuOES+sD2GVuUJMt7COcNRiwJ/MRz7D/qo4sRo4rNkH8nSjS27vLwHwFdUN0Woq359MsGRLfk6ka5uydEsAdx0vGDB2upf4KZWGZXfFJvHvgGWEBHmZYl0ve08aj/iB3NrtfGs0StOSZ4nTac X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(258220229709018)(227817650892897)(75325880899374)(275809806118684)(21532816269658); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040174)(601004)(2401047)(8121501046)(5005006)(13018025)(13016025)(3002001)(10201501046)(6055026); SRVR:DB3PR05MB0921; BCL:0; PCL:0; RULEID:; SRVR:DB3PR05MB0921; X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB0921; 4:NWgd5iQGdiNwHLWvYIeEoG/JlT06LR6J07HN0Q2Kx4+vx1x2HLCwL76+dn4+CMFA+aKGjbL31c8IEbWoyuMHGHz9Fc/WhtGf7ZndOUmfBRHzhAj1BGs35oACwUj0PJ5AXjhWOZ4G6f0dbwPQy0MEJSGL0ytbCkUHRXn1LIUJFkekUYHXzfMIy6C6wa4+9n+5RcQN4Dlvyc2qXGqFCuxuteUAFo4MXiZQPf8/ivvwpLuAbbU9myVBxj7t4kZnzJO8P4sVNH1XyQ+ESe8KW4Hrt6dUY19TB5ueFxzs2iX6rVeNd0j4LRWZvsXfGKvxDJLhaoTTJNXbsN7VJ33i8VC3GXOm89jJkpoHQH0TlaWUOOO4AmacHWWLXz751LTwiYw9wIehsLeNdIjvG4gaGKJODjiaUKHPBvtOs6zZXM0buYyZvJsN7S6WK6zYkhBfPDztc+hEgidkEsH/rHXLdkI5jvlNn7h+TXxfieJUShXzSPdEXPo8XhzD+g1z/BdNkwlCMnwlex3WA4OeeXK1MvZ2KJfUqcVWJZPtrRnsmt5ksP4PNjA4ozyTFaoariI4lEH/aweVUok5xa4ejBq7E2iMMBGR4pIlOMPJ8pzha4JdJzYgx1WD42VLpI7CbuiSZp6X X-Forefront-PRVS: 0031A0FFAF X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; DB3PR05MB0921; 23:DuwV+wi1ELet9nrbibtryTogjQLQO3uv0p1pl?= =?Windows-1252?Q?DPvyTev8+N+YeRN9uJWGAlYFdCC6fiooqCP2lw7BVKoaMCaFn6yVCdez?= =?Windows-1252?Q?9jlY5jAyf88+p7dh6Lb/jbKE/g+lwDPPB6vIDSaYtG86egEbreu1E/Fd?= =?Windows-1252?Q?viW6p396j3p7mJE9zk6vwLOqGcnJ/VGyWJDSpsO3zRnKVnDaIN4J4/Oc?= =?Windows-1252?Q?H/9+5VilgHu+dvMCXJRsy6vPKMAEuGgvBrFKFXwrjkXLfIkpNr00h1qx?= =?Windows-1252?Q?ADo3/pRMvJa5b6FrkeVbjxLHe0Q2kQMLGE05HDNPcjO1w/JVem4btkH8?= =?Windows-1252?Q?n7OYubOWHM9iijO6Hz4CbgRsObmjWVu0SkgDE8g3iENpeehgis4CXNpR?= =?Windows-1252?Q?Xl1flEYq5T1nqIZJ/FNF8REk2Ycxr79r0lQqTGMrfyuwV0cxRFr6JvhD?= =?Windows-1252?Q?o3Bl1qONFoxIKhl5e0CjZT5H85OekNLISr/tpCG4ZOTW51DDrIRLFi3P?= =?Windows-1252?Q?Fhk2BcNRqXMBUUBeomOd8C70CsnYIzRP0Xg+1AMbUHmXGnZUC4foFj0p?= =?Windows-1252?Q?O0yigGS4W+SaEqNLMk//W219OD5PS7JhheOOiFRzY072WLed27N0tUhs?= =?Windows-1252?Q?ULutm3deH9hrDN2udJSQBGvCsBayo76u9eyCJ2fjrEiR/isVbFwJVsG1?= =?Windows-1252?Q?MoAqvwKbTSVLOjF6RkBltD4mK2pOKHZr7CXj7U7shHfX7+JVf8TlAbJE?= =?Windows-1252?Q?1MUIpXhdxTC8GNm7L6kUikVIgDV2ZVbnpjPbE63eRpjUxXB3RMtoJRre?= =?Windows-1252?Q?Z+RYtT68QZ+5uPqCkbHFE+PbzZa3hSl2S/9/qWLy73jvvW1wplMQOhcT?= =?Windows-1252?Q?8n9WzPClTtlnu1IH8YDmMfCIT5+MTeDjhsIpzz0SGdX03cCTyPnZdH3S?= =?Windows-1252?Q?OlrAqN7jp55kjtn/WiyqF0HVlhgG1xg2IeJvAdGYirQzlqUCF6oJ9o7I?= =?Windows-1252?Q?sbahbu/wff4aI2ZoLhEi3mfntg9RaAAQ4m7AiaOh8vQwA0wKpt1rpSu9?= =?Windows-1252?Q?rAWlZVgxwuLll0hXJTIPNBVVy/fNUJ395GtilCf+QlAxgbIIfK1EHggU?= =?Windows-1252?Q?KX/sN/y51m+TEk2zZFa8sKjn9QcxDomLvuMZCOtPZvzb9ddsmsrCndl3?= =?Windows-1252?Q?32hn17skPf/V7a4NAtLDvIT7Lf2xya4BFR1T/82ThYLYWf+h2jMyBI9Z?= =?Windows-1252?Q?+5zzvvE+IIZTotfO+SF9mRKaLzdH+hTKRVpwRzEsKtX6MiE/p1hUa3vt?= =?Windows-1252?Q?Mn6lUbH1dypqi7hd7U19OmVZdU/RWN9avNhfxo4AEYOA/F3UJZjXydQt?= =?Windows-1252?Q?Bo8FmpaRAsgNpsy7MrSjnUVjoeQTxK+j8OiU3XWK+3w8DvHih4KX49X6?= =?Windows-1252?Q?h0hV48fMbvSbezS6/s80DQHKOUtOGmjR2fYN3+pPsn4IUP0V252n6UXg?= =?Windows-1252?Q?WnOK42HUhNdBdei1zStYgmBlcG2gMavl70ZOHoTtf5aFPX+mQ=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB0921; 6:tBWP8ho/lAX7x26hrD1zMCdoer/AH0FQMnwN4pg1Ydm+dPC1x00lMZK4DUgqxXBrQARu97Vh5eRGnMOMn5qyv/ig9wmyV8QeDEuDtiNNrnrZUM4ANpRB5dlpAw4sv0br7yl3T3gbfaTnsZTMc7Dz33PXFRbSOtXhf4JlWN4CxN7BByY5ubV5oDohZwcyWzwU8iiBlMDz8EG1K+W7oSjXdKVRSZBH4Iv59ecJk196RourNTJ+cBDyn/7Umr+hJ8ioUIIqMjk6L62KPftmKfw+P8z4Mic9PBFc66EB9eMVeF3xgc6O9qa3KSUHfLlb+UylxFrL7KSO7p0JyO4ushgeGw==; 5:qn0rdolS0MzI5R0EC6PgvCnZwdsTLcKDaEyXBZFTaUyotIqJkzanYU6ERO9z+eIosIFnqnFZDxlotbGX6bA19IvoYe0wYvq+BFQh9hp3g5BI9pESQvkzAm8SawJ1mLJVt0R4P7FSDDcS5afFII1r/g==; 24:z+rpbhZBHCU0jwOXo50SRQYkJahxgOdAI4R/R/oIDi2o7XJJQaTbfBucXZowhiw7CXOtdWIz0bqi93I4g/rbvoNqrCZkZNErwdJFtQ81UMg=; 7:oMsm844opQUi0VzhxpPRqZAa2eWN83U2SyyVmuolv2x9WUoeuVpiSDHV/5QtDtL4pJAhvy7Yu/HfJ9mKtOHMic2FK9404fm8jAqFp1k6OIdqGBDbFkhrQjW8WaQ/BSDrLBcGWPyUP7xjVV1w6vtr/vofBar4fWK4IoR9L5WNexK5uqbMrSF+VfV+8lQvWilhzAzpG4phy7CORw5LM5uftGXIVIVwSzGXVaD3XU8qb7LyWy4brUCi0X3KQLmBzjIw SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Aug 2016 22:51:25.1264 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB3PR05MB0921 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 23:07:52 -0000 Hi, On 8/11/2016 11:43 PM, Ben RUBSON wrote: > Here are the tests with udaddy from FreeBSD, trying to connect to Linux : > > # udaddy -s 192.168.2.2 > libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. > libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. > udaddy: starting client > udaddy: connecting > libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. > udaddy: event: RDMA_CM_EVENT_ADDR_ERROR, error: -19 yes, you got the same event in iser (event 1). There is a configuration issue with your setup. Once you overcome this, iSER should work for you. Meny/Hans, can you assist here ? Thanks, Max. > test complete > return status -19 > > Sounds like the issue is with FreeBSD itself. > > Ben > > > >> On 11 Aug 2016, at 18:59, Ben RUBSON wrote: >> >> >>> On 11 Aug 2016, at 18:10, Max Gurtovoy wrote: >>> >>> On 8/11/2016 6:33 PM, Ben RUBSON wrote: >>>> Thank you very much Max for your help. >>>> >>>> >>>> >>>> I managed to compile the kernel with iSER support doing the 3 modifications below. >>>> >>>> I added the following to /usr/src/sys/conf/options : >>>> ICL_KERNEL_PROXY opt_global.h >>>> >>>> And I added "options ICL_KERNEL_PROXY" to my kernel configuration file. >>>> >>>> I then faced this compilation error : >>>> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: error: implicit declaration of function 'icl_conn_handoff_sock' >>>> icl_conn_handoff_sock(cs->cs_conn, so); >>>> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: note: did you mean 'icl_soft_handoff_sock'? >>>> /usr/src/sys/dev/iscsi/icl.h:158:7: note: 'icl_soft_handoff_sock' declared here >>>> int icl_soft_handoff_sock(struct icl_conn *ic, struct socket *so); >>>> >>>> So I replaced icl_conn_handoff_sock by icl_soft_handoff_sock (sounds like it is the needed correction). >>>> >>>> iscsictl -r now does not produce previous "invalid argument" error. >>>> >>>> @trasz : perhaps these modifications should be done in FreeBSD 11 source tree ? >> >> I'm also rebuilding world with the following to see if it can help : >> # cat /etc/src.conf >> WITH_ICL_KERNEL_PROXY="YES" >> WITH_OFED="YES" >> >>>> Now I'm facing the following issue : >>>> >>>> # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>> iscsid[8743]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Input/output error >>>> kernel: ERROR: iser_connect_error: conn 0xfffff8096786f000 >>>> iscsid[1078]: child process 8743 terminated with exit status 1 >>> >>> please increase the debug level in both initiator and target and sent it out. >> >> Logs from the initiator : >> iscsid[39668]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Input/output error >> kernel: INFO: iser_free_ib_conn_res: freeing conn 0xfffff8048d276000 cma_id 0 qp 0 >> kernel: DEBUG: iser_conn_connect: before cv_wait: 0xfffff8048d276000 >> kernel: INFO: iser_cma_handler: event 1 status -19 conn 0xfffff8048d276000 id 0xfffff80880606800 >> kernel: ERROR: iser_connect_error: conn 0xfffff8048d276000 >> kernel: DEBUG: iser_conn_connect: after cv_wait: 0xfffff8048d276000 >> iscsid[1078]: child process 39668 terminated with exit status 1 >> >> Logs from the target (here I tried TGT) : >> No logs, as if TGT did not receive anything. >> If I try to connect without the "-r", here is what I get : >> tgtd: login_start(502) Target iqn.2012-06.com.test:target1 is RDMA, but conn cid:0 from iqn.1994-09.org.freebsd:srv1 is TCP >> So target is correctly iSER configured. >> I tried without iSER on both sides, of course it works. >> >>> From first look I think you need to configure the LIO target to work with demo mode. >> >> I double-checked, LIO was in demo mode, I followed this guideline : >> https://community.mellanox.com/docs/DOC-1468 >> >> One strange thing, on initiator, sounds like no packet goes through the interface when trying to connect : >> # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets >> hw.mlxen1.stat.rx_packets: 386 >> hw.mlxen1.stat.tx_packets: 409 >> # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >> # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets >> hw.mlxen1.stat.rx_packets: 386 >> hw.mlxen1.stat.tx_packets: 409 >> >>> Another thing you can try is the user space tgt target (compile with make ISCSI_RDMA=1) that I work with mostly. >>> >>>> >>>> If I remove the "-r" option from the iscsictl command, it correctly connects to the target. >>>> >>>> On target side, Lio, targetcli : >>>> /> ls iscsi/ >>>> o- iscsi ............................................. [1 Target] >>>> o- iqn.2012-06.com.test:target1 ....................... [1 TPG] >>>> o- tpg1 ........................................... [enabled] >>>> o- acls .......................................... [0 ACLs] >>>> o- luns ........................................... [1 LUN] >>>> | o- lun0 ..................... [iblock/block1 (/dev/sdc7)] >>>> o- portals ..................................... [1 Portal] >>>> o- 192.168.2.2:3260 .................. [OK, iser enabled] >>>> >>>> I wanted to make some RDMA connection tests with udaddy for example, but I did not found the FreeBSD version. >>>> >>>> Any advice ? >>>> >>>> Many thanks ! >>>> >>>> Ben >>>> >>>> >>>> >>>>> On 11 Aug 2016, at 15:44, Max Gurtovoy wrote: >>>>> >>>>> These are the instructions I get from iscsi maintainer that merged our code to FreeBSD-11: >>>>> 1. set WITH_OFED=yes in /etc/make.conf >>>>> 2. "make buildkernel buildworld installkernel installworld" >>>>> 3. reboot >>>>> 4. kldload iser >>>>> >>>>> After that, make sure you configured all the interfaces correctly and that you have ping between the 2 servers. >>>>> later you need to check basic RDMA stuff on your servers (Added Hans/Oded/Meny to help you if needed). >>>>> >>>>> Only if the above are working you can proceed to check iser. >>>>> >>>>> Max. >>>>> >>>>> On 8/11/2016 4:22 PM, Ben RUBSON wrote: >>>>>> I just tested to connect to a Linux iSER enabled target, but I still get this error message at initiator side : >>>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument >>>>>> >>>>>>> as if my initiator did not understand the iSER command "ISCSIDCONNECT". >>>>>>> How to be sure everything is correctly compiled with ICL_KERNEL_PROXY enabled ? >>>>>> >>>>>> Ben >>>>>> >>>>>> >>>>>>> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >>>>>>> >>>>>>> Hi Ben, >>>>>>> >>>>>>> iSER initiator is supported in FreeBSD-11 but not the iser target. >>>>>>> for the target you should use Linux target such as TGT (user space), >>>>>>> Lio or SCST. >>>>>>> >>>>>>> thanks, >>>>>>> Max. >>>>>>> >>>>>>> >>>>>>> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>>>>>>> Hello, >>>>>>>> >>>>>>>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ### My configuration : >>>>>>>> >>>>>>>> 2 servers with Mellanox ConnectX-3 NICs. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ### What I did : >>>>>>>> >>>>>>>> I rebuilt kernel adding the following to GENERIC : >>>>>>>> options OFED >>>>>>>> device mlxen >>>>>>>> options COMPAT_LINUXKPI >>>>>>>> >>>>>>>> I built iser : >>>>>>>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload iser >>>>>>>> (I saw later-on that I could have used "device iser" in kernel configuration) >>>>>>>> >>>>>>>> My /etc/ctl.conf : >>>>>>>> portal-group pg0 { >>>>>>>> discovery-auth-group no-authentication >>>>>>>> listen 192.168.2.2 >>>>>>>> offload iser >>>>>>>> } >>>>>>>> target iqn.2012-06.com.test:target1 { >>>>>>>> auth-group no-authentication >>>>>>>> portal-group pg0 >>>>>>>> alias my-iser-disk >>>>>>>> lun 0 { >>>>>>>> path /dev/da8 >>>>>>>> } >>>>>>>> } >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ### Error : >>>>>>>> >>>>>>>> As soon as I do the following : >>>>>>>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>>>>>> I get this error : >>>>>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Invalid argument >>>>>>>> iscsid[655]: child process 1187 terminated with exit status 1 >>>>>>>> >>>>>>>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no packet is sent at all when trying to connect. >>>>>>>> >>>>>>>> Did I miss something ? >>>>>>>> >>>>>>>> Many thanks ! >>>>>>>> >>>>>>>> Ben > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From owner-freebsd-scsi@freebsd.org Fri Aug 12 07:38:24 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 527A5BB6B21 for ; Fri, 12 Aug 2016 07:38:24 +0000 (UTC) (envelope-from hanss@mellanox.com) Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on0085.outbound.protection.outlook.com [104.47.0.85]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7A66617B4 for ; Fri, 12 Aug 2016 07:38:22 +0000 (UTC) (envelope-from hanss@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=0/75CsST6Leu02pFlutTXFzEhjz6dXA9mb0FYTXoKvg=; b=AK63lKa7WK0yi23it+niu+evP1hnT+w5R0vns7LaELLPbLKmOc9b2Nc8z19tsRCrj46gUL1oeKBCpSj372Yb6AlWjRW32KAXzE41FYqROByTfbGidgHj+7zgSLfh7TpsVf3WonAB7/78C7H6m4SczC323xU5wPrnEBaLuOcOHvo= Received: from AM5PR0501MB2580.eurprd05.prod.outlook.com (10.169.152.7) by AM5PR0501MB2580.eurprd05.prod.outlook.com (10.169.152.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Fri, 12 Aug 2016 07:38:13 +0000 Received: from AM5PR0501MB2580.eurprd05.prod.outlook.com ([10.169.152.7]) by AM5PR0501MB2580.eurprd05.prod.outlook.com ([10.169.152.7]) with mapi id 15.01.0549.026; Fri, 12 Aug 2016 07:38:03 +0000 From: Hans Petter Selasky To: Max Gurtovoy , Ben RUBSON , "freebsd-scsi@freebsd.org" CC: Oren Duer , Oded Shanoon , "Meny Yossefi" , Roy Shterman Subject: RE: Help to make iSER working Thread-Topic: Help to make iSER working Thread-Index: AQHR89afeAUqYlaWPEGlnNhjMqc1iKBD49OAgAAKYwCAAA2XAIAAPn+AgAAjyQCAAJKkgA== Date: Fri, 12 Aug 2016 07:38:03 +0000 Message-ID: References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=hanss@mellanox.com; x-originating-ip: [62.141.129.119] x-ms-office365-filtering-correlation-id: 2d0fc593-437b-463a-6d02-08d3c2839801 x-microsoft-exchange-diagnostics: 1; AM5PR0501MB2580; 6:Kc6Zsm3GjOG3EJImgncm/DrYLZHxQ0DMm4OeOknNep+s4jT3l+AUczDk41TYxwu9/P7tjZMqmazW2aGv/YoY0E0TntIuO29DB3TYgz4jD60eZgcC8iucOsXLdzW2t+qsNNy9pvVKLAyNMku7cqLWZpvLcX7YV8PG+819YSBjEYIwt2Pav67pC/nqZ/YRv5dOMIqa80E9A6Gqdui7Sz9tZiu1baevGmBYcofoSZJ6yUB9snyBmwcs1D520H7G2Ttnsb+5sfqBIzX9pxQBm0e6/R81sQqco+FeG+yTyvphr6wQF0tnQqFTddXGWu+GXtJJYezvYvU0O8CBuDCgU3du9A==; 5:QhjQ4aa503kMz7z9zmFPFR5QZ0xJ8bmPjTpZuR0jfAdJRbnru8R+PqcLFxAupSt7VZgdXPjMvj7OPvqcm9vSCPxPIx1qiQEJ5jibQTbAD1NXgcIl53Xf72x1y8c2Si1MIlWBAxTXK2roiv/4ICOmZA==; 24:pV1sm/cMDbnHOVXLJgE+xxjSyJbnp2e+MpqJ33sTKjPRfOTqEYYJHpQB0IICxGa7M0hO5+tYn9HOUBemxJ5zNQ35Blpvt/qdEo+Hqw23644=; 7:DnfbkjVQDC16RzexFGFl3nJMwmoQFeTgghW+5atxAsBtUWlv0czEnOfAsNJxuHenetJT/uVYU6bBdzTq+/5ejEmmZrwq8oxGd/OmXnIZShCJeSHLfh2h2qbfR8BSAsdlo6A0qOOSvAPMXRJjnjzWW6D2A4M/DKdVfFbXEnWwKRPO1YA/9KT+2hctdR9OWI1EdIfzFnjQkPAs6llknDgeIoA/lB8rtqunyUxMwi3YJjKdPXOIq5EvkfgCnZFPK4JF x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:AM5PR0501MB2580; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(258220229709018)(227817650892897)(75325880899374)(275809806118684)(21532816269658); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6055026); SRVR:AM5PR0501MB2580; BCL:0; PCL:0; RULEID:; SRVR:AM5PR0501MB2580; x-forefront-prvs: 003245E729 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(24454002)(13464003)(189002)(377454003)(199003)(54094003)(45984002)(66654002)(2950100001)(68736007)(2501003)(92566002)(76176999)(50986999)(54356999)(2906002)(2900100001)(81156014)(86362001)(8676002)(106116001)(106356001)(81166006)(7846002)(74316002)(101416001)(9686002)(8936002)(5001770100001)(10400500002)(97736004)(4001430100002)(76576001)(189998001)(87936001)(7696003)(305945005)(107886002)(7736002)(586003)(4326007)(19580405001)(122556002)(77096005)(6116002)(3900700001)(102836003)(33656002)(5002640100001)(3660700001)(3846002)(93886004)(19580395003)(105586002)(3280700002)(15975445007)(66066001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM5PR0501MB2580; H:AM5PR0501MB2580.eurprd05.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Aug 2016 07:38:03.3894 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0501MB2580 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Aug 2016 07:38:24 -0000 Hi, Error 19 means ENODEV. Possibly something is not supported. Meny: I wonder if it is better if Ben install our infiniband patches to bri= ng the IB code up to v3.2? --HPS -----Original Message----- From: Max Gurtovoy=20 Sent: Friday, August 12, 2016 1:51 AM To: Ben RUBSON ; freebsd-scsi@freebsd.org Cc: Oren Duer ; Oded Shanoon ; Meny = Yossefi ; Hans Petter Selasky ; Roy= Shterman Subject: Re: Help to make iSER working Hi, On 8/11/2016 11:43 PM, Ben RUBSON wrote: > Here are the tests with udaddy from FreeBSD, trying to connect to Linux : > > # udaddy -s 192.168.2.2 > libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. > libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. > udaddy: starting client > udaddy: connecting > libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. > udaddy: event: RDMA_CM_EVENT_ADDR_ERROR, error: -19 yes, you got the same event in iser (event 1). There is a configuration issue with your setup. Once you overcome this, iSER should work for you. Meny/Hans, can you assist here ? Thanks, Max. > test complete > return status -19 > > Sounds like the issue is with FreeBSD itself. > > Ben > > > >> On 11 Aug 2016, at 18:59, Ben RUBSON wrote: >> >> >>> On 11 Aug 2016, at 18:10, Max Gurtovoy wrote: >>> >>> On 8/11/2016 6:33 PM, Ben RUBSON wrote: >>>> Thank you very much Max for your help. >>>> >>>> >>>> >>>> I managed to compile the kernel with iSER support doing the 3 modifica= tions below. >>>> >>>> I added the following to /usr/src/sys/conf/options : >>>> ICL_KERNEL_PROXY opt_global.h >>>> >>>> And I added "options ICL_KERNEL_PROXY" to my kernel configuration file= . >>>> >>>> I then faced this compilation error : >>>> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: er= ror: implicit declaration of function 'icl_conn_handoff_sock' >>>> icl_conn_handoff_sock(cs->cs_conn, so); >>>> /usr/src/sys/modules/ctl/../../cam/ctl/ctl_frontend_iscsi.c:1358:2: no= te: did you mean 'icl_soft_handoff_sock'? >>>> /usr/src/sys/dev/iscsi/icl.h:158:7: note: 'icl_soft_handoff_sock' decl= ared here >>>> int icl_soft_handoff_sock(struct icl_conn *ic, struct socket=20 >>>> *so); >>>> >>>> So I replaced icl_conn_handoff_sock by icl_soft_handoff_sock (sounds l= ike it is the needed correction). >>>> >>>> iscsictl -r now does not produce previous "invalid argument" error. >>>> >>>> @trasz : perhaps these modifications should be done in FreeBSD 11 sour= ce tree ? >> >> I'm also rebuilding world with the following to see if it can help : >> # cat /etc/src.conf >> WITH_ICL_KERNEL_PROXY=3D"YES" >> WITH_OFED=3D"YES" >> >>>> Now I'm facing the following issue : >>>> >>>> # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 >>>> iscsid[8743]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to=20 >>>> connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT:=20 >>>> Input/output error >>>> kernel: ERROR: iser_connect_error: conn 0xfffff8096786f000 >>>> iscsid[1078]: child process 8743 terminated with exit status 1 >>> >>> please increase the debug level in both initiator and target and sent i= t out. >> >> Logs from the initiator : >> iscsid[39668]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to=20 >> connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT:=20 >> Input/output error >> kernel: INFO: iser_free_ib_conn_res: freeing conn 0xfffff8048d276000=20 >> cma_id 0 qp 0 >> kernel: DEBUG: iser_conn_connect: before cv_wait: 0xfffff8048d276000 >> kernel: INFO: iser_cma_handler: event 1 status -19 conn=20 >> 0xfffff8048d276000 id 0xfffff80880606800 >> kernel: ERROR: iser_connect_error: conn 0xfffff8048d276000 >> kernel: DEBUG: iser_conn_connect: after cv_wait: 0xfffff8048d276000 >> iscsid[1078]: child process 39668 terminated with exit status 1 >> >> Logs from the target (here I tried TGT) : >> No logs, as if TGT did not receive anything. >> If I try to connect without the "-r", here is what I get : >> tgtd: login_start(502) Target iqn.2012-06.com.test:target1 is RDMA,=20 >> but conn cid:0 from iqn.1994-09.org.freebsd:srv1 is TCP So target is cor= rectly iSER configured. >> I tried without iSER on both sides, of course it works. >> >>> From first look I think you need to configure the LIO target to work wi= th demo mode. >> >> I double-checked, LIO was in demo mode, I followed this guideline : >> https://community.mellanox.com/docs/DOC-1468 >> >> One strange thing, on initiator, sounds like no packet goes through the = interface when trying to connect : >> # sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets >> hw.mlxen1.stat.rx_packets: 386 >> hw.mlxen1.stat.tx_packets: 409 >> # iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 #=20 >> sysctl hw.mlxen1.stat.rx_packets hw.mlxen1.stat.tx_packets >> hw.mlxen1.stat.rx_packets: 386 >> hw.mlxen1.stat.tx_packets: 409 >> >>> Another thing you can try is the user space tgt target (compile with ma= ke ISCSI_RDMA=3D1) that I work with mostly. >>> >>>> >>>> If I remove the "-r" option from the iscsictl command, it correctly co= nnects to the target. >>>> >>>> On target side, Lio, targetcli : >>>> /> ls iscsi/ >>>> o- iscsi ............................................. [1 Target] >>>> o- iqn.2012-06.com.test:target1 ....................... [1 TPG] >>>> o- tpg1 ........................................... [enabled] >>>> o- acls .......................................... [0 ACLs] >>>> o- luns ........................................... [1 LUN] >>>> | o- lun0 ..................... [iblock/block1 (/dev/sdc7)] >>>> o- portals ..................................... [1 Portal] >>>> o- 192.168.2.2:3260 .................. [OK, iser enabled] >>>> >>>> I wanted to make some RDMA connection tests with udaddy for example, b= ut I did not found the FreeBSD version. >>>> >>>> Any advice ? >>>> >>>> Many thanks ! >>>> >>>> Ben >>>> >>>> >>>> >>>>> On 11 Aug 2016, at 15:44, Max Gurtovoy wrote: >>>>> >>>>> These are the instructions I get from iscsi maintainer that merged ou= r code to FreeBSD-11: >>>>> 1. set WITH_OFED=3Dyes in /etc/make.conf 2. "make buildkernel=20 >>>>> buildworld installkernel installworld" >>>>> 3. reboot >>>>> 4. kldload iser >>>>> >>>>> After that, make sure you configured all the interfaces correctly and= that you have ping between the 2 servers. >>>>> later you need to check basic RDMA stuff on your servers (Added Hans/= Oded/Meny to help you if needed). >>>>> >>>>> Only if the above are working you can proceed to check iser. >>>>> >>>>> Max. >>>>> >>>>> On 8/11/2016 4:22 PM, Ben RUBSON wrote: >>>>>> I just tested to connect to a Linux iSER enabled target, but I still= get this error message at initiator side : >>>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed=20 >>>>>> to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT:=20 >>>>>> Invalid argument >>>>>> >>>>>>> as if my initiator did not understand the iSER command "ISCSIDCONNE= CT". >>>>>>> How to be sure everything is correctly compiled with ICL_KERNEL_PRO= XY enabled ? >>>>>> >>>>>> Ben >>>>>> >>>>>> >>>>>>> On 10 Aug 2016, at 22:51, Max Gurtovoy wrote: >>>>>>> >>>>>>> Hi Ben, >>>>>>> >>>>>>> iSER initiator is supported in FreeBSD-11 but not the iser target. >>>>>>> for the target you should use Linux target such as TGT (user=20 >>>>>>> space), Lio or SCST. >>>>>>> >>>>>>> thanks, >>>>>>> Max. >>>>>>> >>>>>>> >>>>>>> On 8/10/2016 8:13 PM, Ben RUBSON wrote: >>>>>>>> Hello, >>>>>>>> >>>>>>>> I have some difficulties to make iSER (FreeBSD 11 BETA3) working. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ### My configuration : >>>>>>>> >>>>>>>> 2 servers with Mellanox ConnectX-3 NICs. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ### What I did : >>>>>>>> >>>>>>>> I rebuilt kernel adding the following to GENERIC : >>>>>>>> options OFED >>>>>>>> device mlxen >>>>>>>> options COMPAT_LINUXKPI >>>>>>>> >>>>>>>> I built iser : >>>>>>>> cd /usr/src/sys/modules/iser/ ; make ; make install ; kldload=20 >>>>>>>> iser (I saw later-on that I could have used "device iser" in=20 >>>>>>>> kernel configuration) >>>>>>>> >>>>>>>> My /etc/ctl.conf : >>>>>>>> portal-group pg0 { >>>>>>>> discovery-auth-group no-authentication listen 192.168.2.2=20 >>>>>>>> offload iser } target iqn.2012-06.com.test:target1 { auth-group=20 >>>>>>>> no-authentication portal-group pg0 alias my-iser-disk lun 0 {=20 >>>>>>>> path /dev/da8 } } >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ### Error : >>>>>>>> >>>>>>>> As soon as I do the following : >>>>>>>> iscsictl -A -r -t iqn.2012-06.com.test:target1 -p 192.168.2.2 I=20 >>>>>>>> get this error : >>>>>>>> iscsid[1187]: 192.168.2.2 (iqn.2012-06.com.test:target1):=20 >>>>>>>> failed to connect to 192.168.2.2 using ICL kernel proxy:=20 >>>>>>>> ISCSIDCONNECT: Invalid argument >>>>>>>> iscsid[655]: child process 1187 terminated with exit status 1 >>>>>>>> >>>>>>>> "sysctl hw.mlxen1.stat.tx_packets" on initiator shows that no pack= et is sent at all when trying to connect. >>>>>>>> >>>>>>>> Did I miss something ? >>>>>>>> >>>>>>>> Many thanks ! >>>>>>>> >>>>>>>> Ben > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From owner-freebsd-scsi@freebsd.org Sat Aug 13 11:36:31 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56567BB8D62 for ; Sat, 13 Aug 2016 11:36:31 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x22d.google.com (mail-wm0-x22d.google.com [IPv6:2a00:1450:400c:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D9140187E for ; Sat, 13 Aug 2016 11:36:30 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x22d.google.com with SMTP id i5so20477612wmg.0 for ; Sat, 13 Aug 2016 04:36:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=inMJEzxXPXt9b/DHSYK54QRQ5cXN6nYIQhNmHfI8/Qg=; b=oFm7+loIVSFYZtFjK2oSEmf/ns5bek/mQcUaLAmQKdQA0H9+PTBs36wAEzD1Fz0cdw ghrpL6Ow0VOcQV55SudNFc47cag4JXAjmx2gPJMseHOaR09bcQHt4apOMQjMPych9LQO BzBkKHtyymy5VyjTlEMRcOlB577LZAFlPiEFzBuwPU0gPVa93475rptQ5AUemMszYHhW naCPphUGDTWNcu3rgYMnCyP2m8Nc17qMRYUH4lY+PnJbjPIF83m1bJ2mV9Kj4OTBtd/x 16k2sykmaUBIzeqLHJEKvRzJVvfdmqE3sW0BqoWc+b6Nvh6cVYjGw0tvlOPcM4jnV6nY Qq8g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=inMJEzxXPXt9b/DHSYK54QRQ5cXN6nYIQhNmHfI8/Qg=; b=feVY6fSv6VUSPZXx1Qu6BUtz7RnE2EHBddGCagZp0u11V7qwtFP7DhWPrBmSdA+FhX 2UhPlHGzy4Kdf30AJILutNbQiXY88Ey1tWVT5MKza9jzCQpiUInsQXyts+px3tkLKJOw QJ8Sw4vYuMpIAaICOW2DiP1bc6cmAfRbxW0r3W6Dcvx2Re/BMRpHJVtsKXX/c8hC0V0R w3lErBLUHeOZvbk7jNAiPv94m93B5L2aHltaE54epOSSHVlWsN77VYrFzOihdA78UJSb bWaz2zz+j2gVWRt1NBOoRI2QY3FPhgBjBtjwNkEQsRcXPBBkdPjc2KcUdicYfBXx8MT6 7mZw== X-Gm-Message-State: AEkoousMT09mHdQOWBNR9nIDJuiAlOEAiunpsk2Wr31NyrNxwPDu6j2eUYs85g8rngrHVA== X-Received: by 10.28.25.71 with SMTP id 68mr448538wmz.19.1471088189054; Sat, 13 Aug 2016 04:36:29 -0700 (PDT) Received: from [172.20.10.6] ([80.12.42.130]) by smtp.gmail.com with ESMTPSA id q139sm6791686wmb.18.2016.08.13.04.36.26 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 13 Aug 2016 04:36:28 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: Date: Sat, 13 Aug 2016 13:36:20 +0200 Cc: Max Gurtovoy , Oren Duer , Oded Shanoon , Meny Yossefi , Roy Shterman , Hans Petter Selasky Content-Transfer-Encoding: quoted-printable Message-Id: References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> To: "freebsd-scsi@freebsd.org" X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Aug 2016 11:36:31 -0000 Hi, I went with a fresh new install to have a clean status. What I did : // FreeBSD 11-RC1 installation # echo "WITH_OFED=3DYES" > /etc/make.conf # cd /usr/src/ ; make buildkernel KERNCONF=3DGENERIC ; make = installkernel KERNCONF=3DGENERIC # cd /usr/src/sys/modules/mlx4 ; make ; make install # cd /usr/src/sys/modules/mlxen ; make ; make install # cd /usr/src/sys/modules/iser ; make ; make install # echo "mlx4_load=3DYES" >> /boot/loader.conf # echo "mlxen_load=3DYES" >> /boot/loader.conf # echo "iser_load=3DYES" >> /boot/loader.conf # reboot Everything went fine, no code modition needed or whatever, perfect. # iscsictl -A -t iqn.2012-06.com.test:target1 -p 192.168.2.2 On the target, I get : tgtd[1912]: tgtd: login_start(502) Target iqn.2012-06.com.test:target1 = is RDMA, but conn cid:0 from iqn.1994-09.org.freebsd:srv1 is TCP Perfect, the target is correctly iSER enabled. # iscsictl -A -t iqn.2012-06.com.test:target1 -p 192.168.2.2 -r I still get the following error : iscsid[1062]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to = connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: = Input/output error kernel: INFO: iser_free_ib_conn_res: freeing conn 0xfffff80147771000 = cma_id 0 qp 0 kernel: DEBUG: iser_conn_connect: before cv_wait: 0xfffff80147771000 kernel: INFO: iser_cma_handler: event 1 status -19 conn = 0xfffff80147771000 id 0xfffff8005f0e5400 kernel: ERROR: iser_connect_error: conn 0xfffff80147771000 kernel: DEBUG: iser_conn_connect: after cv_wait: 0xfffff80147771000 iscsid[853]: child process 1062 terminated with exit status 1 Waiting for your instructions, would really be nice to have it working = for 11 release. Many thanks ! Best regards, Ben > On 12 Aug 2016, at 09:38, Hans Petter Selasky = wrote: >=20 > Hi, >=20 > Error 19 means ENODEV. Possibly something is not supported. >=20 > Meny: I wonder if it is better if Ben install our infiniband patches = to bring the IB code up to v3.2? >=20 > --HPS >=20 > -----Original Message----- > From: Max Gurtovoy=20 > Sent: Friday, August 12, 2016 1:51 AM > To: Ben RUBSON ; freebsd-scsi@freebsd.org > Cc: Oren Duer ; Oded Shanoon ; = Meny Yossefi ; Hans Petter Selasky = ; Roy Shterman > Subject: Re: Help to make iSER working >=20 > Hi, >=20 > On 8/11/2016 11:43 PM, Ben RUBSON wrote: >> Here are the tests with udaddy from FreeBSD, trying to connect to = Linux : >>=20 >> # udaddy -s 192.168.2.2 >> libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. >> libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. >> udaddy: starting client >> udaddy: connecting >> libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. >> udaddy: event: RDMA_CM_EVENT_ADDR_ERROR, error: -19 >=20 > yes, you got the same event in iser (event 1). > There is a configuration issue with your setup. > Once you overcome this, iSER should work for you. >=20 > Meny/Hans, > can you assist here ? >=20 > Thanks, > Max. From owner-freebsd-scsi@freebsd.org Sat Aug 13 13:12:43 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6E530BB8C7F for ; Sat, 13 Aug 2016 13:12:43 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x229.google.com (mail-wm0-x229.google.com [IPv6:2a00:1450:400c:c09::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 089AE115F for ; Sat, 13 Aug 2016 13:12:42 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x229.google.com with SMTP id o80so23420395wme.1 for ; Sat, 13 Aug 2016 06:12:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=XCdHZtyJ+ZXNEZ6aARNxM9bIWWEpGA2oeWJOgFC65oY=; b=Sf1+GHFGAYKN53214eFEWgLqYVmE2owonXImTO4r8KCP8xXpVyn49pIwz1PQHlHRlp xl8rLHUrLIarX5eppXEkQvsc1VZOtKkyHZ9B8aTu3yn5Wpu+09a81nQ317q92fqWciQz CZTDETWhFNY/do/+GGxJzXAOPH6cyYbK8xWSvaVoloM70wIFliLg55t5gZD7r76A8uJp knbq47nEO7M4FA2aoXPJxMrr9GrwCsCcLjXkfXoHy3Y4l3hYlQb6qnULtQZHkzNYr42w J4XMtQss562unAiz9V/0zRAlAgMg+6BRS4zLAaYUbCP2ZS4enGfHLXtL4qTdxm8DQQdF lqKw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=XCdHZtyJ+ZXNEZ6aARNxM9bIWWEpGA2oeWJOgFC65oY=; b=Q3FRm2/NfwSworIr4AqM5Z37CQlfvNfrO68ic2eSP18YHr6vBeDBA/c3mTo/KlWOcw iqj4HrmxJAOzNH3yH3AH5mOYvLmK2IXwjsKylHO8EKlHQWGw1Jzfb8VwXLYQzuY7gh3n wd+Aio2niLiBXwue6ak12Sj5pieeEqYIUL1BTZUNw3t2WgX8cKCYerrR6YR6zdgCPKAY 2qMrFP4w+aKhZ/zkf5mJSgeXNWzu4/QsMVcIgyEme75QytV8EHwoEqPIDo3hdJVP74k+ dw9IlILOP1Nn5v8AU8kT9Gj0cJaEBq212XXa2Er4of2Fpkm6RGYlM0icAWpEzPXkg/86 ffbg== X-Gm-Message-State: AEkoout2VlOsIdRBlj82GHaOoMAZsbRRKYad7s6l3SxeMrRa27xHLMjNUiDdUWOWdOUojQ== X-Received: by 10.28.129.137 with SMTP id c131mr3435544wmd.79.1471093960779; Sat, 13 Aug 2016 06:12:40 -0700 (PDT) Received: from [172.20.10.6] ([80.12.58.75]) by smtp.gmail.com with ESMTPSA id pm1sm12098511wjb.40.2016.08.13.06.12.38 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 13 Aug 2016 06:12:40 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help to make iSER working From: Ben RUBSON In-Reply-To: Date: Sat, 13 Aug 2016 15:12:37 +0200 Cc: Max Gurtovoy , Oren Duer , Oded Shanoon , Meny Yossefi , Roy Shterman , Hans Petter Selasky Content-Transfer-Encoding: quoted-printable Message-Id: References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> To: "freebsd-scsi@freebsd.org" X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Aug 2016 13:12:43 -0000 > On 13 Aug 2016, at 13:36, Ben RUBSON wrote: >=20 > Hi, >=20 > I went with a fresh new install to have a clean status. >=20 > What I did : >=20 > // FreeBSD 11-RC1 installation > # echo "WITH_OFED=3DYES" > /etc/make.conf > # cd /usr/src/ ; make buildkernel KERNCONF=3DGENERIC ; make = installkernel KERNCONF=3DGENERIC > # cd /usr/src/sys/modules/mlx4 ; make ; make install > # cd /usr/src/sys/modules/mlxen ; make ; make install > # cd /usr/src/sys/modules/iser ; make ; make install > # echo "mlx4_load=3DYES" >> /boot/loader.conf > # echo "mlxen_load=3DYES" >> /boot/loader.conf > # echo "iser_load=3DYES" >> /boot/loader.conf > # reboot This was missing : cd /usr/src/sys/modules/mlx4ib/ ; make ; make install ; kldload = mlx4ib.ko Now it works perfectly... I'm really sorry for the useless noise on this list... I hope this above howto will help others. Thank you again for your support, and sorry again :-/ Benchmarks will of course follow. Best regards, Ben