From owner-freebsd-scsi@FreeBSD.ORG Tue Jun 23 15:42:17 2015 Return-Path: Delivered-To: freebsd-scsi@nevdull.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C039B26E for ; Tue, 23 Jun 2015 15:42:17 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from emea01-db3-obe.outbound.protection.outlook.com (mail-db3on0093.outbound.protection.outlook.com [157.55.234.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 19B8AB88 for ; Tue, 23 Jun 2015 15:42:16 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from AM3PR05CA023.eurprd05.prod.outlook.com (10.141.192.33) by DB3PR05MB217.eurprd05.prod.outlook.com (10.242.133.17) with Microsoft SMTP Server (TLS) id 15.1.195.15; Tue, 23 Jun 2015 15:42:14 +0000 Received: from DB3FFO11FD037.protection.gbl (2a01:111:f400:7e04::151) by AM3PR05CA023.outlook.office365.com (2a01:111:e400:882a::33) with Microsoft SMTP Server (TLS) id 15.1.201.16 via Frontend Transport; Tue, 23 Jun 2015 15:42:13 +0000 Authentication-Results: spf=none (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none; Received-SPF: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) Received: from mtlcas13.mtl.com (193.47.165.134) by DB3FFO11FD037.mail.protection.outlook.com (10.47.217.68) with Microsoft SMTP Server (TLS) id 15.1.190.9 via Frontend Transport; Tue, 23 Jun 2015 15:42:11 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.775.38; Tue, 23 Jun 2015 18:42:29 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.775.38 via Frontend Transport; Tue, 23 Jun 2015 18:42:29 +0300 Received: from [10.223.0.78] (10.223.0.78) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.123.3; Tue, 23 Jun 2015 18:42:04 +0300 Message-ID: <55897E4B.8060608@mellanox.com> Date: Tue, 23 Jun 2015 18:42:03 +0300 From: Max Gurtovoy User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: John-Mark Gurney CC: , Sagi Grimberg , Oren Duer , Hans Petter Selasky Subject: Re: gmultipath HA over iscsi/iser References: <557DA8C0.1020209@mellanox.com> <20150619162015.GD96349@funkthat.com> In-Reply-To: <20150619162015.GD96349@funkthat.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.223.0.78] X-EOPAttributedMessage: 0 X-Microsoft-Exchange-Diagnostics: 1; DB3FFO11FD037; 1:DNxNDIfcdpMNNnBww7c8ZNGXZpizIfAmyElLfkz9Dd8sTH50CkvXR5GBzEWyoESU5gU1sTfWTksi0xIdQroT012s3sNxhAsEtts1RRY22DQ76d2mkvqMCw11FPoaE6YKnAAnkyHkmjrFIU1prnz9ZgnWMO6Mb0loAp+0w//wabMrq8LtSy7ac9sesmxKLfj6Z8epgWpJ7pIZ7jX7ytD2ugxPncgnb7zYiR4X+cvVdK0OLKyqaLmpfsqooCVe4jGacS2HgfRDQvA/Bt/PSxwV2WDfMZZpgDU0XikOKcQkRv8jj75RcWcwooHV5lGkca16 X-Forefront-Antispam-Report: CIP:193.47.165.134; CTRY:IL; IPV:NLI; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(2980300002)(428002)(189002)(51704005)(377454003)(479174004)(199003)(164054003)(24454002)(77096005)(105586002)(6806004)(110136002)(50466002)(189998001)(47776003)(65806001)(62966003)(65956001)(86362001)(77156002)(107886002)(36756003)(83506001)(33656002)(87936001)(46102003)(4001350100001)(106466001)(64126003)(23746002)(101416001)(92566002)(80316001)(99136001)(2950100001)(50986999)(59896002)(76176999)(87266999)(65816999)(54356999)(3940600001)(4001430100001); DIR:OUT; SFP:1101; SCL:1; SRVR:DB3PR05MB217; H:mtlcas13.mtl.com; FPR:; SPF:None; MLV:sfv; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB217; 2:OVlV6G/a84fdR3NBqLmIN1xGYFpGr4yhKjstNh//nIivosc2+hW+m3MOiMU9RZbd; 3:0YTbQgVI/fMoAh7oXTwLV3i5TNktisXhEpt1AuSLLvWBFGby1Cu7es7MzbYlepa3O+p1VUYFY3YQDrz7Lg2GMWhPQEgD1jatbM9HHTzFqRNaknoz0mNYvq362oiVptaKT7tdkPbNZJ37adiHiKAYCddVC2bE3g2iMxLRKaoHPZJTrVfc6oi2EgCb4S2icihbOWUxT0FXXJ3MSFglK1vU8vUP6zl7K54DSoY8Iop3xxVmhVzVyfA7PBdShgUIR2KZ; 20:N45uZ/qQZWDorazQzdWwk79rEr5/f0FqRw2+IsY5hE3+ZjdnSSGZ4c1Be/Hk21dcCMeFna8Rd/JtesZ6dl30zRBgjSasciUdeTIOnPPisA5qyNwEMRp6odG2keNkvvLeop9CEQnP36uzLFKDr8EmT3LoBYCicwKQ7LYoTsgjJSokhuNc6AvSrMjhWIaywGcLXVpe6XxIbq7ZWWkaU0J21jRKuRK9NSZLOwKyN1Mjo+R9/jTx3jM5y+p3R74MW15cjLHnRoZqldoihxpDuT67azNye9K4KVo+p6kfRJMFwbwVY2t9h1BHK89+t2vjF4tAiMtL0v+jk2m5QKJ9iZKA+LBWKkQMgZngET5Qs3pYss+CkLF7Z9gvnlylpmkXEaHJnAYgyllegwgMHRuiS5+U8o0mBSyM73Um00w0nJrc0IXh5VBUIEhDTRMNnxggYmz9Ruo1NYyrJQZO+eNTyrgktgoCGTlDTEyxkQ9KOxltulYAgjTtcWK3IBho+TptQgeo X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DB3PR05MB217; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(5005006)(3002001); SRVR:DB3PR05MB217; BCL:0; PCL:0; RULEID:; SRVR:DB3PR05MB217; X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB217; 4:MwUN4ESZjfeJ47+f7bhxomchwfkncxFAJgR9oP5M9BqBFrbB84nISALuew7GRj460pDbZ5xVFE7fi/1TTJ5d2ac30mUYtrYtTNGBS6ZEjkTffQ9lIbrrcZCpgaIk8prOIisbX+GiHV3SfkaFRHgEoPFgse3SsnqgP7gcr+5f0KmcIn/S3YJPfgQGhB8faK+gVtHjfb0e6aL0/wFeJqJLMAWo8GrbfIAlSQ/a85k6sea1oDB5ERaCcMNsLI3vdQFZfdk98kHDmGS5XSVAj8cgHf7PvzRiPlVvVAxGIgToiaQ= X-Forefront-PRVS: 06167FAD59 X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; DB3PR05MB217; 23:LTLdXOduEHGN1XpaGEsQiisp1eS9VGHMTBrsx8?= =?Windows-1252?Q?oFxGmyKHZ49mTCeZWxLC2FMj5p/F8Oi8AX+8r8lKygAPw7G/Q/XuQdYN?= =?Windows-1252?Q?ScLD+iw7sgE5sCp/PHwk10XlW9TzKgcx20/IHGtXE48PUMR4QN4eBnPJ?= =?Windows-1252?Q?RL3QHACJJNYeka72C3l/mAklJ33LJUXfnD3UF25uyyFBv1W52sCDczZK?= =?Windows-1252?Q?Cf2IB6LmV1hDDE/Pswh8uvcM3JGYNmQy9Db1ESljxpr9zJ09UN2imwzJ?= =?Windows-1252?Q?rXhyX22h9RDof3K3vnyXmf9MbR7KF1ZYWChlKBmJJf2NB5GPosUxcWVZ?= =?Windows-1252?Q?+9ws3MPJtVotI7anhObnJQnP2tB4eBvKHuEmHaTI9243DuEvHHP39XYr?= =?Windows-1252?Q?El3xmGAfN9YjO/CgTcMRqzK63EbQdTBw0NKDCe+fuzxWmPSvWELp9DN/?= =?Windows-1252?Q?IeaI1PDEPzSDZKYEh8gZxGhiB1g6waWK33URcI2BVLwlkNqEJsvA2BPm?= =?Windows-1252?Q?nEXzzs9XHLOKxyJGaMrr0Kt59Yqz9RrK0Nl3Yrie9OFl86nGkz79322o?= =?Windows-1252?Q?Hq+kdH/7iOV2Vcu6ZZOowW5T8C7hklal8sHAT50ACccklN12GTYnrFdw?= =?Windows-1252?Q?wrzHp7eg9JK12qabB1K1w2V391xLFaFIGnPU4WORHvQpsbbswBYRiYPW?= =?Windows-1252?Q?1h8JoWreYgpb9lx9aMlxBq9YNDB8dNJM8HG0NHS+VUmeilpHEeeJDsSN?= =?Windows-1252?Q?vSR/jHqGHWFmS4p6WB6Xzl2B4G7O3xcXgnICgPs5pdwmuJvBGbrdhuJq?= =?Windows-1252?Q?TG+jbS+dZHddRolxr84ZFg1U0KftvvO25A0dYAY3EAk62iynrLzezkDt?= =?Windows-1252?Q?eQ+CPItPZMzfL597Jz5nYSY2wEQJ0UApie55ORHUgxZoj18+yDYr42Ps?= =?Windows-1252?Q?c0Wyzs7j97mB9h49VYU9Di2ayhnlr1r0mJmQgPRiWw69omso/oYoqfi7?= =?Windows-1252?Q?/UoDrdBk0vEPvRSGB9AAezSpBIvLvuTYLYsHhZ09hdQ8pM2Gr8O6Qepl?= =?Windows-1252?Q?r1nnRzgWaXvqX2xvYh0RrQqL+TmtP75PS4/3zRuclkdTT43e4N1oAIFk?= =?Windows-1252?Q?k1wtPQDDfHiANYMzwdvkhzMMQZwgrssIGx6yWj823rwvr9qYAEnCmdAQ?= =?Windows-1252?Q?xSfiqD4BYg3Hhmn0Lu+XNrCz4EgNQEl3PlpX8PUbdh2+SHjW8M?= X-Microsoft-Exchange-Diagnostics: 1; DB3PR05MB217; 5:Oy2IJlvgTfAYYB33bHN3ep2SDKOEENy9GKWa3CPH7pfb7jBm+MWriPjLEtppS3fErTlpsmryjvbcTQsyUUiMv9b2lzzinXCj4Wud2dVX0UKd8vethpH7nUJaMOuQqhvL2zBbnniqCekkyEIlKA0yDw==; 24:TSunMG24EXjUwfD+ZeS4Mcm4Tl1pdwDju2jKtIzV+urP4LsaGw4oKY4q8oBWGQksUTg1xqeLhtNFhMau2bRHqHR4/XCPlqZ57opeDhkbZnA=; 20:mbmPN/myon+ANeMnkvsWifCouM97uQ9awQRiG5AvmmI8/EWabJZf5LvhKN6EK/6wlqxHdStjlwZnHI2mpb9g3A== X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Jun 2015 15:42:11.6962 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB3PR05MB217 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jun 2015 15:42:17 -0000 Hi All, On 6/19/2015 7:20 PM, John-Mark Gurney wrote: > Max Gurtovoy wrote this message on Sun, Jun 14, 2015 at 19:16 +0300: >> lately I was testing HA using gmultipath utility over iSCSI/iSER devices. >> I'm working on 11-current code base. >> I created 1 LUN on the target side and connected via 2 different >> physical ports from the initiator side. >> On the initiator side I see see /dev/da0 and /dev/da1. >> I created multipath device using: >> gmultipath label dm0 /dev/da0 /dev/da1. >> Now I have new device /dev/multipath/dm0. >> I set kern.iscsi.fail_on_disconnection=1 (to fail IO fast). >> >> Issue 1: >> ------------- >> I can't run simple fio/dd traffice over /dev/da0 nor /dev/da1. >> The only traffic that possible is using the multipath device dm0. >> Is this by design ? > > This is probably because geom only lets one writer open the device at > a time, and when the dm0 device is open, it blocks any other writers > to it's underlying devices... There is a special geom debug flag that > you can set to avoid this... > I tried this debug exclusive flag with iSCSI/iSER but when I set it to 0 the system crushed at the 'gmultipath label ...' stage. John, did you try it over iSCSI ? >> In the linux implementation we can run traffic on both block devices and >> multipath devices. >> >> Issue 2: >> -------------- >> I run some fio traffic utility over multipath device dm0 on initiator >> side with port toggling in a loop >> >> Port 1 down --> sleep 2 mins (iSCSI/ISER device reconnecting meanwhile >> with no success) --> port 1 up --> sleep 5 mins (iSCSI/ISER device >> reconnecting successecfully) >> Port 2 down --> sleep 2 mins (iSCSI/ISER device reconnecting meanwhile >> with no success) --> port 2 up --> sleep 5 mins (iSCSI/ISER device >> reconnecting successecfully) >> >> The expected result is that when the port N is down than the traffic >> moves to the available port and continue succesfully. >> I run this test for many hours and traffic FAILED (even though there was >> at least 1 suitable path between initiator and target). > > Someone else will need to answer this one... > I'm pretty new in the FreeBSD community so I don't know who is the maintainer of the gmultipath driver. Maybe we can discuss about testing the gmultipath driver over iscsi/iser devices and fix some bugs together ? We are planning to add it to our test plan and HA is in high priority for us. Thanks, Max From owner-freebsd-scsi@FreeBSD.ORG Wed Jun 24 00:14:14 2015 Return-Path: Delivered-To: freebsd-scsi@nevdull.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8AA0DD19 for ; Wed, 24 Jun 2015 00:14:14 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "gold.funkthat.com", Issuer "gold.funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C1FC1F0A; Wed, 24 Jun 2015 00:14:13 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.14.5/8.14.5) with ESMTP id t5O0EDes059273 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 23 Jun 2015 17:14:13 -0700 (PDT) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.14.5/8.14.5/Submit) id t5O0EDoi059272; Tue, 23 Jun 2015 17:14:13 -0700 (PDT) (envelope-from jmg) Date: Tue, 23 Jun 2015 17:14:13 -0700 From: John-Mark Gurney To: Max Gurtovoy Cc: freebsd-scsi@freebsd.org, Sagi Grimberg , Oren Duer , Hans Petter Selasky , mav@freebsd.org Subject: Re: gmultipath HA over iscsi/iser Message-ID: <20150624001412.GS96349@funkthat.com> References: <557DA8C0.1020209@mellanox.com> <20150619162015.GD96349@funkthat.com> <55897E4B.8060608@mellanox.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <55897E4B.8060608@mellanox.com> X-Operating-System: FreeBSD 9.1-PRERELEASE amd64 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (gold.funkthat.com [127.0.0.1]); Tue, 23 Jun 2015 17:14:13 -0700 (PDT) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2015 00:14:14 -0000 Max Gurtovoy wrote this message on Tue, Jun 23, 2015 at 18:42 +0300: > On 6/19/2015 7:20 PM, John-Mark Gurney wrote: > > Max Gurtovoy wrote this message on Sun, Jun 14, 2015 at 19:16 +0300: > >> lately I was testing HA using gmultipath utility over iSCSI/iSER devices. > >> I'm working on 11-current code base. > >> I created 1 LUN on the target side and connected via 2 different > >> physical ports from the initiator side. > >> On the initiator side I see see /dev/da0 and /dev/da1. > >> I created multipath device using: > >> gmultipath label dm0 /dev/da0 /dev/da1. > >> Now I have new device /dev/multipath/dm0. > >> I set kern.iscsi.fail_on_disconnection=1 (to fail IO fast). > >> > >> Issue 1: > >> ------------- > >> I can't run simple fio/dd traffice over /dev/da0 nor /dev/da1. > >> The only traffic that possible is using the multipath device dm0. > >> Is this by design ? > > > > This is probably because geom only lets one writer open the device at > > a time, and when the dm0 device is open, it blocks any other writers > > to it's underlying devices... There is a special geom debug flag that > > you can set to avoid this... > > I tried this debug exclusive flag with iSCSI/iSER but when I set it to 0 > the system crushed at the 'gmultipath label ...' stage. > John, > did you try it over iSCSI ? Nope, I didn't.. In fact, I was thinking of another debug flag the one in kern.geom.debugflags, but that one should have worked too... Since it doesn't, please file a bug report and notify the maintainer of multipath with a complete report... > >> In the linux implementation we can run traffic on both block devices and > >> multipath devices. > >> > >> Issue 2: > >> -------------- > >> I run some fio traffic utility over multipath device dm0 on initiator > >> side with port toggling in a loop > >> > >> Port 1 down --> sleep 2 mins (iSCSI/ISER device reconnecting meanwhile > >> with no success) --> port 1 up --> sleep 5 mins (iSCSI/ISER device > >> reconnecting successecfully) > >> Port 2 down --> sleep 2 mins (iSCSI/ISER device reconnecting meanwhile > >> with no success) --> port 2 up --> sleep 5 mins (iSCSI/ISER device > >> reconnecting successecfully) > >> > >> The expected result is that when the port N is down than the traffic > >> moves to the available port and continue succesfully. > >> I run this test for many hours and traffic FAILED (even though there was > >> at least 1 suitable path between initiator and target). > > > > Someone else will need to answer this one... > > I'm pretty new in the FreeBSD community so I don't know who is the > maintainer of the gmultipath driver. Though I realize it's difficult, it's easiest to look at the source to see who's been touching it last: https://svnweb.freebsd.org/base/head/sys/geom/multipath/g_multipath.c?view=log Looks like mav has been somewhat active recently... I've cc'd him... > Maybe we can discuss about testing the gmultipath driver over iscsi/iser > devices and fix some bugs together ? I can help out some, but engaging mav, or some of the others that are more active in storage would be better... > We are planning to add it to our test plan and HA is in high priority > for us. You should definately talk/coordinate w/ the people at iXsystems (mav works there), as they work in storage w/ iSCSI, etc. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-scsi@freebsd.org Wed Jun 24 05:32:07 2015 Return-Path: Delivered-To: freebsd-scsi@nevdull.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 07E69141E5B5 for ; Wed, 24 Jun 2015 05:32:07 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-lb0-x231.google.com (mail-lb0-x231.google.com [IPv6:2a00:1450:4010:c04::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ADA5C9A4 for ; Wed, 24 Jun 2015 05:21:56 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by lbbvz5 with SMTP id vz5so19383602lbb.0 for ; Tue, 23 Jun 2015 22:21:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=B2KqhI+pbpdh0m2HufWM8X/t7WM5KtmYeMU1GYavQjw=; b=j4Y42U5JAcEYLMvs1KCIO2nd3572OYT5pH+94PAUM3W7Fyztw0xzz1Aut+5WBoR+sX mZBwvzHtfcFYmPfL9CTW9ZGcHF8iKaCAvtVukjnpUA9UwJJLPGJZgCp64kb+pEQ2ohnc pvuohlWzH3GkhM/k0fWrfAuxqYYNi51FZGQWdj0JQR9hgc3XW3kmMrFj3GRSZIIbLrVD oc1NM6Px6qW5511yRkKFYqKT979zG63SRcPgz2NArPIcx1ozfN6tDVcmgkKLlP8NDBpN Uad043TqFTJKgVDUTOSQgP/KRb5ZVa0I41IoCQrh4Omr57S0GrCzMzQama9GgKRT+0CQ 6GtQ== X-Received: by 10.112.135.131 with SMTP id ps3mr38037750lbb.84.1435123314897; Tue, 23 Jun 2015 22:21:54 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([134.249.139.101]) by mx.google.com with ESMTPSA id jr6sm5255553lab.12.2015.06.23.22.21.53 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 Jun 2015 22:21:53 -0700 (PDT) Sender: Alexander Motin Message-ID: <558A3E6F.90903@FreeBSD.org> Date: Wed, 24 Jun 2015 08:21:51 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: John-Mark Gurney , Max Gurtovoy CC: freebsd-scsi@freebsd.org, Sagi Grimberg , Oren Duer , Hans Petter Selasky Subject: Re: gmultipath HA over iscsi/iser References: <557DA8C0.1020209@mellanox.com> <20150619162015.GD96349@funkthat.com> <55897E4B.8060608@mellanox.com> <20150624001412.GS96349@funkthat.com> In-Reply-To: <20150624001412.GS96349@funkthat.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2015 05:32:07 -0000 Hi, Max. On 24.06.2015 03:14, John-Mark Gurney wrote: > Max Gurtovoy wrote this message on Tue, Jun 23, 2015 at 18:42 +0300: >> On 6/19/2015 7:20 PM, John-Mark Gurney wrote: >>> Max Gurtovoy wrote this message on Sun, Jun 14, 2015 at 19:16 +0300: >>>> lately I was testing HA using gmultipath utility over iSCSI/iSER devices. >>>> I'm working on 11-current code base. >>>> I created 1 LUN on the target side and connected via 2 different >>>> physical ports from the initiator side. >>>> On the initiator side I see see /dev/da0 and /dev/da1. >>>> I created multipath device using: >>>> gmultipath label dm0 /dev/da0 /dev/da1. >>>> Now I have new device /dev/multipath/dm0. >>>> I set kern.iscsi.fail_on_disconnection=1 (to fail IO fast). >>>> >>>> Issue 1: >>>> ------------- >>>> I can't run simple fio/dd traffice over /dev/da0 nor /dev/da1. >>>> The only traffic that possible is using the multipath device dm0. >>>> Is this by design ? Yes, that is by design. Otherwise geom tasting process could be confused in some situations. For example, it may be not obvious whether partition tables should be handled over multipath or over raw devices. And if user mounts file system via partition labels or GPT IDs, it is not predictable which of three (or more) instances he will mount. There is sysctl kern.geom.multipath.exclusive, documented in man page, to control that behavior, but I would not recommend you to disable it. >>>> In the linux implementation we can run traffic on both block devices and >>>> multipath devices. There is an Easter egg in GEOM that allows to do the same: kern.geom.debugflags=16. It allows access to raw GEOM devices in any situation. But that is a hack and should be considered as such with all possible cautions. >>>> Issue 2: >>>> -------------- >>>> I run some fio traffic utility over multipath device dm0 on initiator >>>> side with port toggling in a loop >>>> >>>> Port 1 down --> sleep 2 mins (iSCSI/ISER device reconnecting meanwhile >>>> with no success) --> port 1 up --> sleep 5 mins (iSCSI/ISER device >>>> reconnecting successecfully) >>>> Port 2 down --> sleep 2 mins (iSCSI/ISER device reconnecting meanwhile >>>> with no success) --> port 2 up --> sleep 5 mins (iSCSI/ISER device >>>> reconnecting successecfully) >>>> >>>> The expected result is that when the port N is down than the traffic >>>> moves to the available port and continue succesfully. >>>> I run this test for many hours and traffic FAILED (even though there was >>>> at least 1 suitable path between initiator and target). I am not aware about such bug. We may need some deeper debugging to diagnose that. > Though I realize it's difficult, it's easiest to look at the source to > see who's been touching it last: > https://svnweb.freebsd.org/base/head/sys/geom/multipath/g_multipath.c?view=log > > Looks like mav has been somewhat active recently... I've cc'd him... > >> Maybe we can discuss about testing the gmultipath driver over iscsi/iser >> devices and fix some bugs together ? > > I can help out some, but engaging mav, or some of the others that > are more active in storage would be better... > >> We are planning to add it to our test plan and HA is in high priority >> for us. > > You should definately talk/coordinate w/ the people at iXsystems (mav > works there), as they work in storage w/ iSCSI, etc. I was not a original gmultipath author, but I've rewritten significant part of it to make it work, and now it works fine for us. I am open to bug reports and propositions about improving it. -- Alexander Motin From owner-freebsd-scsi@freebsd.org Sat Jun 27 03:56:09 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4253198E6C9; Sat, 27 Jun 2015 03:56:09 +0000 (UTC) (envelope-from bah@bananmonarki.se) Received: from feeder.usenet4all.se (1-1-1-38a.far.sth.bostream.se [82.182.32.53]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 524AC151C; Sat, 27 Jun 2015 03:55:57 +0000 (UTC) (envelope-from bah@bananmonarki.se) Received: from testbox.news4all.se (testbox.usenet4all.se [10.0.0.3]) by feeder.usenet4all.se (8.13.1/8.13.1) with ESMTP id t5R3sYsw048415; Sat, 27 Jun 2015 05:54:35 +0200 (CEST) (envelope-from bah@bananmonarki.se) Message-ID: <558E1E7A.5000105@bananmonarki.se> Date: Sat, 27 Jun 2015 05:54:34 +0200 From: Bernt Hansson User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: vermaden , freebsd-questions@freebsd.org, freebsd-scsi@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: Working and Supported SCSI Controller References: In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2015 03:56:09 -0000 On 2012-05-24 01:02, vermaden wrote: > Hi, > > as HARDWARE NOTES are next to useless: > http://lists.freebsd.org/pipermail/freebsd-questions/2012-May/241164.html > > What *working* PCI/PCI-X SCSI controller do You guys suggest? > > Requirements: PCI/PCI-X Ultra160 or Ultra320 with one or more 68-pin internal connector > > Thanks in advance for Your suggestions, > vermaden Adaptech 2940 From owner-freebsd-scsi@freebsd.org Sat Jun 27 04:05:49 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6E90898E829 for ; Sat, 27 Jun 2015 04:05:49 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 41E711A6B for ; Sat, 27 Jun 2015 04:05:48 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 612C42141C for ; Sat, 27 Jun 2015 00:05:47 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute3.internal (MEProxy); Sat, 27 Jun 2015 00:05:47 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=zDm980qeD9DmxKI 6+T4HkJX99Us=; b=sQ5J+P/aiFXHUm5LeQl/AioNu9gE4G4q/zNaTkQtme/yuip l4UlEHs6VJphvbLpvXxo6JRjsd5y6lrNQRQcasQ7llAU5lbMDcTnSpXWNL55vY/I 9IMC4LAQ2MCWJDVmNYxlDVuye8mVPUUsBqkJiwukWoWdp6VBJKKYk2HNtPQk= X-Sasl-enc: AbJiRct6BFsUzYtmfRQcFk0X2B4Ev+cEXm75C9pMeATh 1435377946 Received: from [10.79.22.142] (unknown [166.175.186.137]) by mail.messagingengine.com (Postfix) with ESMTPA id C275B680197; Sat, 27 Jun 2015 00:05:46 -0400 (EDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: Working and Supported SCSI Controller From: Josh Paetzel X-Mailer: iPhone Mail (12F70) In-Reply-To: <558E1E7A.5000105@bananmonarki.se> Date: Fri, 26 Jun 2015 23:05:42 -0500 Cc: vermaden , "freebsd-questions@freebsd.org" , "freebsd-scsi@freebsd.org" , "freebsd-hardware@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <558E1E7A.5000105@bananmonarki.se> To: Bernt Hansson X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2015 04:05:49 -0000 An adaptec 2940 isn't a U160 controller. The adaptec 19160/29160/39160 are, but I haven't used them since FreeBSD 4.x= . No idea if they still work. Thanks, Josh Paetzel > On Jun 26, 2015, at 10:54 PM, Bernt Hansson wrote: >=20 >> On 2012-05-24 01:02, vermaden wrote: >> Hi, >>=20 >> as HARDWARE NOTES are next to useless: >> http://lists.freebsd.org/pipermail/freebsd-questions/2012-May/241164.html= >>=20 >> What *working* PCI/PCI-X SCSI controller do You guys suggest? >>=20 >> Requirements: PCI/PCI-X Ultra160 or Ultra320 with one or more 68-pin inte= rnal connector >>=20 >> Thanks in advance for Your suggestions, >> vermaden > Adaptech 2940 > _______________________________________________ > freebsd-hardware@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hardware > To unsubscribe, send any mail to "freebsd-hardware-unsubscribe@freebsd.org= " From owner-freebsd-scsi@freebsd.org Sat Jun 27 13:26:57 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 103C098E1C8; Sat, 27 Jun 2015 13:26:57 +0000 (UTC) (envelope-from bah@bananmonarki.se) Received: from feeder.usenet4all.se (1-1-1-38a.far.sth.bostream.se [82.182.32.53]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 83A65128A; Sat, 27 Jun 2015 13:26:54 +0000 (UTC) (envelope-from bah@bananmonarki.se) Received: from testbox.news4all.se (testbox.usenet4all.se [10.0.0.3]) by feeder.usenet4all.se (8.13.1/8.13.1) with ESMTP id t5RDQn6i059911; Sat, 27 Jun 2015 15:26:49 +0200 (CEST) (envelope-from bah@bananmonarki.se) Message-ID: <558EA499.7080207@bananmonarki.se> Date: Sat, 27 Jun 2015 15:26:49 +0200 From: Bernt Hansson User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: Josh Paetzel CC: vermaden , "freebsd-questions@freebsd.org" , "freebsd-scsi@freebsd.org" , "freebsd-hardware@freebsd.org" Subject: Re: Working and Supported SCSI Controller References: <558E1E7A.5000105@bananmonarki.se> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2015 13:26:57 -0000 On 2015-06-27 06:05, Josh Paetzel wrote: > An adaptec 2940 isn't a U160 controller. > > The adaptec 19160/29160/39160 are, but I haven't used them since FreeBSD 4.x. No idea if they still work. > > Thanks, > > We have 19160 and 2940UW on freebsd 8.X On Jun 26, 2015, at 10:54 PM, Bernt Hansson wrote: >>> On 2012-05-24 01:02, vermaden wrote: >>> Hi, >>> >>> as HARDWARE NOTES are next to useless: >>> http://lists.freebsd.org/pipermail/freebsd-questions/2012-May/241164.html >>> >>> What *working* PCI/PCI-X SCSI controller do You guys suggest? >>> >>> Requirements: PCI/PCI-X Ultra160 or Ultra320 with one or more 68-pin internal connector >>> >>> Thanks in advance for Your suggestions, >>> vermaden >> Adaptech 2940 >> _______________________________________________ >> freebsd-hardware@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hardware >> To unsubscribe, send any mail to "freebsd-hardware-unsubscribe@freebsd.org" > > From owner-freebsd-scsi@freebsd.org Sat Jun 27 14:30:51 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 24C1C98EB79; Sat, 27 Jun 2015 14:30:51 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo.poczta.interia.pl (smtpo.poczta.interia.pl [217.74.65.152]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B706D1577; Sat, 27 Jun 2015 14:30:50 +0000 (UTC) (envelope-from vermaden@interia.pl) X-Interia-R: Interia X-Interia-R-IP: 195.69.80.4 X-Interia-R-Helo: Received: from w530.local (unknown [195.69.80.4]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by poczta.interia.pl (INTERIA.PL) with ESMTPSA; Sat, 27 Jun 2015 16:15:18 +0200 (CEST) Message-ID: <558EB032.1020100@interia.pl> Date: Sat, 27 Jun 2015 16:16:18 +0200 From: vermaden User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: Bernt Hansson , Josh Paetzel CC: "freebsd-questions@freebsd.org" , "freebsd-scsi@freebsd.org" , "freebsd-hardware@freebsd.org" Subject: Re: Working and Supported SCSI Controller References: <558E1E7A.5000105@bananmonarki.se> <558EA499.7080207@bananmonarki.se> In-Reply-To: <558EA499.7080207@bananmonarki.se> X-Interia-Antivirus: OK DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=biztos; t=1435414521; bh=6cx099TgbbEV4NvtRqR9QYHbx6Zowj9J2/yadh1LP60=; h=X-Interia-R:X-Interia-R-IP:X-Interia-R-Helo:Message-ID:Date:From: User-Agent:MIME-Version:To:CC:Subject:References:In-Reply-To: Content-Type:X-Interia-Antivirus; b=qNNuGt7qL++x48viHqNgG3LXDRjk6pQ0l6USEX7csqD4Q0UNmaPcgvNYCePw8vqvy pYXBdSE+F25XWrUSZeapPZ+4RqzSN/e1ZKeqrF7ksROind92TNYJcJ0PpdX9Gq2JXf MCG6U6Kbc5mDZeXSlYmhzGNexoaWN4BwWZMrqNSI= Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2015 14:30:51 -0000 Hi. More then 3 years for a reply ... better late then never tho ;) I do not own that LTO3 tape drive any more ... and I do not even own that motherboard to which I needed that SCSI conreoller ;) Regards, vermaden On 06/27/2015 15:26, Bernt Hansson wrote: > On 2015-06-27 06:05, Josh Paetzel wrote: >> An adaptec 2940 isn't a U160 controller. >> >> The adaptec 19160/29160/39160 are, but I haven't used them since >> FreeBSD 4.x. No idea if they still work. >> >> Thanks, >> >> We have 19160 and 2940UW on freebsd 8.X > > On Jun 26, 2015, at 10:54 PM, Bernt Hansson wrote: >>>> On 2012-05-24 01:02, vermaden wrote: >>>> Hi, >>>> >>>> as HARDWARE NOTES are next to useless: >>>> http://lists.freebsd.org/pipermail/freebsd-questions/2012-May/241164.html >>>> >>>> >>>> What *working* PCI/PCI-X SCSI controller do You guys suggest? >>>> >>>> Requirements: PCI/PCI-X Ultra160 or Ultra320 with one or more >>>> 68-pin internal connector >>>> >>>> Thanks in advance for Your suggestions, >>>> vermaden >>> Adaptech 2940 >>> _______________________________________________ >>> freebsd-hardware@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hardware >>> To unsubscribe, send any mail to >>> "freebsd-hardware-unsubscribe@freebsd.org" >> >> > From owner-freebsd-scsi@freebsd.org Sat Jun 27 19:08:27 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CF87198E2A4; Sat, 27 Jun 2015 19:08:27 +0000 (UTC) (envelope-from bah@bananmonarki.se) Received: from feeder.usenet4all.se (1-1-1-38a.far.sth.bostream.se [82.182.32.53]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DC7CC1278; Sat, 27 Jun 2015 19:08:15 +0000 (UTC) (envelope-from bah@bananmonarki.se) Received: from testbox.news4all.se (testbox.usenet4all.se [10.0.0.3]) by feeder.usenet4all.se (8.13.1/8.13.1) with ESMTP id t5RJ8AA2066773; Sat, 27 Jun 2015 21:08:10 +0200 (CEST) (envelope-from bah@bananmonarki.se) Message-ID: <558EF49A.5070901@bananmonarki.se> Date: Sat, 27 Jun 2015 21:08:10 +0200 From: Bernt Hansson User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: vermaden , Josh Paetzel CC: "freebsd-questions@freebsd.org" , "freebsd-scsi@freebsd.org" , "freebsd-hardware@freebsd.org" Subject: Re: Working and Supported SCSI Controller References: <558E1E7A.5000105@bananmonarki.se> <558EA499.7080207@bananmonarki.se> <558EB032.1020100@interia.pl> In-Reply-To: <558EB032.1020100@interia.pl> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2015 19:08:27 -0000 On 2015-06-27 16:16, vermaden wrote: > Hi. > > More then 3 years for a reply ... better late then never tho ;) > Do not know what future you live in... but nonte less it is 2015 where i live. > I do not own that LTO3 tape drive any more ... and I do not even own > that motherboard to which I needed that SCSI conreoller ;) > > Regards, > vermaden > > > > On 06/27/2015 15:26, Bernt Hansson wrote: >> On 2015-06-27 06:05, Josh Paetzel wrote: >>> An adaptec 2940 isn't a U160 controller. >>> >>> The adaptec 19160/29160/39160 are, but I haven't used them since >>> FreeBSD 4.x. No idea if they still work. >>> >>> Thanks, >>> >>> We have 19160 and 2940UW on freebsd 8.X >> >> On Jun 26, 2015, at 10:54 PM, Bernt Hansson wrote: >>>>> On 2012-05-24 01:02, vermaden wrote: >>>>> Hi, >>>>> >>>>> as HARDWARE NOTES are next to useless: >>>>> http://lists.freebsd.org/pipermail/freebsd-questions/2012-May/241164.html >>>>> >>>>> >>>>> What *working* PCI/PCI-X SCSI controller do You guys suggest? >>>>> >>>>> Requirements: PCI/PCI-X Ultra160 or Ultra320 with one or more >>>>> 68-pin internal connector >>>>> >>>>> Thanks in advance for Your suggestions, >>>>> vermaden >>>> Adaptech 2940 >>>> _______________________________________________ >>>> freebsd-hardware@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-hardware >>>> To unsubscribe, send any mail to >>>> "freebsd-hardware-unsubscribe@freebsd.org" >>> >>> >> > > From owner-freebsd-scsi@freebsd.org Sat Jun 27 23:46:32 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9DFEB98EE82; Sat, 27 Jun 2015 23:46:32 +0000 (UTC) (envelope-from quartz@sneakertech.com) Received: from douhisi.pair.com (douhisi.pair.com [209.68.5.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7B612159E; Sat, 27 Jun 2015 23:46:32 +0000 (UTC) (envelope-from quartz@sneakertech.com) Received: from [10.2.2.1] (pool-173-48-121-235.bstnma.fios.verizon.net [173.48.121.235]) by douhisi.pair.com (Postfix) with ESMTPSA id 1C7FB3F722; Sat, 27 Jun 2015 19:46:25 -0400 (EDT) Message-ID: <558F35D0.4040601@sneakertech.com> Date: Sat, 27 Jun 2015 19:46:24 -0400 From: Quartz User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: Bernt Hansson CC: vermaden , Josh Paetzel , "freebsd-scsi@freebsd.org" , "freebsd-questions@freebsd.org" , "freebsd-hardware@freebsd.org" Subject: Re: Working and Supported SCSI Controller References: <558E1E7A.5000105@bananmonarki.se> <558EA499.7080207@bananmonarki.se> <558EB032.1020100@interia.pl> <558EF49A.5070901@bananmonarki.se> In-Reply-To: <558EF49A.5070901@bananmonarki.se> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2015 23:46:32 -0000 >> More then 3 years for a reply ... better late then never tho ;) >> > Do not know what future you live in... but nonte less it is 2015 where i > live. FWIW, your own reply quotes that message as: "On 2012-05-24 01:02, vermaden wrote: "