From owner-freebsd-scsi@FreeBSD.ORG Fri Dec 6 16:24:31 2013 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 714726FD; Fri, 6 Dec 2013 16:24:31 +0000 (UTC) Received: from mtv-iport-1.cisco.com (mtv-iport-1.cisco.com [173.36.130.12]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 410A31B3D; Fri, 6 Dec 2013 16:24:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=4370; q=dns/txt; s=iport; t=1386347071; x=1387556671; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=B8cioS76qbMAJ+Z/z61OZEzzxY4i6+PMofd7XEBkEk4=; b=B1fqLf/NEbVVHupzDPjg9o+ZnaKLzYRV3WTQAOycwNdUs5mbHV4A/vo0 4jVHsWAhmUCRyK2glXIB3AdcudIfYwmS3xEPYYd0O/fjchFxe3UVzpMrG MKwtTSndM7JQA64tTm8SEh7wBjpfoePQhSbGb5zprPkQkwOM8FEzbUfG0 0=; X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AhAFAOD4oVKrRDoG/2dsb2JhbABZgwe6C4EiFnSCJgEBBA4sKwYOEAshJQ8FSYgUwRAXjkdJB4MggRMDiUKENYocAZITg0qBSA X-IronPort-AV: E=Sophos;i="4.93,841,1378857600"; d="scan'208";a="96409262" Received: from mtv-core-1.cisco.com ([171.68.58.6]) by mtv-iport-1.cisco.com with ESMTP; 06 Dec 2013 16:23:21 +0000 Received: from dambriskodt.cisco.com (dambriskodt.cisco.com [171.71.230.115]) by mtv-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id rB6GNKok019455 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 6 Dec 2013 16:23:20 GMT Received: from dambriskodt.cisco.com (localhost [127.0.0.1]) by dambriskodt.cisco.com (8.14.7/8.14.3) with ESMTP id rB6GMCUA014519; Fri, 6 Dec 2013 08:22:12 -0800 (PST) (envelope-from ambrisko@dambriskodt.cisco.com) Received: (from ambrisko@localhost) by dambriskodt.cisco.com (8.14.7/8.14.3/Submit) id rB6GMBXX014518; Fri, 6 Dec 2013 08:22:11 -0800 (PST) (envelope-from ambrisko) Date: Fri, 6 Dec 2013 08:22:11 -0800 From: Doug Ambrisko To: "Desai, Kashyap" Subject: Re: LSI - MR-Fusion controller driver patch and man page Message-ID: <20131206162211.GB14280@cisco.com> References: <08ba2a262fba45f687cdd3225f325110@BN1PR07MB247.namprd07.prod.outlook.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <08ba2a262fba45f687cdd3225f325110@BN1PR07MB247.namprd07.prod.outlook.com> User-Agent: Mutt/1.4.2.3i X-Mailman-Approved-At: Fri, 06 Dec 2013 16:27:49 +0000 Cc: "scottl@netflix.com" , "Radford, Adam" , "Kenneth D. Merry" , "sean_bruno@yahoo.com" , "Mankani, Krishnaraddi" , "dwhite@ixsystems.com" , "Maloy, Joe" , "jpaetzel@freebsd.org" , "freebsd-scsi@freebsd.org" , "McConnell, Stephen" X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Dec 2013 16:24:31 -0000 Sounds like good progress. I'll need to play with it a bit. One question I have with fast path, is how does LSI determine if they should use that method versus the RAID firmware? The problem I've seen with fast path is that it skips the NVRAM cache which is a huge performance boost for us. Is there a sysctl to control it? I could probably read through the code to figure it out but thought it would be good to get an idea of how LSI plans to use it since you guys are the experts on this feature. I understand from Adam that LSI uses this to increase the IOPS. I can see it potentially used if an SSD is in the system so then LD or PD access could be improved to that type of device. In past experience fast path was slower and created a bunch of SCSI sense errors reported by the RAID firmware. That is one reason why I removed support of fastpath in mfi. I also didn't want to introduce potential bugs if the RAID firmware and driver got out of sync. due to bugs. Recently we found with SW RAID that trying to load balance IOs across drives can defeat read ahead caches of disks. Thanks, Doug A. On Fri, Dec 06, 2013 at 02:37:21PM +0000, Desai, Kashyap wrote: | Hi, | | Please consider attached patch for FreeBSD upstream check-in. | | Please find attached patch for driver for LSI's MegaRaid Controllers. This driver supports Thunderbolt onwards Device IDs of MR controllers. | Currently it supports 0x005B and 0x005D Device IDs. | | NOTE : This driver will not eliminate or by pass any functionality of driver which already support above to Device IDs to keep existing user experience unchanged. | | Driver will be always given priority over driver and only if customer/user wants to use/migrate from to , it will hook up into kernel via device.hint rules. (Attached is mrsas man page for more info.) | | LSI will continue to update driver in future in timely bases. We have another set of patch in pipeline to be submitted for , but need first go ahead for attached patch and later we will continue to keep up-to-date (In sync with LSI released driver which is available at lsi's external site) | | Apply patch with "patch -p0 < patchname.patch" from head directory. | | -- Few notes for user-- | LSI recommends using fusion_force bit In hint settings at start of the day, if they want to use . ( will be a default choice for MR-Fusion HBA), if will be changed only with fusion_force hint settings. (See mrsas man page) Changing any default behavior is well tested for most of the condition. | Switching from to for MR-Fusion options is designed to allow user as one time choice, though multiple time switch from to is possible, it is not recommended. So, user needs to decide from start of the day, which driver they want to use for MR-Fusion card. | | -- Implementation details -- | To support this feature, we have modify code to change default return type from probe. Currently driver return "BUS_PROBE_DEFAULT". driver has been be changed to return "BUS_PROBE_LOW_PRIORITY" if fusion_force hint from device.hints is set. | Please notice, above mentioned implementation in driver is only applicable in case of MR-Fusion controller detection. For any other controllers, supported by driver, the behavior of probe return will remain same as before. | | | -- High level feature list of -- | 1. Supports Fast Path feature of LSI controllers. | 2. Supports 4K sector Drives. | 3. CAM layer based interface. All VDs will be attached to CAM layer (Expected storage will be visible in "camcontroll") | 4. Complete support of Online Controller Reset. (OCR) | 5. OCR on Fimrware fault and IO timeout case. | 6. Work well with management application which is generic application provided by LSI for all other Operating system. | 7. Supporst DIF enabled VDs (Same support as provided in Linux and other OSes in FreeBSD) | 8. Fast Path Load balance support. | | - In summary, this driver is in part with Linux based MR drivers and all other features will be available to as planned activity from LSI | | This code is well tested by LSI Q/A team on 32 bit and 64 bit FreeBSD Released OSes. | | | Thanks, Kashyap |