From owner-freebsd-scsi@freebsd.org Mon Nov 6 22:37:45 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2834DE68AFD for ; Mon, 6 Nov 2017 22:37:45 +0000 (UTC) (envelope-from avv314@gmail.com) Received: from mail-yw0-x22d.google.com (mail-yw0-x22d.google.com [IPv6:2607:f8b0:4002:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D479663452 for ; Mon, 6 Nov 2017 22:37:44 +0000 (UTC) (envelope-from avv314@gmail.com) Received: by mail-yw0-x22d.google.com with SMTP id t71so9288845ywc.3 for ; Mon, 06 Nov 2017 14:37:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Q5AY71yVfZ+Uzja0DIzQPbVZI7O3IYPGY/Wr1dM5n2E=; b=NoJFCQhgQ9UjUZuy2sYOM+aCwZlJ19UGPq0xTKFhGiua9ZvWEXgWsa6QJik/SJTe4M chsKwo6A28bV3ROpMsF0hA5VLhrnFUcjVtgvyw0/F+xPVdfBcKB9F+H0u0dX/sX8Gope Nes5jypd6ZiU4IPA7N2T5FbzsI7cGQg2GHkLcmv7qSunp/715hikZ/esoNElmVGWj/19 tn3GOE3xVpFcHB6iIYouVvb9O5Hx0gynbNSLAEOd328Mp9wcPQ9UZ5+cFbFKbI106eFf 2S9AxOypOdjgn64lS/YMsuKMW0Wwa62g36RJzMeGRcRUsVIk8DTgquS7WMuvrbRTHR1S D8GQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Q5AY71yVfZ+Uzja0DIzQPbVZI7O3IYPGY/Wr1dM5n2E=; b=K1psJf8YTbVAm7LlksGrfsRhBrq2+P4bs5PshJlPb+fdGxjGrhbntxRcvfDeRAftn4 uS6eYUwPw1doRFXVDaEadeCDWi3hsEGoFQTj3U4wq6IGOgCOCZ5y/FWC4T8NcOQLSlKq tPijYHBkq+dTCq9CiaxlYWzURGmQ2qgj8LIJ63ui95CJc8bteh7tSLUl5Q3W//UXk2PC nq+asYDl+YuS2dYQLo3jhPqRiVfq6mv+7DmqpUMtFW4gaDQEn+3CMSStIlaJuc11UuQM qBTHrziv1wPeoEswCcQVhYJ380sCuzNDUN7NAkMEQ3Dg/bBwHij7ozb334RZIS5vmWUG fWEQ== X-Gm-Message-State: AMCzsaWgjstmI2IdHpNLIcCHk3BHLUDAfJ5Gr5SB21pP/6bMBksUXCSd DElA29d06rTE95iHAW2DmQraJJ4sFmOrWBm1F176ZQ== X-Google-Smtp-Source: ABhQp+RMvSaMfod2FKZXCqKFJPxn4VHEaCroRkBj7wUb33LKxEW90AKsTlwoYjCth2Gd1WTBekLXnkWwkHbHaKyn/Rs= X-Received: by 10.37.174.159 with SMTP id b31mr10721281ybj.285.1510007863671; Mon, 06 Nov 2017 14:37:43 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.12.215 with HTTP; Mon, 6 Nov 2017 14:37:43 -0800 (PST) From: Andrew Vylegzhanin Date: Tue, 7 Nov 2017 01:37:43 +0300 Message-ID: Subject: LSI2008 and SAS3 backplane To: freebsd-scsi@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Nov 2017 22:37:45 -0000 Hi! I have a problem with low transfer speed (150MB/sec instead of 600Mb/sec) on SAS2 controller to SAS3 drive via SAS3 backplane. Hardware config is follows: Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay JBOD with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 pcs) are SEAGATE ST6000NM0095 E002. So, partial dmesg out: ... mps1: port 0x9c00-0x9cff mem 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 numa-domain 1 on pci16 mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd mps1: IOCCapabilities: 185c .... ses1 at mps1 bus 0 scbus8 target 81 lun 0 ses1: Fixed Enclosure Services SPC-3 SCSI device ses1: 150.000MB/s transfers ses1: Command Queueing enabled ses1: SCSI-3 ENC Device ses2 at mps1 bus 0 scbus8 target 82 lun 0 ses2: Fixed Enclosure Services SPC-3 SCSI device ses2: 150.000MB/s transfers ses2: Command Queueing enabled ses2: SCSI-3 ENC Device ses1: da0: Element descriptor: 'Slot00' .... da0 at mps1 bus 0 scbus8 target 61 lun 0 da3 at mps1 bus 0 scbus8 target 64 lun 0 ... da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number ZAD119P20000C730KZK3 da0: 150.000MB/s transfers da0: Command Queueing enabled da0: 5723166MB (11721045168 512 byte sectors) Some additional info. There is two identical system with same problem. System is under load now, and there is no erros, timeouts on disk i/o, so it seems to be not cable/hardware problem. I've tried other vendor SATA3 drive, got same 150MB/s. This server works on full speed (600MB/s transfers) with SAS2 JBOD (Dell MD1220) w/o problems. Any ideas? -- Andrew