From owner-freebsd-scsi@freebsd.org Thu Sep 22 14:39:22 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 64746BE5A51 for ; Thu, 22 Sep 2016 14:39:22 +0000 (UTC) (envelope-from kashyap.desai@broadcom.com) Received: from mail-it0-x233.google.com (mail-it0-x233.google.com [IPv6:2607:f8b0:4001:c0b::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 390B9790 for ; Thu, 22 Sep 2016 14:39:22 +0000 (UTC) (envelope-from kashyap.desai@broadcom.com) Received: by mail-it0-x233.google.com with SMTP id n143so83466315ita.1 for ; Thu, 22 Sep 2016 07:39:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; h=from:references:in-reply-to:mime-version:thread-index:date :message-id:subject:to:cc; bh=qLorXH6wp/o7nPh1xVgfWMZRb5alMyklIMi6kjPJpSQ=; b=FI1RWtIvocbHmPAIj1SEMDK8bG2CSyNh6JmPZD4fD7zUFx5MhAm2W579C13mNTkDWw bXyeDGF8umf7FzMBnmuMOHTviK4v9k/zO+nfDAP1Zb5JiPSjkwQH/JKZE5teRQ1HXt12 0wQ1AOIMKMfLxn3Gf4ffZLEingBYgxNdjDQ8g= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:references:in-reply-to:mime-version :thread-index:date:message-id:subject:to:cc; bh=qLorXH6wp/o7nPh1xVgfWMZRb5alMyklIMi6kjPJpSQ=; b=E4Dsi7iIOsSZqRcJ9+m0FeqHNw//74LkXC85Tsf5SPoHcFni/E9BeBfmsuEJKQHD03 GZ8/o8YKELHn5YcMOP6+AX1LyElGkm3Vn59y69IRdhn3YloIdrCyrnY9t0zguB5u4MkT uWlilkkk2nmLsPUmyytJpdOHFlYQCYm8Qy5QQs+5QW3w9YfrE1SVrdRDEmrJZTWKr/D9 OVRiCff4dHZlvscT16hk7IJwg/3B8gxlHJjmyRpO7NPAW1zUE7WfYmwhmQuEy8MJ6WVU 43OCU3+q4Ngt7Ar4j74rds32Q3BTJK7NkJ40MfXxyqjYbpopjOPBObhc7v0oMz7aiWgt C9hg== X-Gm-Message-State: AE9vXwMclMd+XOvcBoyaKEUYDbePJyOIov+Sy1eQIoz5d+3+LbdiOdcA5Q9+SZc5gmNnp6ch7gyvsnLHHgNaBSk7 X-Received: by 10.36.65.2 with SMTP id x2mr11151829ita.78.1474555161217; Thu, 22 Sep 2016 07:39:21 -0700 (PDT) From: Kashyap Desai References: <03ee30cfdb1ac86b644ff3516e0d88c0@mail.gmail.com> In-Reply-To: <03ee30cfdb1ac86b644ff3516e0d88c0@mail.gmail.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 14.0 Thread-Index: AQHWPDlcg2acl0r0bM9EVuOrjfsiOqB9QxSQ Date: Thu, 22 Sep 2016 20:09:19 +0530 Message-ID: Subject: RE: MRSAS: SATA drives are getting deleted and then readded after controller reset To: Sumit Saxena , freebsd-scsi@freebsd.org, scott4long@yahoo.com, ken@freebsd.org Cc: Seema Kumashikar , Stephen Mcconnell , Sreekanth Reddy Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Sep 2016 14:39:22 -0000 Hi - To add one more thing - This issue is even common for IT HBA (mpr driver), so looks to be a common issue. If you have SATA drive and just do "camcontrol rescan all", SATA disc is added and removed back by CAM layer. One more log snippet - mrsas0: Reset successful (xpt0:mrsas0:1:-1:ffffffff): rescan already queued (xpt0:mrsas0:1:-1:ffffffff): rescan already queued da2 at mrsas0 bus 1 scbus1 target 51 lun 0 da2: s/n 9XE09LAH detached cam_periph_alloc: attempt to re-allocate valid device da2 rejected flags 0x118 refcount 2 daasync: Unable to attach to new device due to status 0x6 (da2:mrsas0:1:51:0): Periph destroyed (da2:mrsas0:1:51:0): UNMAPPED da2 at mrsas0 bus 1 scbus1 target 51 lun 0 da2: Fixed Direct Access SPC-4 SCSI device da2: Serial Number 9XE09LAH da2: 150.000MB/s transfers da2: 238475MB (488397168 512 byte sectors) ` Kashyap > -----Original Message----- > From: Sumit Saxena [mailto:sumit.saxena@broadcom.com] > Sent: Thursday, September 22, 2016 7:54 PM > To: freebsd-scsi@freebsd.org; scott4long@yahoo.com; ken@freebsd.org > Cc: Kashyap Desai; Seema Kumashikar > Subject: MRSAS: SATA drives are getting deleted and then readded after > controller reset > > Ken/Scott, > > On FreeBSD11.0 RC1, we are facing an issue where SATA drives connected > behind LSI's MegaRAID controller getting deleted and added back after > controller reset. > I am using Broadcom/Avago/LSI's MegaRAID Invader controller(device ID- > 0x005d). The point to note here is- this behavior is not observed with SAS > drives > on FreeBSD11.0-RC1. > Also on FreeBSD10.3 this behavior is not at all observed on SATA as well. > We are debugging the issue but it would be much helpful if we can get > quick > inputs/pointers. > > Please find below the detailed information- > > OS: FreeBSD 11.0 RC1 > Controller: LSI's MegaRAID invader controller > > Connected devices list: > > root@freeBSD11:~ # camcontrol devlist > at scbus5 target 0 lun 0 (pass0,ada0) > at scbus6 target 0 lun 0 (ses0,pass1) > at scbus8 target 51 lun 0 > (da9,pass11)----------------------------------------->this is SATA drive > which is getting > deleted and re-added post controller reset > at scbus8 target 163 lun 0 (da8,pass10) > at scbus9 target 0 lun 0 (da6,pass8) > at scbus9 target 1 lun 0 (da2,pass4) > at scbus9 target 2 lun 0 (da0,pass2) > at scbus9 target 3 lun 0 (da7,pass9) > at scbus9 target 4 lun 0 (da3,pass5) > at scbus9 target 5 lun 0 (da1,pass3) > at scbus10 target 48 lun 0 (da4,pass6) > at scbus10 target 54 lun 0 (da5,pass7) > > > Relevant dmesg logs snippet(da9 is SATA drive which is getting deleted and > added back): > > ================================ > mrsas0: Initiaiting OCR because of FW fault! > mrsas0: Waiting for FW to come to ready state > mrsas0: Jbod map is supported > mrsas0: Reset successful > da9 at mrsas0 bus 1 scbus8 target 51 lun 0 > da9: s/n 9XE02AR2 detached > (da9:mrsas0:1:51:0): Periph destroyed > (da9:mrsas0:1:51:0): UNMAPPED > (da9:mrsas0:1:51:0): fatal error, could not acquire reference count > g_access(918): provider da9 has error > g_access(918): provider da9 has error > g_access(918): provider da9 has error > (da9:mrsas0:1:51:0): UNMAPPED > da9 at mrsas0 bus 1 scbus8 target 51 lun 0 > da9: Fixed Direct Access SPC-4 SCSI device > da9: Serial Number 9XE02AR2 > da9: 150.000MB/s transfers > da9: 238475MB (488397168 512 byte sectors) > ================================= > > Thanks, > Sumit