From owner-freebsd-scsi@freebsd.org Fri Dec 11 22:44:40 2015 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E438B9D7575 for ; Fri, 11 Dec 2015 22:44:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ob0-x22c.google.com (mail-ob0-x22c.google.com [IPv6:2607:f8b0:4003:c01::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B3DA7198E for ; Fri, 11 Dec 2015 22:44:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by obc18 with SMTP id 18so93185640obc.2 for ; Fri, 11 Dec 2015 14:44:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=8vt+vr0bQJZ2bvKgNha3ksi7nPCJhuOsensI5+mCG2A=; b=U9otsWw3ipb6/4NG3smXJM4QCwGwTdKF1nP2/a+vOzqFRutBSsnTQBHSIM21D7iyqr JE+3LMdQPq7mc+uMbwio69RA6bMZTSQ0yTIUvgRHwga1G9e3F/XpVZRF2WqnFMWf7WXs B0+ZnjNUyqUCdTYzTwmjF7u2ch+shX0SGCsXlDR1zs9syIyvgUD164Gz2ud9S6cG40/9 FtL+gltmg/aCCw0xeWgUb1UVjaRq4cTMaqlFrvWmsQgKDO7DjM0a1mn6M5CklVqgat8E Gz1Q9ocYSiu0CoDecupqofiEEYyyvZ5IY0nVaiFOfaA9l3P46Ph/2VN1QI6QzJUsSo6L KJrQ== MIME-Version: 1.0 X-Received: by 10.182.171.105 with SMTP id at9mr17178851obc.49.1449873880118; Fri, 11 Dec 2015 14:44:40 -0800 (PST) Sender: asomers@gmail.com Received: by 10.202.0.7 with HTTP; Fri, 11 Dec 2015 14:44:40 -0800 (PST) In-Reply-To: <566B4F68.2040807@mWare.ca> References: <566B4F68.2040807@mWare.ca> Date: Fri, 11 Dec 2015 15:44:40 -0700 X-Google-Sender-Auth: yjwZwWWQMJoYKWCTA__YxYxKI5Y Message-ID: Subject: Re: Informal(?) sesX messages From: Alan Somers To: Mykel@mware.ca Cc: FreeBSD-scsi Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Dec 2015 22:44:41 -0000 On Fri, Dec 11, 2015 at 3:34 PM, wrote: > Hi all, please CC me on reply as I'm not subscribed to this list. > > I've got one of those Supermicro 72-drive monster machines, all ZFS'd up. > https://www.supermicro.com/products/system/4u/6048/SSG-6048R-E1CR72L.cfm > > And before & after replacing a faulty SAS Expander and a pair of cables > (gobs of WRITE/ABORT errors), I'm still occasionally seeing these kernel > messages (in groups), and I'm not sure if they're benign, or pointing to a > SAS expander event... or what. I admit, this is my first time dealing with a > machine with SAS expanders, so I'm a bit out of my depth in diagnosis > thereof. > > Dec 11 16:06:54 ZFS-AF kernel: ses5: da7,pass7: Element descriptor: 'Slot00' > Dec 11 16:06:54 ZFS-AF kernel: ses5: da7,pass7: SAS Device Slot Element: 1 > Phys at Slot 0 > Dec 11 16:06:54 ZFS-AF kernel: ses5: phy 0: SAS device type 1 id 0 > Dec 11 16:06:54 ZFS-AF kernel: ses5: phy 0: protocols: Initiator( None ) > Target( SSP ) > Dec 11 16:06:54 ZFS-AF kernel: ses5: phy 0: parent 500304801ea2df3f addr > 5000c500844bd449 > These look like device arrival notifications. If you scroll up, do you see any departure notifications? They should look like this: mps0: mpssas_prepare_remove: Sending reset for target ID 10 da0 at mps0 bus 0 scbus0 target 10 lun 0 da0: s/n JPW930HQ15H26H detached mps0: Unfreezing devq for target ID 10 xpt_release_devq(): requested 1 > present 0 (da0:mps0:0:10:0): Periph destroyed Also, could you post your HBA and expander firmware versions? For the HBA, use "sysctl dev.mps.0.firmware_version". For the expander, install sg3_utils and do "sg_inq --hex --len=64 ses0". The firmware version is the dotted quad at the end. # sg_inq --hex --len=64 ses0 00 0d 00 05 02 34 00 40 02 41 49 43 20 43 4f 52 50 ....4.@.AIC CORP 10 53 41 53 20 36 47 20 45 78 70 61 6e 64 65 72 20 SAS 6G Expander 20 30 62 30 31 78 33 36 2d 31 2e 31 31 2e 31 2e 31 0b01x36-1.11.1.1 30 00 20 20 20 20 20 20 20 -Alan