From owner-freebsd-scsi@freebsd.org Wed May 29 19:56:24 2019 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6FEF015ABD32 for ; Wed, 29 May 2019 19:56:24 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DB874846FA for ; Wed, 29 May 2019 19:56:23 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 30A1B220E7; Wed, 29 May 2019 15:56:23 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Wed, 29 May 2019 15:56:23 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsco.org; h= content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=fm3; bh=W a9Au1YJWtCO+KPkq2bXOllDTG3mGZ8O4Pl3gX1bUjU=; b=lnpdPiSXo0BrS7+Tw t6gQR1lLtL2PXUYIp7qPqc1p71KOhKU0VfDFxMDNJn7tjIn0pQPD61p66hd1ikXd OE6LtDgyniCDO5bf5WQoHO1tqriqpg52kOrTnkhC5g+b3A0ct2AXCnZC9RAX5Uq/ Mthh/eFev1sRA1kfUp4ZFHCKl/RUZorn7OTVyTpNivUDdPtDknOQts17fhZyMa9I IDkAOdN7E5bupSvczqxG63prkHWSjuRWLVhj3L1KN+8KJ3yS2Q6SGfrjv+DIkqTn kqjKVBbG8Rr2Eu9T80yhYO/ZRZiauy8LQoV+98FClbhrx89Mf897d0ClgCLzhLj/ ivnbg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=Wa9Au1YJWtCO+KPkq2bXOllDTG3mGZ8O4Pl3gX1bU jU=; b=anH6JmB6+NThSBc+VQ9QnTBVXrQkHBmEMOYUA2QLuRuvjfSb76FjR1oJo WFP+ivHdb6VDn/PHXnGejXRt7fX5fT9rh24xwH3Q/iUZ36hUH7ceg+MgNpOMp25j pdXZG8KlRTavLDqiM1WwAyHL0SVB098kOHnQdNXEa7l2w8JrVwZpr7qfn5/qywOP 9BBrVrVxOGcc0doG5I8WuJZtWB4N+habDA+ROFl1uS6esXufY8k7Pvr0R5ntoS+2 7tr6zj2v4pZpIvbcjWEx2qHvrPe3+NikpodikXLjwH06XJlT4I8XjIjikEYDoVU5 Ph6jQNG91suuHYAVWgdtweHPgY2tQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduuddruddvjedgudegiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurheptggguffhjgffgffkfhfvofesth hqmhdthhdtjeenucfhrhhomhepufgtohhtthcunfhonhhguceoshgtohhtthhlsehsrghm shgtohdrohhrgheqnecukfhppedujeegrddvtdelrddvuddrudejkeenucfrrghrrghmpe hmrghilhhfrhhomhepshgtohhtthhlsehsrghmshgtohdrohhrghenucevlhhushhtvghr ufhiiigvpedt X-ME-Proxy: Received: from [172.20.10.2] (178.sub-174-209-21.myvzw.com [174.209.21.178]) by mail.messagingengine.com (Postfix) with ESMTPA id 0972D380083; Wed, 29 May 2019 15:56:21 -0400 (EDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: SAS3008 On FreeBSD 12 wGeli - OS Wont Boot From: Scott Long In-Reply-To: <41a1b364-4a17-44ff-a3ca-da9b80b16c2e@www.fastmail.com> Date: Wed, 29 May 2019 13:56:20 -0600 Cc: freebsd-scsi@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <120DF864-06FB-4396-887B-78DA3E7DA351@samsco.org> <3A9F7544-40A8-4446-ADC8-18CE57A9F55A@samsco.org> <14e0991e-2e53-4127-baf0-dc674b6d8653@www.fastmail.com> <41a1b364-4a17-44ff-a3ca-da9b80b16c2e@www.fastmail.com> To: Wallace Barrow X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: DB874846FA X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=samsco.org header.s=fm3 header.b=lnpdPiSX; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=anH6JmB6; spf=pass (mx1.freebsd.org: domain of scottl@samsco.org designates 66.111.4.26 as permitted sender) smtp.mailfrom=scottl@samsco.org X-Spamd-Result: default: False [-6.55 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[samsco.org:s=fm3,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[samsco.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[samsco.org:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; MX_GOOD(-0.01)[cached: in2-smtp.messagingengine.com]; IP_SCORE(-3.46)[ip: (-9.41), ipnet: 66.111.4.0/24(-4.65), asn: 11403(-3.16), country: US(-0.06)]; NEURAL_HAM_SHORT(-0.99)[-0.985,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[26.4.111.66.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2019 19:56:24 -0000 Thanks! It looks like there are 2 problems here. One is that the chain = frame logic really needs to auto-tune itself and not complain on the = console (and have larger default scaling). The second is that under = extreme resource shortage caused by the lack of chain frames, the driver = has a bug that corrupts its internal state and bookkeeping. It=E2=80=99s = not clear to me why GELI would trigger that, but it=E2=80=99s a good = clue. Thanks again for the report, I=E2=80=99ll see if I can find root = cause. Scott > On May 29, 2019, at 1:53 PM, Wallace Barrow wrote: >=20 > That is correct.=20 >=20 > After the tunable was set the servers were rebooted many times and I = am unable to reproduce the issue. So it seems that was the fix. >=20 > --=20 > Wallace Barrow > incin@incin.me >=20 > On Wed, May 29, 2019, at 2:49 PM, Scott Long wrote: >> Hi Wallace, >>=20 >> Sorry for the long delay in getting back to you, thanks for the = update.=20 >> Is my understanding correct that the problem went away once you=20 >> manually set the chain_frames tunable during install? >>=20 >> Thanks, >> Scott >>=20