From owner-freebsd-scsi@FreeBSD.ORG Thu Feb 23 09:25:18 2012 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9C60E106566B; Thu, 23 Feb 2012 09:25:18 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id 294788FC16; Thu, 23 Feb 2012 09:25:17 +0000 (UTC) Received: from skuns.kiev.zoral.com.ua (localhost [127.0.0.1]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id q1N9OwaE036298; Thu, 23 Feb 2012 11:24:58 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5) with ESMTP id q1N9OwRM044834; Thu, 23 Feb 2012 11:24:58 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5/Submit) id q1N9OvTG044833; Thu, 23 Feb 2012 11:24:57 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 23 Feb 2012 11:24:57 +0200 From: Konstantin Belousov To: "Desai, Kashyap" Message-ID: <20120223092457.GB55074@deviant.kiev.zoral.com.ua> References: <20120222191519.GT55074@deviant.kiev.zoral.com.ua> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ATYltwmfWCpDp8Ax" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: "freebsd-scsi@freebsd.org" , "Kenneth D. Merry" , "Justin T. Gibbs" , freebsd-stable , "McConnell, Stephen" Subject: Re: mpslsi0 : Trying sleep, but thread marked as sleeping prohibited X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2012 09:25:18 -0000 --ATYltwmfWCpDp8Ax Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Feb 23, 2012 at 05:52:12AM +0530, Desai, Kashyap wrote: >=20 >=20 > > -----Original Message----- > > From: Konstantin Belousov [mailto:kostikbel@gmail.com] > > Sent: Thursday, February 23, 2012 12:45 AM > > To: Desai, Kashyap > > Cc: freebsd-scsi@freebsd.org; freebsd-stable; Justin T. Gibbs; Kenneth > > D. Merry; McConnell, Stephen > > Subject: Re: mpslsi0 : Trying sleep, but thread marked as sleeping > > prohibited > >=20 > > On Wed, Feb 22, 2012 at 07:36:42PM +0530, Desai, Kashyap wrote: > > > Hi, > > > > > > I am doing some code changes in mps dirver. While working on those > > changes, I come to know about something which is new to me. > > > Some expert help is required to clarify my doubt. > > > > > > 1. When any irq is register with FreeBSD OS, it sets " TDP_NOSLEEPING" > > > pflag. It means though irq in freebsd is treated as thread, We cannot > > sleep in IRQ because of " "TDP_NOSLEEPING " set. > > > 2. In mps driver we have below code snippet in ISR routine. > > > > > > > > > mps_dprint(sc, MPS_TRACE, "%s\n", __func__); > > > mps_lock(sc); > > > mps_intr_locked(data); > > > mps_unlock(sc); > > > > > > I wonder why there is no issue with above code ? Theoretical we cannot > > > sleep in ISR. (as explained in #1) Any thoughts ? > > > > > > > > > 3. I recently added few place msleep() instead of DELAY in ISR context > > > and I see " Trying sleep, but thread marked as sleeping prohibited". > > > > > FreeBSD has several basic ways to prevent a thread from executing on > > CPU. > > They mostly fall into two categories: bounded sleep, sometimes called > > blocking, and unbounded sleep, usually abbreviated as sleep. The bounded > > there refers to amount of code executed by other thread that hold > > resource preventing blocked thread from making a progress. > >=20 > > Examples of the blocking primitives are mutexes, rw locks and rm locks. > > The blocking is not counted as sleeping, so interrupt threads, which are > > designated as non-sleeping, still can lock mutexes. > Thanks for the tech help. .=20 >=20 > As per you comment, So now I understood as "TDP_NOSLEEPING" is only > for unbounded sleep restriction. Just curious to know, What is a > reason that thread can do blocking sleep but can't do unbounded sleep > ? Since technically we introduced sleeping restriction on interrupt > thread is to avoid starvation and that can be fit with either of the > sleep type. Is this not true ? No, not to avoid starvation. The intent of the blocking primitives is to acquire resources for limited amount of time. In other words, you never take a mutex for undefinitely long computation process. On the other hand, msleep sleep usually has no limitations. You do not want the interrupt thread to be put off the processor for undefined time, so sleep is prohibited. Another issue is that sleeping locks do not do priority propagation to the resource owners, while turnstiles used for blocking do. This way, interrupt thread waiting for mutex donates its priority to the current mutex owner, or at least it shall do. >=20 > I will be able to progress on my work based on your comment. A much thank= s for correcting my doubt. >=20 > ~ Kashyap >=20 > >=20 > > Examples of the sleeping primitives are msleep(), sx locks, lockmgr > > locks and conditional variables. > >=20 > > In essence, the locking facilities are split into several classes that > > form the hierarchy, and you cannot legally obtain the lock of higher > > class while holding a lock of lower class: > > spin mutexes -> blocking locks -> sleeping locks. > > It establishes some meta-order on the all locks. > >=20 > > Does this make sense ? >=20 --ATYltwmfWCpDp8Ax Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iEYEARECAAYFAk9GBekACgkQC3+MBN1Mb4gWYACdF0VYEz9/Zlgfb3xdfANWWZar j6IAoPD8FnxUrm+aokl/YQqtevqYMLrU =4uF7 -----END PGP SIGNATURE----- --ATYltwmfWCpDp8Ax--