From owner-freebsd-current@freebsd.org Thu Dec 1 20:28:17 2016 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2147DC61C25 for ; Thu, 1 Dec 2016 20:28:17 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 0CC781F09 for ; Thu, 1 Dec 2016 20:28:17 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 0C2A0C61C24; Thu, 1 Dec 2016 20:28:17 +0000 (UTC) Delivered-To: current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0BC98C61C23 for ; Thu, 1 Dec 2016 20:28:17 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DE6341F08 for ; Thu, 1 Dec 2016 20:28:16 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from ralph.baldwin.cx (c-73-231-226-104.hsd1.ca.comcast.net [73.231.226.104]) by mail.baldwin.cx (Postfix) with ESMTPSA id B2AEF10AA28; Thu, 1 Dec 2016 15:28:07 -0500 (EST) From: John Baldwin To: Sepherosa Ziehau Cc: "freebsd-current@freebsd.org" Subject: Re: Please test EARLY_AP_STARTUP Date: Thu, 01 Dec 2016 09:49:24 -0800 Message-ID: <2914745.0k996KCSkq@ralph.baldwin.cx> User-Agent: KMail/4.14.10 (FreeBSD/11.0-PRERELEASE; KDE/4.14.10; amd64; ; ) In-Reply-To: References: <7005233.xZtqgRZ2t6@ralph.baldwin.cx> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Thu, 01 Dec 2016 15:28:07 -0500 (EST) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Dec 2016 20:28:17 -0000 On Thursday, December 01, 2016 01:53:29 PM Sepherosa Ziehau wrote: > On Wed, Nov 30, 2016 at 9:59 AM, Sepherosa Ziehau wrote: > >>> After fdc is disabled and hyperv/storvsc is fixed, it seems to boot > >>> fine, except a long delay (28~30seconds) here: > >>> .... > >>> Timecounters tick every 1.000 msec > >>> ----- > >>> 28 ~ 30 seconds delay > >>> ----- > >>> vlan: initialized, using hash tables with chaining > >>> .... > >>> > >>> I have the bootverbose dmesg here: > >>> https://people.freebsd.org/~sephe/dmesg_earlyap.txt > >>> > >>> I booted 10 times, only one boot does not suffer this 30 seconds > >>> delay. It sounds like some races to me. Any hints? > >> > >> It is likely a race as we start running things sooner now, yes. Can you > >> break into DDB during the hang and see what thread0 is waiting on? If > >> it is in the interrupt hooks you can use 'show conifhk' in DDB to see the > >> list of pending interrupt hooks. That provides a list of candidate drivers > >> to inspect (e.g. stack traces of relevant kthreads) for what is actually > >> waiting (and what it is waiting on) > > > > Just tried, but I failed to break into DDB during the 30 seconds > > delay. DDB was entered after the 30 seconds delay, though I press the > > break key when the delay started. > > I tried add VERBOSE_SYSINIT option in order to get a rough location of > this delay, but the system boots just fine w/ VERBOSE_SYSINIT option, > sigh. You could add KTR_PROC tracing and use 'show ktr' in DDB when you break in after the 30 second delay to see what it was doing during the delay perhaps? -- John Baldwin