From eugen@grosbein.net Wed Aug 24 05:34:50 2022 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MCFDQ3Zlcz4ZH8D for ; Wed, 24 Aug 2022 05:35:18 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MCFDP43Hmz3KG9 for ; Wed, 24 Aug 2022 05:35:17 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.16.1/8.16.1) with ESMTPS id 27O5Yvup086241 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 24 Aug 2022 05:34:58 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: mason@blisses.org Received: from [10.58.0.11] (dadvw [10.58.0.11] (may be forged)) by eg.sd.rdtc.ru (8.16.1/8.16.1) with ESMTPS id 27O5Yt9O017437 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Wed, 24 Aug 2022 12:34:55 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Help debugging Vultr boot delay...? To: Mason Loring Bliss , freebsd-hackers@freebsd.org References: From: Eugene Grosbein Message-ID: Date: Wed, 24 Aug 2022 12:34:50 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT autolearn=disabled version=3.4.2 X-Spam-Report: * -0.0 SHORTCIRCUIT No description available. * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 4MCFDP43Hmz3KG9 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=fail (mx1.freebsd.org: domain of eugen@grosbein.net does not designate 2a01:4f8:c2c:26d8::2 as permitted sender) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-1.10 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; R_SPF_FAIL(1.00)[-all]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; R_DKIM_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[grosbein.net]; FREEFALL_USER(0.00)[eugen]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N 24.08.2022 11:27, Mason Loring Bliss wrote: > Hi all. I noticed a couple oddities with Vultr's FreeBSD support recently. > The first was that when you asked for a 13.1 VM (with the alternative being > 12.3) you'd actually get a 13.0 image. They've addressed this now, so it's > no longer a concern. > > The second issue is still there and while I've brought it to their > attention, it'd probably be useful if they had some expert help. What I'm > observing with new VMs, both their images and via FreeBSD's own install > media, is a pause of one and three quarters minutes (around 105 seconds) > between: > > ugen0.2: at usbus0 > > and the next line, which appears to be: > > hdacc0: at cad 0 on hdac0 > > FreeBSD believes it's on Hyper-V 10.0.14393 [SP0] but the same VM booted > into GNU/Linux probes KVM, so I've got to ask about that. > > Given fairly limited access to the VM - pretty much, a KVM console and > whatever I can manage to be saved to disk - is there any useful way I can > get more data about what's going on during the visible pause? This appears > with the FreeBSD 13.1 install (disc1) ISO and with 13.0 as supplied by > Vultr, but I can boot other ISOs with something custom to explore, as > needed. > > Thanks in advance if anyone has clues or ideas. I'll report back when I > know more, regardless. I have my own small VM at vultr.com. If I run "ping X.X.X.X" against it from outside, then "shutdown -r now" from inside the VM, I get exactly 20 probes lost (20 seconds) after it stops responding and starts responding again after reboot. So, my instance has not such problem. I created it in times of 13.0-RELEASE but I booted in off FreeBSD official ISO image for 64 bits, destroyed pre-installed GPT partitioning and installed 13.0 system using MBR+ZFS-on-slice. Since then, it was upgraded to 13.1-STABLE/amd64. Also I have in /boot/loader.conf: beastie_disable="YES" autoboot_delay="3" kern.vty=sc hw.memtest.tests=0 aesni_load="YES" dumpdev="/dev/label/swap" zfs_load="YES" vfs.root.mountfrom="zfs:z" vfs.zfs.arc_max="100M" vfs.zfs.vdev.cache.size="32M" vfs.zfs.prefetch_disable="1" vfs.zfs.vdev.trim_on_init="0" vfs.zfs.compressed_arc_enabled="1" vfs.zfs.abd_scatter_enabled="0" My kernel is GENERIC plus three options: KDB, KDB_UNATTENDED and KDB_TRACE usbconfig shows me: ugen0.1: at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA) ugen0.2: at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON (100mA) Please post output of "pciconf -lvvv".