From owner-freebsd-hackers@freebsd.org Mon Oct 5 00:03:33 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 10C1E437D93 for ; Mon, 5 Oct 2020 00:03:33 +0000 (UTC) (envelope-from meowthink@gmail.com) Received: from mail-ed1-x543.google.com (mail-ed1-x543.google.com [IPv6:2a00:1450:4864:20::543]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4C4LR82mMcz4Qwj for ; Mon, 5 Oct 2020 00:03:32 +0000 (UTC) (envelope-from meowthink@gmail.com) Received: by mail-ed1-x543.google.com with SMTP id l24so7450930edj.8 for ; Sun, 04 Oct 2020 17:03:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=42B4RDptX2aD4wQbjt4rl1nxxFwG3eE3cAupmpDOmiw=; b=XX3VFPtXOBqkEaVyR/NNPEKiUeM5a8RWgb1I7Wc0FxP5BjR3A6TuXj8dwMf1/TqnCf TeNpd5zxDI64lx2EGmu/R+QsH7gOpyJ8YEV0BSwx+6Ry7npSpGvrADHPkaWxqJMacWiY Tdfhkw5grP2KO+Bp89lFay7wlhg2EtN7qhqSaW9LE+8KT5QrNRL0S+cqk6uKwbWvRg4s gaB2ZlKWspZFXIovpDtOWuh1tRvef7saacECSwa9vMcLeG/GclltypIu4UNCIGvJoabM MH2crau6ySSHgFV7ReKY9ZYb2NRjFFyXHw/gSEjWjv1JbAqfdd30aOdTSSf5hvQbfUWE 075g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=42B4RDptX2aD4wQbjt4rl1nxxFwG3eE3cAupmpDOmiw=; b=R74RG5muX8DcIC1MAMGtvSNkEMujuF9+Ed01pRYtpipoXDH9OYCVIS5uMgWaFGZf6p MdHNcuBaHtqpjZRa4cQo9Ph4vUEbqIkxoQ+tzLspCwFD5Jprc/Wi/hAKd2Z8+5P64+kN Uhwk9Z3E1gzzav5S2JN3TQqkZo2gNHiyohCOvwaMHXdA/ZvRudO2pEijOcvkNmXQpkBo EqI6U1FeI8E7ZmuU96DKiBdN3HwY0jYhTRlU2bEGf2ZL/vx8rhBZZIjvJu06h4WBEDf2 ullZLvTmuGGPkDFXU86XStPe639oCQd2MHyPb5NsUI6XWTO0CcF7B5vb/JkNW+27N9Zu n/3Q== X-Gm-Message-State: AOAM5306SX89hpOMkPyE8NZZW7W/A/6bCFPAivJsFRzYn2bOWx+FpAzV ZBVi+xHRek/8qSYXobTXoS2KLx/zi7YM/ncMhWfPDBuqlK8= X-Google-Smtp-Source: ABdhPJyE3LD+6YVKbBZ/JJHK1QXWXsCdDi3EkCUCQqvUQB6gfARNvE9ivG3r2JQKtp/ug01PlTlT7gFapI/Pv1oVqgs= X-Received: by 2002:a50:8e43:: with SMTP id 3mr5621579edx.178.1601856210782; Sun, 04 Oct 2020 17:03:30 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Meowthink Date: Mon, 5 Oct 2020 08:03:19 +0800 Message-ID: Subject: Re: How this wired boot timing bug comes, init rc scripts or zfs? To: FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4C4LR82mMcz4Qwj X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=XX3VFPtX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of meowthink@gmail.com designates 2a00:1450:4864:20::543 as permitted sender) smtp.mailfrom=meowthink@gmail.com X-Spamd-Result: default: False [-2.55 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_HAM_LONG(-1.04)[-1.043]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::543:from]; NEURAL_HAM_SHORT(-0.52)[-0.517]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2020 00:03:33 -0000 On Mon, Oct 5, 2020 at 5:37 AM Warner Losh wrote: > > > > On Sun, Oct 4, 2020, 3:28 PM Rick Macklem wrote: >> >> Meowthink wrote: >> >Hello hackers, >> >Recently I installworld and rebooted a server, seems working, but my >> >kerberized nfsd, precisely gssd, is not functional. >> >At first I thought it may be a bug from stable, so I did some trivial >> >tests, replacing the kernel with releng one, then the whole world, but >> >found this is nothing related to the kernel, and triggers randomly >> >when rebooting some recent stable/11 world (releng/11.4 seems fine). >> >To dig it deeper, here is what the console showed when failing: >> >``` >> >Oct 3 20:23:59 r kernel: Starting file system checks: >> >Oct 3 20:23:59 r kernel: /etc/rc: WARNING: run_rc_command: cannot run >> >/usr/sbin/gssd >> >Oct 3 20:23:59 r kernel: Mounting local filesystems:. >> >Oct 3 20:23:59 r kernel: Updating CPU Microcode... >> >Oct 3 20:23:59 r kernel: Done. >> >Oct 3 20:23:59 r kernel: Starting ctld. >> >Oct 3 20:23:59 r kernel: ctld: bind(2) failed for [::]: Can't assign >> >requested address >> >Oct 3 20:23:59 r kernel: ctld: bind(2) failed for 0.0.0.0: Can't >> >assign requested address >> >Oct 3 20:23:59 r kernel: ctld: failed to apply configuration; exiting >> >Oct 3 20:23:59 r kernel: /etc/rc: WARNING: failed to start ctld >> >Oct 3 20:23:59 r kernel: ELF ldconfig path: /lib /usr/lib >> >/usr/lib/compat /usr/local/lib /usr/dt/lib /usr/local/lib/compat >> >/usr/local/lib/gcc9 /usr/local/lib/graphviz /usr/local/lib/nss >> >/usr/local/lib/perl5/5.28/mach/CORE /usr/local/lib/pth >> >/usr/local/lib/qt4 /usr/local/lib/qt5 /usr/local/lib/samba4 >> >/usr/local/llvm10/lib /usr/local/share/chromium >> >Oct 3 20:23:59 r kernel: 32-bit compatibility ldconfig path: >> >/usr/lib32 /usr/local/lib32/compat >> >Oct 3 20:23:59 r kernel: Setting hostname: r.domain.net. >> >Oct 3 20:23:59 r kernel: Setting up harvesting: >> >[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED >> >Oct 3 20:23:59 r kernel: Feeding entropy: . >> >Oct 3 20:23:59 r kernel: Starting Network: lo0 bge0 bge1. >> >``` >> >Then I realized I have / and /usr in separated zfs(same zpool). It may >> >be that / mounted but /usr not. Thus I changed my /etc/rc.d/gssd line >> >7 to # REQUIRE: mountcritlocal. >> I don't know what has changed post-11.4 to cause this. >> However, the problem with adding "mountcritlocal" is that it assumes >> /usr is a locally mounted file system and not NFS mounted nor a subtree >> of "/". >> --> I think a better solution might be to move gssd to /sbin, which should >> always be a part of the root fs. (/etc/rc.d/gssd already has "root" as >> REQUIRED.) > > > Make the move. It is an early utility in reality. > > Warner But take care :) $ ldd /usr/sbin/gssd /usr/sbin/gssd: libgssapi.so.10 => /usr/lib/libgssapi.so.10 (0x80082b000) libkrb5.so.11 => /usr/lib/libkrb5.so.11 (0x800a35000) libroken.so.11 => /usr/lib/libroken.so.11 (0x800cb4000) libc.so.7 => /lib/libc.so.7 (0x800ec7000) libasn1.so.11 => /usr/lib/libasn1.so.11 (0x80127e000) libcom_err.so.5 => /usr/lib/libcom_err.so.5 (0x801521000) libcrypt.so.5 => /lib/libcrypt.so.5 (0x801723000) libcrypto.so.8 => /lib/libcrypto.so.8 (0x801a00000) libhx509.so.11 => /usr/lib/libhx509.so.11 (0x801e75000) libwind.so.11 => /usr/lib/libwind.so.11 (0x8020c2000) libheimbase.so.11 => /usr/lib/libheimbase.so.11 (0x8022ea000) libprivateheimipcc.so.11 => /usr/lib/libprivateheimipcc.so.11 (0x8024ee000) libthr.so.3 => /lib/libthr.so.3 (0x8026f1000) >> >> >> I have a similar problem with the rpc.tlsclntd daemon I have developed >> for NFS-over-TLS. >> - Neither sec=krb5[ip] nor tls can be used for an NFS mounted root, >> but I think we just have to live with that? >> >> Do others have any suggestions? rick >> >> By the way, /etc/rc.d/ctld to # >> REQUIRE: netif. Everything works fine, even rebooting several times. >> What I am confused is how this happens. It seems that /etc/rc.d/gssd >> (in addition, /etc/rc.d/ctld) hasn't been changed since 2016. Both >> gssd and init in stable/11 have no functional changes since >> releng/11.4. Maybe zfs? but it's in the kernel, and kernel r366306 >> with releng/11.4 world works(though I only tested few times since >> rebooting is too boring). >> Any ideas? >> >> Cheers, >> meowthink >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"