From owner-freebsd-stable@freebsd.org Sun Feb 14 23:15:48 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2164D5408D7 for ; Sun, 14 Feb 2021 23:15:48 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qv1-xf33.google.com (mail-qv1-xf33.google.com [IPv6:2607:f8b0:4864:20::f33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Df34g0wfzz4jTl for ; Sun, 14 Feb 2021 23:15:46 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qv1-xf33.google.com with SMTP id y10so2452530qvo.6 for ; Sun, 14 Feb 2021 15:15:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=KIHN2MM4WAfAhBHLwhYkW0E9GpQsrvDkmTAzU0h9ouQ=; b=B0mxqHcPWEUE/8ESqIOe3x7GW2QSWoJAv4yNWOlbkcEIVl1AsZPOgjGSKwG+CKQJo7 Hi84uygWkt7Mqm2jLD7/LtVKfZ0+4xsfFwXl2g44ra/W7tu6o0ldjLLDRS54laUm4JYR QQ1hlXScPvkxh6sxsKeClJn0ced6ggGnLx4ln067DvcWYeKiH24kobWuQOKu564ZDEpq fW2FQBHAbi3Q4KLkLG6zRDcOutYszt2D8Gcjrv3ejhxC3EXQCDnAvoqcfE7SzzoMLsFe 9a+ELIYsrNwc6cqk9CfMLlTkCkFasxW5nlewpYMziBDWTere8x+F9vHjjBX8eaifxPEC Tj8w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=KIHN2MM4WAfAhBHLwhYkW0E9GpQsrvDkmTAzU0h9ouQ=; b=sJFxS1xLxoqmLqTUSzVJVN4xG+iv4RoVw2HW/NLtUqUA+hIQj/zOdfZZSRkSHGDYoi 3caB8k7BC17STafkgHQRQ9E9T0pTbTngZTJoYcbxI+4IDCFz7QJ2nzyANDU/Zwf1uxej xuM9Ap+5Nr1GRgLRkFNLFlvzul0mGoYGX9j3SghGWKgM0oKFlMSCuXYQEf+ms0ZB4wVK w7a/ydo0HLTpxPnM5u4d7I2XZnw8U0P2OJGh13rzI2xuSLfyw3okBb+ByOoFILm5IIxO 6EhPWR9NrgOYmmlYlTlYiQ8QtIqAgSEVitAZhDozjZJnmOiv81WShV+fIKAvLPQroAwG pi3Q== X-Gm-Message-State: AOAM531YNFRN3cStEYcwHcD+SkswX3rvaSzuWbOjH1lVuxZMWyaJHTZz byhaa3JGw59zYXVz75pGK3KMo5ifV7A= X-Google-Smtp-Source: ABdhPJwHHMxe7j0MW0Kx1vLCwIxgqhkNc/UOiL0O1m/Hg2TXQ9suwfhHZbd9Xl7/w2OnstS/K+tU0g== X-Received: by 2002:ad4:584b:: with SMTP id de11mr12710619qvb.13.1613344545953; Sun, 14 Feb 2021 15:15:45 -0800 (PST) Received: from spy (198-84-202-9.cpe.teksavvy.com. [198.84.202.9]) by smtp.gmail.com with ESMTPSA id a206sm6804367qkc.7.2021.02.14.15.15.44 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 14 Feb 2021 15:15:45 -0800 (PST) Sender: Mark Johnston Date: Sun, 14 Feb 2021 19:16:29 -0500 From: Mark Johnston To: Leon Dietrich Cc: freebsd-stable@freebsd.org Subject: Re: Microcode update prevents boot Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Df34g0wfzz4jTl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=B0mxqHcP; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::f33 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::f33:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::f33:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f33:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Feb 2021 23:15:48 -0000 On Sun, Feb 14, 2021 at 02:01:14PM +0100, Leon Dietrich wrote: > Hi there, > > I already worked around the issue myself. I'm just writing this here in > case someone else may have the same issue and is seeking an answer. > > > I recently upgraded the intel cpu microcode update package. Since then > the boot process hang at the stage where the other cpu cores where > enabled (shortly after enabling acpi). In order to resolve the issue one > has to boot in safe mode (not single user mode!) and comment (or remove) > the lines enabling the cpu microcode update on boot in > /boot/loader.conf. One can and should reboot then. > > After making these changes the system boots again and all cores are > started and SMT works as well. One should note that one's not running > the newer microcode (including some security-) fixes. Having > microcode_update_enable="YES" in /etc/rc.conf doesn't prevent booting > and does not cause noticeable instability. > > For reference: Im running FreeBSD 12.1 on a supermicro embedded board > with intel xeon E3-1585L v5 cpus. > > > I hope someone will find this info useful. I see that r347931 was not merged to stable/12 branch, but the lockless delayed invalidation changes were indeed present in 12.1. Could you see if the hang persists when boot-time ucode loading is enabled and vm.pmap.di_locked=1 is configured? Note that you could apply both configurations at the loader prompt, i.e., without having to edit loader.conf and boot in safe mode to revert the change.