From nobody Mon Sep 13 06:33:35 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3B46817B1F76 for ; Mon, 13 Sep 2021 06:33:53 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [128.127.146.8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.norma.perm.ru", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H7GsB4kkzz3Qwg for ; Mon, 13 Sep 2021 06:33:50 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from [192.168.243.7] ([192.168.243.7]) by elf.hq.norma.perm.ru (8.16.1/8.15.2) with ESMTP id 18D6VGA8051212 for ; Mon, 13 Sep 2021 11:31:17 +0500 (+05) (envelope-from eugene@zhegan.in) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=vivat-retail.ru; s=key; t=1631514678; bh=tCY7Ge3r+FUN3hX3gloYybBp+mEGb5I6A0zcDPYcT70=; h=To:From:Subject:Date; b=CxEfpyTn5MglVTtEVsH9uNsE+4s0x6OOZ8JT+z7v9+AYoPeEk2DXDITpx48CaBpKr BvPyoIQRqfO0rcvM2VIa4mhL6PycK7pbJi3LU5cuDxYEQZNq/cOeoNdWO6d0hlS65o qeDXyHcPI8dz3tkP9A/7S3mIgkYN7Ry7xx1/2+TM= To: freebsd-stable@freebsd.org From: "Eugene M. Zheganin" Subject: FreeBSD 12.1 vs 13.0 TCP connections count Message-ID: <9cac45f1-9b81-5ed8-b3ae-c9567ac977cb@zhegan.in> Date: Mon, 13 Sep 2021 11:33:35 +0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: ru X-Rspamd-Queue-Id: 4H7GsB4kkzz3Qwg X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=fail ("headers rsa verify failed") header.d=vivat-retail.ru header.s=key header.b=CxEfpyTn; dmarc=none; spf=pass (mx1.freebsd.org: domain of eugene@zhegan.in designates 128.127.146.8 as permitted sender) smtp.mailfrom=eugene@zhegan.in X-Spamd-Result: default: False [-2.30 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_DKIM_REJECT(1.00)[vivat-retail.ru:s=key]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_NA(0.00)[zhegan.in]; R_SPF_ALLOW(-0.20)[+mx]; DKIM_TRACE(0.00)[vivat-retail.ru:-]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:212494, ipnet:128.127.146.0/24, country:RU]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hello, I'm using FreeBSD as a balancer in a production environment, along with nginx on a CARP-enabled couple of servers. Recently I've upgraded one to 13.0 from 12.1, so far so good, but there's one thing that bothers me. When I switch the client traffic from 12.1 to 13.0 in a CARP group, I get way fewer TCP connections count on a 13.0 than I get on 12.1. Say, I get 100K on a 12.1? but this traffic flow gives me only about 25K on a 13.0. You could say "yeah, that's because 75K of clients get DoS on a 13.0 due some sort of regression" - but this explanation isn't working, because I'm also constantly graphing the client error rate from the client point of view (client application sends it to an analyzer) and the latter rate doesn't change. You can observe the change on a pic: http://zhegan.in/files/tcp-connections.png Look at the green graph and a yellow graph. Green is 12.1 and yellow is 13.3. Don't mind the spiked yellow part, it's a detuning consequence (btw that's what happend when you cap down the ARC on heavily biffering files balancer) and mind only the steady yellow part. You can see the active/passive carp switches and each times the number of connections on a 13.0 drops down and then restores when onm 12.1. I'm also graphing the balancer/nginx accepts/handled rate which is constant at 4K/sec - means the flow itself isn't changing a lot. I'm also graphing the connections scoreboard from nginx and it also shows x4 drops/rises when switching from 12.1to 13.0. Is this a bug/glitch of the 13.3 statistics (seems unprobeble because nginx shows it too) or is there some other explanation that I don't get ? Thanks. Eugene. From nobody Tue Sep 14 12:11:26 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AD9D417B9B83; Tue, 14 Sep 2021 12:11:39 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from land.berklix.org (land.berklix.org [144.76.10.75]) by mx1.freebsd.org (Postfix) with ESMTP id 4H82JV5ltSz4Qm6; Tue, 14 Sep 2021 12:11:38 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from mart.js.berklix.net (p4fe6dae8.dip0.t-ipconnect.de [79.230.218.232]) (authenticated bits=128) by land.berklix.org (8.15.2/8.15.2) with ESMTPA id 18ECBWha028961; Tue, 14 Sep 2021 12:11:32 GMT (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by mart.js.berklix.net (8.14.3/8.14.3) with ESMTP id 18ECBQXT036653; Tue, 14 Sep 2021 14:11:26 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.16.1/8.16.1) with ESMTP id 18ECBQBe071018; Tue, 14 Sep 2021 14:11:26 +0200 (CEST) (envelope-from jhs@berklix.com) Message-Id: <202109141211.18ECBQBe071018@fire.js.berklix.net> To: freebsd-stable@FreeBSD.org, freebsd-current@FreeBSD.org cc: "Dimitry Andric" , "Julian H. Stacey" Subject: Re: src/lib/libgcc_s needs mv /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a From: "Julian H. Stacey" Organization: http://berklix.com/jhs/ User-agent: EXMH on FreeBSD http://berklix.com/free/ X-From: http://www.berklix.org/~jhs/ In-reply-to: Your message "Sun, 12 Sep 2021 14:53:58 +0200." <202109121253.18CCrw1O000484@fire.js.berklix.net> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <71016.1631621486.1@fire.js.berklix.net> Content-Transfer-Encoding: quoted-printable Date: Tue, 14 Sep 2021 14:11:26 +0200 X-Rspamd-Queue-Id: 4H82JV5ltSz4Qm6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jhs@berklix.com has no SPF policy when checking 144.76.10.75) smtp.mailfrom=jhs@berklix.com X-Spamd-Result: default: False [-1.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[jhs]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; URI_HIDDEN_PATH(1.00)[http://berklix.com/~jhs/bin/.csh/unsetenv.csh]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[berklix.com]; AUTH_NA(1.00)[]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:144.76.0.0/16, country:DE]; RECEIVED_SPAMHAUS_PBL(0.00)[79.230.218.232:received] X-ThisMailContainsUnwantedMimeParts: N Hi stable@ & current@, Apologies for a cross post, as = a fault reported May 2019 on current, is still breaking on stable Sept 202= 1. 2019 Refs: Subject: lib/libgcc_s fails on make all after make world succeeds https://lists.freebsd.org/pipermail/freebsd-current/2019-May/073440.html From: Julian H. Stacey jhs at berklix.com Sun May 19 21:30:10 UTC 2019 https://lists.freebsd.org/pipermail/freebsd-current/2019-May/073442.html From: Dimitry Andric dim at FreeBSD.org = Date: Sun, 19 May 2019 23:54:18 +0200 2021 Ref: Subject: src/lib/libgcc_s needs mv /usr/obj/usr/src/amd64.amd64/lib/libc/l= ibc.a https://lists.freebsd.org/archives/freebsd-stable/2021-September/000225.h= tml From: From: Julian H. Stacey = Dimitry suggested maybe a rare race condition, so I just started a make -B -j 1 world It will take a while, old machines here, (maybe that's what's exposing a race condition not seen on faster boxes ?) = A 2nd speculation was I may be missing symbolic links ? Last year & maybe earlier, I had problems from missing symbolic links, when I was fetching src/ with a (since fixed, Sept 2020) ctm; But my src= -12/ is new, not CTM supplied, but from cd ~/git/`hostname -s`/src-12 git clone -o freebsd -b stable/12 https://git.freebsd.org/src.git src cd ~/git/`hostname -s`/src-12/src = git pull --ff-only The only symbolic links I have are in src-cur/ contrib/bc/ contrib/tcpdump/ sys/contrib/openzfs/ src-12/ contrib/bc/ contrib/tcpdump/ So lack of symbolic links is not the problem, unless someone sees more lin= ks I dont have, if one of you could perhaps kindly check ? with eg cd /usr/src; find -s . -type l | sort | grep -v sys/amd64/compile \ grep -v contrib/bc | grep -v contrib/tcpdump | grep -v sys/contrib/open= zfs Anyone else seen problems making lib/libgcc_s ? Any other ideas what else to check ? I've already checked as in my last post appended. I'm now checking for any files only under root or only under a tree installed by setenv DESTDIR . Suggestions welcome please ? {=3D=3D=3D=3D=3D=3D To: FreeBSD-STABLE Mailing List Subject: src/lib/libgcc_s needs mv /usr/obj/usr/src/amd64.amd64/lib/libc/l= ibc.a Date: Sun, 12 Sep 2021 14:53:58 +0200 Hi all, Anyone else seen this ? After cd /usr/src ; make install this fails cd /usr/src/lib/libgcc_s ; make until a manual mv /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a \ /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a.MV when = cd /usr/src ; make all ; make install can run OK, but then again needs another 'mv'. Identical: md5 /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a* /usr/lib/libc= .a Maybe its changing where linking from ? ** I've had this on & off for months I think, on multiple hardware, but possi= bly just 12.2-STABLE, = it's still so with a stable src/ fetched a day or ago with git pull --ff-o= nly To help simplify debug, I have no /etc/src.conf /etc/make.conf I also stripped my env with http://berklix.com/~jhs/bin/.csh/unsetenv.csh source `which unsetenv.csh` Remaining: DESTDIR DISPLAY HOSTDISPLAY PATH TERM TERMCAP TERMPATH None of that helps. I am running a 12.2 self built system, uncustomised src/, no kernel module= s, uname -a FreeBSD fire.js.berklix.net 12.2-RELEASE FreeBSD 12.2-RELEASE #0: Sat May 22 20:41:18 CEST 2021 jhs@fire.js.berklix.net:/1s4/ftp/pri/FreeBSD/releases/12.2-RELEASE/generi= c/src/sys/amd64/compile/GENERIC amd64 with the exception of /boot/kernel which is 12.2-RELEASE as for some unkno= wn reason I cant boot a local compiled or cross compiled 12.2-STABLE kernel (I'm still investigating that presumed un-associated issue) ** Here's a script log : {------- =3D=3D=3D> etc (install) =3D=3D=3D> etc/sendmail (install) cd /usr1/src/share/man; make makedb makewhatis /usr/share/man makewhatis /usr/share/openssl/man .... cd /usr/src/lib/libgcc_s ; make cat /usr1/src/lib/libgcc_s/Symbol.map /usr1/src/lib/libgcc_s/SymbolDefault= .map | cpp - - | awk -v vfile=3D/usr1/src/lib/libgcc_s/Versions.def -f /u= sr/share/mk/version_gen.awk > Version.map building shared library libgcc_s.so.1 cc -nodefaultlibs -Wl,--version-script=3DVersion.map -shared -Wl,-x -Wl= ,--fatal-warnings -Wl,--warn-shared-textrel -o libgcc_s.so.1.full -Wl,-so= name,libgcc_s.so.1 `NM=3D'nm' NMFLAGS=3D'' lorder i386/fp_mode.pico absvd= i2.pico absvsi2.pico absvti2.pico addvdi3.pico addvsi3.pico addvti3.pico a= pple_versioning.pico ashldi3.pico ashlti3.pico ashrdi3.pico ashrti3.pico b= swapdi2.pico bswapsi2.pico clear_cache.pico clzdi2.pico clzsi2.pico clzti2= .pico cmpdi2.pico cmpti2.pico ctzdi2.pico ctzsi2.pico ctzti2.pico divdc3.p= ico divdi3.pico divmoddi4.pico divmodsi4.pico divsc3.pico divsi3.pico divt= c3.pico divti3.pico divxc3.pico enable_execute_stack.pico eprintf.pico ext= endhfsf2.pico ffsdi2.pico ffssi2.pico ffsti2.pico fixdfdi.pico fixdfti.pic= o fixsfdi.pico fixsfti.pico fixunsdfdi.pico fixunsdfsi.pico fixunsdfti.pic= o fixunssfdi.pico fixunssfsi.pico fixunssfti.pico fixunsxfdi.pico fixunsxf= si.pico fixunsxfti.pico fixxfdi.pico fixxfti.pico floatditf.pico floattidf= .pico floattisf.pico floattixf.pico floatunditf.pico floatunsidf.pico floa= tunsisf.pico floatuntidf.pico floatuntisf.pico floatuntixf.pico gcc_person= ality_v0.pico int_util.pico lshrdi3.pico lshrti3.pico moddi3.pico modsi3.p= ico modti3.pico muldc3.pico muldi3.pico mulodi4.pico mulosi4.pico muloti4.= pico mulsc3.pico multc3.pico multi3.pico mulvdi3.pico mulvsi3.pico mulvti3= .pico mulxc3.pico negdf2.pico negdi2.pico negsf2.pico negti2.pico negvdi2.= pico negvsi2.pico negvti2.pico paritydi2.pico paritysi2.pico parityti2.pic= o popcountdi2.pico popcountsi2.pico popcountti2.pico powidf2.pico powisf2.= pico powitf2.pico powixf2.pico subvdi3.pico subvsi3.pico subvti3.pico tram= poline_setup.pico truncdfhf2.pico truncsfhf2.pico ucmpdi2.pico ucmpti2.pic= o udivdi3.pico udivmoddi4.pico udivmodsi4.pico udivmodti4.pico udivsi3.pic= o udivti3.pico umoddi3.pico umodsi3.pico umodti3.pico floatdidf.pico float= disf.pico floatdixf.pico floatundidf.pico floatundisf.pico floatundixf.pic= o cpu_model.pico adddf3.pico addsf3.pico divdf3.pico divsf3.pico extendsfd= f2.pico fixdfsi.pico fixsfsi.pico floatsidf.pic! o floatsisf.pico muldf3.pico mulsf3.pico subdf3.pico subsf3.pico truncdfs= f2.pico comparedf2.pico comparesf2.pico gcc_personality_v0.pico int_util.p= ico Unwind-EHABI.pico Unwind-sjlj.pico UnwindLevel1-gcc-ext.pico UnwindLev= el1.pico UnwindRegistersRestore.pico UnwindRegistersSave.pico libunwind.pi= co s_fabs.pico s_fabsf.pico s_fabsl.pico s_fmax.pico s_fmaxf.pico s_logb.p= ico s_logbf.pico s_scalbn.pico s_scalbnf.pico s_fmaxl.pico s_logbl.pico s_= scalbnl.pico | tsort -q` -L/1s4/release/12.2-STABLE/usr/obj/usr/src/amd64= .amd64/lib/libc -lc ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_sz_size2index_tab in readonly segment; recompile object = files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the = output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_sz.o) >>> referenced by sz.h:158 (/usr1/src/contrib/jemalloc/include/jemalloc/in= ternal/sz.h:158) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_arenas in readonly segment; recompile object files with = -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by atomic.h:55 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/atomic.h:55) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_sz_index2size_tab in readonly segment; recompile object = files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the = output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_sz.o) >>> referenced by sz.h:201 (/usr1/src/contrib/jemalloc/include/jemalloc/in= ternal/sz.h:201) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst local symbol in readonly segment; recompile object files with -fPIC or= pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by mutex.h:144 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/mutex.h:144) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst local symbol in readonly segment; recompile object files with -fPIC or= pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by mutex.h:203 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/mutex.h:203) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst local symbol in readonly segment; recompile object files with -fPIC or= pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by mutex.h:214 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/mutex.h:214) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extent_hooks_default in readonly segment; recompile objec= t files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in th= e output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by jemalloc_internal_inlines_a.h:91 (/usr1/src/contrib/jema= lloc/include/jemalloc/internal/jemalloc_internal_inlines_a.h:91) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extents_rtree in readonly segment; recompile object files= with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the outpu= t >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by rtree.h:381 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/rtree.h:381) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extents_rtree in readonly segment; recompile object files= with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the outpu= t >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by rtree.h:381 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/rtree.h:381) >>> jemalloc_jemalloc.o:(a0ialloc) in archive /1s4/release/1= 2.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_arenas in readonly segment; recompile object files with = -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by atomic.h:55 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/atomic.h:55) >>> jemalloc_jemalloc.o:(a0idalloc) in archive /1s4/release/= 12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_sz_index2size_tab in readonly segment; recompile object = files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the = output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_sz.o) >>> referenced by sz.h:201 (/usr1/src/contrib/jemalloc/include/jemalloc/in= ternal/sz.h:201) >>> jemalloc_jemalloc.o:(a0idalloc) in archive /1s4/release/= 12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extents_rtree in readonly segment; recompile object files= with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the outpu= t >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by rtree.h:381 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/rtree.h:381) >>> jemalloc_jemalloc.o:(a0idalloc) in archive /1s4/release/= 12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extents_rtree in readonly segment; recompile object files= with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the outpu= t >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by rtree.h:381 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/rtree.h:381) >>> jemalloc_jemalloc.o:(a0idalloc) in archive /1s4/release/= 12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extents_rtree in readonly segment; recompile object files= with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the outpu= t >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by rtree.h:381 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/rtree.h:381) >>> jemalloc_jemalloc.o:(a0idalloc) in archive /1s4/release/= 12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_extents_rtree in readonly segment; recompile object files= with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the outpu= t >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_extent.o) >>> referenced by rtree.h:381 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/rtree.h:381) >>> jemalloc_jemalloc.o:(a0idalloc) in archive /1s4/release/= 12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_arenas in readonly segment; recompile object files with = -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by atomic.h:55 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/atomic.h:55) >>> jemalloc_jemalloc.o:(__je_arena_set) in archive /1s4/rel= ease/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_arenas_lock in readonly segment; recompile object files w= ith -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by mutex.h:144 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/mutex.h:144) >>> jemalloc_jemalloc.o:(__je_arena_init) in archive /1s4/re= lease/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_arenas_lock in readonly segment; recompile object files w= ith -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by mutex.h:203 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/mutex.h:203) >>> jemalloc_jemalloc.o:(__je_arena_init) in archive /1s4/re= lease/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32S aga= inst symbol: __je_arenas in readonly segment; recompile object files with = -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by atomic.h:55 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/atomic.h:55) >>> jemalloc_jemalloc.o:(__je_arena_init) in archive /1s4/re= lease/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mcan't create dynamic relocation R_X86_64_32 agai= nst symbol: __je_arenas_lock in readonly segment; recompile object files w= ith -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output >>> defined in /1s4/release/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/li= bc/libc.a(jemalloc_jemalloc.o) >>> referenced by mutex.h:214 (/usr1/src/contrib/jemalloc/include/jemalloc= /internal/mutex.h:214) >>> jemalloc_jemalloc.o:(__je_arena_init) in archive /1s4/re= lease/12.2-STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a ld: =1B[0;31merror: =1B[0mtoo many errors emitted, stopping now (use -erro= r-limit=3D0 to see all errors) cc: =1B[0;1;31merror: =1B[0mlinker command failed with exit code 1 (use -v= to see invocation)=1B[0m *** Error code 1 Stop. make: stopped in /usr1/src/lib/libgcc_s 12.2-RELEASE /dev/pts/2 jhs 1 fire/usr1/src/lib/libgcc_s ls -l /usr/obj/u= sr/src/amd64.amd64/lib/libc/libc.a -rw-r--r-- 1 jhs staff 17050712 Sep 12 13:28 /usr/obj/usr/src/amd64.amd= 64/lib/libc/libc.a 12.2-RELEASE /dev/pts/2 jhs 2 fire/usr1/src/lib/libgcc_s mv /usr/obj/usr/s= rc/amd64.amd64/lib/libc/libc.a /usr/obj/usr/src/amd64.amd64/lib/libc/libc.= a.MV 12.2-RELEASE /dev/pts/2 jhs 3 fire/usr1/src/lib/libgcc_s make building shared library libgcc_s.so.1 cc -nodefaultlibs -Wl,--version-script=3DVersion.map -shared -Wl,-x -Wl= ,--fatal-warnings -Wl,--warn-shared-textrel -o libgcc_s.so.1.full -Wl,-so= name,libgcc_s.so.1 `NM=3D'nm' NMFLAGS=3D'' lorder i386/fp_mode.pico absvd= i2.pico absvsi2.pico absvti2.pico addvdi3.pico addvsi3.pico addvti3.pico a= pple_versioning.pico ashldi3.pico ashlti3.pico ashrdi3.pico ashrti3.pico b= swapdi2.pico bswapsi2.pico clear_cache.pico clzdi2.pico clzsi2.pico clzti2= .pico cmpdi2.pico cmpti2.pico ctzdi2.pico ctzsi2.pico ctzti2.pico divdc3.p= ico divdi3.pico divmoddi4.pico divmodsi4.pico divsc3.pico divsi3.pico divt= c3.pico divti3.pico divxc3.pico enable_execute_stack.pico eprintf.pico ext= endhfsf2.pico ffsdi2.pico ffssi2.pico ffsti2.pico fixdfdi.pico fixdfti.pic= o fixsfdi.pico fixsfti.pico fixunsdfdi.pico fixunsdfsi.pico fixunsdfti.pic= o fixunssfdi.pico fixunssfsi.pico fixunssfti.pico fixunsxfdi.pico fixunsxf= si.pico fixunsxfti.pico fixxfdi.pico fixxfti.pico floatditf.pico floattidf= .pico floattisf.pico floattixf.pico floatunditf.pico floatunsidf.pico floa= tunsisf.pico floatuntidf.pico floatuntisf.pico floatuntixf.pico gcc_person= ality_v0.pico int_util.pico lshrdi3.pico lshrti3.pico moddi3.pico modsi3.p= ico modti3.pico muldc3.pico muldi3.pico mulodi4.pico mulosi4.pico muloti4.= pico mulsc3.pico multc3.pico multi3.pico mulvdi3.pico mulvsi3.pico mulvti3= .pico mulxc3.pico negdf2.pico negdi2.pico negsf2.pico negti2.pico negvdi2.= pico negvsi2.pico negvti2.pico paritydi2.pico paritysi2.pico parityti2.pic= o popcountdi2.pico popcountsi2.pico popcountti2.pico powidf2.pico powisf2.= pico powitf2.pico powixf2.pico subvdi3.pico subvsi3.pico subvti3.pico tram= poline_setup.pico truncdfhf2.pico truncsfhf2.pico ucmpdi2.pico ucmpti2.pic= o udivdi3.pico udivmoddi4.pico udivmodsi4.pico udivmodti4.pico udivsi3.pic= o udivti3.pico umoddi3.pico umodsi3.pico umodti3.pico floatdidf.pico float= disf.pico floatdixf.pico floatundidf.pico floatundisf.pico floatundixf.pic= o cpu_model.pico adddf3.pico addsf3.pico divdf3.pico divsf3.pico extendsfd= f2.pico fixdfsi.pico fixsfsi.pico floatsidf.pic! o floatsisf.pico muldf3.pico mulsf3.pico subdf3.pico subsf3.pico truncdfs= f2.pico comparedf2.pico comparesf2.pico gcc_personality_v0.pico int_util.p= ico Unwind-EHABI.pico Unwind-sjlj.pico UnwindLevel1-gcc-ext.pico UnwindLev= el1.pico UnwindRegistersRestore.pico UnwindRegistersSave.pico libunwind.pi= co s_fabs.pico s_fabsf.pico s_fabsl.pico s_fmax.pico s_fmaxf.pico s_logb.p= ico s_logbf.pico s_scalbn.pico s_scalbnf.pico s_fmaxl.pico s_logbl.pico s_= scalbnl.pico | tsort -q` -L/1s4/release/12.2-STABLE/usr/obj/usr/src/amd64= .amd64/lib/libc -lc objcopy --only-keep-debug libgcc_s.so.1.full libgcc_s.so.1.debug objcopy --strip-debug --add-gnu-debuglink=3Dlibgcc_s.so.1.debug libgcc_s.= so.1.full libgcc_s.so.1 12.2-RELEASE /dev/pts/2 jhs 4 fire/usr1/src/lib/libgcc_s = -------} =3D=3D=3D=3D=3D=3D} Cheers, -- = Julian Stacey http://berklix.com/jhs/ http://stolenvotes.uk From nobody Tue Sep 14 18:09:46 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7A3A517C25A6 for ; Tue, 14 Sep 2021 18:09:59 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound1b.ore.mailhop.org (outbound1b.ore.mailhop.org [54.200.247.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8BFy6Nqvz3pgd for ; Tue, 14 Sep 2021 18:09:58 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1631642993; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=Z402RzXT1qqAo4wYyS+sazNMPJvgPX/szylWpINY42LHuY4ECg3v4rSlbQQjg9ndwAM7FKuFvqsHn E6LcMC1VSsaY8hb/XrfbHLPxAgcDOvD+BG+a/8B4iDt1P7BCEor5kJQy5P0yBAMRyEoa5pBZnUoZ3c BtAoSaDsYlnTIFdsv6feV2hv6QZGfwSIBewB/N30TY7Sv3zXgtIDVtRaUrjep78jT5KUfNk1CkIE+o xR9dbqargzg4l+wvu+EiPIFG3vm3C+UfqDnzmnIb1bj6E0QdWumk9ZXU4YfDS1MgtocNXGsFIlB+tg v4wun8tyiFYHXYuqpv4jJO0YhYJ5wqA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:dkim-signature:from; bh=VYWZAt4Bjzef8z6UBZYj2tp/ewlgIiJNW9bebW/nDHM=; b=Ad1q6SPWvlNuUtClYIlXo8pV9DAPsb0yGjs+CAlczpL3w8fATiizYOBIstE1raxPi2CvK29q0JlZe 2FoVPN00cqzBl05/IulX8IqVVUZOaQoVj/t5BQz9Uz/QHlMSsIndsTFw1vHGO5qGEAdAUOmqNU9tr7 9cTaawVAF2d8CfMPGdr8APgVCZcHtEp/hJ7AoFlH00IPzt5LUyrmZ8YH9w6I5fjQEZ7s4HeIS8UnAr psd0jhteWF+y3fhQC5Cacrkiplug0CTyM2oxncsraTvEOYkPtitsqUJnrM+DiQclS1JjM7+uCUylGe qj5ZRo501LmqCqonvQ2TGOILndI74gw== ARC-Authentication-Results: i=1; outbound3.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=24.8.225.114; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:from; bh=VYWZAt4Bjzef8z6UBZYj2tp/ewlgIiJNW9bebW/nDHM=; b=BLo0nWiqOs61BkWDiyi4MOkrujWSEfOH3SxHrqrdTH1wv1HIXouUmiTkIOXvbfx5F3IAFhO6xaphv uI82rs6fTQB5Bc4yM3kmYDztgiH86/TAtN1lqK53WtVmC6e3oE7ZZ7iBghJgwiIqWXIDFjI6QJLGDB yJV06+4dyeADpuzyfcKJZUgz/FMNrDxX5ZsSHTlH7LZxsKvC0ehGvKf+wfvSjSFBz2WAc7lGQkxokd 1aO+blrHI3FObHfCRXz89JHvSwi7D7iXdVTEDY6rQJVUgWW3X3uh/Uo1riVqKnOiGYCzyrgm2WwtBM t6fUqSAF4WofhzN44X/kl9+LfPUv9jw== X-Originating-IP: 24.8.225.114 X-MHO-RoutePath: aGlwcGll X-MHO-User: f1e14373-1586-11ec-8de4-bf9d68d023b6 X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (c-24-8-225-114.hsd1.co.comcast.net [24.8.225.114]) by outbound3.ore.mailhop.org (Halon) with ESMTPSA id f1e14373-1586-11ec-8de4-bf9d68d023b6; Tue, 14 Sep 2021 18:09:51 +0000 (UTC) Received: from [172.22.42.84] (rev2.hippie.lan [172.22.42.84]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id 18EI9kYx022758; Tue, 14 Sep 2021 12:09:46 -0600 (MDT) (envelope-from ian@freebsd.org) X-Authentication-Warning: paranoia.hippie.lan: Host rev2.hippie.lan [172.22.42.84] claimed to be [172.22.42.84] Message-ID: <26a6a3c8e87a4cf887c334ff8339e4f10d93988b.camel@freebsd.org> Subject: Re: src/lib/libgcc_s needs mv /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a From: Ian Lepore To: "Julian H. Stacey" , FreeBSD-STABLE Mailing List Date: Tue, 14 Sep 2021 12:09:46 -0600 In-Reply-To: <202109121253.18CCrw1O000484@fire.js.berklix.net> References: <202109121253.18CCrw1O000484@fire.js.berklix.net> Content-Type: text/plain; charset="ISO-8859-1" User-Agent: Evolution 3.40.3 FreeBSD GNOME Team List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4H8BFy6Nqvz3pgd X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:16509, ipnet:54.200.0.0/15, country:US] X-ThisMailContainsUnwantedMimeParts: N On Sun, 2021-09-12 at 14:53 +0200, Julian H. Stacey wrote: > Hi all, > Anyone else seen this ? After >         cd /usr/src ; make install > this fails >         cd /usr/src/lib/libgcc_s ; make > until a manual >         mv /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a    \ >            /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a.MV > when >         cd /usr/src ; make all ; make install > can run OK, but then again needs another 'mv'. > > Identical: md5 /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a* > /usr/lib/libc.a > > Maybe its changing where linking from ? ** > > I've had this on & off for months I think, on multiple hardware, but > possibly > just 12.2-STABLE, > it's still so with a stable src/ fetched a day or ago with git pull -- > ff-only > > To help simplify debug, I have no /etc/src.conf /etc/make.conf > I also stripped my env with > http://berklix.com/~jhs/bin/.csh/unsetenv.csh >         source `which unsetenv.csh` >         Remaining: DESTDIR DISPLAY HOSTDISPLAY PATH TERM TERMCAP > TERMPATH > None of that helps. > > I am running a 12.2 self built system, uncustomised src/, no kernel > modules, > uname -a >         FreeBSD fire.js.berklix.net 12.2-RELEASE FreeBSD 12.2-RELEASE >         #0: Sat May 22 20:41:18 CEST 2021 >         jhs@fire.js.berklix.net:/1s4/ftp/pri/FreeBSD/releases/12.2- > RELEASE/generic/src/sys/amd64/compile/GENERIC >         amd64 > > with the exception of /boot/kernel which is 12.2-RELEASE as for some > unknown > reason I cant boot a local compiled or cross compiled 12.2-STABLE > kernel > (I'm still investigating that presumed un-associated issue) > > ** Here's a script log : > {------- > > ===> etc (install) > ===> etc/sendmail (install) > cd /usr1/src/share/man; make makedb > makewhatis /usr/share/man > makewhatis /usr/share/openssl/man > > .... > > cd /usr/src/lib/libgcc_s ; make > cat /usr1/src/lib/libgcc_s/Symbol.map > /usr1/src/lib/libgcc_s/SymbolDefault.map | cpp - -  | awk -v > vfile=/usr1/src/lib/libgcc_s/Versions.def -f > /usr/share/mk/version_gen.awk > Version.map > building shared library libgcc_s.so.1 > cc  -nodefaultlibs -Wl,--version-script=Version.map   -shared -Wl,-x - > Wl,--fatal-warnings -Wl,--warn-shared-textrel  -o libgcc_s.so.1.full - > Wl,-soname,libgcc_s.so.1  `NM='nm' NMFLAGS='' lorder i386/fp_mode.pico > absvdi2.pico absvsi2.pico absvti2.pico addvdi3.pico addvsi3.pico > addvti3.pico apple_versioning.pico ashldi3.pico ashlti3.pico > ashrdi3.pico ashrti3.pico bswapdi2.pico bswapsi2.pico clear_cache.pico > clzdi2.pico clzsi2.pico clzti2.pico cmpdi2.pico cmpti2.pico ctzdi2.pico > ctzsi2.pico ctzti2.pico divdc3.pico divdi3.pico divmoddi4.pico > divmodsi4.pico divsc3.pico divsi3.pico divtc3.pico divti3.pico > divxc3.pico enable_execute_stack.pico eprintf.pico extendhfsf2.pico > ffsdi2.pico ffssi2.pico ffsti2.pico fixdfdi.pico fixdfti.pico > fixsfdi.pico fixsfti.pico fixunsdfdi.pico fixunsdfsi.pico > fixunsdfti.pico fixunssfdi.pico fixunssfsi.pico fixunssfti.pico > fixunsxfdi.pico fixunsxfsi.pico fixunsxfti.pico fixxfdi.pico > fixxfti.pico floatditf.pico floattidf.pico floattisf.pico > floattixf.pico floatunditf.pico floatunsidf.pico floatunsisf.pico > floatuntidf.pico floatuntisf.pico floatuntixf.pico > gcc_personality_v0.pico int_util.pico lshrdi3.pico lshrti3.pico > moddi3.pico modsi3.pico modti3.pico muldc3.pico muldi3.pico > mulodi4.pico mulosi4.pico muloti4.pico mulsc3.pico multc3.pico > multi3.pico mulvdi3.pico mulvsi3.pico mulvti3.pico mulxc3.pico > negdf2.pico negdi2.pico negsf2.pico negti2.pico negvdi2.pico > negvsi2.pico negvti2.pico paritydi2.pico paritysi2.pico parityti2.pico > popcountdi2.pico popcountsi2.pico popcountti2.pico powidf2.pico > powisf2.pico powitf2.pico powixf2.pico subvdi3.pico subvsi3.pico > subvti3.pico trampoline_setup.pico truncdfhf2.pico truncsfhf2.pico > ucmpdi2.pico ucmpti2.pico udivdi3.pico udivmoddi4.pico udivmodsi4.pico > udivmodti4.pico udivsi3.pico udivti3.pico umoddi3.pico umodsi3.pico > umodti3.pico floatdidf.pico floatdisf.pico floatdixf.pico > floatundidf.pico floatundisf.pico floatundixf.pico cpu_model.pico > adddf3.pico addsf3.pico divdf3.pico divsf3.pico extendsfdf2.pico > fixdfsi.pico fixsfsi.pico floatsidf.pico floatsisf.pico muldf3.pico > mulsf3.pico subdf3.pico subsf3.pico truncdfsf2.pico comparedf2.pico > comparesf2.pico gcc_personality_v0.pico int_util.pico Unwind-EHABI.pico > Unwind-sjlj.pico UnwindLevel1-gcc-ext.pico UnwindLevel1.pico > UnwindRegistersRestore.pico UnwindRegistersSave.pico libunwind.pico > s_fabs.pico s_fabsf.pico s_fabsl.pico s_fmax.pico s_fmaxf.pico > s_logb.pico s_logbf.pico s_scalbn.pico s_scalbnf.pico s_fmaxl.pico > s_logbl.pico s_scalbnl.pico |  tsort -q` -L/1s4/release/12.2- > STABLE/usr/obj/usr/src/amd64.amd64/lib/libc -lc > ld: error: can't create dynamic relocation R_X86_64_32S > against symbol: __je_sz_size2index_tab in readonly segment; recompile > object files with -fPIC or pass '-Wl,-z,notext' to allow text > relocations in the output > > > > defined in /1s4/release/12.2- > > > > STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a(jemalloc_sz.o) > > > > referenced by sz.h:158 > > > > (/usr1/src/contrib/jemalloc/include/jemalloc/internal/sz.h:158) > > > >               jemalloc_jemalloc.o:(a0ialloc) in archive > > > > /1s4/release/12.2- > > > > STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a > > ld: error: can't create dynamic relocation R_X86_64_32S > against symbol: __je_arenas in readonly segment; recompile object files > with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the > output > > > > defined in /1s4/release/12.2- > > > > STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a(jemalloc_jemal > > > > loc.o) > > > > referenced by atomic.h:55 > > > > (/usr1/src/contrib/jemalloc/include/jemalloc/internal/atomic.h:55 > > > > ) > > > >               jemalloc_jemalloc.o:(a0ialloc) in archive > > > > /1s4/release/12.2- > > > > STABLE/usr/obj/usr/src/amd64.amd64/lib/libc/libc.a > [many similar errors snipped] > d: error: too many errors emitted, stopping now (use -error- > limit=0 to see all errors) > cc: error: linker command failed with exit code 1 (use -v > to see invocation) > *** Error code 1 > > Stop. > make: stopped in /usr1/src/lib/libgcc_s > > > 12.2-RELEASE /dev/pts/2 jhs 1 fire/usr1/src/lib/libgcc_s ls -l  > /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a > -rw-r--r--  1 jhs  staff  17050712 Sep 12 13:28 > /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a > > 12.2-RELEASE /dev/pts/2 jhs 2 fire/usr1/src/lib/libgcc_s mv > /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a > /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a.MV > > 12.2-RELEASE /dev/pts/2 jhs 3 fire/usr1/src/lib/libgcc_s make > building shared library libgcc_s.so.1 > cc  -nodefaultlibs -Wl,--version-script=Version.map   -shared -Wl,-x - > Wl,--fatal-warnings -Wl,--warn-shared-textrel  -o libgcc_s.so.1.full - > Wl,-soname,libgcc_s.so.1  `NM='nm' NMFLAGS='' lorder i386/fp_mode.pico > absvdi2.pico absvsi2.pico absvti2.pico addvdi3.pico addvsi3.pico > addvti3.pico apple_versioning.pico ashldi3.pico ashlti3.pico > ashrdi3.pico ashrti3.pico bswapdi2.pico bswapsi2.pico clear_cache.pico > clzdi2.pico clzsi2.pico clzti2.pico cmpdi2.pico cmpti2.pico ctzdi2.pico > ctzsi2.pico ctzti2.pico divdc3.pico divdi3.pico divmoddi4.pico > divmodsi4.pico divsc3.pico divsi3.pico divtc3.pico divti3.pico > divxc3.pico enable_execute_stack.pico eprintf.pico extendhfsf2.pico > ffsdi2.pico ffssi2.pico ffsti2.pico fixdfdi.pico fixdfti.pico > fixsfdi.pico fixsfti.pico fixunsdfdi.pico fixunsdfsi.pico > fixunsdfti.pico fixunssfdi.pico fixunssfsi.pico fixunssfti.pico > fixunsxfdi.pico fixunsxfsi.pico fixunsxfti.pico fixxfdi.pico > fixxfti.pico floatditf.pico floattidf.pico floattisf.pico > floattixf.pico floatunditf.pico floatunsidf.pico floatunsisf.pico > floatuntidf.pico floatuntisf.pico floatuntixf.pico > gcc_personality_v0.pico int_util.pico lshrdi3.pico lshrti3.pico > moddi3.pico modsi3.pico modti3.pico muldc3.pico muldi3.pico > mulodi4.pico mulosi4.pico muloti4.pico mulsc3.pico multc3.pico > multi3.pico mulvdi3.pico mulvsi3.pico mulvti3.pico mulxc3.pico > negdf2.pico negdi2.pico negsf2.pico negti2.pico negvdi2.pico > negvsi2.pico negvti2.pico paritydi2.pico paritysi2.pico parityti2.pico > popcountdi2.pico popcountsi2.pico popcountti2.pico powidf2.pico > powisf2.pico powitf2.pico powixf2.pico subvdi3.pico subvsi3.pico > subvti3.pico trampoline_setup.pico truncdfhf2.pico truncsfhf2.pico > ucmpdi2.pico ucmpti2.pico udivdi3.pico udivmoddi4.pico udivmodsi4.pico > udivmodti4.pico udivsi3.pico udivti3.pico umoddi3.pico umodsi3.pico > umodti3.pico floatdidf.pico floatdisf.pico floatdixf.pico > floatundidf.pico floatundisf.pico floatundixf.pico cpu_model.pico > adddf3.pico addsf3.pico divdf3.pico divsf3.pico extendsfdf2.pico > fixdfsi.pico fixsfsi.pico floatsidf.pico floatsisf.pico muldf3.pico > mulsf3.pico subdf3.pico subsf3.pico truncdfsf2.pico comparedf2.pico > comparesf2.pico gcc_personality_v0.pico int_util.pico Unwind-EHABI.pico > Unwind-sjlj.pico UnwindLevel1-gcc-ext.pico UnwindLevel1.pico > UnwindRegistersRestore.pico UnwindRegistersSave.pico libunwind.pico > s_fabs.pico s_fabsf.pico s_fabsl.pico s_fmax.pico s_fmaxf.pico > s_logb.pico s_logbf.pico s_scalbn.pico s_scalbnf.pico s_fmaxl.pico > s_logbl.pico s_scalbnl.pico |  tsort -q` -L/1s4/release/12.2- > STABLE/usr/obj/usr/src/amd64.amd64/lib/libc -lc > objcopy --only-keep-debug libgcc_s.so.1.full libgcc_s.so.1.debug > objcopy --strip-debug --add-gnu-debuglink=libgcc_s.so.1.debug  > libgcc_s.so.1.full libgcc_s.so.1 > > 12.2-RELEASE /dev/pts/2 jhs 4 fire/usr1/src/lib/libgcc_s > -------} > > Cheers, I ran into this problem when trying to update our build system to use freebsd 13 for our armv7-based products (we were previously using 11.2- stable; we skipped 12.x completely). Our build process creates a chroot directory, checks out the freebsd source into it, bootstraps the compiler, builds the world with that compiler and installs the world into the chroot dir. It then chroots into that area and builds clang and world-libs again as an armv7 cross- build environment. It was while doing the latter (specifically, doing "make xdev") that I ran into the errors about being unable to create a relocation in a read-only text segment while linking libgcc_s. I tracked the cause of the error message down to trying to static-link libc (which had been built as non-PIC code) into libgcc_s which was being built as a shared (PIC) library. Here's the fix I committed to get around the problem (with some more commentary after it): files: lib/libgcc_s/Makefile description: When building libgcc_s for armv7, link against libc_pic.a, which is built as position-independent code. That means it will not include movw/movt instructions which require relocation fixup in the text segment, which is readonly in a shared lib such as libgcc_s. I'm not certain this is the best or only fix available for this problem, but it is a fix for what has prevented us from building freebsd 12 or later for almost 2 years now. It seems to me that other shared libs link with libc.a and they don't have any problems with text relocs. But maybe there are only a few problematic functions in libc, and not all shared libs run into those few functions. diff -r 38de27edd9d7 -r 118e28fad4ff lib/libgcc_s/Makefile --- a/lib/libgcc_s/Makefile Mon Jul 05 11:45:38 2021 -0600 +++ b/lib/libgcc_s/Makefile Tue Jul 06 13:22:25 2021 -0600 @@ -10,7 +10,11 @@ MK_SSP= no WARNS?= 2 LDFLAGS+= -nodefaultlibs +.if ${MACHINE_ARCH} == "armv7" +LIBADD+= c_pic +.else LIBADD+= c +.endif VERSION_DEF= ${.CURDIR}/Versions.def SYMBOL_MAPS= ${.CURDIR}/Symbol.map As you can see from my commit message, I don't feel like I really properly understood the problem and fixed it the right way. It was just something I could do at the time to make progress (we still aren't actually using this 13-stable yet). I had to wrap the fix in .if to limit it to armv7, because with the change in effect all the time, I ended up with different errors during the initial amd64 build of the chroot. So all in all, I'm not saying this is the fix for the problem you're seeing, but I'm pretty sure your problem and mine are related somehow. Maybe with this as an additional clue, the people who understand the toolchains better will be able to offer some advice. -- Ian From nobody Wed Sep 15 01:29:59 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1D33017C3122 for ; Wed, 15 Sep 2021 01:30:09 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-qt1-x835.google.com (mail-qt1-x835.google.com [IPv6:2607:f8b0:4864:20::835]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8N1r2Dftz3G5h for ; Wed, 15 Sep 2021 01:30:08 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-qt1-x835.google.com with SMTP id m9so948078qtk.4 for ; Tue, 14 Sep 2021 18:30:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:subject:to:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=4aUEVGrbohZ8Kt4KKuBLhhjsP/1vdkUSX4ZJV3mKwxc=; b=dZP3p97YrVW5+ce8XN7LulJb6HTbz6ITsSNejZCVivoCOFt2sqLRVJ+IBZ6lLlSAz1 vyKEG3KwDk4PJL7I2GurL6Rg5h8/mA/raDRWniXXLNnJuvYL53mVBKMWHCphJvwgg65R 7+Bss00p9nvesLpt7CgKQ72MKYm008C/eOwGs++AdXo/oRRYBdVZJaJwhzCVxpZ4ts5o Sc+1P7mE5I+lmXbt6pMAUjruz6K41myJbCdH9vw0Gejm05WpGBw/pp2E3u1BvlVEIQmq Tm/ic5AzpQ5VKxI9UVD8PHjjcP5PLMKZNmoOwt891nEFnURe0se7qfRLWePxc9lmEmzE UM2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:subject:to:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=4aUEVGrbohZ8Kt4KKuBLhhjsP/1vdkUSX4ZJV3mKwxc=; b=wdbnEB34X7g/0rMeVLkfNfdddUS2+EQjqU62MGuoEQ3cG9cWrXelXSDMqKYm8832O4 FvIDTpYI/pVu2vzdmWq6FiDN1kNuuAe73sm0VzR2s/uxPF/9ehnqVyoFdOVKkuutIw1W lFxLz97DreTdiwng7TitROVWzfn1StgYwx62jT8Rnh3pytqIJJeljo8ZCoSCjZRdb1Yt 4v2ODcSj6nYtgeeXpLma1rcMB006ojZIheXI5fcwErW/V5/etWZHXmT5b7bN/pvVh83g bH5XxnAGSKBCIrGlAS+oMxmZVFmoDg8GRFb97FPHeKmyCbgecrRU37l14Oo9GiQJ0X+2 iS7A== X-Gm-Message-State: AOAM530IFLtwmsXYkSVzhhXui+czAyLbzsLfykPTBRgQyWMIyvJe/hgW QRUPJ4k9zpCPRCBLZ3xvHVytN65G5vc= X-Google-Smtp-Source: ABdhPJwUjv0RqlTHwSv6ARtK1ZZ/GYNw1Nk7cgLjz64EMgPTceHHyxfumh7K+WoQSv1kynQX819EvA== X-Received: by 2002:ac8:5ec8:: with SMTP id s8mr7976642qtx.26.1631669400480; Tue, 14 Sep 2021 18:30:00 -0700 (PDT) Received: from spectre.mavhome.dp.ua (104-55-12-234.lightspeed.knvltn.sbcglobal.net. [104.55.12.234]) by smtp.gmail.com with ESMTPSA id z6sm7136218qtq.78.2021.09.14.18.29.59 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 14 Sep 2021 18:29:59 -0700 (PDT) Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) To: mike tancsa , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> From: Alexander Motin Message-ID: Date: Tue, 14 Sep 2021 21:29:59 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4H8N1r2Dftz3G5h X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=dZP3p97Y; dmarc=none; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::835 as permitted sender) smtp.mailfrom=mavbsd@gmail.com X-Spamd-Result: default: False [-3.20 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::835:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N Hi Mike, Could you try my 6c2d4404161a commit? I don't know about your case, but it fixes 0xcc error I see on my systems for timeouts below 120 seconds. On 17.08.2021 15:31, mike tancsa wrote: > Actually, even stranger now, I updated the base src and am no longer > able to reboot via watchdog > > Instead, dmesg has this pop up > > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > interrupt                   total > irq4: uart0                            4 > cpu0:timer                          5726 > cpu1:timer                          4694 > cpu2:timer                          6007 > cpu3:timer                          4449 > irq42: xhci0                         347 > irq43: ahci0                        6448 > irq44: igb0:rxq0                     133 > irq45: igb0:rxq1                    1825 > irq46: igb0:rxq2                       5 > irq47: igb0:rxq3                       4 > irq48: igb0:aq                         2 > Total                       29644 > KDB: stack backtrace: > #0 0xffffffff80c6ad65 at kdb_backtrace+0x65 > #1 0xffffffff80baf74d at hardclock+0x1bd > #2 0xffffffff80bb07c4 at handleevents+0xb4 > #3 0xffffffff80bb152e at timercb+0x24e > #4 0xffffffff81165efb at lapic_handle_timer+0x9b > #5 0xffffffff8107e7c1 at Xtimerint+0xb1 > #6 0xffffffff81068f0e at cpu_idle_acpi+0x3e > #7 0xffffffff81068fbf at cpu_idle+0x9f > #8 0xffffffff80c52864 at sched_idletd+0x2e4 > #9 0xffffffff80bdafce at fork_exit+0x7e > #10 0xffffffff8107dafe at fork_trampoline+0xe > > A kernel from Jul 22 does indeed work. Looking at the sel info I am able > to reboot it with a killall  -9 watchdogd. > > root@r13aug21:/boot # ipmitool sel list | tail -3 >  1ef | 08/17/2021 | 17:51:49 | Session Audit #0xff |  | Asserted >  1f0 | 08/17/2021 | 18:52:11 | Watchdog2 #0xca | Timer interrupt () | > Asserted >  1f1 | 08/17/2021 | 18:52:46 | Watchdog2 #0xca | Power cycle () | Asserted > root@r13aug21:/boot # > > > > -- Alexander Motin From nobody Wed Sep 15 15:23:03 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3C84417D7B59 for ; Wed, 15 Sep 2021 15:23:10 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8kW16Sgrz4mb0; Wed, 15 Sep 2021 15:23:09 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 18FFN2Nw053074 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 15 Sep 2021 11:23:02 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:a977:f4b9:3629:f7dd] ([IPv6:2607:f3e0:0:4:a977:f4b9:3629:f7dd]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 18FFN2AW036090 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 15 Sep 2021 11:23:02 -0400 (EDT) (envelope-from mike@sentex.net) To: Alexander Motin , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> From: mike tancsa Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) Message-ID: Date: Wed, 15 Sep 2021 11:23:03 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Rspamd-Queue-Id: 4H8kW16Sgrz4mb0 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 9/14/2021 9:29 PM, Alexander Motin wrote: > Hi Mike, > > Could you try my 6c2d4404161a commit? I don't know about your case, bu= t > it fixes 0xcc error I see on my systems for timeouts below 120 seconds.= Hi Alexander, This is on the Supermicro X11SCH-F.=C2=A0 BMC firmware was version 1.73 (latest version on the website) ipmi0: port 0xca2,0xca3 on acpi0 ipmi0: KCS mode found at io 0xca2 on acpi ipmi0: IPMI device rev. 1, firmware rev. 1.73, version 2.0, device support mask 0xbf ipmi0: Number of channels 2 ipmi0: Attached watchdog ipmi0: Establishing power cycle handler Its no longer printing the error!=C2=A0 If I start up watchdogd -t 30 and then do a killall -9 watchdogd, it does a graceful shutdown of the box !?!=C2=A0 Thats very cool. Even be= tter than before as a hard reset. But I guess will it do a hard reset if the box is actually live locked ?=C2=A0 I did a quick test to confirm, that i= t does indeed not wait around too=C2=A0 long.=C2=A0 I added an infinite loo= p in /usr/local/etc/rc.d/stop-shutdown.sh and it only fired for 6 seconds before the box hard reset its logged in the BMC log too. # ipmitool sel list =C2=A0=C2=A0 1 | 09/15/2021 | 14:42:04 | Watchdog2 #0xca | Timer interrup= t () | Asserted =C2=A0=C2=A0 2 | 09/15/2021 | 14:42:22 | Watchdog2 #0xca | Power cycle ()= | Asserted I also tried on a X11SSL-F ipmi0: IPMI device rev. 1, firmware rev. 1.60, version 2.0, device support mask 0xbf ipmi0: Number of channels 2 ipmi0: Attached watchdog ipmi0: Establishing power cycle handler =C2=A0# ipmitool sel list | tail -3 =C2=A0=C2=A0 6 | 08/20/2021 | 20:45:38 | Fan #0x45 | Lower Non-recoverabl= e going low=C2=A0 | Asserted =C2=A0=C2=A0 7 | 09/15/2021 | 11:15:28 | Watchdog2 #0xca | Timer interrup= t () | Asserted =C2=A0=C2=A0 8 | 09/15/2021 | 11:15:38 | Watchdog2 #0xca | Power cycle ()= | Asserted # I have a RELENG_12 box in production I will try as well later, but so far so good.=C2=A0 Thanks for fixing! =C2=A0=C2=A0=C2=A0 ---Mike =C2=A0=C2=A0=C2=A0 ---Mike From nobody Wed Sep 15 18:49:12 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2D49E17C0258 for ; Wed, 15 Sep 2021 18:49:14 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8q4n206Bz4lYR; Wed, 15 Sep 2021 18:49:13 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 18FInB2d069711 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 15 Sep 2021 14:49:11 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:a977:f4b9:3629:f7dd] ([IPv6:2607:f3e0:0:4:a977:f4b9:3629:f7dd]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 18FInBM3024265 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 15 Sep 2021 14:49:11 -0400 (EDT) (envelope-from mike@sentex.net) From: mike tancsa To: Alexander Motin , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) Message-ID: <586b04b4-d9b7-1597-4c8f-9bbcb9255c5a@sentex.net> Date: Wed, 15 Sep 2021 14:49:12 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 Content-Language: en-US X-Rspamd-Queue-Id: 4H8q4n206Bz4lYR X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.19 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.995]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N T24gOS8xNS8yMDIxIDExOjIzIEFNLCBtaWtlIHRhbmNzYSB3cm90ZToNCj4NCj4gSSBhbHNv IHRyaWVkIG9uIGEgWDExU1NMLUYNCj4NCj4gaXBtaTA6IElQTUkgZGV2aWNlIHJldi4gMSwg ZmlybXdhcmUgcmV2LiAxLjYwLCB2ZXJzaW9uIDIuMCwgZGV2aWNlDQo+IHN1cHBvcnQgbWFz ayAweGJmDQo+IGlwbWkwOiBOdW1iZXIgb2YgY2hhbm5lbHMgMg0KPiBpcG1pMDogQXR0YWNo ZWQgd2F0Y2hkb2cNCj4gaXBtaTA6IEVzdGFibGlzaGluZyBwb3dlciBjeWNsZSBoYW5kbGVy DQo+DQo+IMKgIyBpcG1pdG9vbCBzZWwgbGlzdCB8IHRhaWwgLTMNCj4gwqDCoCA2IHwgMDgv MjAvMjAyMSB8IDIwOjQ1OjM4IHwgRmFuICMweDQ1IHwgTG93ZXIgTm9uLXJlY292ZXJhYmxl IGdvaW5nDQo+IGxvd8KgIHwgQXNzZXJ0ZWQNCj4gwqDCoCA3IHwgMDkvMTUvMjAyMSB8IDEx OjE1OjI4IHwgV2F0Y2hkb2cyICMweGNhIHwgVGltZXIgaW50ZXJydXB0ICgpIHwNCj4gQXNz ZXJ0ZWQNCj4gwqDCoCA4IHwgMDkvMTUvMjAyMSB8IDExOjE1OjM4IHwgV2F0Y2hkb2cyICMw eGNhIHwgUG93ZXIgY3ljbGUgKCkgfCBBc3NlcnRlZA0KPiAjDQo+DQo+IEkgaGF2ZSBhIFJF TEVOR18xMiBib3ggaW4gcHJvZHVjdGlvbiBJIHdpbGwgdHJ5IGFzIHdlbGwgbGF0ZXIsIGJ1 dCBzbw0KPiBmYXIgc28gZ29vZC7CoCBUaGFua3MgZm9yIGZpeGluZyENCg0KDQpPbiBSRUxF TkdfMTIgYXMgb2YgdG9kYXksIEkgc3RpbGwgaGF2ZSB0aGUgaXNzdWUgb24gYSBYMTFTQ0wt RiBib2FyZC4NCk5vdCBzdXJlIGlmIHRoYXRzIHRoZSBib2FyZCwgUkVMRU5HXzEyIG9yIG90 aGVyIG1pc3NpbmcgY2hhbmdlcyBmcm9tDQpIRUFEIG9yIGEgY29tYm8gdGhlcmUgb2YgPw0K DQotLS0gaXBtaS5jLnByZXYgMjAyMS0wOS0xNSAxNDozOToyOC45NDMxNjEwMDAgLTA0MDAN CisrKyBpcG1pLmPCoMKgwqDCoMKgIDIwMjEtMDktMTUgMTQ6Mzk6NTAuOTk3ODM2MDAwIC0w NDAwDQpAQCAtNjYyLDcgKzY2Miw4IEBADQrCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqAgcmVxLT5pcl9yZXF1ZXN0WzBdID0gSVBNSV9TRVRfV0RfVElNRVJfRE9OVF9TVE9QDQrC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCB8IElQTUlfU0VUX1dEX1RJ TUVSX1NNU19PUzsNCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCByZXEtPmlyX3Jl cXVlc3RbMV0gPSAod2RfdGltZXJfYWN0aW9ucyAmIDB4ZmYpOw0KLcKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqAgcmVxLT5pcl9yZXF1ZXN0WzJdID0gKHdkX3ByZXRpbWVvdXRfY291 bnRkb3duICYgMHhmZik7DQorwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCByZXEtPmly X3JlcXVlc3RbMl0gPSBtaW4oMHhmZiwNCivCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoCBtaW4od2RfcHJldGltZW91dF9jb3VudGRvd24sIChzZWMgKyAy KSAvIDQpKTsNCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCByZXEtPmlyX3JlcXVl c3RbM10gPSAwOyAvKiBUaW1lciB1c2UgKi8NCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoCByZXEtPmlyX3JlcXVlc3RbNF0gPSAoc2VjICogMTApICYgMHhmZjsNCsKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCByZXEtPmlyX3JlcXVlc3RbNV0gPSAoc2VjICogMTAp ID4+IDg7DQoNCkkgZGlkIG5vdGljZSwgdGhlcmUgYXJlIG90aGVyIGNoYW5nZXMgaW4gdGhl IHZlcnNpb24gaW4gSEVBRA0KDQpAQCAtMjcsMTYgKzI3LDE5IEBADQrCoCAqLw0KwqANCsKg I2luY2x1ZGUgPHN5cy9jZGVmcy5oPg0KLV9fRkJTRElEKCIkRnJlZUJTRDogc3RhYmxlLzEy L3N5cy9kZXYvaXBtaS9pcG1pLmMgMzcwMzAzIDIwMjEtMDgtMTMNCjAxOjIwOjU5WiBnaXQy c3ZuICQiKTsNCitfX0ZCU0RJRCgiJEZyZWVCU0QkIik7DQrCoA0KwqAjaW5jbHVkZSA8c3lz L3BhcmFtLmg+DQrCoCNpbmNsdWRlIDxzeXMvc3lzdG0uaD4NCsKgI2luY2x1ZGUgPHN5cy9i dXMuaD4NCsKgI2luY2x1ZGUgPHN5cy9jb25kdmFyLmg+DQrCoCNpbmNsdWRlIDxzeXMvY29u Zi5oPg0KKyNpbmNsdWRlIDxzeXMvZXZlbnRoYW5kbGVyLmg+DQrCoCNpbmNsdWRlIDxzeXMv a2VybmVsLmg+DQorI2luY2x1ZGUgPHN5cy9sb2NrLmg+DQrCoCNpbmNsdWRlIDxzeXMvbWFs bG9jLmg+DQrCoCNpbmNsdWRlIDxzeXMvbW9kdWxlLmg+DQorI2luY2x1ZGUgPHN5cy9tdXRl eC5oPg0KwqAjaW5jbHVkZSA8c3lzL3BvbGwuaD4NCsKgI2luY2x1ZGUgPHN5cy9yZWJvb3Qu aD4NCsKgI2luY2x1ZGUgPHN5cy9ybWFuLmg+DQpAQCAtOTMsMTEgKzk2LDE0IEBADQrCoHN0 YXRpYyBpbnQgd2Rfc3RhcnR1cF9jb3VudGRvd24gPSAwOyAvKiBzZWMgKi8NCsKgc3RhdGlj IGludCB3ZF9wcmV0aW1lb3V0X2NvdW50ZG93biA9IDEyMDsgLyogc2VjICovDQrCoHN0YXRp YyBpbnQgY3ljbGVfd2FpdCA9IDEwOyAvKiBzZWMgKi8NCitzdGF0aWMgaW50IHdkX2luaXRf ZW5hYmxlID0gMTsNCsKgDQotc3RhdGljIFNZU0NUTF9OT0RFKF9odywgT0lEX0FVVE8sIGlw bWksIENUTEZMQUdfUkQsIDAsDQorc3RhdGljIFNZU0NUTF9OT0RFKF9odywgT0lEX0FVVE8s IGlwbWksIENUTEZMQUdfUkQgfCBDVExGTEFHX01QU0FGRSwgMCwNCsKgwqDCoMKgICJJUE1J IGRyaXZlciBwYXJhbWV0ZXJzIik7DQrCoFNZU0NUTF9JTlQoX2h3X2lwbWksIE9JRF9BVVRP LCBvbiwgQ1RMRkxBR19SV1RVTiwNCsKgwqDCoMKgwqDCoMKgICZvbiwgMCwgIiIpOw0KK1NZ U0NUTF9JTlQoX2h3X2lwbWksIE9JRF9BVVRPLCB3ZF9pbml0X2VuYWJsZSwgQ1RMRkxBR19S V1RVTiwNCivCoMKgwqDCoMKgwqAgJndkX2luaXRfZW5hYmxlLCAxLCAiRW5hYmxlIHdhdGNo ZG9nIGluaXRpYWxpemF0aW9uIik7DQrCoFNZU0NUTF9JTlQoX2h3X2lwbWksIE9JRF9BVVRP LCB3ZF90aW1lcl9hY3Rpb25zLCBDVExGTEFHX1JXLA0KwqDCoMKgwqDCoMKgwqAgJndkX3Rp bWVyX2FjdGlvbnMsIDAsDQrCoMKgwqDCoMKgwqDCoCAiSVBNSSB3YXRjaGRvZyB0aW1lciBh Y3Rpb25zIChpbmNsdWRpbmcgcHJlLXRpbWVvdXQgaW50ZXJydXB0KSIpOw0KQEAgLTY2Miw3 ICs2NjgsOCBAQA0KwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHJlcS0+aXJfcmVx dWVzdFswXSA9IElQTUlfU0VUX1dEX1RJTUVSX0RPTlRfU1RPUA0KwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfCBJUE1JX1NFVF9XRF9USU1FUl9TTVNfT1M7DQrC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgcmVxLT5pcl9yZXF1ZXN0WzFdID0gKHdk X3RpbWVyX2FjdGlvbnMgJiAweGZmKTsNCi3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg IHJlcS0+aXJfcmVxdWVzdFsyXSA9ICh3ZF9wcmV0aW1lb3V0X2NvdW50ZG93biAmIDB4ZmYp Ow0KK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgcmVxLT5pcl9yZXF1ZXN0WzJdID0g bWluKDB4ZmYsDQorwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIG1pbih3 ZF9wcmV0aW1lb3V0X2NvdW50ZG93biwgKHNlYyArIDIpIC8gNCkpOw0KwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgIHJlcS0+aXJfcmVxdWVzdFszXSA9IDA7IC8qIFRpbWVyIHVz ZSAqLw0KwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHJlcS0+aXJfcmVxdWVzdFs0 XSA9IChzZWMgKiAxMCkgJiAweGZmOw0KwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg IHJlcS0+aXJfcmVxdWVzdFs1XSA9IChzZWMgKiAxMCkgPj4gODsNCkBAIC05MDYsNyArOTEz LDcgQEANCsKgwqDCoMKgwqDCoMKgwqAgKiBQcm9iZSBmb3Igd2F0Y2hkb2csIGJ1dCBvbmx5 IGZvciBiYWNrZW5kcyB3aGljaCBzdXBwb3J0DQrCoMKgwqDCoMKgwqDCoMKgICogcG9sbGVk IGRyaXZlciByZXF1ZXN0cy4NCsKgwqDCoMKgwqDCoMKgwqAgKi8NCi3CoMKgwqDCoMKgwqAg aWYgKHNjLT5pcG1pX2RyaXZlcl9yZXF1ZXN0c19wb2xsZWQpIHsNCivCoMKgwqDCoMKgwqAg aWYgKHdkX2luaXRfZW5hYmxlICYmIHNjLT5pcG1pX2RyaXZlcl9yZXF1ZXN0c19wb2xsZWQp IHsNCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBJUE1JX0lOSVRfRFJJVkVSX1JF UVVFU1QocmVxLA0KSVBNSV9BRERSKElQTUlfQVBQX1JFUVVFU1QsIDApLA0KwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgSVBNSV9HRVRfV0RPRywgMCwgMCk7DQrC oA0KQEAgLTk0OSwxNCArOTU2LDE0IEBADQrCoMKgwqDCoMKgwqDCoCB9IGVsc2UgaWYgKCFv bikNCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAodm9pZClpcG1pX3NldF93YXRj aGRvZyhzYywgMCk7DQrCoMKgwqDCoMKgwqDCoCAvKg0KLcKgwqDCoMKgwqDCoMKgICogUG93 ZXIgY3ljbGUgdGhlIHN5c3RlbSBvZmYgdXNpbmcgSVBNSS4gV2UgdXNlIGxhc3QgLSAxIHNp bmNlDQp3ZSBkb24ndA0KK8KgwqDCoMKgwqDCoMKgICogUG93ZXIgY3ljbGUgdGhlIHN5c3Rl bSBvZmYgdXNpbmcgSVBNSS4gV2UgdXNlIGxhc3QgLSAyIHNpbmNlDQp3ZSBkb24ndA0KwqDC oMKgwqDCoMKgwqDCoCAqIGhhbmRsZSBhbGwgdGhlIG90aGVyIGtpbmRzIG9mIHJlYm9vdHMu IFdlJ2xsIGxldCBvdGhlcnMNCmhhbmRsZSB0aGVtLg0KwqDCoMKgwqDCoMKgwqDCoCAqIFdl IG9ubHkgdHJ5IHRvIGRvIHRoaXMgaWYgdGhlIEJNQyBzdXBwb3J0cyB0aGUgQ2hhc3NpcyBk ZXZpY2UuDQrCoMKgwqDCoMKgwqDCoMKgICovDQrCoMKgwqDCoMKgwqDCoCBpZiAoc2MtPmlw bWlfZGV2X3N1cHBvcnQgJiBJUE1JX0FEU19DSEFTU0lTKSB7DQrCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqAgZGV2aWNlX3ByaW50ZihkZXYsICJFc3RhYmxpc2hpbmcgcG93ZXIg Y3ljbGUgaGFuZGxlclxuIik7DQrCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgc2Mt PmlwbWlfcG93ZXJfY3ljbGVfdGFnID0NCkVWRU5USEFORExFUl9SRUdJU1RFUihzaHV0ZG93 bl9maW5hbCwNCi3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgaXBtaV9w b3dlcl9jeWNsZSwgc2MsIFNIVVRET1dOX1BSSV9MQVNUIC0gMSk7DQorwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIGlwbWlfcG93ZXJfY3ljbGUsIHNjLCBTSFVURE9X Tl9QUklfTEFTVCAtIDIpOw0KwqDCoMKgwqDCoMKgwqAgfQ0KwqB9DQrCoA0KDQoNCg0K From nobody Wed Sep 15 19:49:01 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 546D317BBA89 for ; Wed, 15 Sep 2021 19:49:03 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-qk1-x732.google.com (mail-qk1-x732.google.com [IPv6:2607:f8b0:4864:20::732]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8rPq1bLJz3KGD for ; Wed, 15 Sep 2021 19:49:03 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-qk1-x732.google.com with SMTP id ay33so4780599qkb.10 for ; Wed, 15 Sep 2021 12:49:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:subject:to:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=pzeTcEBgD5yl4dH+bqJD3dTmNz13loUoADTDDRBFcZg=; b=RfkH8aF03yUdbYVnyjDIQsR/PVsxHSLDW0EkL3LjLrPKtXktFaTAZ7IXlvGt70Qb+I TcUn1HA0fW4K951qmOucQEX3zff9sBggJXyE0yg6wkB1ezLNaPDYru/udTfP7TaqBIW9 oZVCIUOQMROJvZ1Lkn8/48V2k9sSEJElKZK/IT8Lh1crr24JdlqlcOsYbinJ9WBmxhf4 0VFouGyQ6u2WsTlwBedMq6LaNdlXNC0mZtAO0F682W4hQ0GQPHkfVVPD1wiA8K8uvXLs 3ItzTiE6V4w9P3f8Aud02pc7MDvs+0b3ovGCeX3GHuQXyyfhX8XiPvTUW+bXLnR0jj7T B4FA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:subject:to:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=pzeTcEBgD5yl4dH+bqJD3dTmNz13loUoADTDDRBFcZg=; b=5esmjxMfCzQtoR6xZSAV+TNHgNk33MSBNEj9m4peTw/zfs9EO44h1WpnH0sUnVVe0A 1gwtkA0LdFqchhsJtAOlObYL1RO/sjEukK+bQHeu8XHND2z/vnn20d9I+TLLkKT36XKM FZ2vGstVc3n8vTJwtQTaIWbVkpu7iiTo/gg+I4xTVVsWxaHZj3moRUKI/jGTgbnNCVbo h3eDn8f4eOu8c0ZhkUZz5yaYrYngq7uka+6sq6ksFd2kQwPowbJaIcrd0Vsr6579b2vY L/PWQhQFFOx6R9DeD8pWwhzv5eMUSO+PZsqjyABSiqdsZep4o/okOuH7ewxA2JtBgtU8 azSw== X-Gm-Message-State: AOAM532LdK7UcTCzrnInjDqiNAHb+MnaSucItbh6zmrKw+eIB9ByNwOT ehi/2dwdutOLZ28LxMBcV6QiQjFfC9c= X-Google-Smtp-Source: ABdhPJxNxcuqtz8lfyD9Vuago7OWDO5Gqr9iH7H7miw5Y0LtGtj3p9z+vguQFhOHf08PHrPhmgnNBg== X-Received: by 2002:a37:67d7:: with SMTP id b206mr1607881qkc.395.1631735342459; Wed, 15 Sep 2021 12:49:02 -0700 (PDT) Received: from mavoffice.ixsystems.com ([38.32.73.2]) by smtp.gmail.com with ESMTPSA id z6sm607428qtq.78.2021.09.15.12.49.01 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 15 Sep 2021 12:49:01 -0700 (PDT) Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) To: mike tancsa , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> <586b04b4-d9b7-1597-4c8f-9bbcb9255c5a@sentex.net> From: Alexander Motin Message-ID: <8fcb399d-8f26-b7a2-bf60-414d4ea1006e@FreeBSD.org> Date: Wed, 15 Sep 2021 15:49:01 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: <586b04b4-d9b7-1597-4c8f-9bbcb9255c5a@sentex.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4H8rPq1bLJz3KGD X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 15.09.2021 14:49, mike tancsa wrote: > On 9/15/2021 11:23 AM, mike tancsa wrote: >> >> I also tried on a X11SSL-F >> >> ipmi0: IPMI device rev. 1, firmware rev. 1.60, version 2.0, device >> support mask 0xbf >> ipmi0: Number of channels 2 >> ipmi0: Attached watchdog >> ipmi0: Establishing power cycle handler >> >>  # ipmitool sel list | tail -3 >>    6 | 08/20/2021 | 20:45:38 | Fan #0x45 | Lower Non-recoverable going >> low  | Asserted >>    7 | 09/15/2021 | 11:15:28 | Watchdog2 #0xca | Timer interrupt () | >> Asserted >>    8 | 09/15/2021 | 11:15:38 | Watchdog2 #0xca | Power cycle () | Asserted >> # >> >> I have a RELENG_12 box in production I will try as well later, but so >> far so good.  Thanks for fixing! > > On RELENG_12 as of today, I still have the issue on a X11SCL-F board. What issues do you have there exactly? > Not sure if thats the board, RELENG_12 or other missing changes from > HEAD or a combo there of ? > > --- ipmi.c.prev 2021-09-15 14:39:28.943161000 -0400 > +++ ipmi.c      2021-09-15 14:39:50.997836000 -0400 > @@ -662,7 +662,8 @@ >                 req->ir_request[0] = IPMI_SET_WD_TIMER_DONT_STOP >                     | IPMI_SET_WD_TIMER_SMS_OS; >                 req->ir_request[1] = (wd_timer_actions & 0xff); > -               req->ir_request[2] = (wd_pretimeout_countdown & 0xff); > +               req->ir_request[2] = min(0xff, > +                       min(wd_pretimeout_countdown, (sec + 2) / 4)); >                 req->ir_request[3] = 0; /* Timer use */ >                 req->ir_request[4] = (sec * 10) & 0xff; >                 req->ir_request[5] = (sec * 10) >> 8; I suppose this is what you merged down? It by itself should fix the specific issue that affected at least me. > I did notice, there are other changes in the version in HEAD > > @@ -27,16 +27,19 @@ >   */ >   >  #include > -__FBSDID("$FreeBSD: stable/12/sys/dev/ipmi/ipmi.c 370303 2021-08-13 > 01:20:59Z git2svn $"); > +__FBSDID("$FreeBSD$"); >   >  #include >  #include >  #include >  #include >  #include > +#include >  #include > +#include >  #include >  #include > +#include >  #include >  #include >  #include > @@ -93,11 +96,14 @@ >  static int wd_startup_countdown = 0; /* sec */ >  static int wd_pretimeout_countdown = 120; /* sec */ >  static int cycle_wait = 10; /* sec */ > +static int wd_init_enable = 1; >   > -static SYSCTL_NODE(_hw, OID_AUTO, ipmi, CTLFLAG_RD, 0, > +static SYSCTL_NODE(_hw, OID_AUTO, ipmi, CTLFLAG_RD | CTLFLAG_MPSAFE, 0, >      "IPMI driver parameters"); >  SYSCTL_INT(_hw_ipmi, OID_AUTO, on, CTLFLAG_RWTUN, >         &on, 0, ""); > +SYSCTL_INT(_hw_ipmi, OID_AUTO, wd_init_enable, CTLFLAG_RWTUN, > +       &wd_init_enable, 1, "Enable watchdog initialization"); >  SYSCTL_INT(_hw_ipmi, OID_AUTO, wd_timer_actions, CTLFLAG_RW, >         &wd_timer_actions, 0, >         "IPMI watchdog timer actions (including pre-timeout interrupt)"); > @@ -662,7 +668,8 @@ >                 req->ir_request[0] = IPMI_SET_WD_TIMER_DONT_STOP >                     | IPMI_SET_WD_TIMER_SMS_OS; >                 req->ir_request[1] = (wd_timer_actions & 0xff); > -               req->ir_request[2] = (wd_pretimeout_countdown & 0xff); > +               req->ir_request[2] = min(0xff, > +                   min(wd_pretimeout_countdown, (sec + 2) / 4)); >                 req->ir_request[3] = 0; /* Timer use */ >                 req->ir_request[4] = (sec * 10) & 0xff; >                 req->ir_request[5] = (sec * 10) >> 8; > @@ -906,7 +913,7 @@ >          * Probe for watchdog, but only for backends which support >          * polled driver requests. >          */ > -       if (sc->ipmi_driver_requests_polled) { > +       if (wd_init_enable && sc->ipmi_driver_requests_polled) { >                 IPMI_INIT_DRIVER_REQUEST(req, > IPMI_ADDR(IPMI_APP_REQUEST, 0), >                     IPMI_GET_WDOG, 0, 0); >   > @@ -949,14 +956,14 @@ >         } else if (!on) >                 (void)ipmi_set_watchdog(sc, 0); >         /* > -        * Power cycle the system off using IPMI. We use last - 1 since > we don't > +        * Power cycle the system off using IPMI. We use last - 2 since > we don't >          * handle all the other kinds of reboots. We'll let others > handle them. >          * We only try to do this if the BMC supports the Chassis device. >          */ >         if (sc->ipmi_dev_support & IPMI_ADS_CHASSIS) { >                 device_printf(dev, "Establishing power cycle handler\n"); >                 sc->ipmi_power_cycle_tag = > EVENTHANDLER_REGISTER(shutdown_final, > -                   ipmi_power_cycle, sc, SHUTDOWN_PRI_LAST - 1); > +                   ipmi_power_cycle, sc, SHUTDOWN_PRI_LAST - 2); >         } >  } This seems to be irrelevant. -- Alexander Motin From nobody Wed Sep 15 19:52:09 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6D3C017BC52C for ; Wed, 15 Sep 2021 19:52:09 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8rTP2Lnlz3Lb0; Wed, 15 Sep 2021 19:52:09 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 18FJq8Wm066189 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 15 Sep 2021 15:52:08 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:a977:f4b9:3629:f7dd] ([IPv6:2607:f3e0:0:4:a977:f4b9:3629:f7dd]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 18FJq87v050651 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 15 Sep 2021 15:52:08 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) To: Alexander Motin , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> <586b04b4-d9b7-1597-4c8f-9bbcb9255c5a@sentex.net> <8fcb399d-8f26-b7a2-bf60-414d4ea1006e@FreeBSD.org> From: mike tancsa Message-ID: Date: Wed, 15 Sep 2021 15:52:09 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: <8fcb399d-8f26-b7a2-bf60-414d4ea1006e@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4H8rTP2Lnlz3Lb0 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 9/15/2021 3:49 PM, Alexander Motin wrote: > >> On RELENG_12 as of today, I still have the issue on a X11SCL-F board. > What issues do you have there exactly? Oh, sorry, this constant spew to dmesg ipmi0: Watchdog set returned 0xc0 ipmi0: Watchdog set returned 0xc0 ipmi0: Watchdog set returned 0xc0 ipmi0: Watchdog set returned 0xc0 ipmi0: Watchdog set returned 0xc0 The initial attach looks as ipmi0: port 0xca2,0xca3 on acpi0 ipmi0: KCS mode found at io 0xca2 on acpi ipmi0: IPMI device rev. 1, firmware rev. 1.73, version 2.0, device support mask 0xbf ipmi0: Number of channels 2 ipmi0: Attached watchdog ipmi0: Establishing power cycle handler     ---Mike From nobody Wed Sep 15 22:41:36 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4D9AB17B2B21 for ; Wed, 15 Sep 2021 22:41:49 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from land.berklix.org (land.berklix.org [144.76.10.75]) by mx1.freebsd.org (Postfix) with ESMTP id 4H8wF75yx0z4r6V; Wed, 15 Sep 2021 22:41:47 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from mart.js.berklix.net (p4fc4cd5f.dip0.t-ipconnect.de [79.196.205.95]) (authenticated bits=128) by land.berklix.org (8.15.2/8.15.2) with ESMTPA id 18FMff6i009128; Wed, 15 Sep 2021 22:41:41 GMT (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by mart.js.berklix.net (8.14.3/8.14.3) with ESMTP id 18FMfacv047611; Thu, 16 Sep 2021 00:41:36 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.16.1/8.16.1) with ESMTP id 18FMfaah056469; Thu, 16 Sep 2021 00:41:36 +0200 (CEST) (envelope-from jhs@berklix.com) Message-Id: <202109152241.18FMfaah056469@fire.js.berklix.net> To: Ian Lepore cc: FreeBSD-STABLE Mailing List Subject: Re: src/lib/libgcc_s needs mv /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a From: "Julian H. Stacey" Organization: http://berklix.com/jhs/ User-agent: EXMH on FreeBSD http://berklix.com/free/ X-From: http://www.berklix.org/~jhs/ In-reply-to: Your message "Tue, 14 Sep 2021 12:09:46 -0600." <26a6a3c8e87a4cf887c334ff8339e4f10d93988b.camel@freebsd.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <56461.1631745696.1@fire.js.berklix.net> Date: Thu, 16 Sep 2021 00:41:36 +0200 X-Rspamd-Queue-Id: 4H8wF75yx0z4r6V X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jhs@berklix.com has no SPF policy when checking 144.76.10.75) smtp.mailfrom=jhs@berklix.com X-Spamd-Result: default: False [-1.56 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[jhs]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[berklix.com]; AUTH_NA(1.00)[]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.56)[-0.559]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:144.76.0.0/16, country:DE]; RECEIVED_SPAMHAUS_PBL(0.00)[79.196.205.95:received] X-ThisMailContainsUnwantedMimeParts: N Ian, Thanks for your post, which I must re-read, meantime on 2 boxes I found with addition of -B -j 1 I can repeat eg: cd /usr/src/ make -B -j 1 all make -B -j 1 install make -B -j 1 all make -B -j 1 install make -B -j 1 all make -B -j 1 install without breakage in lib/libgcc_s/ Cheers, -- Julian Stacey http://berklix.com/jhs/ http://stolenvotes.uk From nobody Wed Sep 15 23:19:01 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C54A217C5A84 for ; Wed, 15 Sep 2021 23:19:03 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-qv1-xf33.google.com (mail-qv1-xf33.google.com [IPv6:2607:f8b0:4864:20::f33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H8x474Whxz3JvN for ; Wed, 15 Sep 2021 23:19:03 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-qv1-xf33.google.com with SMTP id z12so3028343qvx.5 for ; Wed, 15 Sep 2021 16:19:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:subject:to:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=69e6QEF4TiF5dIVU832EmNKauEVc7CYOmDtapZMN0gc=; b=VJ6PLj+cv1hRUQfiqDutlAWgQNGz1EyEXmz51atCFK67uZCOP/wlIAPpWzN4VPCNvp 3rxlL5GlMg4M+CIoZk/XT5T8jM4X2i5Fn1zld8JRkY9HfBx3Wvsy1JsL5b9q0F6X+FAI y1pzjC/C2hqth/LhTmX47bW9Lc9qq/LVVDktQabvElCogB7X0wN0BldEmTtzRMRemraP gf6yBV8u8fpmU9Ipd+iREV7Zcm/c7EHIpscFWqakVwK5qOCiFe+wvb88Ybx6rOPGL8kP 20q0H7x1OkPxqG4HzGSaDrdVGUHrX9Rf6BrqLcWkQzRu30BeqyNksYaOv5xx3kIL9pjh uajA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:subject:to:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=69e6QEF4TiF5dIVU832EmNKauEVc7CYOmDtapZMN0gc=; b=rMu89Kem1Isq6vA58zQt8yKeWZ7gq60RynOyn55tjnc61cMsq9AOZ4Rbgpad7YPgFw Dy09v1U49jqSoe5ThmsguSpaC5AHqW4QVrg6lBuiaDq8B/7XFxo7TbaptS+VMLVRefBr EKsHZpJrektW/3CStlrt9bRw1DZrRTMJZDxqESyVkZpHk1t8yVfoFMB2w4HtsF7Cd1um qd5IDWUHEU2J8QfSqcOBbXfYJjrEl4DLcekq8KAN0nq5bhtD+2/TV+RhHAkt2nBhxC2h IzsjFF+Hg68VxTQeL+zpkpJtIT/OMVwc/h+P87Ft323noI2aK0TsJHCdpE/H70UZvveX ohlQ== X-Gm-Message-State: AOAM533biv35aE7T7Ubq48bFlz58QbSP2I/ga8C/6ELkhsou/+oJn9nx 7LHOfd7/V0g5OrVim3jrxl7Bgd2xsDA= X-Google-Smtp-Source: ABdhPJyouuDAOlAgAGRTJnIWXTKLqLaml6IJ2q/j4k4myaWvx5kTqOLyR1XcycOn6EsVVAg3TzP55A== X-Received: by 2002:a05:6214:148b:: with SMTP id bn11mr2369428qvb.67.1631747942893; Wed, 15 Sep 2021 16:19:02 -0700 (PDT) Received: from spectre.mavhome.dp.ua (104-55-12-234.lightspeed.knvltn.sbcglobal.net. [104.55.12.234]) by smtp.gmail.com with ESMTPSA id v8sm969821qtk.49.2021.09.15.16.19.02 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 15 Sep 2021 16:19:02 -0700 (PDT) Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) To: mike tancsa , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> <586b04b4-d9b7-1597-4c8f-9bbcb9255c5a@sentex.net> <8fcb399d-8f26-b7a2-bf60-414d4ea1006e@FreeBSD.org> From: Alexander Motin Message-ID: Date: Wed, 15 Sep 2021 19:19:01 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4H8x474Whxz3JvN X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 15.09.2021 15:52, mike tancsa wrote: > On 9/15/2021 3:49 PM, Alexander Motin wrote: >>> On RELENG_12 as of today, I still have the issue on a X11SCL-F board. >> What issues do you have there exactly? > > Oh, sorry, this constant spew to dmesg > > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > ipmi0: Watchdog set returned 0xc0 > > The initial attach looks as > > ipmi0: port 0xca2,0xca3 on acpi0 > ipmi0: KCS mode found at io 0xca2 on acpi > ipmi0: IPMI device rev. 1, firmware rev. 1.73, version 2.0, device > support mask 0xbf > ipmi0: Number of channels 2 > ipmi0: Attached watchdog > ipmi0: Establishing power cycle handler Status 0xc0 means "Node Busy. Command could not be processed because command processing resources are temporarily unavailable.". Some sources propose command retrial after delay, but considering it is reported regularly I suppose it won't help. Have you tried to reset the BMC, for example with `ipmitool mc reset cold`, may be it unstuck that "Busy"? -- Alexander Motin From nobody Thu Sep 16 13:04:44 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BB1F917B6326 for ; Thu, 16 Sep 2021 13:04:45 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H9HNs4dV3z4bty; Thu, 16 Sep 2021 13:04:45 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 18GD4itv064112 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 16 Sep 2021 09:04:44 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4::29] ([IPv6:2607:f3e0:0:4:0:0:0:29]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 18GD4imx070282 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 16 Sep 2021 09:04:44 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: ipmi0: Watchdog set returned 0xc0 (releng_13) To: Alexander Motin , FreeBSD-STABLE Mailing List References: <51e58d7a-1b33-f7e3-13aa-3be5fee5c826@FreeBSD.org> <2c1ad9db-b92a-d0a8-b2ae-b3ffafc04604@sentex.net> <1f0d32e1-e907-080f-1669-65148c245dd8@sentex.net> <586b04b4-d9b7-1597-4c8f-9bbcb9255c5a@sentex.net> <8fcb399d-8f26-b7a2-bf60-414d4ea1006e@FreeBSD.org> From: mike tancsa Message-ID: <48971f96-3bf1-6b66-ab15-af963f9c72b2@sentex.net> Date: Thu, 16 Sep 2021 09:04:44 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4H9HNs4dV3z4bty X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 9/15/2021 7:19 PM, Alexander Motin wrote: > ipmi0: Watchdog set returned 0xc0 >> ipmi0: Watchdog set returned 0xc0 >> ipmi0: Watchdog set returned 0xc0 >> ipmi0: Watchdog set returned 0xc0 >> ipmi0: Watchdog set returned 0xc0 >> >> The initial attach looks as >> >> ipmi0: port 0xca2,0xca3 on acpi0 >> ipmi0: KCS mode found at io 0xca2 on acpi >> ipmi0: IPMI device rev. 1, firmware rev. 1.73, version 2.0, device >> support mask 0xbf >> ipmi0: Number of channels 2 >> ipmi0: Attached watchdog >> ipmi0: Establishing power cycle handler > Status 0xc0 means "Node Busy. Command could not be processed because > command processing resources are temporarily unavailable.". Some > sources propose command retrial after delay, but considering it is > reported regularly I suppose it won't help. > > Have you tried to reset the BMC, for example with `ipmitool mc reset > cold`, may be it unstuck that "Busy"? Thanks, that seems to have fixed it in that I no longer see the 0xc0 message.  Its a production box so I dont want to test the dog.  But I think I have another board in the back somewhere I can dig out and test with     ---Mike From nobody Sun Sep 19 18:02:53 2021 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 77ED217CE99D for ; Sun, 19 Sep 2021 18:03:08 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [128.127.146.8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.norma.perm.ru", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HCFsl1BB3z3t4V for ; Sun, 19 Sep 2021 18:03:06 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from [192.168.243.7] ([192.168.243.7]) by elf.hq.norma.perm.ru (8.16.1/8.15.2) with ESMTP id 18JI0Xox002201 for ; Sun, 19 Sep 2021 23:00:33 +0500 (+05) (envelope-from eugene@zhegan.in) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=vivat-retail.ru; s=key; t=1632074434; bh=bLTiNB1C35k+4AduRNtDtzE3hDXr/u91bw0PCMBW9uw=; h=Subject:To:References:From:Date:In-Reply-To; b=en8muVxbkOUmv7nlDMucqWJ6QmTeUG5U6XsFN7+T5tVLJdMJmEjv4n+0lm+7Sj25o DV1OqCAFWIGH7t6L4otbcaoXlKBtMWegqTijmKdrALG6j2xTssF/yApbSsXigZWi4p aSiWsprcX37yxT6Z1x6ymrSm19IlFsU1NDufiqLo= Subject: Re: FreeBSD 12.1 vs 13.0 TCP connections count To: stable@freebsd.org References: <9cac45f1-9b81-5ed8-b3ae-c9567ac977cb@zhegan.in> From: "Eugene M. Zheganin" Message-ID: Date: Sun, 19 Sep 2021 23:02:53 +0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: <9cac45f1-9b81-5ed8-b3ae-c9567ac977cb@zhegan.in> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: ru X-Rspamd-Queue-Id: 4HCFsl1BB3z3t4V X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=fail ("headers rsa verify failed") header.d=vivat-retail.ru header.s=key header.b=en8muVxb; dmarc=none; spf=pass (mx1.freebsd.org: domain of eugene@zhegan.in designates 128.127.146.8 as permitted sender) smtp.mailfrom=eugene@zhegan.in X-Spamd-Result: default: False [-1.25 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_NA(0.00)[zhegan.in]; R_DKIM_REJECT(1.00)[vivat-retail.ru:s=key]; DKIM_TRACE(0.00)[vivat-retail.ru:-]; NEURAL_SPAM_SHORT(0.05)[0.052]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:212494, ipnet:128.127.146.0/24, country:RU]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hello, 13.09.2021 11:33, Eugene M. Zheganin пишет: > [...] > > I'm also graphing the balancer/nginx accepts/handled rate which is > constant at 4K/sec - means the flow itself isn't changing a lot. > > I'm also graphing the connections scoreboard from nginx and it also > shows x4 drops/rises when switching from 12.1 to 13.0. > > Is this a bug/glitch of the 13.3 statistics (seems unprobeble because > nginx shows it too) or is there some other explanation that I don't get ? > In the end this looks like a regression in the end. Considering two identical servers rented in one datacenter, I have to downgrade 13.x balancer to 12.2 - I'm unable to find other eplanation to the things described above. The difference in connection numbers isn't the major reason; the real reason is the inability to handle the load, and the most discouraging thing is that I'm unable to measure this inability using formal metrics: cpu/disk load is okay, no network errors on the driver layer, no complains in the dmesg or syslog. Eugene. From nobody Sun Sep 19 22:12:13 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CDA2117CF983 for ; Sun, 19 Sep 2021 22:12:18 +0000 (UTC) (envelope-from rollingbits@gmail.com) Received: from mail-qk1-x734.google.com (mail-qk1-x734.google.com [IPv6:2607:f8b0:4864:20::734]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HCMPF54R8z4c9m for ; Sun, 19 Sep 2021 22:12:17 +0000 (UTC) (envelope-from rollingbits@gmail.com) Received: by mail-qk1-x734.google.com with SMTP id f22so36240521qkm.5 for ; Sun, 19 Sep 2021 15:12:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:from:mime-version:subject:date:message-id :references:in-reply-to:to; bh=MGCGUiPXIma3PaUMKLFXMmQxy+zsT28eERKok4GTeik=; b=mJ5mw1YxI1IUEavsXMzbgxcAVlHFiaAfwu9JvGK6djeEOuxBMcrcINllLuSMSNV45S qRVdAvgUoXWsF+GUX5XTgAyi1GVEpUfjDd/asNJY1y53XgLPjFGB5x0/pk3REOmrdmds xKPQhF2P3uqUSeq0ODh13EH/21bIg8XPt/Y7quQg9HzESCL+xRu5Q2nYsnmg7OutVcC5 A64+61XjS+SGR9CpLWbSkEhC/znNjX4QKqeG9Lh0EV3lgYk3EAGS7Ey6bULQNQUIAosu 7fYyuMfcZUL2DvhwnomzUWvbHC2DETTFNjPb9+DRH7DRxpZN8RGiv2SD7C6q36loc4Ue DQMw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:content-transfer-encoding:from:mime-version :subject:date:message-id:references:in-reply-to:to; bh=MGCGUiPXIma3PaUMKLFXMmQxy+zsT28eERKok4GTeik=; b=NSByptKzmI0xx9B6kMJ9WqkcNyAZQEFO61Tur19tN82E5Tvwwd14lf6n2FybBuE8vZ 18KGJFfs9A8eikHAoXYZ5ZnlrcJVMUsmWlgTlblHJI7o7jZectCTRNJOlodDtnOM3DjC Q85kPvGlVBt88URLzrRxKNYcrAYf8Pmnrtus6t1R9qtVRd9CEGFmQRXD1qs8MRkJzTRX LdA/xgMG2LLvBjiH417VMqNdjavillk0I/eG0njbS0neM74hXcMmz2NKnKlogsA3w6I6 rz5rX2LblSCqN3COBhYz/BL4sVR1g3Jwt3wq9YVoMKmKMKzwZb62uJsB7+j2C78mg1Ai xNRQ== X-Gm-Message-State: AOAM5323kiHNB7Jaz4nm95RPKy4qUCOZXtvwR1NLMn3X2hDpc/xav7pS Skgf9Qs4Fr9NXLsL5GaPmMUaDHojqHw= X-Google-Smtp-Source: ABdhPJxacRen5OldUIzFDcqLQ4untNKFgwdrlXS4SuBxHAJBqTGIA0wR1PmyeVrLUpc4gs4pK29EuA== X-Received: by 2002:a37:f607:: with SMTP id y7mr21324031qkj.425.1632089536872; Sun, 19 Sep 2021 15:12:16 -0700 (PDT) Received: from smtpclient.apple ([2804:389:1043:b9d:6072:2fc2:8875:bcb]) by smtp.gmail.com with ESMTPSA id q184sm10064382qkd.35.2021.09.19.15.12.16 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 19 Sep 2021 15:12:16 -0700 (PDT) Content-Type: multipart/alternative; boundary=Apple-Mail-E6CCF517-FC7A-4DBE-A036-A833460CD81B Content-Transfer-Encoding: 7bit From: =?utf-8?Q?Lucas_Nali_de_Magalh=C3=A3es?= List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: Upgrade to 13.0 Date: Sun, 19 Sep 2021 19:12:13 -0300 Message-Id: <4DBB482F-A150-46F4-B4C9-5033D03C7A32@gmail.com> References: <0984F0B6-2AEB-41B4-AD36-5632D768A4D4@gmail.com> In-Reply-To: <0984F0B6-2AEB-41B4-AD36-5632D768A4D4@gmail.com> To: freebsd-stable X-Mailer: iPhone Mail (18H17) X-Rspamd-Queue-Id: 4HCMPF54R8z4c9m X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=mJ5mw1Yx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rollingbits@gmail.com designates 2607:f8b0:4864:20::734 as permitted sender) smtp.mailfrom=rollingbits@gmail.com X-Spamd-Result: default: False [-2.74 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.86)[-0.861]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; R_MIXED_CHARSET(0.62)[subject]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::734:from]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: Y --Apple-Mail-E6CCF517-FC7A-4DBE-A036-A833460CD81B Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable > On Aug 28, 2021, at 5:19 PM, Lucas Nali de Magalh=C3=A3es wrote: >=20 > (=E2=80=A6) > In resume: it's worse. One thing I noted this time: after upgrading pkg itself, drm and restart (up= grade in this machine must be an resumable operation), pkg started being kil= led due to it using all available memory. I also restarted pkg due to packag= e conflicts a few (2 or 3) times. I even thought in asking here what is supp= osed to happen if someone doesn't upgrade their packages for a lot of time b= ut I feel I just found the answer. HTH, --=20 rollingbits =E2=80=94 =F0=9F=93=A7 rollingbits@icloud.com =F0=9F=93=A7 rolli= ngbits@gmail.com =F0=9F=93=A7 rollingbits@yahoo.com