From nobody Fri Oct 8 19:36:18 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8B5DF12DEF76 for ; Fri, 8 Oct 2021 19:36:27 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from mail.protected-networks.net (mail.protected-networks.net [202.12.127.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.protected-networks.net", Issuer "R3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HQz2g2Ztdz3lfr; Fri, 8 Oct 2021 19:36:27 +0000 (UTC) (envelope-from imb@protected-networks.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d= protected-networks.net; h=content-transfer-encoding:content-type :content-type:in-reply-to:from:from:references:content-language :subject:subject:user-agent:mime-version:date:date:message-id; s=201508; t=1633721778; bh=bNm2qguGIGX8mTvg8FxPFG+3iuwzmnjfjPlF VA1LjYU=; b=DgfDJxlLbMKSD0bfr6qHlOUj6krIF/Y7CcSIaWl0RvpBko6STADv ejUL6SBl6zYf2mqVJAtZ/0MrAr7GsJOXAgmYy5eLfzOm+etVlrtpY+stssTL/6wN t09sgYcU3SoKV1jE/ZmIvdzNopYSAYDZ+7V1dFBWD7CGv31guMziTyw= Received: from [192.168.1.10] (toshi.auburn.protected-networks.net [192.168.1.10]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: imb@mail.protected-networks.net) by mail.protected-networks.net (Postfix) with ESMTPSA id 53B7B3C02E; Fri, 8 Oct 2021 15:36:18 -0400 (EDT) Message-ID: Date: Fri, 8 Oct 2021 15:36:18 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Thunderbird/91.2.0 Subject: Re: intermittent bsdtar/jemalloc failures Content-Language: en-NZ To: Konstantin Belousov Cc: Mark Johnston , freebsd-current References: <2908d747-8606-84d6-60b5-249c0d396b6b@protected-networks.net> <31be6e3a-f303-ce78-4dab-5dcc77ed0464@protected-networks.net> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4HQz2g2Ztdz3lfr X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: imb@protected-networks.net From: Michael Butler via freebsd-current X-Original-From: Michael Butler X-ThisMailContainsUnwantedMimeParts: N On 10/7/21 20:19, Konstantin Belousov wrote: > On Thu, Oct 07, 2021 at 05:43:14PM -0400, Michael Butler wrote: >> On 10/7/21 16:52, Mark Johnston wrote: >>> On Thu, Oct 07, 2021 at 04:18:28PM -0400, Michael Butler via freebsd-current wrote: >>>> On 10/7/21 15:39, Konstantin Belousov wrote: >>>>> On Thu, Oct 07, 2021 at 03:28:44PM -0400, Michael Butler via freebsd-current wrote: >>>>>> While building a local release bundle, I sometimes get bsdtar failing (and >>>>>> dumping core) as follows below. Worse, as can be seen below, it doesn't stop >>>>>> the build unless I happen to notice and it yields an incomplete package. >>>>>> >>>>>> a usr/src/sys/netgraph/ng_checksum.h >>>>>> a usr/src/sys/netgraph/ng_message.h >>>>>> a usr/src/sys/netgraph/ng_echo.c >>>>>> a usr/src/sys/netgraph/ng_gif.h >>>>>> : jemalloc_arena.c:747: Failed assertion: >>>>>> "nstime_compare(&decay->epoch, &time) <= 0" >>>>>> Abort trap (core dumped) >>>>>> sh /usr/src/release/scripts/make-manifest.sh *.txz > MANIFEST >>>>>> >>>>>> What causes this? Build machine is a 2x4-core Intel box with ZFS >>>>>> file-systems all around. I tried stopping NTPD temporarily but the failures >>>>>> persist .. sometimes :-( >>>>>> >>>>>> I've seen this at different points in the archiving process so it doesn't >>>>>> seem specific to building kernel.txz. >>>>> >>>>> What timecounter do you use? Perhaps show the whole output from >>>>> sysctl kern.timecounter. >>>> >>>> imb@vm01:/home/imb> sysctl kern.timecounter >>>> kern.timecounter.tsc_shift: 1 >>>> kern.timecounter.smp_tsc_adjust: 0 >>>> kern.timecounter.smp_tsc: 1 >>>> kern.timecounter.invariant_tsc: 1 >>>> kern.timecounter.fast_gettime: 1 >>>> kern.timecounter.tick: 1 >>>> kern.timecounter.choice: ACPI-fast(900) HPET(950) i8254(0) TSC-low(1000) >>>> dummy(-1000000) >>>> kern.timecounter.hardware: HPET >>>> kern.timecounter.alloweddeviation: 5 >>>> kern.timecounter.timehands_count: 2 >>>> kern.timecounter.stepwarnings: 0 >>>> kern.timecounter.tc.ACPI-fast.quality: 900 >>>> kern.timecounter.tc.ACPI-fast.frequency: 3579545 >>>> kern.timecounter.tc.ACPI-fast.counter: 16124892 >>>> kern.timecounter.tc.ACPI-fast.mask: 16777215 >>>> kern.timecounter.tc.HPET.quality: 950 >>>> kern.timecounter.tc.HPET.frequency: 14318180 >>>> kern.timecounter.tc.HPET.counter: 1883995229 >>>> kern.timecounter.tc.HPET.mask: 4294967295 >>>> kern.timecounter.tc.i8254.quality: 0 >>>> kern.timecounter.tc.i8254.frequency: 1193182 >>>> kern.timecounter.tc.i8254.counter: 57 >>>> kern.timecounter.tc.i8254.mask: 65535 >>>> kern.timecounter.tc.TSC-low.quality: 1000 >>>> kern.timecounter.tc.TSC-low.frequency: 1413153007 >>>> kern.timecounter.tc.TSC-low.counter: 2352002295 >>>> kern.timecounter.tc.TSC-low.mask: 4294967295 >>>> >>>> I overrode the default selection of counter-type as NTPD drifted so >>>> badly as to require stepping almost hourly :-( > > If you return to TSC, does the problem go away? > Same question if you leave HPET on, but set fast_gettime to 0. While I've only done one build (still) with HPET with kern.timecounter.fast_gettime=0, I didn't see a core-dump. I'll test more over the weekend, imb