From owner-freebsd-ports@freebsd.org Fri Mar 20 18:47:10 2020 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8120826FB6A for ; Fri, 20 Mar 2020 18:47:10 +0000 (UTC) (envelope-from SRS0=mxbq=5F=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48kXnS26fcz3HgD for ; Fri, 20 Mar 2020 18:47:07 +0000 (UTC) (envelope-from SRS0=mxbq=5F=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 75A9628422; Fri, 20 Mar 2020 19:47:05 +0100 (CET) Received: from illbsd.quip.test (ip-62-24-92-232.net.upcbroadband.cz [62.24.92.232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 4F5F728416; Fri, 20 Mar 2020 19:47:04 +0100 (CET) Subject: Re: Poudriere error: cannot rollback ..., there is a snapshot ... more recent .... To: hartzell@alerce.com, freebsd-ports References: <24180.63928.226844.296582@alice.local> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: <22c32ebe-4a17-64c0-e676-2eaab48527b0@quip.cz> Date: Fri, 20 Mar 2020 19:47:04 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.3 MIME-Version: 1.0 In-Reply-To: <24180.63928.226844.296582@alice.local> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 48kXnS26fcz3HgD X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of SRS0=mxbq=5F=quip.cz=000.fbsd@elsa.codelab.cz has no SPF policy when checking 94.124.105.4) smtp.mailfrom=SRS0=mxbq=5F=quip.cz=000.fbsd@elsa.codelab.cz X-Spamd-Result: default: False [4.03 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; IP_SCORE(0.84)[ip: (0.30), ipnet: 94.124.104.0/21(0.15), asn: 42000(3.64), country: CZ(0.09)]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[quip.cz]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(1.00)[0.998,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[4.105.124.94.list.dnswl.org : 127.0.10.0]; NEURAL_SPAM_LONG(1.00)[1.000,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[000.fbsd@quip.cz,SRS0=mxbq=5F=quip.cz=000.fbsd@elsa.codelab.cz]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:42000, ipnet:94.124.104.0/21, country:CZ]; FROM_NEQ_ENVFROM(0.00)[000.fbsd@quip.cz,SRS0=mxbq=5F=quip.cz=000.fbsd@elsa.codelab.cz]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2020 18:47:10 -0000 George Hartzell wrote on 2020/03/20 18:13: > > I have a FreeBSD 12.1p3 (just updated) root-on-zfs system that's > having trouble doing Poudriere builds. > > It started off life as a FreeBSD 12.1 system and has been building > it's own set of packages using Poudriere successfully since its > inception. > > I few updates ago I started seeing errors in the Poudriere builds. > > I'm trying to run one now and am seeing the errors again. Here's an > example: > > [...] > [00:30:24] [02] [00:00:00] Building devel/py-more-itertools@py37 | py37-more-itertools-8.2.0 > cannot rollback 'zroot/poudriere/jails/12_1-ports_and_hartzell-ref/02': there is a snapshot or bookmark more recent than 'zroot/poudriere/jails/12_1-ports_and_hartzell-ref/02@prepkg' > [00:30:26] [02] [00:00:02] Error: Unable to rollback zroot/poudriere/jails/12_1-ports_and_hartzell-ref/02 to prepkg > =>> Error: Unable to rollback zroot/poudriere/jails/12_1-ports_and_hartzell-ref/02 to prepkg > [...] > > After crashing, I can hit ^T and see: > > [...] > load: 1.01 cmd: sh 36519 [piperd] 1994.36r 0.08u 0.13s 0% 3188k > [12_1-ports_and_hartzell] [2020-03-20_09h30m34s] [parallel_build:] Queued: 149 Built: 72 Failed: 1 Skipped: 4 Ignored: 0 Tobuild: 72 Time: 00:33:31 > [01]: crashed > [02]: devel/p5-IO-stringy | p5-IO-stringy-2.111 package (00:00:00 / 00:00:06) > [00:33:33] Logs: /usr/local/poudriere/data/logs/bulk/12_1-ports_and_hartzell/2020-03-20_09h30m34s > [...] > > a bit later, that builder seems to recover and continue sucessfully > with new jobs: > > [...] > load: 3.40 cmd: sh 36519 [piperd] 2282.32r 0.09u 0.15s 0% 3188k > [12_1-ports_and_hartzell] [2020-03-20_09h30m34s] [parallel_build:] Queued: 149 Built: 80 Failed: 3 Skipped: 10 Ignored: 0 Tobuild: 56 Time: 00:38:19 > [01]: lang/cython@py27 | py27-cython-0.29.15 build (00:01:00 / 00:01:12) > [02]: devel/icu | icu-66.1,1 build (00:03:10 / 00:03:24) > [00:38:21] Logs: /usr/local/poudriere/data/logs/bulk/12_1-ports_and_hartzell/2020-03-20_09h30m34s > [...] > > I'd like to get it working normally again. > > Any ideas what might be going wrong? Any possibility that you have some kind of automatic snapshoting utility run from crontab recursively on filesystem where poudriere have builder jails mounted? I saw this error when I setup zfsnap in crontab with resursive snapshot of /vol0 (each 5 minutes) and my poudriere is in /vol0/poudriere. The workaround was to not create recursive snapshots on /vol0 but on each /vol0 sub-filesystem except /vol0/poudriere. I don't know it this is your problem too. Kind regards Miroslav Lachman