From owner-freebsd-ports@freebsd.org Thu Jul 16 07:26:00 2020 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 069CE3592B4 for ; Thu, 16 Jul 2020 07:26:00 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: from mail-yb1-f193.google.com (mail-yb1-f193.google.com [209.85.219.193]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B6m531wGHz49j3 for ; Thu, 16 Jul 2020 07:25:59 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: by mail-yb1-f193.google.com with SMTP id 134so2385678ybd.6 for ; Thu, 16 Jul 2020 00:25:59 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=4ID/7YGTHiFAh6zfFvU964F3bcoEkGvwyPQ/4rbNfGA=; b=hNNOiwppx5R76pYj+r1pTRcEWjGKR0nQ0Iv2V+eCGagEjZRHH9dPSpVMSYvz2/H/ZM zi1QjBOPfs7BZMxuPxw4XQ0nxYQQ7kOOQrbIbgoisgbFdlqld/ShOeOWmiYN/1Wm73wh vAWmsCL4Pft2yrwvKxKM/3Ma3Rwaa9aSFlHfnJBHnJCAhiou0PKZAsH1+yL+dDV6STOO Q4ox+kZtR+r27yMjebomtf9RQlN5R6qX0G9vG3vo5HpzLJV1FtOcTTxSOn+qY8ksNwz7 8a3R0x+YGE59iJUaQQDDX8A90pIciWHGe3+q72gPNaY1E8UUMOXTYh4qNnJagqETlBgo F8CA== X-Gm-Message-State: AOAM530QAlyNE6UTQU0Tbj7aLYthD6PjtoMnGJQbwYR5tDRzva7HQ0O3 A1bk1aiYZlFtku75qkuYdNvKPjGQRwkXDB+f6gjgL0jtQZw= X-Google-Smtp-Source: ABdhPJz/oAEaWQqf+1VAU2LGpnN4kOHITogFqUJ9wiOR/eeA6eOFz4uWXyF7x3GmkFBK38DkNdVlW3rL7WQ4Xj7PgOI= X-Received: by 2002:a25:e051:: with SMTP id x78mr4282720ybg.127.1594884358070; Thu, 16 Jul 2020 00:25:58 -0700 (PDT) MIME-Version: 1.0 References: <90395E19-4C3A-44D4-AE78-E01C73363DAC@punkt.de> In-Reply-To: <90395E19-4C3A-44D4-AE78-E01C73363DAC@punkt.de> From: Li-Wen Hsu Date: Thu, 16 Jul 2020 15:25:46 +0800 Message-ID: Subject: Re: Fetching FreeBSD packages in poudriere bulk builds? To: "Patrick M. Hausen" Cc: FreeBSD ports Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4B6m531wGHz49j3 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of lwhsufreebsd@gmail.com designates 209.85.219.193 as permitted sender) smtp.mailfrom=lwhsufreebsd@gmail.com X-Spamd-Result: default: False [-1.18 / 15.00]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-ports@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-0.85)[-0.850]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.41)[-0.412]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.193:from]; NEURAL_HAM_MEDIUM(-0.92)[-0.920]; FORGED_SENDER(0.30)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.193:from]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Jul 2020 07:26:00 -0000 On Thu, Jul 16, 2020 at 3:10 PM Patrick M. Hausen wrote: > > Hi all, > > like many we run our own poudriere to build the packages for our infrastr= ucture. > Fetching packages from the standard FreeBSD repos for ports with default = options > is a long requested feature. Of course I understand it will not be implem= ented by elves > and neither do we have the knowledge and manpower to help in this particu= lar area. > > What I am interested in: there are a handful to a dozen ports that take e= xceptionally > long to build. GCC, LLVM, rustlang =E2=80=A6 > > Notably these are all =E2=80=9Einfrastructure=E2=80=9C ports that are bui= lt as dependencies and we do > not change the options of any of them. Did anyone implement a lean hack f= or a > few selected packages to be fetched as binaries? > > E.g. check if they are newer in the FreeBSD quarterly repo, put them in o= ur own repo, > rebuild the repo index and then start poudriere bulk =E2=80=A6? > > Would that work? I have a very hackish way to fetch the dependencies packages before build: https://github.com/lwhsu/freebsd-ports-libreoffice/blob/master/porttest.sh#= L52-L54 It works, but not perfect, and sometimes not very useful when the new packages haven't hit the official repository. Li-Wen